You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by "sergey.dolinkov" <se...@billing.ru> on 2018/07/25 20:25:04 UTC

service deploy cluster singleton lock application

I try create spring java application with apache ignite inside.

When application startup it deploy service(cluster singleton) to cluster.
(it`s ok)

But when i start second node which deploy this service too it is locked.

why this hapends ? Apache Ignite 2.5.0

code of service class:

public class TaskLockWatcher implements Service {
    @IgniteInstanceResource
    private Ignite ignite;
    private SchedulerFuture scheduler;

    @Override
    public void cancel(ServiceContext ctx) {
      LOGGER.info("schedule service cancel");
      if (scheduler != null){
        scheduler.cancel();
        scheduler = null;
      }
    }

    @Override
    public void init(ServiceContext ctx) throws Exception {
      LOGGER.info("schedule service init");
    }

    @Override
    public void execute(ServiceContext ctx) throws Exception {
      LOGGER.info("schedule service execute");
      if (scheduler == null){
        scheduler = ignite.scheduler().scheduleLocal(() -> {
          LOGGER.info("schedule service call");
          List<Ticket> tickets = getTicketForUnlock();
          if (!tickets.isEmpty()){
            changeTicketStatus(tickets, TicketStatus.CREATED);
          }
        }, "* * * * *");
      }
    }
  }

But the locking occurs even if I leave only the output of messages in all
TaskLockWatcher methods.

publishing code:

Ignite ignite = connector.getClient();
IgniteServices svcs = ignite.services();
svcs.deployClusterSingleton("taskLockWatcher", new TaskLockWatcher());


ignite configuration code:

IgniteConfiguration igniteConfiguration = new IgniteConfiguration();
DataStorageConfiguration dataStorageConfiguration = new
DataStorageConfiguration();
dataStorageConfiguration.setWalMode(WALMode.LOG_ONLY);
dataStorageConfiguration.getDefaultDataRegionConfiguration().setPersistenceEnabled(false);
dataStorageConfiguration.getDefaultDataRegionConfiguration().setMaxSize(128);
// MB

List<DataRegionConfiguration> list = new ArrayList<>();
    DataRegionConfiguration configuration = new DataRegionConfiguration();
    configuration.setName("TASK_REGION");
    configuration.setMaxSize(1024);
    configuration.setPersistenceEnabled(true);
    list.add(conf); 
    dataStorageConfiguration.setDataRegionConfigurations(list.toArray(new
DataRegionConfiguration[0]));
   
igniteConfiguration.setDataStorageConfiguration(dataStorageConfiguration);

TcpCommunicationSpi tcpCommunicationSpi = new TcpCommunicationSpi();
    tcpCommunicationSpi.setSlowClientQueueLimit(1000);
    igniteConfiguration.setCommunicationSpi(tcpCommunicationSpi);
    Map<String, String> attrs =
Collections.singletonMap("group.node.filter",
"CLUSTER_TASKS,CLUSTER_TICKETS");
    igniteConfiguration.setUserAttributes(attrs);

TcpDiscoverySpi spi = new TcpDiscoverySpi();
    TcpDiscoveryZookeeperIpFinder ipFinder = new
TcpDiscoveryZookeeperIpFinder();
    ipFinder.setBasePath("/datagrid");
    ipFinder.setCurator(getCuratorFramework());
    spi.setIpFinder(ipFinder);
    igniteConfiguration.setDiscoverySpi(spi);

AtomicConfiguration atomicConfiguration = new AtomicConfiguration();
    atomicConfiguration.setBackups(1);
    atomicConfiguration.setCacheMode(CacheMode.REPLICATED);
    igniteConfiguration.setAtomicConfiguration(atomicConfiguration);
    igniteConfiguration.setIncludeEventTypes(EventType.EVTS_CACHE);

CacheConfiguration<UUID, Ticket> cacheConfiguration = new
CacheConfiguration<>("TICKETS");
    cacheConfiguration.setIndexedTypes(keyClass, UUID.class);



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: service deploy cluster singleton lock application

Posted by Evgenii Zhuravlev <e....@gmail.com>.
Looks like TaskLockWatcher is an inner class, isn't it? When you deploy
service, an instance of it will be serialized and saved to cache. If this
class in inner, most possible it serializes an outer class too. Try to
create not nested Class for Service.

2018-07-26 18:14 GMT+03:00 sergey.dolinkov <se...@billing.ru>:

> upload as files
>
> locked-node-treaddump.txt
> <http://apache-ignite-users.70518.x6.nabble.com/file/
> t1909/locked-node-treaddump.txt>
> worked-node-threaddump.txt
> <http://apache-ignite-users.70518.x6.nabble.com/file/
> t1909/worked-node-threaddump.txt>
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>

Re: service deploy cluster singleton lock application

Posted by "sergey.dolinkov" <se...@billing.ru>.
upload as files

locked-node-treaddump.txt
<http://apache-ignite-users.70518.x6.nabble.com/file/t1909/locked-node-treaddump.txt>  
worked-node-threaddump.txt
<http://apache-ignite-users.70518.x6.nabble.com/file/t1909/worked-node-threaddump.txt>  



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: service deploy cluster singleton lock application

Posted by Evgenii Zhuravlev <e....@gmail.com>.
Do you have thread dumps from another node? Also, please attach it as a
file, it's too big to post it as a message on the user list.

BTW, I see that one thread waiting for canceling the service:

nid=0x1478 waiting on condition [0x000000001cb1c000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:177)
        at
org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:140)
        at
org.apache.ignite.internal.AsyncSupportAdapter.saveOrGet(AsyncSupportAdapter.java:112)
        at
org.apache.ignite.internal.IgniteServicesImpl.cancel(IgniteServicesImpl.java:269)
        at
com.peterservice.openapi.b2b.datamart.datagrid.impl.IgniteFsOperations.<init>(IgniteFsOperations.java:97)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)

Is it really what it should do here? I don't see any thread waiting for
deploying service.

2018-07-26 13:52 GMT+03:00 sergey.dolinkov <se...@billing.ru>:

> it is threddump for locked application
>
>
> 2018-07-26 13:50:15
> Full thread dump Java HotSpot(TM) 64-Bit Server VM (25.152-b16 mixed mode):
>
> "sys-#72" #148 daemon prio=5 os_prio=0 tid=0x00000000229fd800 nid=0x2eb4
> waiting on condition [0x00000000266af000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000a1a0e008> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.LinkedBlockingQueue.poll(
> LinkedBlockingQueue.java:467)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1073)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "sys-#71" #147 daemon prio=5 os_prio=0 tid=0x0000000022a06800 nid=0x28c
> waiting on condition [0x0000000026eae000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000a1a0e008> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.LinkedBlockingQueue.poll(
> LinkedBlockingQueue.java:467)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1073)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "sys-#70" #145 daemon prio=5 os_prio=0 tid=0x0000000022a06000 nid=0x1e00
> waiting on condition [0x0000000026aae000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000a1a0e008> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.LinkedBlockingQueue.poll(
> LinkedBlockingQueue.java:467)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1073)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "sys-#69" #144 daemon prio=5 os_prio=0 tid=0x0000000022a05000 nid=0x30c0
> waiting on condition [0x000000002734e000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000a1a0e008> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.LinkedBlockingQueue.poll(
> LinkedBlockingQueue.java:467)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1073)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "sys-#68" #143 daemon prio=5 os_prio=0 tid=0x0000000022a03800 nid=0x91c
> waiting on condition [0x0000000026baf000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000a1a0e008> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.LinkedBlockingQueue.poll(
> LinkedBlockingQueue.java:467)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1073)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "sys-#67" #142 daemon prio=5 os_prio=0 tid=0x0000000022a03000 nid=0x3c94
> waiting on condition [0x000000005058f000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000a1a0e008> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.LinkedBlockingQueue.poll(
> LinkedBlockingQueue.java:467)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1073)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "RMI TCP Connection(4)-172.21.98.254" #133 daemon prio=5 os_prio=0
> tid=0x00000000229ff000 nid=0x1dc0 in Object.wait() [0x000000001c79c000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at
> com.sun.jmx.remote.internal.ArrayNotificationBuffer.fetchNotifications(
> ArrayNotificationBuffer.java:449)
>         - locked <0x0000000090accb90> (a
> com.sun.jmx.remote.internal.ArrayNotificationBuffer)
>         at
> com.sun.jmx.remote.internal.ArrayNotificationBuffer$ShareBuffer.
> fetchNotifications(ArrayNotificationBuffer.java:227)
>         at
> com.sun.jmx.remote.internal.ServerNotifForwarder.fetchNotifs(
> ServerNotifForwarder.java:274)
>         at
> javax.management.remote.rmi.RMIConnectionImpl$4.run(
> RMIConnectionImpl.java:1270)
>         at
> javax.management.remote.rmi.RMIConnectionImpl$4.run(
> RMIConnectionImpl.java:1268)
>         at
> javax.management.remote.rmi.RMIConnectionImpl.fetchNotifications(
> RMIConnectionImpl.java:1274)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
> 62)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:498)
>         at
> sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:357)
>         at sun.rmi.transport.Transport$1.run(Transport.java:200)
>         at sun.rmi.transport.Transport$1.run(Transport.java:197)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at sun.rmi.transport.Transport.serviceCall(Transport.java:196)
>         at
> sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:568)
>         at
> sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(
> TCPTransport.java:826)
>         at
> sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$
> 0(TCPTransport.java:683)
>         at
> sun.rmi.transport.tcp.TCPTransport$ConnectionHandler$$Lambda$6/
> 1406961078.run(Unknown
> Source)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at
> sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(
> TCPTransport.java:682)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - <0x000000008f243620> (a
> java.util.concurrent.ThreadPoolExecutor$Worker)
>
> "JMX server connection timeout 132" #132 daemon prio=5 os_prio=0
> tid=0x00000000229fe800 nid=0x3eb8 in Object.wait() [0x00000000268ff000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at
> com.sun.jmx.remote.internal.ServerCommunicatorAdmin$Timeout.run(
> ServerCommunicatorAdmin.java:168)
>         - locked <0x000000008fd21260> (a [I)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "RMI TCP Connection(3)-172.21.98.254" #131 daemon prio=5 os_prio=0
> tid=0x0000000022a02000 nid=0x2894 runnable [0x000000001c02e000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.SocketInputStream.socketRead0(Native Method)
>         at java.net.SocketInputStream.socketRead(SocketInputStream.
> java:116)
>         at java.net.SocketInputStream.read(SocketInputStream.java:171)
>         at java.net.SocketInputStream.read(SocketInputStream.java:141)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
>         - locked <0x000000008fce5e20> (a java.io.BufferedInputStream)
>         at java.io.FilterInputStream.read(FilterInputStream.java:83)
>         at
> sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:550)
>         at
> sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(
> TCPTransport.java:826)
>         at
> sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$
> 0(TCPTransport.java:683)
>         at
> sun.rmi.transport.tcp.TCPTransport$ConnectionHandler$$Lambda$6/
> 1406961078.run(Unknown
> Source)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at
> sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(
> TCPTransport.java:682)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - <0x000000008f241040> (a
> java.util.concurrent.ThreadPoolExecutor$Worker)
>
> "logback-2" #125 daemon prio=5 os_prio=0 tid=0x0000000022a04800 nid=0x3250
> waiting on condition [0x000000006f68e000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ad3b84c0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1088)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "session-timeout-worker-#34" #94 daemon prio=5 os_prio=0
> tid=0x0000000022a01800 nid=0x19b0 waiting on condition [0x00000000702ef000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at
> org.apache.ignite.internal.processors.rest.GridRestProcessor$4.body(
> GridRestProcessor.java:476)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "srvc-deploy-#53" #120 daemon prio=5 os_prio=0 tid=0x0000000022a00800
> nid=0x2fd4 waiting on condition [0x000000007010e000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x000000008310d018> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "checkpoint-runner-#49" #116 daemon prio=5 os_prio=0 tid=0x00000000229fd000
> nid=0x3be8 waiting on condition [0x000000006f9ae000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000880a6278> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "checkpoint-runner-#48" #115 daemon prio=5 os_prio=0 tid=0x00000000229fc000
> nid=0xee0 waiting on condition [0x000000006ed3f000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000880a6278> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "checkpoint-runner-#47" #114 daemon prio=5 os_prio=0 tid=0x00000000229fb800
> nid=0x1a20 waiting on condition [0x00000000356ae000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000880a6278> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "checkpoint-runner-#46" #113 daemon prio=5 os_prio=0 tid=0x00000000229fa800
> nid=0x18d0 waiting on condition [0x00000000507ee000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000880a6278> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "db-checkpoint-thread-#45" #112 daemon prio=5 os_prio=0
> tid=0x00000000229fa000 nid=0x2cd0 in Object.wait() [0x000000005069f000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at
> org.apache.ignite.internal.processors.cache.persistence.
> GridCacheDatabaseSharedManager$Checkpointer.waitCheckpointEvent(
> GridCacheDatabaseSharedManager.java:3338)
>         - locked <0x0000000081d0af20> (a
> org.apache.ignite.internal.processors.cache.persistence.
> GridCacheDatabaseSharedManager$Checkpointer)
>         at
> org.apache.ignite.internal.processors.cache.persistence.
> GridCacheDatabaseSharedManager$Checkpointer.body(
> GridCacheDatabaseSharedManager.java:2933)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "ttl-cleanup-worker-#43" #110 daemon prio=5 os_prio=0
> tid=0x00000000229f8800
> nid=0x1490 waiting on condition [0x000000002a5cf000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at
> org.apache.ignite.internal.util.IgniteUtils.sleep(IgniteUtils.java:7629)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheSharedTtlCleanupManag
> er$CleanupWorker.body(GridCacheSharedTtlCleanupManager.java:145)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "wal-file-archiver%null" #108 daemon prio=5 os_prio=0
> tid=0x000000001ab1c800
> nid=0x2b7c in Object.wait() [0x000000002a75f000]
>    java.lang.Thread.State: WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.lang.Object.wait(Object.java:502)
>         at
> org.apache.ignite.internal.processors.cache.persistence.
> wal.FileWriteAheadLogManager$FileArchiver.run(
> FileWriteAheadLogManager.java:1558)
>         - locked <0x00000000880a4e50> (a
> org.apache.ignite.internal.processors.cache.persistence.
> wal.FileWriteAheadLogManager$FileArchiver)
>
>    Locked ownable synchronizers:
>         - None
>
> "exchange-worker-#42" #107 daemon prio=5 os_prio=0 tid=0x000000001ab1b800
> nid=0x2284 waiting on condition [0x000000002a49f000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000081f8a4c0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.LinkedBlockingDeque.pollFirst(
> LinkedBlockingDeque.java:522)
>         at
> java.util.concurrent.LinkedBlockingDeque.poll(
> LinkedBlockingDeque.java:684)
>         at
> org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeMana
> ger$ExchangeWorker.body0(GridCachePartitionExchangeManager.java:2365)
>         at
> org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeMana
> ger$ExchangeWorker.body(GridCachePartitionExchangeManager.java:2299)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "ignite-update-notifier-timer" #106 daemon prio=5 os_prio=0
> tid=0x000000001ab1b000 nid=0x353c in Object.wait() [0x000000002a28e000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.util.TimerThread.mainLoop(Timer.java:552)
>         - locked <0x0000000086597608> (a java.util.TaskQueue)
>         at java.util.TimerThread.run(Timer.java:505)
>
>    Locked ownable synchronizers:
>         - None
>
> "upd-ver-checker" #105 daemon prio=5 os_prio=0 tid=0x000000001ab1a000
> nid=0x1a30 waiting on condition [0x000000002a11e000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at
> org.apache.ignite.internal.processors.cluster.GridUpdateNotifier$1.run(
> GridUpdateNotifier.java:115)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "disco-event-worker-#41" #104 daemon prio=5 os_prio=0
> tid=0x000000001ab19800
> nid=0x3190 waiting on condition [0x0000000029d8f000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000a1b7e830> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at
> org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$
> DiscoveryWorker.body0(GridDiscoveryManager.java:2758)
>         at
> org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$
> DiscoveryWorker.body(GridDiscoveryManager.java:2732)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "tcp-disco-ip-finder-cleaner-#5" #103 daemon prio=10 os_prio=2
> tid=0x000000001ab18800 nid=0x3c2c waiting on condition [0x0000000029aaf000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at
> org.apache.ignite.spi.discovery.tcp.ServerImpl$IpFinderCleaner.body(
> ServerImpl.java:1900)
>         at
> org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)
>
>    Locked ownable synchronizers:
>         - None
>
> "tcp-disco-sock-reader-#4" #102 daemon prio=10 os_prio=2
> tid=0x000000001ab18000 nid=0x3f58 runnable [0x0000000029c3e000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.SocketInputStream.socketRead0(Native Method)
>         at java.net.SocketInputStream.socketRead(SocketInputStream.
> java:116)
>         at java.net.SocketInputStream.read(SocketInputStream.java:171)
>         at java.net.SocketInputStream.read(SocketInputStream.java:141)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
>         at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
>         - locked <0x00000000873e95b0> (a java.io.BufferedInputStream)
>         at
> org.apache.ignite.marshaller.jdk.JdkMarshallerInputStreamWrapper.read(
> JdkMarshallerInputStreamWrapper.java:53)
>         at
> java.io.ObjectInputStream$PeekInputStream.read(
> ObjectInputStream.java:2657)
>         at
> java.io.ObjectInputStream$PeekInputStream.readFully(
> ObjectInputStream.java:2673)
>         at
> java.io.ObjectInputStream$BlockDataInputStream.
> readShort(ObjectInputStream.java:3150)
>         at
> java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:859)
>         at java.io.ObjectInputStream.<init>(ObjectInputStream.java:355)
>         at
> org.apache.ignite.marshaller.jdk.JdkMarshallerObjectInputStream.<init>(
> JdkMarshallerObjectInputStream.java:43)
>         at
> org.apache.ignite.marshaller.jdk.JdkMarshaller.unmarshal0(
> JdkMarshaller.java:137)
>         at
> org.apache.ignite.marshaller.AbstractNodeNameAwareMarshaller.unmarshal(
> AbstractNodeNameAwareMarshaller.java:94)
>         at
> org.apache.ignite.internal.util.IgniteUtils.unmarshal(
> IgniteUtils.java:9907)
>         at
> org.apache.ignite.spi.discovery.tcp.ServerImpl$
> SocketReader.body(ServerImpl.java:5981)
>         at
> org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)
>
>    Locked ownable synchronizers:
>         - None
>
> "tcp-disco-srvr-#2" #77 daemon prio=10 os_prio=2 tid=0x000000001ab17000
> nid=0x21dc runnable [0x000000002925f000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.DualStackPlainSocketImpl.accept0(Native Method)
>         at
> java.net.DualStackPlainSocketImpl.socketAccept(
> DualStackPlainSocketImpl.java:131)
>         at
> java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
>         at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:199)
>         - locked <0x00000000a1e1b158> (a java.net.SocksSocketImpl)
>         at java.net.ServerSocket.implAccept(ServerSocket.java:545)
>         at java.net.ServerSocket.accept(ServerSocket.java:513)
>         at
> org.apache.ignite.spi.discovery.tcp.ServerImpl$TcpServer.body(ServerImpl.
> java:5641)
>         at
> org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)
>
>    Locked ownable synchronizers:
>         - None
>
> "tcp-disco-msg-worker-#3" #101 daemon prio=10 os_prio=2
> tid=0x000000001ab16800 nid=0x3ac8 runnable [0x0000000028c0f000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000846c9108> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.LinkedBlockingDeque.pollFirst(
> LinkedBlockingDeque.java:522)
>         at
> java.util.concurrent.LinkedBlockingDeque.poll(
> LinkedBlockingDeque.java:684)
>         at
> org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorkerAdapter.body(
> ServerImpl.java:6770)
>         at
> org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.body(
> ServerImpl.java:2621)
>         at
> org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)
>
>    Locked ownable synchronizers:
>         - None
>
> "grid-data-loader-flusher-#40" #100 daemon prio=5 os_prio=0
> tid=0x000000001ab15800 nid=0x36ac waiting on condition [0x00000000297ae000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x0000000083c2cea8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at java.util.concurrent.DelayQueue.take(DelayQueue.java:211)
>         at
> org.apache.ignite.internal.processors.datastreamer.
> DataStreamProcessor$2.body(DataStreamProcessor.java:109)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "grid-nio-worker-tcp-rest-3-#39" #99 prio=5 os_prio=0
> tid=0x000000001ab15000
> nid=0x160c runnable [0x000000002961e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x0000000083bf7af8> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x0000000083bf4090> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x0000000083bf3f40> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.
> bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "grid-nio-worker-tcp-rest-2-#38" #98 prio=5 os_prio=0
> tid=0x000000001ab14000
> nid=0x3fe4 runnable [0x000000002949f000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x0000000083bef3a8> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x0000000083beb918> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x0000000083beb7c8> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.
> bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "grid-nio-worker-tcp-rest-1-#37" #97 prio=5 os_prio=0
> tid=0x000000001ab13800
> nid=0x32e0 runnable [0x000000002937e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x0000000083be6c30> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x0000000083be31a0> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x0000000083be3050> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.
> bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "grid-nio-worker-tcp-rest-0-#36" #96 prio=5 os_prio=0
> tid=0x000000001ab12800
> nid=0x3f98 runnable [0x000000002910e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x0000000083bde4b8> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x0000000083bdaa28> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x0000000083bda8d8> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.
> bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "nio-acceptor-#35" #95 daemon prio=5 os_prio=0 tid=0x000000001ab12000
> nid=0x3524 runnable [0x0000000028e2e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x0000000083bd63d0> (a sun.nio.ch.Util$3)
>         - locked <0x0000000083bd63c0> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x0000000083bd6270> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> GridNioAcceptWorker.accept(GridNioServer.java:2870)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> GridNioAcceptWorker.body(GridNioServer.java:2822)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "cron4j::scheduler[9143bc2244bd91995fb92946000001
> 64d633145b499aba8d]::timer[9143bc2244bd91995fb92946000001
> 64d633145d3aa746fa]"
> #93 prio=5 os_prio=0 tid=0x000000001ab11000 nid=0x2054 waiting on condition
> [0x0000000028f6f000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at it.sauronsoftware.cron4j.TimerThread.safeSleep(Unknown Source)
>         at it.sauronsoftware.cron4j.TimerThread.run(Unknown Source)
>
>    Locked ownable synchronizers:
>         - None
>
> "grid-nio-worker-client-listener-3-#33" #92 prio=5 os_prio=0
> tid=0x000000001ab10800 nid=0xbf0 runnable [0x0000000028d0e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000830a2720> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x000000008309ec90> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x000000008309eb40> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.
> bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "grid-nio-worker-client-listener-2-#32" #91 prio=5 os_prio=0
> tid=0x000000001ab0f800 nid=0x210c runnable [0x0000000028aae000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x0000000083099ee8> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x0000000083096458> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x0000000083096308> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.
> bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "grid-nio-worker-client-listener-1-#31" #90 prio=5 os_prio=0
> tid=0x000000001ab0f000 nid=0x2b4c runnable [0x00000000289ae000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000830916b0> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x000000008308dc20> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x000000008308dad0> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.
> bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "grid-nio-worker-client-listener-0-#30" #89 prio=5 os_prio=0
> tid=0x000000001ab0e000 nid=0x24d8 runnable [0x00000000287de000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x0000000083088e78> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000000830853e8> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x0000000083085298> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.
> bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "nio-acceptor-#29" #88 daemon prio=5 os_prio=0 tid=0x000000001ab0d800
> nid=0x3de4 runnable [0x00000000286df000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x0000000083080da0> (a sun.nio.ch.Util$3)
>         - locked <0x0000000083080d90> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x0000000083080c40> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> GridNioAcceptWorker.accept(GridNioServer.java:2870)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> GridNioAcceptWorker.body(GridNioServer.java:2822)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "Thread-10" #87 daemon prio=5 os_prio=0 tid=0x0000000022093000 nid=0x32f0
> runnable [0x000000003580e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
>         at sun.nio.ch.Iocp.access$300(Iocp.java:46)
>         at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
>         at
> sun.nio.ch.AsynchronousChannelGroupImpl$1.run(
> AsynchronousChannelGroupImpl.java:112)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - <0x0000000081f40588> (a
> java.util.concurrent.ThreadPoolExecutor$Worker)
>
> "Thread-9" #86 daemon prio=5 os_prio=0 tid=0x0000000022092800 nid=0x2d30
> runnable [0x000000003544e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
>         at sun.nio.ch.Iocp.access$300(Iocp.java:46)
>         at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
>         at
> sun.nio.ch.AsynchronousChannelGroupImpl$1.run(
> AsynchronousChannelGroupImpl.java:112)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - <0x0000000081f401f8> (a
> java.util.concurrent.ThreadPoolExecutor$Worker)
>
> "Thread-8" #85 daemon prio=5 os_prio=0 tid=0x0000000022091800 nid=0x3d50
> runnable [0x0000000034e8f000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
>         at sun.nio.ch.Iocp.access$300(Iocp.java:46)
>         at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
>         at
> sun.nio.ch.AsynchronousChannelGroupImpl$1.run(
> AsynchronousChannelGroupImpl.java:112)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - <0x0000000081f3fe68> (a
> java.util.concurrent.ThreadPoolExecutor$Worker)
>
> "Thread-7" #84 daemon prio=5 os_prio=0 tid=0x0000000022091000 nid=0x2160
> runnable [0x00000000355af000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
>         at sun.nio.ch.Iocp.access$300(Iocp.java:46)
>         at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
>         at
> sun.nio.ch.AsynchronousChannelGroupImpl$1.run(
> AsynchronousChannelGroupImpl.java:112)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - <0x0000000081f3fad8> (a
> java.util.concurrent.ThreadPoolExecutor$Worker)
>
> "Thread-6" #83 daemon prio=5 os_prio=0 tid=0x0000000022090000 nid=0x22a0
> runnable [0x000000003534f000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
>         at sun.nio.ch.Iocp.access$300(Iocp.java:46)
>         at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
>         at
> sun.nio.ch.AsynchronousChannelGroupImpl$1.run(
> AsynchronousChannelGroupImpl.java:112)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - <0x0000000081f3f748> (a
> java.util.concurrent.ThreadPoolExecutor$Worker)
>
> "Thread-5" #82 daemon prio=5 os_prio=0 tid=0x000000002208f800 nid=0x1068
> runnable [0x000000003514e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
>         at sun.nio.ch.Iocp.access$300(Iocp.java:46)
>         at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
>         at
> sun.nio.ch.AsynchronousChannelGroupImpl$1.run(
> AsynchronousChannelGroupImpl.java:112)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - <0x0000000081f3f3b8> (a
> java.util.concurrent.ThreadPoolExecutor$Worker)
>
> "Thread-4" #81 daemon prio=5 os_prio=0 tid=0x000000002208e800 nid=0x3668
> runnable [0x0000000034f9e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
>         at sun.nio.ch.Iocp.access$300(Iocp.java:46)
>         at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
>         at
> sun.nio.ch.AsynchronousChannelGroupImpl$1.run(
> AsynchronousChannelGroupImpl.java:112)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - <0x0000000081f3f028> (a
> java.util.concurrent.ThreadPoolExecutor$Worker)
>
> "Thread-3" #80 daemon prio=5 os_prio=0 tid=0x000000002208e000 nid=0x2ee8
> runnable [0x0000000034d6e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
>         at sun.nio.ch.Iocp.access$300(Iocp.java:46)
>         at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
>         at
> sun.nio.ch.AsynchronousChannelGroupImpl$1.run(
> AsynchronousChannelGroupImpl.java:112)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - <0x0000000081f3ec48> (a
> java.util.concurrent.ThreadPoolExecutor$Worker)
>
> "Thread-2" #79 daemon prio=5 os_prio=0 tid=0x000000002208d000 nid=0x1d0c
> runnable [0x0000000034c6f000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
>         at sun.nio.ch.Iocp.access$300(Iocp.java:46)
>         at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "tcp-comm-worker-#1" #76 daemon prio=5 os_prio=0 tid=0x000000002208c800
> nid=0x3b34 waiting on condition [0x0000000027edf000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000a15653e0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.LinkedBlockingQueue.poll(
> LinkedBlockingQueue.java:467)
>         at
> org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi$
> CommunicationWorker.body(TcpCommunicationSpi.java:4207)
>         at
> org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)
>
>    Locked ownable synchronizers:
>         - None
>
> "grid-nio-worker-tcp-comm-3-#28" #72 prio=5 os_prio=0
> tid=0x000000002208b800
> nid=0x37ac runnable [0x0000000027c5e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000a15686e8> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000000a15686d8> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000a1568658> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.
> bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "grid-nio-worker-tcp-comm-2-#27" #71 prio=5 os_prio=0
> tid=0x000000002208b000
> nid=0x3334 runnable [0x0000000027d8e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000a156ba08> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000000a156b9f8> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000a156b978> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.
> bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "grid-nio-worker-tcp-comm-1-#26" #70 prio=5 os_prio=0
> tid=0x0000000022088800
> nid=0x2e70 runnable [0x0000000027aee000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000a156ed10> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000000a156ed00> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000a156ec80> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.
> bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "grid-nio-worker-tcp-comm-0-#25" #69 prio=5 os_prio=0
> tid=0x0000000022089800
> nid=0x3f90 runnable [0x0000000026d1e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000a1572018> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000000a1572008> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000a1571f88> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.
> bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "nio-acceptor-#24" #68 daemon prio=5 os_prio=0 tid=0x000000002208a000
> nid=0x2fbc runnable [0x000000002795e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000a1575320> (a sun.nio.ch.Util$3)
>         - locked <0x00000000a1575310> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000a1575290> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> GridNioAcceptWorker.accept(GridNioServer.java:2870)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> GridNioAcceptWorker.body(GridNioServer.java:2822)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "grid-timeout-worker-#23" #67 daemon prio=5 os_prio=0
> tid=0x0000000022088000
> nid=0x1974 in Object.wait() [0x000000002776f000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at
> org.apache.ignite.internal.processors.timeout.GridTimeoutProcessor$
> TimeoutWorker.body(GridTimeoutProcessor.java:203)
>         - locked <0x00000000a15754e8> (a java.lang.Object)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "ignite-clock" #66 daemon prio=10 os_prio=2 tid=0x0000000022087000
> nid=0x2aa4 waiting on condition [0x00000000274fe000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at
> org.apache.ignite.internal.util.IgniteUtils$22.run(IgniteUtils.java:3308)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "jvm-pause-detector-worker" #59 daemon prio=5 os_prio=0
> tid=0x0000000021dba000 nid=0x2034 waiting on condition [0x000000002656f000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at
> org.apache.ignite.internal.LongJVMPauseDetector$1.run(
> LongJVMPauseDetector.java:90)
>
>    Locked ownable synchronizers:
>         - None
>
> "data-streamer-stripe-7-#16" #58 daemon prio=5 os_prio=0
> tid=0x0000000021db9800 nid=0x2f60 waiting on condition [0x00000000262ae000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "data-streamer-stripe-6-#15" #57 daemon prio=5 os_prio=0
> tid=0x0000000021db8800 nid=0x3d74 waiting on condition [0x00000000263ff000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "data-streamer-stripe-5-#14" #56 daemon prio=5 os_prio=0
> tid=0x0000000021db8000 nid=0x25e8 waiting on condition [0x0000000025dfe000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "data-streamer-stripe-4-#13" #55 daemon prio=5 os_prio=0
> tid=0x0000000021db7000 nid=0x3450 waiting on condition [0x000000002604e000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "data-streamer-stripe-3-#12" #54 daemon prio=5 os_prio=0
> tid=0x0000000021db6800 nid=0x2b24 waiting on condition [0x000000002615e000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "data-streamer-stripe-2-#11" #53 daemon prio=5 os_prio=0
> tid=0x0000000021db5800 nid=0xdd8 waiting on condition [0x0000000025f4f000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "data-streamer-stripe-1-#10" #52 daemon prio=5 os_prio=0
> tid=0x0000000021db5000 nid=0xb74 waiting on condition [0x0000000025cdf000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "data-streamer-stripe-0-#9" #51 daemon prio=5 os_prio=0
> tid=0x0000000021db4000 nid=0x3474 waiting on condition [0x0000000025b0e000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "sys-stripe-7-#8" #50 daemon prio=5 os_prio=0 tid=0x0000000021db3000
> nid=0x6cc waiting on condition [0x00000000259df000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "sys-stripe-6-#7" #49 daemon prio=5 os_prio=0 tid=0x0000000021db2800
> nid=0x169c waiting on condition [0x00000000250bf000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "sys-stripe-5-#6" #48 daemon prio=5 os_prio=0 tid=0x0000000021db1800
> nid=0x183c waiting on condition [0x00000000258ce000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "sys-stripe-4-#5" #47 daemon prio=5 os_prio=0 tid=0x0000000021db1000
> nid=0x214c waiting on condition [0x0000000024cce000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "sys-stripe-3-#4" #46 daemon prio=5 os_prio=0 tid=0x0000000021db0000
> nid=0x870 waiting on condition [0x000000002573e000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "sys-stripe-2-#3" #45 daemon prio=5 os_prio=0 tid=0x0000000021daf800
> nid=0x26ec waiting on condition [0x00000000255ef000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "sys-stripe-1-#2" #44 daemon prio=5 os_prio=0 tid=0x0000000021dae800
> nid=0x1688 waiting on condition [0x000000002018f000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "sys-stripe-0-#1" #43 daemon prio=5 os_prio=0 tid=0x0000000021dae000
> nid=0x38ac waiting on condition [0x000000002467f000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "Curator-Framework-0" #42 daemon prio=5 os_prio=0 tid=0x0000000021dad000
> nid=0x1be8 waiting on condition [0x00000000242fe000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000a1576500> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at java.util.concurrent.DelayQueue.take(DelayQueue.java:211)
>         at java.util.concurrent.DelayQueue.take(DelayQueue.java:70)
>         at
> org.apache.curator.framework.imps.CuratorFrameworkImpl.
> backgroundOperationsLoop(CuratorFrameworkImpl.java:804)
>         at
> org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(
> CuratorFrameworkImpl.java:64)
>         at
> org.apache.curator.framework.imps.CuratorFrameworkImpl$4.
> call(CuratorFrameworkImpl.java:267)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(
> ScheduledThreadPoolExecutor.java:293)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - <0x00000000a15768b0> (a
> java.util.concurrent.ThreadPoolExecutor$Worker)
>
> "localhost-startStop-1-EventThread" #41 daemon prio=5 os_prio=0
> tid=0x0000000021dac800 nid=0x3504 waiting on condition [0x000000002454f000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000a18ba970> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at
> org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
>
>    Locked ownable synchronizers:
>         - None
>
> "localhost-startStop-1-SendThread(srv7-ngxeko.net.billing.ru:2181)" #40
> daemon prio=5 os_prio=0 tid=0x000000001b4f2800 nid=0x3e18 runnable
> [0x000000002418e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000a17e7d80> (a sun.nio.ch.Util$3)
>         - locked <0x00000000a17e7d70> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000a17e7cf0> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> ClientCnxnSocketNIO.java:349)
>         at
> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
>
>    Locked ownable synchronizers:
>         - None
>
> "Curator-ConnectionStateManager-0" #39 daemon prio=5 os_prio=0
> tid=0x000000001b4f1800 nid=0x3dc0 waiting on condition [0x000000001c46e000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000a170fa18> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403)
>         at
> org.apache.curator.framework.state.ConnectionStateManager.processEvents(
> ConnectionStateManager.java:245)
>         at
> org.apache.curator.framework.state.ConnectionStateManager.access$000(
> ConnectionStateManager.java:43)
>         at
> org.apache.curator.framework.state.ConnectionStateManager$
> 1.call(ConnectionStateManager.java:111)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - <0x00000000a170fb40> (a
> java.util.concurrent.ThreadPoolExecutor$Worker)
>
> "I/O dispatcher 8" #38 prio=5 os_prio=0 tid=0x000000001b4f0000 nid=0x185c
> runnable [0x0000000024f2e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000a1576c60> (a sun.nio.ch.Util$3)
>         - locked <0x00000000a1576c50> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000a1576b80> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.http.impl.nio.reactor.AbstractIOReactor.
> execute(AbstractIOReactor.java:257)
>         at
> org.apache.http.impl.nio.reactor.BaseIOReactor.execute(
> BaseIOReactor.java:106)
>         at
> org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(
> AbstractMultiworkerIOReactor.java:590)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "I/O dispatcher 7" #37 prio=5 os_prio=0 tid=0x000000001b4ef800 nid=0x14f4
> runnable [0x0000000024a6e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000a1712de0> (a sun.nio.ch.Util$3)
>         - locked <0x00000000a1712dd0> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000a1712d50> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.http.impl.nio.reactor.AbstractIOReactor.
> execute(AbstractIOReactor.java:257)
>         at
> org.apache.http.impl.nio.reactor.BaseIOReactor.execute(
> BaseIOReactor.java:106)
>         at
> org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(
> AbstractMultiworkerIOReactor.java:590)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "I/O dispatcher 6" #36 prio=5 os_prio=0 tid=0x000000001b4ee800 nid=0x3604
> runnable [0x0000000024dce000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000a17eb130> (a sun.nio.ch.Util$3)
>         - locked <0x00000000a17eb120> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000a17eb0a0> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.http.impl.nio.reactor.AbstractIOReactor.
> execute(AbstractIOReactor.java:257)
>         at
> org.apache.http.impl.nio.reactor.BaseIOReactor.execute(
> BaseIOReactor.java:106)
>         at
> org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(
> AbstractMultiworkerIOReactor.java:590)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "I/O dispatcher 5" #35 prio=5 os_prio=0 tid=0x000000001b4ee000 nid=0x278c
> runnable [0x000000001c66f000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000a17ee418> (a sun.nio.ch.Util$3)
>         - locked <0x00000000a17ee408> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000a17ee388> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.http.impl.nio.reactor.AbstractIOReactor.
> execute(AbstractIOReactor.java:257)
>         at
> org.apache.http.impl.nio.reactor.BaseIOReactor.execute(
> BaseIOReactor.java:106)
>         at
> org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(
> AbstractMultiworkerIOReactor.java:590)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "I/O dispatcher 4" #34 prio=5 os_prio=0 tid=0x000000001b4ed000 nid=0x2fe0
> runnable [0x0000000024b7f000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000a17f1700> (a sun.nio.ch.Util$3)
>         - locked <0x00000000a17f16f0> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000a17f1670> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.http.impl.nio.reactor.AbstractIOReactor.
> execute(AbstractIOReactor.java:257)
>         at
> org.apache.http.impl.nio.reactor.BaseIOReactor.execute(
> BaseIOReactor.java:106)
>         at
> org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(
> AbstractMultiworkerIOReactor.java:590)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "I/O dispatcher 3" #33 prio=5 os_prio=0 tid=0x000000001b4ec800 nid=0x367c
> runnable [0x000000001bdbf000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000a17f49e8> (a sun.nio.ch.Util$3)
>         - locked <0x00000000a17f49d8> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000a17f4958> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.http.impl.nio.reactor.AbstractIOReactor.
> execute(AbstractIOReactor.java:257)
>         at
> org.apache.http.impl.nio.reactor.BaseIOReactor.execute(
> BaseIOReactor.java:106)
>         at
> org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(
> AbstractMultiworkerIOReactor.java:590)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "I/O dispatcher 2" #32 prio=5 os_prio=0 tid=0x000000001b4eb800 nid=0x3108
> runnable [0x000000002494f000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000a17f7cd0> (a sun.nio.ch.Util$3)
>         - locked <0x00000000a17f7cc0> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000a17f7c40> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.http.impl.nio.reactor.AbstractIOReactor.
> execute(AbstractIOReactor.java:257)
>         at
> org.apache.http.impl.nio.reactor.BaseIOReactor.execute(
> BaseIOReactor.java:106)
>         at
> org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(
> AbstractMultiworkerIOReactor.java:590)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "I/O dispatcher 1" #31 prio=5 os_prio=0 tid=0x000000001b4ea000 nid=0x3cf4
> runnable [0x000000002479e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000a17fafb8> (a sun.nio.ch.Util$3)
>         - locked <0x00000000a17fafa8> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000a17faf28> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.http.impl.nio.reactor.AbstractIOReactor.
> execute(AbstractIOReactor.java:257)
>         at
> org.apache.http.impl.nio.reactor.BaseIOReactor.execute(
> BaseIOReactor.java:106)
>         at
> org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(
> AbstractMultiworkerIOReactor.java:590)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "pool-4-thread-1" #30 prio=5 os_prio=0 tid=0x000000001b4e8000 nid=0x1d88
> runnable [0x000000001c9df000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000a17fe2f0> (a sun.nio.ch.Util$3)
>         - locked <0x00000000a17fe2e0> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000a17fe210> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor.execute(
> AbstractMultiworkerIOReactor.java:342)
>         at
> org.apache.http.impl.nio.conn.PoolingNHttpClientConnectionManager.execute(
> PoolingNHttpClientConnectionManager.java:194)
>         at
> org.apache.http.impl.nio.client.CloseableHttpAsyncClientBase$1.run(
> CloseableHttpAsyncClientBase.java:64)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "logback-1" #25 daemon prio=5 os_prio=0 tid=0x000000001b4e5000 nid=0x39f4
> waiting on condition [0x000000001effe000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ad3b84c0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "localhost-startStop-1" #24 daemon prio=5 os_prio=0 tid=0x000000001b4e3800
> nid=0x1478 waiting on condition [0x000000001cb1c000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.
> get0(GridFutureAdapter.java:177)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.
> get(GridFutureAdapter.java:140)
>         at
> org.apache.ignite.internal.AsyncSupportAdapter.saveOrGet(
> AsyncSupportAdapter.java:112)
>         at
> org.apache.ignite.internal.IgniteServicesImpl.cancel(
> IgniteServicesImpl.java:269)
>         at
> com.peterservice.openapi.b2b.datamart.datagrid.impl.
> IgniteFsOperations.<init>(IgniteFsOperations.java:97)
>         at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
>         at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(
> NativeConstructorAccessorImpl.java:62)
>         at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(
> DelegatingConstructorAccessorImpl.java:45)
>         at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
>         at
> org.springframework.beans.BeanUtils.instantiateClass(BeanUtils.java:142)
>         at
> org.springframework.beans.factory.support.SimpleInstantiationStrategy.
> instantiate(SimpleInstantiationStrategy.java:122)
>         at
> org.springframework.beans.factory.support.ConstructorResolver.
> autowireConstructor(ConstructorResolver.java:271)
>         at
> org.springframework.beans.factory.support.AbstractAutowireCapableBeanFac
> tory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1154)
>         at
> org.springframework.beans.factory.support.AbstractAutowireCapableBeanFac
> tory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1056)
>         at
> org.springframework.beans.factory.support.AbstractAutowireCapableBeanFac
> tory.doCreateBean(AbstractAutowireCapableBeanFactory.java:513)
>         at
> org.springframework.beans.factory.support.AbstractAutowireCapableBeanFac
> tory.createBean(AbstractAutowireCapableBeanFactory.java:483)
>         at
> org.springframework.beans.factory.support.AbstractBeanFactory$1.
> getObject(AbstractBeanFactory.java:306)
>         at
> org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.
> getSingleton(DefaultSingletonBeanRegistry.java:230)
>         - locked <0x00000000ad3a4818> (a
> java.util.concurrent.ConcurrentHashMap)
>         at
> org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(
> AbstractBeanFactory.java:302)
>         at
> org.springframework.beans.factory.support.AbstractBeanFactory.getBean(
> AbstractBeanFactory.java:197)
>         at
> org.springframework.beans.factory.support.BeanDefinitionValueResolver.
> resolveReference(BeanDefinitionValueResolver.java:351)
>         at
> org.springframework.beans.factory.support.BeanDefinitionValueResolver.
> resolveValueIfNecessary(BeanDefinitionValueResolver.java:108)
>         at
> org.springframework.beans.factory.support.ConstructorResolver.
> resolveConstructorArguments(ConstructorResolver.java:648)
>         at
> org.springframework.beans.factory.support.ConstructorResolver.
> autowireConstructor(ConstructorResolver.java:145)
>         at
> org.springframework.beans.factory.support.AbstractAutowireCapableBeanFac
> tory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1154)
>         at
> org.springframework.beans.factory.support.AbstractAutowireCapableBeanFac
> tory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1056)
>         at
> org.springframework.beans.factory.support.AbstractAutowireCapableBeanFac
> tory.doCreateBean(AbstractAutowireCapableBeanFactory.java:513)
>         at
> org.springframework.beans.factory.support.AbstractAutowireCapableBeanFac
> tory.createBean(AbstractAutowireCapableBeanFactory.java:483)
>         at
> org.springframework.beans.factory.support.AbstractBeanFactory$1.
> getObject(AbstractBeanFactory.java:306)
>         at
> org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.
> getSingleton(DefaultSingletonBeanRegistry.java:230)
>         - locked <0x00000000ad3a4818> (a
> java.util.concurrent.ConcurrentHashMap)
>         at
> org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(
> AbstractBeanFactory.java:302)
>         at
> org.springframework.beans.factory.support.AbstractBeanFactory.getBean(
> AbstractBeanFactory.java:202)
>         at
> org.springframework.beans.factory.config.DependencyDescriptor.
> resolveCandidate(DependencyDescriptor.java:207)
>         at
> org.springframework.beans.factory.support.DefaultListableBeanFactory.
> doResolveDependency(DefaultListableBeanFactory.java:1136)
>         at
> org.springframework.beans.factory.support.DefaultListableBeanFactory.
> resolveDependency(DefaultListableBeanFactory.java:1064)
>         at
> org.springframework.beans.factory.annotation.
> AutowiredAnnotationBeanPostProcessor$AutowiredMethodElement.inject(
> AutowiredAnnotationBeanPostProcessor.java:659)
>         at
> org.springframework.beans.factory.annotation.InjectionMetadata.inject(
> InjectionMetadata.java:88)
>         at
> org.springframework.beans.factory.annotation.
> AutowiredAnnotationBeanPostProcessor.postProcessPropertyValues(
> AutowiredAnnotationBeanPostProcessor.java:366)
>         at
> org.springframework.beans.factory.support.AbstractAutowireCapableBeanFac
> tory.populateBean(AbstractAutowireCapableBeanFactory.java:1225)
>         at
> org.springframework.beans.factory.support.AbstractAutowireCapableBeanFac
> tory.doCreateBean(AbstractAutowireCapableBeanFactory.java:552)
>         at
> org.springframework.beans.factory.support.AbstractAutowireCapableBeanFac
> tory.createBean(AbstractAutowireCapableBeanFactory.java:483)
>         at
> org.springframework.beans.factory.support.AbstractBeanFactory$1.
> getObject(AbstractBeanFactory.java:306)
>         at
> org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.
> getSingleton(DefaultSingletonBeanRegistry.java:230)
>         - locked <0x00000000ad3a4818> (a
> java.util.concurrent.ConcurrentHashMap)
>         at
> org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(
> AbstractBeanFactory.java:302)
>         at
> org.springframework.beans.factory.support.AbstractBeanFactory.getBean(
> AbstractBeanFactory.java:197)
>         at
> org.springframework.beans.factory.support.DefaultListableBeanFactory.
> preInstantiateSingletons(DefaultListableBeanFactory.java:759)
>         at
> org.springframework.context.support.AbstractApplicationContext.
> finishBeanFactoryInitialization(AbstractApplicationContext.java:866)
>         at
> org.springframework.context.support.AbstractApplicationContext.refresh(
> AbstractApplicationContext.java:542)
>         - locked <0x00000000aaaac210> (a java.lang.Object)
>         at
> org.springframework.web.context.ContextLoader.
> configureAndRefreshWebApplicationContext(ContextLoader.java:444)
>         at
> org.springframework.web.context.ContextLoader.initWebApplicationContext(
> ContextLoader.java:326)
>         at
> org.springframework.web.context.ContextLoaderListener.contextInitialized(
> ContextLoaderListener.java:107)
>         at
> org.apache.catalina.core.StandardContext.listenerStart(
> StandardContext.java:5068)
>         at
> org.apache.catalina.core.StandardContext.startInternal(
> StandardContext.java:5584)
>         - locked <0x00000000aa25b5b8> (a
> org.apache.catalina.core.StandardContext)
>         at
> org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:147)
>         - locked <0x00000000aa25b5b8> (a
> org.apache.catalina.core.StandardContext)
>         at
> org.apache.catalina.core.ContainerBase.addChildInternal(
> ContainerBase.java:899)
>         at
> org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:875)
>         at
> org.apache.catalina.core.StandardHost.addChild(StandardHost.java:652)
>         at
> org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:1091)
>         at
> org.apache.catalina.startup.HostConfig$DeployWar.run(HostConfig.java:1980)
>         at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - <0x00000000aa6a26e8> (a
> java.util.concurrent.ThreadPoolExecutor$Worker)
>
> "Catalina-startStop-1" #23 daemon prio=5 os_prio=0 tid=0x000000001b078800
> nid=0x2d90 waiting on condition [0x000000001c8be000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000aa23c568> (a
> java.util.concurrent.FutureTask)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at java.util.concurrent.FutureTask.awaitDone(FutureTask.java:429)
>         at java.util.concurrent.FutureTask.get(FutureTask.java:191)
>         at
> org.apache.catalina.startup.HostConfig.deployWARs(HostConfig.java:830)
>         at
> org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:493)
>         at
> org.apache.catalina.startup.HostConfig.start(HostConfig.java:1709)
>         at
> org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:335)
>         at
> org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(
> LifecycleSupport.java:117)
>         at
> org.apache.catalina.util.LifecycleBase.fireLifecycleEvent(
> LifecycleBase.java:90)
>         at
> org.apache.catalina.util.LifecycleBase.setStateInternal(
> LifecycleBase.java:394)
>         - locked <0x00000000aa021668> (a
> org.apache.catalina.core.StandardHost)
>         at
> org.apache.catalina.util.LifecycleBase.setState(LifecycleBase.java:339)
>         - locked <0x00000000aa021668> (a
> org.apache.catalina.core.StandardHost)
>         at
> org.apache.catalina.core.ContainerBase.startInternal(
> ContainerBase.java:1137)
>         - locked <0x00000000aa021668> (a
> org.apache.catalina.core.StandardHost)
>         at
> org.apache.catalina.core.StandardHost.startInternal(StandardHost.java:819)
>         - locked <0x00000000aa021668> (a
> org.apache.catalina.core.StandardHost)
>         at
> org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:147)
>         - locked <0x00000000aa021668> (a
> org.apache.catalina.core.StandardHost)
>         at
> org.apache.catalina.core.ContainerBase$StartChild.call(
> ContainerBase.java:1572)
>         at
> org.apache.catalina.core.ContainerBase$StartChild.call(
> ContainerBase.java:1562)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - <0x00000000aa2d2250> (a
> java.util.concurrent.ThreadPoolExecutor$Worker)
>
> "RMI RenewClean-[172.21.98.254:29005]" #21 daemon prio=5 os_prio=0
> tid=0x000000001b1b9000 nid=0x9a4 in Object.wait() [0x000000001c56e000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         - waiting on <0x00000000aa66a7b8> (a
> java.lang.ref.ReferenceQueue$Lock)
>         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
>         - locked <0x00000000aa66a7b8> (a java.lang.ref.ReferenceQueue$
> Lock)
>         at
> sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(
> DGCClient.java:563)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "RMI Scheduler(0)" #20 daemon prio=5 os_prio=0 tid=0x000000001b03e800
> nid=0x1c90 waiting on condition [0x000000001a5ee000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000a9ad7340> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "RMI Reaper" #18 prio=5 os_prio=0 tid=0x000000001aead800 nid=0x700 in
> Object.wait() [0x000000001c15f000]
>    java.lang.Thread.State: WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         - waiting on <0x00000000a9ad61a0> (a
> java.lang.ref.ReferenceQueue$Lock)
>         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
>         - locked <0x00000000a9ad61a0> (a java.lang.ref.ReferenceQueue$
> Lock)
>         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
>         at sun.rmi.transport.ObjectTable$Reaper.run(ObjectTable.java:351)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "RMI TCP Accept-29005" #17 daemon prio=5 os_prio=0 tid=0x000000001aeac800
> nid=0x340c runnable [0x000000001bece000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.DualStackPlainSocketImpl.accept0(Native Method)
>         at
> java.net.DualStackPlainSocketImpl.socketAccept(
> DualStackPlainSocketImpl.java:131)
>         at
> java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
>         at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:199)
>         - locked <0x00000000aa1e53b0> (a java.net.SocksSocketImpl)
>         at java.net.ServerSocket.implAccept(ServerSocket.java:545)
>         at java.net.ServerSocket.accept(ServerSocket.java:513)
>         at
> sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(
> TCPTransport.java:400)
>         at
> sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:372)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "RMI TCP Accept-29004" #16 daemon prio=5 os_prio=0 tid=0x000000001b2be800
> nid=0x1fac runnable [0x000000001950e000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.DualStackPlainSocketImpl.accept0(Native Method)
>         at
> java.net.DualStackPlainSocketImpl.socketAccept(
> DualStackPlainSocketImpl.java:131)
>         at
> java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
>         at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:199)
>         - locked <0x00000000aa1e3410> (a java.net.SocksSocketImpl)
>         at java.net.ServerSocket.implAccept(ServerSocket.java:545)
>         at java.net.ServerSocket.accept(ServerSocket.java:513)
>         at
> sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(
> TCPTransport.java:400)
>         at
> sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:372)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "GC Daemon" #15 daemon prio=2 os_prio=-2 tid=0x000000001aef7000 nid=0x329c
> in Object.wait() [0x0000000018fcf000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         - waiting on <0x00000000aa08bef8> (a sun.misc.GC$LatencyLock)
>         at sun.misc.GC$Daemon.run(GC.java:117)
>         - locked <0x00000000aa08bef8> (a sun.misc.GC$LatencyLock)
>
>    Locked ownable synchronizers:
>         - None
>
> "RMI TCP Accept-0" #14 daemon prio=5 os_prio=0 tid=0x0000000019a1d800
> nid=0x3d1c runnable [0x000000001a4be000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.DualStackPlainSocketImpl.accept0(Native Method)
>         at
> java.net.DualStackPlainSocketImpl.socketAccept(
> DualStackPlainSocketImpl.java:131)
>         at
> java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
>         at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:199)
>         - locked <0x00000000a9b0c148> (a java.net.SocksSocketImpl)
>         at java.net.ServerSocket.implAccept(ServerSocket.java:545)
>         at java.net.ServerSocket.accept(ServerSocket.java:513)
>         at
> sun.management.jmxremote.LocalRMIServerSocketFactory$1.accept(
> LocalRMIServerSocketFactory.java:52)
>         at
> sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(
> TCPTransport.java:400)
>         at
> sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:372)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "Service Thread" #12 daemon prio=9 os_prio=0 tid=0x00000000180ef000
> nid=0x3cdc runnable [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
>    Locked ownable synchronizers:
>         - None
>
> "C1 CompilerThread3" #11 daemon prio=9 os_prio=2 tid=0x00000000180ee800
> nid=0x838 waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
>    Locked ownable synchronizers:
>         - None
>
> "C2 CompilerThread2" #10 daemon prio=9 os_prio=2 tid=0x00000000180ea000
> nid=0x3728 waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
>    Locked ownable synchronizers:
>         - None
>
> "C2 CompilerThread1" #9 daemon prio=9 os_prio=2 tid=0x00000000195bf000
> nid=0x3950 waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
>    Locked ownable synchronizers:
>         - None
>
> "C2 CompilerThread0" #8 daemon prio=9 os_prio=2 tid=0x0000000019698800
> nid=0x1bc4 waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
>    Locked ownable synchronizers:
>         - None
>
> "Attach Listener" #6 daemon prio=5 os_prio=2 tid=0x0000000017ff4000
> nid=0x3e5c waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
>    Locked ownable synchronizers:
>         - None
>
> "Signal Dispatcher" #5 daemon prio=9 os_prio=2 tid=0x0000000017feb000
> nid=0x1c44 runnable [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
>    Locked ownable synchronizers:
>         - None
>
> "Surrogate Locker Thread (Concurrent GC)" #4 daemon prio=9 os_prio=0
> tid=0x0000000017fe9800 nid=0x1cd4 waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
>    Locked ownable synchronizers:
>         - None
>
> "Finalizer" #3 daemon prio=8 os_prio=1 tid=0x0000000017fc8800 nid=0x2264 in
> Object.wait() [0x0000000018c1f000]
>    java.lang.Thread.State: WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
>         - locked <0x00000000a9997fc8> (a java.lang.ref.ReferenceQueue$
> Lock)
>         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
>         at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)
>
>    Locked ownable synchronizers:
>         - None
>
> "Reference Handler" #2 daemon prio=10 os_prio=2 tid=0x0000000017f81000
> nid=0x3fb4 in Object.wait() [0x00000000189ff000]
>    java.lang.Thread.State: WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.lang.Object.wait(Object.java:502)
>         at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
>         - locked <0x00000000a9996568> (a java.lang.ref.Reference$Lock)
>         at java.lang.ref.Reference$ReferenceHandler.run(
> Reference.java:153)
>
>    Locked ownable synchronizers:
>         - None
>
> "main" #1 prio=5 os_prio=0 tid=0x000000000226c800 nid=0x2094 waiting on
> condition [0x00000000026ae000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000aa23c608> (a
> java.util.concurrent.FutureTask)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at java.util.concurrent.FutureTask.awaitDone(FutureTask.java:429)
>         at java.util.concurrent.FutureTask.get(FutureTask.java:191)
>         at
> org.apache.catalina.core.ContainerBase.startInternal(
> ContainerBase.java:1120)
>         - locked <0x00000000a9fe3720> (a
> org.apache.catalina.core.StandardEngine)
>         at
> org.apache.catalina.core.StandardEngine.startInternal(
> StandardEngine.java:300)
>         - locked <0x00000000a9fe3720> (a
> org.apache.catalina.core.StandardEngine)
>         at
> org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:147)
>         - locked <0x00000000a9fe3720> (a
> org.apache.catalina.core.StandardEngine)
>         at
> org.apache.catalina.core.StandardService.startInternal(
> StandardService.java:444)
>         - locked <0x00000000a9fe3720> (a
> org.apache.catalina.core.StandardEngine)
>         at
> org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:147)
>         - locked <0x00000000a9f2f330> (a
> org.apache.catalina.core.StandardService)
>         at
> org.apache.catalina.core.StandardServer.startInternal(
> StandardServer.java:738)
>         - locked <0x00000000a9e043d0> (a java.lang.Object)
>         at
> org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:147)
>         - locked <0x00000000a9e026a0> (a
> org.apache.catalina.core.StandardServer)
>         at org.apache.catalina.startup.Catalina.start(Catalina.java:693)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
> 62)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:498)
>         at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:294)
>         at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:428)
>
>    Locked ownable synchronizers:
>         - None
>
> "VM Thread" os_prio=2 tid=0x0000000017f75800 nid=0x2e04 runnable
>
> "Gang worker#0 (Parallel GC Threads)" os_prio=2 tid=0x000000000227d800
> nid=0x2b00 runnable
>
> "Gang worker#1 (Parallel GC Threads)" os_prio=2 tid=0x000000000227e000
> nid=0x39d0 runnable
>
> "Gang worker#2 (Parallel GC Threads)" os_prio=2 tid=0x0000000002280000
> nid=0x2c08 runnable
>
> "Gang worker#3 (Parallel GC Threads)" os_prio=2 tid=0x0000000002282800
> nid=0x1e8 runnable
>
> "Gang worker#4 (Parallel GC Threads)" os_prio=2 tid=0x0000000002285800
> nid=0x3a5c runnable
>
> "Gang worker#5 (Parallel GC Threads)" os_prio=2 tid=0x0000000002287000
> nid=0x37c4 runnable
>
> "Gang worker#6 (Parallel GC Threads)" os_prio=2 tid=0x0000000002288000
> nid=0x15f8 runnable
>
> "Gang worker#7 (Parallel GC Threads)" os_prio=2 tid=0x0000000002289000
> nid=0x1b84 runnable
>
> "Concurrent Mark-Sweep GC Thread" os_prio=2 tid=0x00000000022fe000
> nid=0x3d20 runnable
>
> "Gang worker#0 (Parallel CMS Threads)" os_prio=2 tid=0x00000000022f7000
> nid=0x2cf8 runnable
>
> "Gang worker#1 (Parallel CMS Threads)" os_prio=2 tid=0x00000000022fa800
> nid=0x3afc runnable
>
> "VM Periodic Task Thread" os_prio=2 tid=0x00000000199b6800 nid=0x3138
> waiting on condition
>
> JNI global references: 447
>
>
>
>
>
>
>
>
>
> thred dump for worked node :
>
>
> 2018-07-26 13:52:22
> Full thread dump Java HotSpot(TM) 64-Bit Server VM (25.152-b16 mixed mode):
>
> "sys-#99" #324 daemon prio=5 os_prio=0 tid=0x0000000020e32000 nid=0x23f4
> waiting on condition [0x000000004e1fe000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ab5672e8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.LinkedBlockingQueue.poll(
> LinkedBlockingQueue.java:467)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1073)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "sys-#98" #323 daemon prio=5 os_prio=0 tid=0x000000001d521800 nid=0x2c20
> waiting on condition [0x000000002731e000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ab5672e8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.LinkedBlockingQueue.poll(
> LinkedBlockingQueue.java:467)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1073)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "sys-#97" #321 daemon prio=5 os_prio=0 tid=0x0000000020e38000 nid=0x3b10
> waiting on condition [0x000000004dc0e000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ab5672e8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.LinkedBlockingQueue.poll(
> LinkedBlockingQueue.java:467)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1073)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "sys-#96" #320 daemon prio=5 os_prio=0 tid=0x000000001d086800 nid=0x35f8
> waiting on condition [0x000000001ca6e000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ab5672e8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.LinkedBlockingQueue.poll(
> LinkedBlockingQueue.java:467)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1073)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "sys-#95" #319 daemon prio=5 os_prio=0 tid=0x0000000020e36800 nid=0x33b4
> waiting on condition [0x000000001c07f000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ab5672e8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.LinkedBlockingQueue.poll(
> LinkedBlockingQueue.java:467)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1073)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "sys-#94" #318 daemon prio=5 os_prio=0 tid=0x0000000020e37800 nid=0x26d0
> waiting on condition [0x000000001c57e000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ab5672e8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.LinkedBlockingQueue.poll(
> LinkedBlockingQueue.java:467)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1073)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "RMI TCP Connection(6)-172.21.98.254" #294 daemon prio=5 os_prio=0
> tid=0x000000001d087800 nid=0x2e8c in Object.wait() [0x000000004fa3c000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at
> com.sun.jmx.remote.internal.ArrayNotificationBuffer.fetchNotifications(
> ArrayNotificationBuffer.java:449)
>         - locked <0x00000000a578bfa8> (a
> com.sun.jmx.remote.internal.ArrayNotificationBuffer)
>         at
> com.sun.jmx.remote.internal.ArrayNotificationBuffer$ShareBuffer.
> fetchNotifications(ArrayNotificationBuffer.java:227)
>         at
> com.sun.jmx.remote.internal.ServerNotifForwarder.fetchNotifs(
> ServerNotifForwarder.java:274)
>         at
> javax.management.remote.rmi.RMIConnectionImpl$4.run(
> RMIConnectionImpl.java:1270)
>         at
> javax.management.remote.rmi.RMIConnectionImpl$4.run(
> RMIConnectionImpl.java:1268)
>         at
> javax.management.remote.rmi.RMIConnectionImpl.fetchNotifications(
> RMIConnectionImpl.java:1274)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
> 62)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:498)
>         at
> sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:357)
>         at sun.rmi.transport.Transport$1.run(Transport.java:200)
>         at sun.rmi.transport.Transport$1.run(Transport.java:197)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at sun.rmi.transport.Transport.serviceCall(Transport.java:196)
>         at
> sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:568)
>         at
> sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(
> TCPTransport.java:826)
>         at
> sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$
> 0(TCPTransport.java:683)
>         at
> sun.rmi.transport.tcp.TCPTransport$ConnectionHandler$$Lambda$6/
> 918386799.run(Unknown
> Source)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at
> sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(
> TCPTransport.java:682)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - <0x00000000a578c460> (a
> java.util.concurrent.ThreadPoolExecutor$Worker)
>
> "RMI TCP Connection(7)-172.21.98.254" #292 daemon prio=5 os_prio=0
> tid=0x000000001d085000 nid=0x1308 runnable [0x0000000112fae000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.SocketInputStream.socketRead0(Native Method)
>         at java.net.SocketInputStream.socketRead(SocketInputStream.
> java:116)
>         at java.net.SocketInputStream.read(SocketInputStream.java:171)
>         at java.net.SocketInputStream.read(SocketInputStream.java:141)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
>         - locked <0x00000000a5750430> (a java.io.BufferedInputStream)
>         at java.io.FilterInputStream.read(FilterInputStream.java:83)
>         at
> sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:550)
>         at
> sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(
> TCPTransport.java:826)
>         at
> sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$
> 0(TCPTransport.java:683)
>         at
> sun.rmi.transport.tcp.TCPTransport$ConnectionHandler$$Lambda$6/
> 918386799.run(Unknown
> Source)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at
> sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(
> TCPTransport.java:682)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - <0x00000000a57505f0> (a
> java.util.concurrent.ThreadPoolExecutor$Worker)
>
> "JMX server connection timeout 291" #291 daemon prio=5 os_prio=0
> tid=0x000000001d084800 nid=0x3c3c in Object.wait() [0x0000000111b6f000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at
> com.sun.jmx.remote.internal.ServerCommunicatorAdmin$Timeout.run(
> ServerCommunicatorAdmin.java:168)
>         - locked <0x00000000a57cbd30> (a [I)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "http-bio-18080-exec-4" #285 daemon prio=5 os_prio=0 tid=0x000000001d083000
> nid=0x2d98 waiting on condition [0x000000002773e000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000afdbbbf8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at org.apache.tomcat.util.threads.TaskQueue.take(
> TaskQueue.java:104)
>         at org.apache.tomcat.util.threads.TaskQueue.take(
> TaskQueue.java:32)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(
> TaskThread.java:61)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "http-bio-18080-exec-3" #277 daemon prio=5 os_prio=0 tid=0x000000001d082000
> nid=0x1dcc waiting on condition [0x00000000359fe000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000afdbbbf8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at org.apache.tomcat.util.threads.TaskQueue.take(
> TaskQueue.java:104)
>         at org.apache.tomcat.util.threads.TaskQueue.take(
> TaskQueue.java:32)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(
> TaskThread.java:61)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "http-bio-18080-exec-2" #276 daemon prio=5 os_prio=0 tid=0x0000000020e34800
> nid=0x31c8 waiting on condition [0x000000002720e000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000afdbbbf8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at org.apache.tomcat.util.threads.TaskQueue.take(
> TaskQueue.java:104)
>         at org.apache.tomcat.util.threads.TaskQueue.take(
> TaskQueue.java:32)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(
> TaskThread.java:61)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "http-bio-18080-exec-1" #275 daemon prio=5 os_prio=0 tid=0x0000000020e35000
> nid=0xa68 waiting on condition [0x00000000274ce000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000afdbbbf8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at org.apache.tomcat.util.threads.TaskQueue.take(
> TaskQueue.java:104)
>         at org.apache.tomcat.util.threads.TaskQueue.take(
> TaskQueue.java:32)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at
> org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(
> TaskThread.java:61)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "tcp-disco-sock-reader-#6" #270 daemon prio=10 os_prio=2
> tid=0x000000001d522800 nid=0x2ee4 runnable [0x0000000026fce000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.SocketInputStream.socketRead0(Native Method)
>         at java.net.SocketInputStream.socketRead(SocketInputStream.
> java:116)
>         at java.net.SocketInputStream.read(SocketInputStream.java:171)
>         at java.net.SocketInputStream.read(SocketInputStream.java:141)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
>         at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
>         - locked <0x00000000af465708> (a java.io.BufferedInputStream)
>         at
> org.apache.ignite.marshaller.jdk.JdkMarshallerInputStreamWrapper.read(
> JdkMarshallerInputStreamWrapper.java:53)
>         at
> java.io.ObjectInputStream$PeekInputStream.read(
> ObjectInputStream.java:2657)
>         at
> java.io.ObjectInputStream$PeekInputStream.readFully(
> ObjectInputStream.java:2673)
>         at
> java.io.ObjectInputStream$BlockDataInputStream.
> readShort(ObjectInputStream.java:3150)
>         at
> java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:859)
>         at java.io.ObjectInputStream.<init>(ObjectInputStream.java:355)
>         at
> org.apache.ignite.marshaller.jdk.JdkMarshallerObjectInputStream.<init>(
> JdkMarshallerObjectInputStream.java:43)
>         at
> org.apache.ignite.marshaller.jdk.JdkMarshaller.unmarshal0(
> JdkMarshaller.java:137)
>         at
> org.apache.ignite.marshaller.AbstractNodeNameAwareMarshaller.unmarshal(
> AbstractNodeNameAwareMarshaller.java:94)
>         at
> org.apache.ignite.internal.util.IgniteUtils.unmarshal(
> IgniteUtils.java:9907)
>         at
> org.apache.ignite.spi.discovery.tcp.ServerImpl$
> SocketReader.body(ServerImpl.java:5981)
>         at
> org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)
>
>    Locked ownable synchronizers:
>         - None
>
> "logback-2" #266 daemon prio=5 os_prio=0 tid=0x000000001d07d000 nid=0x3300
> waiting on condition [0x00000001125af000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ae0d8870> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1088)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "ajp-bio-18009-AsyncTimeout" #264 daemon prio=5 os_prio=0
> tid=0x000000001d07c000 nid=0x25b8 waiting on condition [0x00000001123af000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at
> org.apache.tomcat.util.net.JIoEndpoint$AsyncTimeout.run(
> JIoEndpoint.java:152)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "ajp-bio-18009-Acceptor-0" #263 daemon prio=5 os_prio=0
> tid=0x0000000021a07800 nid=0x2310 runnable [0x0000000111fde000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.DualStackPlainSocketImpl.accept0(Native Method)
>         at
> java.net.DualStackPlainSocketImpl.socketAccept(
> DualStackPlainSocketImpl.java:131)
>         at
> java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
>         at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:199)
>         - locked <0x00000000aa1b4440> (a java.net.SocksSocketImpl)
>         at java.net.ServerSocket.implAccept(ServerSocket.java:545)
>         at java.net.ServerSocket.accept(ServerSocket.java:513)
>         at
> org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(
> DefaultServerSocketFactory.java:60)
>         at
> org.apache.tomcat.util.net.JIoEndpoint$Acceptor.run(JIoEndpoint.java:222)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "http-bio-18080-AsyncTimeout" #262 daemon prio=5 os_prio=0
> tid=0x0000000021a06800 nid=0x2a98 waiting on condition [0x000000011216f000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at
> org.apache.tomcat.util.net.JIoEndpoint$AsyncTimeout.run(
> JIoEndpoint.java:152)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "http-bio-18080-Acceptor-0" #261 daemon prio=5 os_prio=0
> tid=0x0000000021a06000 nid=0x2458 runnable [0x0000000111a6e000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.DualStackPlainSocketImpl.accept0(Native Method)
>         at
> java.net.DualStackPlainSocketImpl.socketAccept(
> DualStackPlainSocketImpl.java:131)
>         at
> java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
>         at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:199)
>         - locked <0x00000000aa1afe90> (a java.net.SocksSocketImpl)
>         at java.net.ServerSocket.implAccept(ServerSocket.java:545)
>         at java.net.ServerSocket.accept(ServerSocket.java:513)
>         at
> org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(
> DefaultServerSocketFactory.java:60)
>         at
> org.apache.tomcat.util.net.JIoEndpoint$Acceptor.run(JIoEndpoint.java:222)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "ContainerBackgroundProcessor[StandardEngine[Catalina]]" #260 daemon
> prio=5
> os_prio=0 tid=0x0000000021a05000 nid=0xf14 waiting on condition
> [0x000000004f4ce000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at
> org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.
> run(ContainerBase.java:1510)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "javamelody manager" #259 daemon prio=5 os_prio=0 tid=0x0000000021a04800
> nid=0x558 in Object.wait() [0x0000000111e9f000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.util.TimerThread.mainLoop(Timer.java:552)
>         - locked <0x00000000afcecae0> (a java.util.TaskQueue)
>         at java.util.TimerThread.run(Timer.java:505)
>
>    Locked ownable synchronizers:
>         - None
>
> "javamelody host-manager" #258 daemon prio=5 os_prio=0
> tid=0x00000000213aa000 nid=0x2260 in Object.wait() [0x000000004eace000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.util.TimerThread.mainLoop(Timer.java:552)
>         - locked <0x00000000afcd3978> (a java.util.TaskQueue)
>         at java.util.TimerThread.run(Timer.java:505)
>
>    Locked ownable synchronizers:
>         - None
>
> "javamelody examples" #257 daemon prio=5 os_prio=0 tid=0x000000001b2be000
> nid=0x2f0c in Object.wait() [0x000000011196f000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.util.TimerThread.mainLoop(Timer.java:552)
>         - locked <0x00000000af6f4df0> (a java.util.TaskQueue)
>         at java.util.TimerThread.run(Timer.java:505)
>
>    Locked ownable synchronizers:
>         - None
>
> "javamelody docs" #256 daemon prio=5 os_prio=0 tid=0x000000001d521000
> nid=0x3cb0 in Object.wait() [0x000000011185f000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.util.TimerThread.mainLoop(Timer.java:552)
>         - locked <0x00000000afb7ef00> (a java.util.TaskQueue)
>         at java.util.TimerThread.run(Timer.java:505)
>
>    Locked ownable synchronizers:
>         - None
>
> "javamelody b2b-datamart-loader-8.6.0" #250 daemon prio=5 os_prio=0
> tid=0x000000001b2bc000 nid=0x3a54 in Object.wait() [0x0000000076bee000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.util.TimerThread.mainLoop(Timer.java:552)
>         - locked <0x00000000acd3fa08> (a java.util.TaskQueue)
>         at java.util.TimerThread.run(Timer.java:505)
>
>    Locked ownable synchronizers:
>         - None
>
> "pool-41-thread-1" #249 prio=5 os_prio=0 tid=0x000000001b2bb000 nid=0x1f24
> waiting on condition [0x00000001107af000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000acd5c448> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "pool-39-thread-3" #248 prio=5 os_prio=0 tid=0x000000001b2ba800 nid=0x21a0
> waiting on condition [0x000000011043f000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000acd3abd8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "metrics.messages.payments_doc_add.pool-22" #247 prio=5 os_prio=0
> tid=0x000000001b2b9800 nid=0x38e8 waiting on condition [0x00000001102bf000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac7ca0c0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1081)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "elastic-evictor-21" #246 daemon prio=5 os_prio=0 tid=0x000000001b2b9000
> nid=0x25ec waiting on condition [0x000000011017f000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac7cd330> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "pool-39-thread-2" #245 prio=5 os_prio=0 tid=0x000000001b2b8000 nid=0x1de0
> waiting on condition [0x0000000076aee000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000acd3fa38> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "AMQP Connection 172.30.176.163:5672" #244 prio=5 os_prio=0
> tid=0x000000001de49800 nid=0x32d8 runnable [0x000000007699e000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.SocketInputStream.socketRead0(Native Method)
>         at java.net.SocketInputStream.socketRead(SocketInputStream.
> java:116)
>         at java.net.SocketInputStream.read(SocketInputStream.java:171)
>         at java.net.SocketInputStream.read(SocketInputStream.java:141)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
>         - locked <0x00000000ac75b290> (a java.io.BufferedInputStream)
>         at
> java.io.DataInputStream.readUnsignedByte(DataInputStream.java:288)
>         at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:91)
>         at
> com.rabbitmq.client.impl.SocketFrameHandler.readFrame(
> SocketFrameHandler.java:164)
>         - locked <0x00000000ac700580> (a java.io.DataInputStream)
>         at
> com.rabbitmq.client.impl.AMQConnection$MainLoop.run(
> AMQConnection.java:571)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "pool-37-thread-3" #243 prio=5 os_prio=0 tid=0x000000001de49000 nid=0x180c
> waiting on condition [0x000000007679f000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac78a248> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "metrics.messages.adjustment_rollback.pool-20" #242 prio=5 os_prio=0
> tid=0x000000001de48000 nid=0x3b58 waiting on condition [0x000000007659e000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000acd3fa68> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1081)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "elastic-evictor-19" #241 daemon prio=5 os_prio=0 tid=0x000000001de47800
> nid=0x364 waiting on condition [0x000000007631f000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000acd3fa98> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "pool-37-thread-2" #240 prio=5 os_prio=0 tid=0x000000001de46800 nid=0x3794
> waiting on condition [0x000000004e04f000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac78a290> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "AMQP Connection 172.30.176.163:5672" #239 prio=5 os_prio=0
> tid=0x000000001de46000 nid=0x17f0 runnable [0x000000007648e000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.SocketInputStream.socketRead0(Native Method)
>         at java.net.SocketInputStream.socketRead(SocketInputStream.
> java:116)
>         at java.net.SocketInputStream.read(SocketInputStream.java:171)
>         at java.net.SocketInputStream.read(SocketInputStream.java:141)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
>         - locked <0x00000000acd35400> (a java.io.BufferedInputStream)
>         at
> java.io.DataInputStream.readUnsignedByte(DataInputStream.java:288)
>         at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:91)
>         at
> com.rabbitmq.client.impl.SocketFrameHandler.readFrame(
> SocketFrameHandler.java:164)
>         - locked <0x00000000ac76bc40> (a java.io.DataInputStream)
>         at
> com.rabbitmq.client.impl.AMQConnection$MainLoop.run(
> AMQConnection.java:571)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "pool-35-thread-3" #238 prio=5 os_prio=0 tid=0x000000001de45000 nid=0x384c
> waiting on condition [0x000000007225e000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac78a2c0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "metrics.messages.adjustment_add.pool-18" #237 prio=5 os_prio=0
> tid=0x000000001de44800 nid=0x910 waiting on condition [0x0000000071e0e000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac78a308> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1081)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "elastic-evictor-17" #236 daemon prio=5 os_prio=0 tid=0x000000001de43800
> nid=0x31c4 waiting on condition [0x0000000071cde000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000acd3fae0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "pool-35-thread-2" #235 prio=5 os_prio=0 tid=0x000000001de43000 nid=0x4ac
> waiting on condition [0x0000000071b2e000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac78a338> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "AMQP Connection 172.30.176.163:5672" #234 prio=5 os_prio=0
> tid=0x000000001f057000 nid=0x1770 runnable [0x000000007186f000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.SocketInputStream.socketRead0(Native Method)
>         at java.net.SocketInputStream.socketRead(SocketInputStream.
> java:116)
>         at java.net.SocketInputStream.read(SocketInputStream.java:171)
>         at java.net.SocketInputStream.read(SocketInputStream.java:141)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
>         - locked <0x00000000acd35450> (a java.io.BufferedInputStream)
>         at
> java.io.DataInputStream.readUnsignedByte(DataInputStream.java:288)
>         at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:91)
>         at
> com.rabbitmq.client.impl.SocketFrameHandler.readFrame(
> SocketFrameHandler.java:164)
>         - locked <0x00000000ac76bcc0> (a java.io.DataInputStream)
>         at
> com.rabbitmq.client.impl.AMQConnection$MainLoop.run(
> AMQConnection.java:571)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "pool-33-thread-3" #233 prio=5 os_prio=0 tid=0x000000001f056000 nid=0x1f20
> waiting on condition [0x00000000719de000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac78a368> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "metrics.messages.receipt_annul.pool-16" #232 prio=5 os_prio=0
> tid=0x000000001f055800 nid=0x13d8 waiting on condition [0x0000000070ffe000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac5c7338> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1081)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "elastic-evictor-15" #231 daemon prio=5 os_prio=0 tid=0x000000001f054800
> nid=0x3af8 waiting on condition [0x000000007176f000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac78a3b0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "pool-33-thread-2" #230 prio=5 os_prio=0 tid=0x000000001f054000 nid=0x31d0
> waiting on condition [0x00000000715ce000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000acd3fb28> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "AMQP Connection 172.30.176.163:5672" #229 prio=5 os_prio=0
> tid=0x000000001f053000 nid=0x107c runnable [0x000000007141f000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.SocketInputStream.socketRead0(Native Method)
>         at java.net.SocketInputStream.socketRead(SocketInputStream.
> java:116)
>         at java.net.SocketInputStream.read(SocketInputStream.java:171)
>         at java.net.SocketInputStream.read(SocketInputStream.java:141)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
>         - locked <0x00000000ac72c978> (a java.io.BufferedInputStream)
>         at
> java.io.DataInputStream.readUnsignedByte(DataInputStream.java:288)
>         at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:91)
>         at
> com.rabbitmq.client.impl.SocketFrameHandler.readFrame(
> SocketFrameHandler.java:164)
>         - locked <0x00000000acd6c1b8> (a java.io.DataInputStream)
>         at
> com.rabbitmq.client.impl.AMQConnection$MainLoop.run(
> AMQConnection.java:571)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "pool-31-thread-3" #228 prio=5 os_prio=0 tid=0x000000001f052800 nid=0x1af4
> waiting on condition [0x000000007131e000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000acd3fb58> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "metrics.messages.receipt_add.pool-14" #227 prio=5 os_prio=0
> tid=0x000000001f051800 nid=0x2e2c waiting on condition [0x000000004fe5e000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac5c72d8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1081)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "elastic-evictor-13" #226 daemon prio=5 os_prio=0 tid=0x000000001f051000
> nid=0x3fa8 waiting on condition [0x000000007112f000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000acd3fba0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "pool-31-thread-2" #225 prio=5 os_prio=0 tid=0x000000001f050000 nid=0x15a8
> waiting on condition [0x0000000070eef000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac5c7308> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "AMQP Connection 172.30.176.163:5672" #224 prio=5 os_prio=0
> tid=0x0000000020018800 nid=0x3cd4 runnable [0x0000000070dae000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.SocketInputStream.socketRead0(Native Method)
>         at java.net.SocketInputStream.socketRead(SocketInputStream.
> java:116)
>         at java.net.SocketInputStream.read(SocketInputStream.java:171)
>         at java.net.SocketInputStream.read(SocketInputStream.java:141)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
>         - locked <0x00000000ac75b1f0> (a java.io.BufferedInputStream)
>         at
> java.io.DataInputStream.readUnsignedByte(DataInputStream.java:288)
>         at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:91)
>         at
> com.rabbitmq.client.impl.SocketFrameHandler.readFrame(
> SocketFrameHandler.java:164)
>         - locked <0x00000000ac7004e0> (a java.io.DataInputStream)
>         at
> com.rabbitmq.client.impl.AMQConnection$MainLoop.run(
> AMQConnection.java:571)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "pool-29-thread-3" #223 prio=5 os_prio=0 tid=0x0000000020018000 nid=0x30dc
> waiting on condition [0x000000007051f000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000acd3fbd0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "metrics.messages.subscriber_change_owner.pool-12" #222 prio=5 os_prio=0
> tid=0x0000000020017000 nid=0x39ec waiting on condition [0x0000000070bee000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac5c72c0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1081)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "elastic-evictor-11" #221 daemon prio=5 os_prio=0 tid=0x0000000020016800
> nid=0x1c78 waiting on condition [0x0000000070a7e000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac78a3f8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "pool-29-thread-2" #220 prio=5 os_prio=0 tid=0x0000000020015800 nid=0x1c58
> waiting on condition [0x00000000708ee000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac5c7260> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "AMQP Connection 172.30.176.163:5672" #219 prio=5 os_prio=0
> tid=0x0000000020015000 nid=0x39dc runnable [0x000000007076f000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.SocketInputStream.socketRead0(Native Method)
>         at java.net.SocketInputStream.socketRead(SocketInputStream.
> java:116)
>         at java.net.SocketInputStream.read(SocketInputStream.java:171)
>         at java.net.SocketInputStream.read(SocketInputStream.java:141)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
>         - locked <0x00000000acd35838> (a java.io.BufferedInputStream)
>         at
> java.io.DataInputStream.readUnsignedByte(DataInputStream.java:288)
>         at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:91)
>         at
> com.rabbitmq.client.impl.SocketFrameHandler.readFrame(
> SocketFrameHandler.java:164)
>         - locked <0x00000000aafd3e80> (a java.io.DataInputStream)
>         at
> com.rabbitmq.client.impl.AMQConnection$MainLoop.run(
> AMQConnection.java:571)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "pool-27-thread-3" #218 prio=5 os_prio=0 tid=0x0000000020014000 nid=0x3418
> waiting on condition [0x000000007064f000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac5c7200> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "metrics.messages.phone_number_change.pool-10" #217 prio=5 os_prio=0
> tid=0x0000000020013800 nid=0x2590 waiting on condition [0x00000000703ef000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac78a428> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1081)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "elastic-evictor-9" #216 daemon prio=5 os_prio=0 tid=0x0000000020012800
> nid=0x3f88 waiting on condition [0x000000007025f000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac5c71b8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "pool-27-thread-2" #215 prio=5 os_prio=0 tid=0x0000000020012000 nid=0x13dc
> waiting on condition [0x000000006fccf000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac78a458> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "AMQP Connection 172.30.176.163:5672" #214 prio=5 os_prio=0
> tid=0x000000001fc8b000 nid=0x352c runnable [0x000000007008e000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.SocketInputStream.socketRead0(Native Method)
>         at java.net.SocketInputStream.socketRead(SocketInputStream.
> java:116)
>         at java.net.SocketInputStream.read(SocketInputStream.java:171)
>         at java.net.SocketInputStream.read(SocketInputStream.java:141)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
>         - locked <0x00000000ac75b240> (a java.io.BufferedInputStream)
>         at
> java.io.DataInputStream.readUnsignedByte(DataInputStream.java:288)
>         at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:91)
>         at
> com.rabbitmq.client.impl.SocketFrameHandler.readFrame(
> SocketFrameHandler.java:164)
>         - locked <0x00000000ac7003e0> (a java.io.DataInputStream)
>         at
> com.rabbitmq.client.impl.AMQConnection$MainLoop.run(
> AMQConnection.java:571)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "pool-25-thread-3" #213 prio=5 os_prio=0 tid=0x000000001fc8a800 nid=0x1a5c
> waiting on condition [0x000000006ff1f000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac5c7170> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "metrics.messages.payments_rollback.pool-8" #212 prio=5 os_prio=0
> tid=0x000000001fc89800 nid=0x363c waiting on condition [0x000000006fddf000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac7cd360> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1081)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "elastic-evictor-7" #211 daemon prio=5 os_prio=0 tid=0x000000001fc89000
> nid=0x1f44 waiting on condition [0x000000006fb4e000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac5c7050> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "pool-25-thread-2" #210 prio=5 os_prio=0 tid=0x000000001fc88000 nid=0x1660
> waiting on condition [0x000000004f34e000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac7cd390> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "AMQP Connection 172.30.176.163:5672" #209 prio=5 os_prio=0
> tid=0x000000001fc87800 nid=0x33e0 runnable [0x000000004de4f000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.SocketInputStream.socketRead0(Native Method)
>         at java.net.SocketInputStream.socketRead(SocketInputStream.
> java:116)
>         at java.net.SocketInputStream.read(SocketInputStream.java:171)
>         at java.net.SocketInputStream.read(SocketInputStream.java:141)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
>         - locked <0x00000000aaf29040> (a java.io.BufferedInputStream)
>         at
> java.io.DataInputStream.readUnsignedByte(DataInputStream.java:288)
>         at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:91)
>         at
> com.rabbitmq.client.impl.SocketFrameHandler.readFrame(
> SocketFrameHandler.java:164)
>         - locked <0x00000000ac7bc730> (a java.io.DataInputStream)
>         at
> com.rabbitmq.client.impl.AMQConnection$MainLoop.run(
> AMQConnection.java:571)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "pool-22-thread-3" #208 prio=5 os_prio=0 tid=0x000000001fc86800 nid=0x2bf8
> waiting on condition [0x000000006f9cf000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac78a5d8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "metrics.messages.payments.ps-bisrt_addon-payment-1.pool-6" #207 prio=5
> os_prio=0 tid=0x000000001fc86000 nid=0x3658 waiting on condition
> [0x000000006f84f000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac7cd3c0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1081)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "elastic-evictor-5" #206 daemon prio=5 os_prio=0 tid=0x000000001fc85000
> nid=0x3880 waiting on condition [0x000000006f6df000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac7cd2a0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "pool-22-thread-2" #205 prio=5 os_prio=0 tid=0x000000001fc84800 nid=0x1b7c
> waiting on condition [0x000000006f58f000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac7cd2d0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "AMQP Connection 172.30.176.163:5672" #204 prio=5 os_prio=0
> tid=0x0000000020e83000 nid=0x1610 runnable [0x000000006f3ae000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.SocketInputStream.socketRead0(Native Method)
>         at java.net.SocketInputStream.socketRead(SocketInputStream.
> java:116)
>         at java.net.SocketInputStream.read(SocketInputStream.java:171)
>         at java.net.SocketInputStream.read(SocketInputStream.java:141)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
>         - locked <0x00000000aaa49e18> (a java.io.BufferedInputStream)
>         at
> java.io.DataInputStream.readUnsignedByte(DataInputStream.java:288)
>         at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:91)
>         at
> com.rabbitmq.client.impl.SocketFrameHandler.readFrame(
> SocketFrameHandler.java:164)
>         - locked <0x00000000ac75ebb8> (a java.io.DataInputStream)
>         at
> com.rabbitmq.client.impl.AMQConnection$MainLoop.run(
> AMQConnection.java:571)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "pool-20-thread-3" #203 prio=5 os_prio=0 tid=0x0000000020e82000 nid=0x2d60
> waiting on condition [0x000000006f1ee000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000acd5c490> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "metrics.messages.subscriber_activations.pool-4" #202 prio=5 os_prio=0
> tid=0x0000000020e81800 nid=0x3704 waiting on condition [0x000000004f5ee000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000acd5c3b8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1081)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "elastic-evictor-3" #201 daemon prio=5 os_prio=0 tid=0x0000000020e80800
> nid=0x2888 waiting on condition [0x000000006f0ce000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac7cd318> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "pool-20-thread-2" #200 prio=5 os_prio=0 tid=0x0000000020e80000 nid=0x219c
> waiting on condition [0x000000006eefe000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000acd5c3e8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "AMQP Connection 172.30.176.163:5672" #199 prio=5 os_prio=0
> tid=0x00000000213a8800 nid=0x1fd4 runnable [0x000000006edef000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.SocketInputStream.socketRead0(Native Method)
>         at java.net.SocketInputStream.socketRead(SocketInputStream.
> java:116)
>         at java.net.SocketInputStream.read(SocketInputStream.java:171)
>         at java.net.SocketInputStream.read(SocketInputStream.java:141)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
>         - locked <0x00000000aaa49e68> (a java.io.BufferedInputStream)
>         at
> java.io.DataInputStream.readUnsignedByte(DataInputStream.java:288)
>         at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:91)
>         at
> com.rabbitmq.client.impl.SocketFrameHandler.readFrame(
> SocketFrameHandler.java:164)
>         - locked <0x00000000ac75eab8> (a java.io.DataInputStream)
>         at
> com.rabbitmq.client.impl.AMQConnection$MainLoop.run(
> AMQConnection.java:571)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "pool-18-thread-2" #198 prio=5 os_prio=0 tid=0x0000000020e7f000 nid=0x31d4
> waiting on condition [0x000000005079f000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac78a788> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "AMQP Connection 172.30.176.163:5672" #197 prio=5 os_prio=0
> tid=0x0000000020e7e800 nid=0x245c runnable [0x000000005062f000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.SocketInputStream.socketRead0(Native Method)
>         at java.net.SocketInputStream.socketRead(SocketInputStream.
> java:116)
>         at java.net.SocketInputStream.read(SocketInputStream.java:171)
>         at java.net.SocketInputStream.read(SocketInputStream.java:141)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
>         - locked <0x00000000aaf29090> (a java.io.BufferedInputStream)
>         at
> java.io.DataInputStream.readUnsignedByte(DataInputStream.java:288)
>         at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:91)
>         at
> com.rabbitmq.client.impl.SocketFrameHandler.readFrame(
> SocketFrameHandler.java:164)
>         - locked <0x00000000ac7bc5f0> (a java.io.DataInputStream)
>         at
> com.rabbitmq.client.impl.AMQConnection$MainLoop.run(
> AMQConnection.java:571)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "pool-15-thread-3" #196 prio=5 os_prio=0 tid=0x0000000020e7d800 nid=0x33dc
> waiting on condition [0x000000005043f000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac7cd210> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "metrics.messages.chargesrpc.pool-2" #195 prio=5 os_prio=0
> tid=0x0000000020e7d000 nid=0x34dc waiting on condition [0x000000005027e000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac7cd258> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1081)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "elastic-evictor-1" #194 daemon prio=5 os_prio=0 tid=0x0000000020e7c000
> nid=0x26bc waiting on condition [0x000000005014f000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000acd5c430> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "pool-15-thread-2" #193 prio=5 os_prio=0 tid=0x000000001d526000 nid=0x37f0
> waiting on condition [0x000000004ff6e000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ac7cd168> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "AMQP Connection 172.30.176.163:5672" #192 prio=5 os_prio=0
> tid=0x000000001d525800 nid=0x67c runnable [0x000000004fd5e000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.SocketInputStream.socketRead0(Native Method)
>         at java.net.SocketInputStream.socketRead(SocketInputStream.
> java:116)
>         at java.net.SocketInputStream.read(SocketInputStream.java:171)
>         at java.net.SocketInputStream.read(SocketInputStream.java:141)
>         at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
>         at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
>         - locked <0x00000000aaf290e0> (a java.io.BufferedInputStream)
>         at
> java.io.DataInputStream.readUnsignedByte(DataInputStream.java:288)
>         at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:91)
>         at
> com.rabbitmq.client.impl.SocketFrameHandler.readFrame(
> SocketFrameHandler.java:164)
>         - locked <0x00000000ac7bc650> (a java.io.DataInputStream)
>         at
> com.rabbitmq.client.impl.AMQConnection$MainLoop.run(
> AMQConnection.java:571)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "resources.DB.b2b_datamart_1155218999 housekeeper" #156 daemon prio=5
> os_prio=0 tid=0x000000001d520000 nid=0x148c waiting on condition
> [0x000000004f93e000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ab549c60> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "resources.DB.b2b_datamart_3277181263 housekeeper" #146 daemon prio=5
> os_prio=0 tid=0x00000000213a9800 nid=0x1698 waiting on condition
> [0x000000004ebde000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ab567168> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "resources.DB.bis_4206841024 housekeeper" #138 daemon prio=5 os_prio=0
> tid=0x00000000213a8000 nid=0x4f8 waiting on condition [0x000000003552e000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ab549e28> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "Curator-Framework-0" #134 daemon prio=5 os_prio=0 tid=0x00000000213a7000
> nid=0x21fc waiting on condition [0x0000000024ade000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ab567198> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at java.util.concurrent.DelayQueue.take(DelayQueue.java:211)
>         at java.util.concurrent.DelayQueue.take(DelayQueue.java:70)
>         at
> org.apache.curator.framework.imps.CuratorFrameworkImpl.
> backgroundOperationsLoop(CuratorFrameworkImpl.java:804)
>         at
> org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(
> CuratorFrameworkImpl.java:64)
>         at
> org.apache.curator.framework.imps.CuratorFrameworkImpl$4.
> call(CuratorFrameworkImpl.java:267)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(
> ScheduledThreadPoolExecutor.java:293)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - <0x00000000ab3f2480> (a
> java.util.concurrent.ThreadPoolExecutor$Worker)
>
> "localhost-startStop-1-EventThread" #133 daemon prio=5 os_prio=0
> tid=0x00000000213a6800 nid=0x3fe0 waiting on condition [0x000000004e9be000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ab5671e0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at
> org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
>
>    Locked ownable synchronizers:
>         - None
>
> "localhost-startStop-1-SendThread(srv7-ngxeko.net.billing.ru:2181)" #132
> daemon prio=5 os_prio=0 tid=0x00000000213a5800 nid=0x1a0c runnable
> [0x000000004e5ce000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000ab567240> (a sun.nio.ch.Util$3)
>         - locked <0x00000000ab567228> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000ab526de0> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> ClientCnxnSocketNIO.java:349)
>         at
> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
>
>    Locked ownable synchronizers:
>         - None
>
> "Curator-ConnectionStateManager-0" #131 daemon prio=5 os_prio=0
> tid=0x00000000213a5000 nid=0xf70 waiting on condition [0x000000004e7ee000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ab5672a0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403)
>         at
> org.apache.curator.framework.state.ConnectionStateManager.processEvents(
> ConnectionStateManager.java:245)
>         at
> org.apache.curator.framework.state.ConnectionStateManager.access$000(
> ConnectionStateManager.java:43)
>         at
> org.apache.curator.framework.state.ConnectionStateManager$
> 1.call(ConnectionStateManager.java:111)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - <0x00000000ab3f4cc0> (a
> java.util.concurrent.ThreadPoolExecutor$Worker)
>
> "ttl-cleanup-worker-#50" #117 daemon prio=5 os_prio=0
> tid=0x0000000020e33800
> nid=0x1574 waiting on condition [0x000000004d80f000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at
> org.apache.ignite.internal.util.IgniteUtils.sleep(IgniteUtils.java:7629)
>         at
> org.apache.ignite.internal.processors.cache.GridCacheSharedTtlCleanupManag
> er$CleanupWorker.body(GridCacheSharedTtlCleanupManager.java:145)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "srvc-deploy-#49" #116 daemon prio=5 os_prio=0 tid=0x0000000020e33000
> nid=0x2bc0 waiting on condition [0x000000002a20e000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ab5a25a8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "checkpoint-runner-#47" #114 daemon prio=5 os_prio=0 tid=0x0000000020e31800
> nid=0x1bf4 waiting on condition [0x000000004d44f000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ab5a25f0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "checkpoint-runner-#46" #113 daemon prio=5 os_prio=0 tid=0x0000000020e30800
> nid=0x36c4 waiting on condition [0x000000004d28f000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ab5a25f0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "checkpoint-runner-#45" #112 daemon prio=5 os_prio=0 tid=0x0000000020e30000
> nid=0x1db0 waiting on condition [0x000000004d10e000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ab5a25f0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "checkpoint-runner-#44" #111 daemon prio=5 os_prio=0 tid=0x0000000020e2f000
> nid=0x318c waiting on condition [0x000000002aa9f000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ab5a25f0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "db-checkpoint-thread-#43" #110 daemon prio=5 os_prio=0
> tid=0x0000000020e2e800 nid=0x35ac in Object.wait() [0x0000000035daf000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at
> org.apache.ignite.internal.processors.cache.persistence.
> GridCacheDatabaseSharedManager$Checkpointer.waitCheckpointEvent(
> GridCacheDatabaseSharedManager.java:3338)
>         - locked <0x00000000ae097068> (a
> org.apache.ignite.internal.processors.cache.persistence.
> GridCacheDatabaseSharedManager$Checkpointer)
>         at
> org.apache.ignite.internal.processors.cache.persistence.
> GridCacheDatabaseSharedManager$Checkpointer.body(
> GridCacheDatabaseSharedManager.java:2933)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "wal-file-archiver%null" #108 daemon prio=5 os_prio=0
> tid=0x0000000020e2d800
> nid=0x1be4 in Object.wait() [0x000000002acae000]
>    java.lang.Thread.State: WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.lang.Object.wait(Object.java:502)
>         at
> org.apache.ignite.internal.processors.cache.persistence.
> wal.FileWriteAheadLogManager$FileArchiver.run(
> FileWriteAheadLogManager.java:1558)
>         - locked <0x00000000a9a4c938> (a
> org.apache.ignite.internal.processors.cache.persistence.
> wal.FileWriteAheadLogManager$FileArchiver)
>
>    Locked ownable synchronizers:
>         - None
>
> "session-timeout-worker-#34" #94 daemon prio=5 os_prio=0
> tid=0x0000000020e2d000 nid=0x30c8 waiting on condition [0x000000002ab9f000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at
> org.apache.ignite.internal.processors.rest.GridRestProcessor$4.body(
> GridRestProcessor.java:476)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "exchange-worker-#42" #106 daemon prio=5 os_prio=0 tid=0x0000000020e2c000
> nid=0x3594 waiting on condition [0x0000000027aaf000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ab5a2638> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.LinkedBlockingDeque.pollFirst(
> LinkedBlockingDeque.java:522)
>         at
> java.util.concurrent.LinkedBlockingDeque.poll(
> LinkedBlockingDeque.java:684)
>         at
> org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeMana
> ger$ExchangeWorker.body0(GridCachePartitionExchangeManager.java:2365)
>         at
> org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeMana
> ger$ExchangeWorker.body(GridCachePartitionExchangeManager.java:2299)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "ignite-update-notifier-timer" #105 daemon prio=5 os_prio=0
> tid=0x0000000020e2b800 nid=0x3b68 in Object.wait() [0x000000002a92f000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.util.TimerThread.mainLoop(Timer.java:552)
>         - locked <0x00000000ab5a2668> (a java.util.TaskQueue)
>         at java.util.TimerThread.run(Timer.java:505)
>
>    Locked ownable synchronizers:
>         - None
>
> "upd-ver-checker" #104 daemon prio=5 os_prio=0 tid=0x0000000020e2a800
> nid=0x290c waiting on condition [0x0000000029ebf000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at
> org.apache.ignite.internal.processors.cluster.GridUpdateNotifier$1.run(
> GridUpdateNotifier.java:115)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "disco-event-worker-#41" #103 daemon prio=5 os_prio=0
> tid=0x0000000020e2a000
> nid=0x10e0 waiting on condition [0x000000002a79e000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ab5a2d30> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at
> org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$
> DiscoveryWorker.body0(GridDiscoveryManager.java:2758)
>         at
> org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$
> DiscoveryWorker.body(GridDiscoveryManager.java:2732)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "tcp-disco-ip-finder-cleaner-#4" #102 daemon prio=10 os_prio=2
> tid=0x00000000206f0800 nid=0x3d0 waiting on condition [0x000000002a68f000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at
> org.apache.ignite.spi.discovery.tcp.ServerImpl$IpFinderCleaner.body(
> ServerImpl.java:1900)
>         at
> org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)
>
>    Locked ownable synchronizers:
>         - None
>
> "tcp-disco-srvr-#2" #77 daemon prio=10 os_prio=2 tid=0x00000000206f0000
> nid=0x20c8 runnable [0x000000002a31e000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.DualStackPlainSocketImpl.accept0(Native Method)
>         at
> java.net.DualStackPlainSocketImpl.socketAccept(
> DualStackPlainSocketImpl.java:131)
>         at
> java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
>         at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:199)
>         - locked <0x00000000aaacd640> (a java.net.SocksSocketImpl)
>         at java.net.ServerSocket.implAccept(ServerSocket.java:545)
>         at java.net.ServerSocket.accept(ServerSocket.java:513)
>         at
> org.apache.ignite.spi.discovery.tcp.ServerImpl$TcpServer.body(ServerImpl.
> java:5641)
>         at
> org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)
>
>    Locked ownable synchronizers:
>         - None
>
> "tcp-disco-msg-worker-#3" #101 daemon prio=10 os_prio=2
> tid=0x00000000206ef000 nid=0x39ac runnable [0x000000002a0ee000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ab5a2da8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.LinkedBlockingDeque.pollFirst(
> LinkedBlockingDeque.java:522)
>         at
> java.util.concurrent.LinkedBlockingDeque.poll(
> LinkedBlockingDeque.java:684)
>         at
> org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorkerAdapter.body(
> ServerImpl.java:6770)
>         at
> org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.body(
> ServerImpl.java:2621)
>         at
> org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)
>
>    Locked ownable synchronizers:
>         - None
>
> "grid-data-loader-flusher-#40" #100 daemon prio=5 os_prio=0
> tid=0x00000000206ee800 nid=0x13a0 waiting on condition [0x00000000294df000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ab5a2e38> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at java.util.concurrent.DelayQueue.take(DelayQueue.java:211)
>         at
> org.apache.ignite.internal.processors.datastreamer.
> DataStreamProcessor$2.body(DataStreamProcessor.java:109)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "grid-nio-worker-tcp-rest-3-#39" #99 prio=5 os_prio=0
> tid=0x00000000206ed800
> nid=0x26d8 runnable [0x0000000029b0e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000aa4ba250> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000000ab5f2e20> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000ab2e77c8> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.
> bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "grid-nio-worker-tcp-rest-2-#38" #98 prio=5 os_prio=0
> tid=0x00000000206ed000
> nid=0x2a08 runnable [0x0000000029fbe000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000ab6b54d0> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000000ab5a3390> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000ad945838> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.
> bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "grid-nio-worker-tcp-rest-1-#37" #97 prio=5 os_prio=0
> tid=0x00000000206ec000
> nid=0x2fc4 runnable [0x0000000029d8e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000aa4ba3b0> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000000ab5f43f8> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000ab2f8d38> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.
> bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "grid-nio-worker-tcp-rest-0-#36" #96 prio=5 os_prio=0
> tid=0x00000000206eb800
> nid=0x3fc4 runnable [0x0000000029c2e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000aa4ba4f0> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000000ab5f53a0> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000ab2f8db8> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.
> bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "nio-acceptor-#35" #95 daemon prio=5 os_prio=0 tid=0x00000000206ea800
> nid=0xd24 runnable [0x000000002999f000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000ab5f71c8> (a sun.nio.ch.Util$3)
>         - locked <0x00000000ab5f71b0> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000ab2f8e38> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> GridNioAcceptWorker.accept(GridNioServer.java:2870)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> GridNioAcceptWorker.body(GridNioServer.java:2822)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "cron4j::scheduler[9143bc22115d37ab01b8a97d000001
> 64d631fe61675fc033]::timer[9143bc22115d37ab01b8a97d000001
> 64d631fe6307e35966]"
> #93 prio=5 os_prio=0 tid=0x00000000206ea000 nid=0x3dc4 waiting on condition
> [0x00000000297df000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at it.sauronsoftware.cron4j.TimerThread.safeSleep(Unknown Source)
>         at it.sauronsoftware.cron4j.TimerThread.run(Unknown Source)
>
>    Locked ownable synchronizers:
>         - None
>
> "grid-nio-worker-client-listener-3-#33" #92 prio=5 os_prio=0
> tid=0x00000000206e9000 nid=0x364c runnable [0x000000002962e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000ab2afae8> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000000ab646950> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000ab5e1840> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.
> bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "grid-nio-worker-client-listener-2-#32" #91 prio=5 os_prio=0
> tid=0x00000000206e8800 nid=0x3a84 runnable [0x00000000293de000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000aa4ba970> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000000ab5f8298> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000ab2f8eb8> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.
> bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "grid-nio-worker-client-listener-1-#31" #90 prio=5 os_prio=0
> tid=0x00000000206e7800 nid=0x3b7c runnable [0x000000002920e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000ab2afb28> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000000ab646968> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000ab5e18c0> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.
> bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "grid-nio-worker-client-listener-0-#30" #89 prio=5 os_prio=0
> tid=0x00000000206e7000 nid=0xc0c runnable [0x000000002834e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000aa4bacb0> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000000ab646980> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000ab2f8f38> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.
> bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "nio-acceptor-#29" #88 daemon prio=5 os_prio=0 tid=0x00000000206e6000
> nid=0x132c runnable [0x000000002909e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000ab5fd470> (a sun.nio.ch.Util$3)
>         - locked <0x00000000ab5fd458> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000ab2f8fb8> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> GridNioAcceptWorker.accept(GridNioServer.java:2870)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> GridNioAcceptWorker.body(GridNioServer.java:2822)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "Thread-10" #87 daemon prio=5 os_prio=0 tid=0x00000000206e5800 nid=0x23bc
> runnable [0x000000003618f000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
>         at sun.nio.ch.Iocp.access$300(Iocp.java:46)
>         at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
>         at
> sun.nio.ch.AsynchronousChannelGroupImpl$1.run(
> AsynchronousChannelGroupImpl.java:112)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - <0x00000000ab5768b0> (a
> java.util.concurrent.ThreadPoolExecutor$Worker)
>
> "Thread-9" #86 daemon prio=5 os_prio=0 tid=0x00000000206e4800 nid=0x2fd0
> runnable [0x000000003607f000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
>         at sun.nio.ch.Iocp.access$300(Iocp.java:46)
>         at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
>         at
> sun.nio.ch.AsynchronousChannelGroupImpl$1.run(
> AsynchronousChannelGroupImpl.java:112)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - <0x00000000ab478f30> (a
> java.util.concurrent.ThreadPoolExecutor$Worker)
>
> "Thread-8" #85 daemon prio=5 os_prio=0 tid=0x00000000206e4000 nid=0x2464
> runnable [0x0000000035eff000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
>         at sun.nio.ch.Iocp.access$300(Iocp.java:46)
>         at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
>         at
> sun.nio.ch.AsynchronousChannelGroupImpl$1.run(
> AsynchronousChannelGroupImpl.java:112)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - <0x00000000ab5768e0> (a
> java.util.concurrent.ThreadPoolExecutor$Worker)
>
> "Thread-7" #84 daemon prio=5 os_prio=0 tid=0x00000000206e3000 nid=0x369c
> runnable [0x0000000035cae000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
>         at sun.nio.ch.Iocp.access$300(Iocp.java:46)
>         at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
>         at
> sun.nio.ch.AsynchronousChannelGroupImpl$1.run(
> AsynchronousChannelGroupImpl.java:112)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - <0x00000000ab576910> (a
> java.util.concurrent.ThreadPoolExecutor$Worker)
>
> "Thread-6" #83 daemon prio=5 os_prio=0 tid=0x00000000206e2800 nid=0xf78
> runnable [0x0000000035b1e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
>         at sun.nio.ch.Iocp.access$300(Iocp.java:46)
>         at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
>         at
> sun.nio.ch.AsynchronousChannelGroupImpl$1.run(
> AsynchronousChannelGroupImpl.java:112)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - <0x00000000ab576940> (a
> java.util.concurrent.ThreadPoolExecutor$Worker)
>
> "Thread-5" #82 daemon prio=5 os_prio=0 tid=0x00000000206e1800 nid=0x34a8
> runnable [0x000000003563f000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
>         at sun.nio.ch.Iocp.access$300(Iocp.java:46)
>         at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
>         at
> sun.nio.ch.AsynchronousChannelGroupImpl$1.run(
> AsynchronousChannelGroupImpl.java:112)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - <0x00000000ab576970> (a
> java.util.concurrent.ThreadPoolExecutor$Worker)
>
> "Thread-4" #81 daemon prio=5 os_prio=0 tid=0x0000000019b5c000 nid=0x1d14
> runnable [0x00000000358df000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
>         at sun.nio.ch.Iocp.access$300(Iocp.java:46)
>         at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
>         at
> sun.nio.ch.AsynchronousChannelGroupImpl$1.run(
> AsynchronousChannelGroupImpl.java:112)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - <0x00000000ab5769a0> (a
> java.util.concurrent.ThreadPoolExecutor$Worker)
>
> "Thread-3" #80 daemon prio=5 os_prio=0 tid=0x0000000019b5b800 nid=0xe04
> runnable [0x00000000357af000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
>         at sun.nio.ch.Iocp.access$300(Iocp.java:46)
>         at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
>         at
> sun.nio.ch.AsynchronousChannelGroupImpl$1.run(
> AsynchronousChannelGroupImpl.java:112)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - <0x00000000ab47b030> (a
> java.util.concurrent.ThreadPoolExecutor$Worker)
>
> "Thread-2" #79 daemon prio=5 os_prio=0 tid=0x0000000019b5a800 nid=0x3890
> runnable [0x00000000285bf000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
>         at sun.nio.ch.Iocp.access$300(Iocp.java:46)
>         at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "tcp-comm-worker-#1" #76 daemon prio=5 os_prio=0 tid=0x0000000019b5a000
> nid=0x3958 waiting on condition [0x00000000288af000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ab646a58> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.LinkedBlockingQueue.poll(
> LinkedBlockingQueue.java:467)
>         at
> org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi$
> CommunicationWorker.body(TcpCommunicationSpi.java:4207)
>         at
> org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)
>
>    Locked ownable synchronizers:
>         - None
>
> "grid-nio-worker-tcp-comm-3-#28" #72 prio=5 os_prio=0
> tid=0x0000000019b59000
> nid=0xfe8 runnable [0x00000000286ff000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000aa4bb450> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000000ab6026f8> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000ab2f9038> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.
> bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "grid-nio-worker-tcp-comm-2-#27" #71 prio=5 os_prio=0
> tid=0x0000000019b58800
> nid=0x1960 runnable [0x00000000280ae000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000ab2afca8> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000000ab6471a8> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000ab5e19c0> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.
> bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "grid-nio-worker-tcp-comm-1-#26" #70 prio=5 os_prio=0
> tid=0x0000000019b57000
> nid=0xa78 runnable [0x000000002845f000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000aa4bb590> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000000aa6269e8> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000ab2f90b8> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.
> bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "grid-nio-worker-tcp-comm-0-#25" #69 prio=5 os_prio=0
> tid=0x0000000019b56000
> nid=0x2c84 runnable [0x000000002763e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000aa4bb710> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000000aa627138> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000ab2f9138> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.
> bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "nio-acceptor-#24" #68 daemon prio=5 os_prio=0 tid=0x0000000019b57800
> nid=0x3614 runnable [0x000000002824f000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000aa627768> (a sun.nio.ch.Util$3)
>         - locked <0x00000000aa627750> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000ab2f91b8> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> GridNioAcceptWorker.accept(GridNioServer.java:2870)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$
> GridNioAcceptWorker.body(GridNioServer.java:2822)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "grid-timeout-worker-#23" #67 daemon prio=5 os_prio=0
> tid=0x0000000019b55800
> nid=0x2b48 in Object.wait() [0x000000002788f000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at
> org.apache.ignite.internal.processors.timeout.GridTimeoutProcessor$
> TimeoutWorker.body(GridTimeoutProcessor.java:203)
>         - locked <0x00000000ab576f50> (a java.lang.Object)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "ignite-clock" #66 daemon prio=10 os_prio=2 tid=0x0000000019b54800
> nid=0x650
> waiting on condition [0x0000000027f9e000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at
> org.apache.ignite.internal.util.IgniteUtils$22.run(IgniteUtils.java:3308)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "jvm-pause-detector-worker" #59 daemon prio=5 os_prio=0
> tid=0x0000000019b4e800 nid=0x804 waiting on condition [0x00000000268bf000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at
> org.apache.ignite.internal.LongJVMPauseDetector$1.run(
> LongJVMPauseDetector.java:90)
>
>    Locked ownable synchronizers:
>         - None
>
> "data-streamer-stripe-7-#16" #58 daemon prio=5 os_prio=0
> tid=0x0000000019b4e000 nid=0x794 waiting on condition [0x0000000026e6e000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "data-streamer-stripe-6-#15" #57 daemon prio=5 os_prio=0
> tid=0x0000000019b4d000 nid=0x3708 waiting on condition [0x0000000026c6e000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "data-streamer-stripe-5-#14" #56 daemon prio=5 os_prio=0
> tid=0x0000000021c36800 nid=0x37a4 waiting on condition [0x0000000026b4f000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "data-streamer-stripe-4-#13" #55 daemon prio=5 os_prio=0
> tid=0x0000000021c36000 nid=0x554 waiting on condition [0x00000000269cf000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "data-streamer-stripe-3-#12" #54 daemon prio=5 os_prio=0
> tid=0x0000000021c35000 nid=0x32a0 waiting on condition [0x00000000261df000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "data-streamer-stripe-2-#11" #53 daemon prio=5 os_prio=0
> tid=0x0000000021c34800 nid=0x3274 waiting on condition [0x000000002674f000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "data-streamer-stripe-1-#10" #52 daemon prio=5 os_prio=0
> tid=0x0000000021c33800 nid=0x560 waiting on condition [0x00000000265cf000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "data-streamer-stripe-0-#9" #51 daemon prio=5 os_prio=0
> tid=0x0000000021c33000 nid=0x1a50 waiting on condition [0x000000002648f000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "sys-stripe-7-#8" #50 daemon prio=5 os_prio=0 tid=0x0000000021c32000
> nid=0x155c waiting on condition [0x00000000262df000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "sys-stripe-6-#7" #49 daemon prio=5 os_prio=0 tid=0x0000000021c31800
> nid=0x3584 waiting on condition [0x000000002603e000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "sys-stripe-5-#6" #48 daemon prio=5 os_prio=0 tid=0x0000000021c30800
> nid=0x3cbc waiting on condition [0x0000000025e6f000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "sys-stripe-4-#5" #47 daemon prio=5 os_prio=0 tid=0x0000000021c30000
> nid=0x14b4 waiting on condition [0x0000000025c8e000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "sys-stripe-3-#4" #46 daemon prio=5 os_prio=0 tid=0x000000001b2fc000
> nid=0x550 waiting on condition [0x0000000025b1e000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "sys-stripe-2-#3" #45 daemon prio=5 os_prio=0 tid=0x000000001b2fb800
> nid=0x14cc waiting on condition [0x00000000256af000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "sys-stripe-1-#2" #44 daemon prio=5 os_prio=0 tid=0x000000001b2fa800
> nid=0x3a80 waiting on condition [0x0000000025a1f000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "sys-stripe-0-#1" #43 daemon prio=5 os_prio=0 tid=0x000000001b2fa000
> nid=0xfdc waiting on condition [0x000000002411e000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$
> StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.
> run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "Curator-Framework-0" #42 daemon prio=5 os_prio=0 tid=0x000000001b2f9000
> nid=0x3810 waiting on condition [0x00000000254be000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ab63da78> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at java.util.concurrent.DelayQueue.take(DelayQueue.java:211)
>         at java.util.concurrent.DelayQueue.take(DelayQueue.java:70)
>         at
> org.apache.curator.framework.imps.CuratorFrameworkImpl.
> backgroundOperationsLoop(CuratorFrameworkImpl.java:804)
>         at
> org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(
> CuratorFrameworkImpl.java:64)
>         at
> org.apache.curator.framework.imps.CuratorFrameworkImpl$4.
> call(CuratorFrameworkImpl.java:267)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(
> ScheduledThreadPoolExecutor.java:293)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - <0x00000000ab46a3a0> (a
> java.util.concurrent.ThreadPoolExecutor$Worker)
>
> "localhost-startStop-1-EventThread" #41 daemon prio=5 os_prio=0
> tid=0x000000001b2f8800 nid=0x1558 waiting on condition [0x00000000242df000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ab644d40> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(
> LinkedBlockingQueue.java:442)
>         at
> org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
>
>    Locked ownable synchronizers:
>         - None
>
> "localhost-startStop-1-SendThread(srv7-ngxeko.net.billing.ru:2181)" #40
> daemon prio=5 os_prio=0 tid=0x000000001b2f7800 nid=0x2ecc runnable
> [0x000000001294f000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000ab645220> (a sun.nio.ch.Util$3)
>         - locked <0x00000000ab645208> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000aaa21bd8> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> ClientCnxnSocketNIO.java:349)
>         at
> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
>
>    Locked ownable synchronizers:
>         - None
>
> "Curator-ConnectionStateManager-0" #39 daemon prio=5 os_prio=0
> tid=0x000000001b2f7000 nid=0x34f0 waiting on condition [0x000000002527f000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ab642210> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.
> java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403)
>         at
> org.apache.curator.framework.state.ConnectionStateManager.processEvents(
> ConnectionStateManager.java:245)
>         at
> org.apache.curator.framework.state.ConnectionStateManager.access$000(
> ConnectionStateManager.java:43)
>         at
> org.apache.curator.framework.state.ConnectionStateManager$
> 1.call(ConnectionStateManager.java:111)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - <0x00000000ab4ac700> (a
> java.util.concurrent.ThreadPoolExecutor$Worker)
>
> "I/O dispatcher 8" #38 prio=5 os_prio=0 tid=0x000000001b2f6000 nid=0xec8
> runnable [0x000000002537f000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000aa627df8> (a sun.nio.ch.Util$3)
>         - locked <0x00000000aa627de0> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000ab2f9238> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.http.impl.nio.reactor.AbstractIOReactor.
> execute(AbstractIOReactor.java:257)
>         at
> org.apache.http.impl.nio.reactor.BaseIOReactor.execute(
> BaseIOReactor.java:106)
>         at
> org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(
> AbstractMultiworkerIOReactor.java:590)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "I/O dispatcher 7" #37 prio=5 os_prio=0 tid=0x000000001b2f5800 nid=0x27c4
> runnable [0x000000002445e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000aa678338> (a sun.nio.ch.Util$3)
>         - locked <0x00000000aa678320> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000aa5dc8e8> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.http.impl.nio.reactor.AbstractIOReactor.
> execute(AbstractIOReactor.java:257)
>         at
> org.apache.http.impl.nio.reactor.BaseIOReactor.execute(
> BaseIOReactor.java:106)
>         at
> org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(
> AbstractMultiworkerIOReactor.java:590)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "I/O dispatcher 6" #36 prio=5 os_prio=0 tid=0x000000001b2f4800 nid=0x3ba4
> runnable [0x000000002510e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000aa62a700> (a sun.nio.ch.Util$3)
>         - locked <0x00000000aa62a6e8> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000ab307170> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.http.impl.nio.reactor.AbstractIOReactor.
> execute(AbstractIOReactor.java:257)
>         at
> org.apache.http.impl.nio.reactor.BaseIOReactor.execute(
> BaseIOReactor.java:106)
>         at
> org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(
> AbstractMultiworkerIOReactor.java:590)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "I/O dispatcher 5" #35 prio=5 os_prio=0 tid=0x000000001b2f4000 nid=0x3040
> runnable [0x0000000023a9f000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000aa633168> (a sun.nio.ch.Util$3)
>         - locked <0x00000000aa633150> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000ab3071f0> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.http.impl.nio.reactor.AbstractIOReactor.
> execute(AbstractIOReactor.java:257)
>         at
> org.apache.http.impl.nio.reactor.BaseIOReactor.execute(
> BaseIOReactor.java:106)
>         at
> org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(
> AbstractMultiworkerIOReactor.java:590)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "I/O dispatcher 4" #34 prio=5 os_prio=0 tid=0x000000001b2f3000 nid=0x19c8
> runnable [0x0000000024f2e000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000aa63fab0> (a sun.nio.ch.Util$3)
>         - locked <0x00000000aa63fa98> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000aa3f0e70> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.http.impl.nio.reactor.AbstractIOReactor.
> execute(AbstractIOReactor.java:257)
>         at
> org.apache.http.impl.nio.reactor.BaseIOReactor.execute(
> BaseIOReactor.java:106)
>         at
> org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(
> AbstractMultiworkerIOReactor.java:590)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "I/O dispatcher 3" #33 prio=5 os_prio=0 tid=0x000000001b2f1800 nid=0x3940
> runnable [0x0000000024d4f000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000aa6466c0> (a sun.nio.ch.Util$3)
>         - locked <0x00000000aa6466a8> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000aa3f0ef0> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.http.impl.nio.reactor.AbstractIOReactor.
> execute(AbstractIOReactor.java:257)
>         at
> org.apache.http.impl.nio.reactor.BaseIOReactor.execute(
> BaseIOReactor.java:106)
>         at
> org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(
> AbstractMultiworkerIOReactor.java:590)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "I/O dispatcher 2" #32 prio=5 os_prio=0 tid=0x000000001b2ef800 nid=0x3c14
> runnable [0x0000000024bde000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000aa646c78> (a sun.nio.ch.Util$3)
>         - locked <0x00000000aa646c60> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000aa3f0f70> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.http.impl.nio.reactor.AbstractIOReactor.
> execute(AbstractIOReactor.java:257)
>         at
> org.apache.http.impl.nio.reactor.BaseIOReactor.execute(
> BaseIOReactor.java:106)
>         at
> org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(
> AbstractMultiworkerIOReactor.java:590)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "I/O dispatcher 1" #31 prio=5 os_prio=0 tid=0x000000001b2f1000 nid=0x37e0
> runnable [0x00000000249de000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000aa647230> (a sun.nio.ch.Util$3)
>         - locked <0x00000000aa647218> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000aa3f0ff0> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.http.impl.nio.reactor.AbstractIOReactor.
> execute(AbstractIOReactor.java:257)
>         at
> org.apache.http.impl.nio.reactor.BaseIOReactor.execute(
> BaseIOReactor.java:106)
>         at
> org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(
> AbstractMultiworkerIOReactor.java:590)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "pool-4-thread-1" #30 prio=5 os_prio=0 tid=0x000000001b2f0000 nid=0x29f4
> runnable [0x0000000023b9f000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(
> WindowsSelectorImpl.java:296)
>         at
> sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(
> WindowsSelectorImpl.java:278)
>         at
> sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000000aa647788> (a sun.nio.ch.Util$3)
>         - locked <0x00000000aa647770> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000000aa565820> (a sun.nio.ch.WindowsSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor.execute(
> AbstractMultiworkerIOReactor.java:342)
>         at
> org.apache.http.impl.nio.conn.PoolingNHttpClientConnectionManager.execute(
> PoolingNHttpClientConnectionManager.java:194)
>         at
> org.apache.http.impl.nio.client.CloseableHttpAsyncClientBase$1.run(
> CloseableHttpAsyncClientBase.java:64)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "logback-1" #25 daemon prio=5 os_prio=0 tid=0x000000001b2ee800 nid=0x3d24
> waiting on condition [0x000000002211f000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000ae0d8870> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "RMI RenewClean-[172.21.98.254:19005]" #21 daemon prio=5 os_prio=0
> tid=0x000000001b169000 nid=0x1374 in Object.wait() [0x000000001c7ef000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
>         - locked <0x00000000aa216fa0> (a java.lang.ref.ReferenceQueue$
> Lock)
>         at
> sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(
> DGCClient.java:563)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "RMI Scheduler(0)" #20 daemon prio=5 os_prio=0 tid=0x000000001ae37000
> nid=0x38a4 waiting on condition [0x000000001c69f000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000000a9ad7068> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$
> ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(
> ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(
> ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "RMI Reaper" #18 prio=5 os_prio=0 tid=0x000000001af87000 nid=0x15a0 in
> Object.wait() [0x000000001c1ef000]
>    java.lang.Thread.State: WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         - waiting on <0x00000000a9ad5ec8> (a
> java.lang.ref.ReferenceQueue$Lock)
>         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
>         - locked <0x00000000a9ad5ec8> (a java.lang.ref.ReferenceQueue$
> Lock)
>         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
>         at sun.rmi.transport.ObjectTable$Reaper.run(ObjectTable.java:351)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "RMI TCP Accept-19005" #17 daemon prio=5 os_prio=0 tid=0x000000001b03a000
> nid=0x3fec runnable [0x000000001bf4e000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.DualStackPlainSocketImpl.accept0(Native Method)
>         at
> java.net.DualStackPlainSocketImpl.socketAccept(
> DualStackPlainSocketImpl.java:131)
>         at
> java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
>         at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:199)
>         - locked <0x00000000aa1e5198> (a java.net.SocksSocketImpl)
>         at java.net.ServerSocket.implAccept(ServerSocket.java:545)
>         at java.net.ServerSocket.accept(ServerSocket.java:513)
>         at
> sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(
> TCPTransport.java:400)
>         at
> sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:372)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "RMI TCP Accept-19004" #16 daemon prio=5 os_prio=0 tid=0x000000001ae07800
> nid=0x36c0 runnable [0x000000001a60e000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.DualStackPlainSocketImpl.accept0(Native Method)
>         at
> java.net.DualStackPlainSocketImpl.socketAccept(
> DualStackPlainSocketImpl.java:131)
>         at
> java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
>         at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:199)
>         - locked <0x00000000aa1e31f8> (a java.net.SocksSocketImpl)
>         at java.net.ServerSocket.implAccept(ServerSocket.java:545)
>         at java.net.ServerSocket.accept(ServerSocket.java:513)
>         at
> sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(
> TCPTransport.java:400)
>         at
> sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:372)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "GC Daemon" #15 daemon prio=2 os_prio=-2 tid=0x000000001ae11000 nid=0x1500
> in Object.wait() [0x000000001bc2f000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         - waiting on <0x00000000aa08b960> (a sun.misc.GC$LatencyLock)
>         at sun.misc.GC$Daemon.run(GC.java:117)
>         - locked <0x00000000aa08b960> (a sun.misc.GC$LatencyLock)
>
>    Locked ownable synchronizers:
>         - None
>
> "RMI TCP Accept-0" #14 daemon prio=5 os_prio=0 tid=0x0000000019c03000
> nid=0xdf0 runnable [0x000000001a48f000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.DualStackPlainSocketImpl.accept0(Native Method)
>         at
> java.net.DualStackPlainSocketImpl.socketAccept(
> DualStackPlainSocketImpl.java:131)
>         at
> java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
>         at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:199)
>         - locked <0x00000000a9b0c148> (a java.net.SocksSocketImpl)
>         at java.net.ServerSocket.implAccept(ServerSocket.java:545)
>         at java.net.ServerSocket.accept(ServerSocket.java:513)
>         at
> sun.management.jmxremote.LocalRMIServerSocketFactory$1.accept(
> LocalRMIServerSocketFactory.java:52)
>         at
> sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(
> TCPTransport.java:400)
>         at
> sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:372)
>         at java.lang.Thread.run(Thread.java:748)
>
>    Locked ownable synchronizers:
>         - None
>
> "Service Thread" #12 daemon prio=9 os_prio=0 tid=0x000000001821f800
> nid=0x3588 runnable [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
>    Locked ownable synchronizers:
>         - None
>
> "C1 CompilerThread3" #11 daemon prio=9 os_prio=2 tid=0x000000001981f000
> nid=0x2308 waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
>    Locked ownable synchronizers:
>         - None
>
> "C2 CompilerThread2" #10 daemon prio=9 os_prio=2 tid=0x000000001820c800
> nid=0x2fb0 waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
>    Locked ownable synchronizers:
>         - None
>
> "C2 CompilerThread1" #9 daemon prio=9 os_prio=2 tid=0x00000000198fb800
> nid=0x25cc waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
>    Locked ownable synchronizers:
>         - None
>
> "C2 CompilerThread0" #8 daemon prio=9 os_prio=2 tid=0x00000000198a5000
> nid=0x3074 waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
>    Locked ownable synchronizers:
>         - None
>
> "Attach Listener" #6 daemon prio=5 os_prio=2 tid=0x0000000018111800
> nid=0x32f4 waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
>    Locked ownable synchronizers:
>         - None
>
> "Signal Dispatcher" #5 daemon prio=9 os_prio=2 tid=0x0000000018109000
> nid=0x308 runnable [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
>    Locked ownable synchronizers:
>         - None
>
> "Surrogate Locker Thread (Concurrent GC)" #4 daemon prio=9 os_prio=0
> tid=0x0000000018107800 nid=0x2560 waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
>    Locked ownable synchronizers:
>         - None
>
> "Finalizer" #3 daemon prio=8 os_prio=1 tid=0x00000000180e6000 nid=0x20b4 in
> Object.wait() [0x000000001909f000]
>    java.lang.Thread.State: WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
>         - locked <0x00000000a9997fc8> (a java.lang.ref.ReferenceQueue$
> Lock)
>         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
>         at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)
>
>    Locked ownable synchronizers:
>         - None
>
> "Reference Handler" #2 daemon prio=10 os_prio=2 tid=0x000000001809e800
> nid=0xff0 in Object.wait() [0x0000000018e8f000]
>    java.lang.Thread.State: WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.lang.Object.wait(Object.java:502)
>         at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
>         - locked <0x00000000a9996568> (a java.lang.ref.Reference$Lock)
>         at java.lang.ref.Reference$ReferenceHandler.run(
> Reference.java:153)
>
>    Locked ownable synchronizers:
>         - None
>
> "main" #1 prio=5 os_prio=0 tid=0x000000000222c800 nid=0x130c runnable
> [0x000000000248e000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.DualStackPlainSocketImpl.accept0(Native Method)
>         at
> java.net.DualStackPlainSocketImpl.socketAccept(
> DualStackPlainSocketImpl.java:131)
>         at
> java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
>         at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:199)
>         - locked <0x00000000afcb66e8> (a java.net.SocksSocketImpl)
>         at java.net.ServerSocket.implAccept(ServerSocket.java:545)
>         at java.net.ServerSocket.accept(ServerSocket.java:513)
>         at
> org.apache.catalina.core.StandardServer.await(StandardServer.java:452)
>         at org.apache.catalina.startup.Catalina.await(Catalina.java:781)
>         at org.apache.catalina.startup.Catalina.start(Catalina.java:727)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
> 62)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:498)
>         at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:294)
>         at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:428)
>
>    Locked ownable synchronizers:
>         - None
>
> "VM Thread" os_prio=2 tid=0x0000000018097800 nid=0x19f4 runnable
>
> "Gang worker#0 (Parallel GC Threads)" os_prio=2 tid=0x000000000223d800
> nid=0x36b8 runnable
>
> "Gang worker#1 (Parallel GC Threads)" os_prio=2 tid=0x000000000223e000
> nid=0x197c runnable
>
> "Gang worker#2 (Parallel GC Threads)" os_prio=2 tid=0x0000000002240000
> nid=0x2acc runnable
>
> "Gang worker#3 (Parallel GC Threads)" os_prio=2 tid=0x0000000002242800
> nid=0x1014 runnable
>
> "Gang worker#4 (Parallel GC Threads)" os_prio=2 tid=0x0000000002245800
> nid=0x20dc runnable
>
> "Gang worker#5 (Parallel GC Threads)" os_prio=2 tid=0x0000000002247000
> nid=0x2b5c runnable
>
> "Gang worker#6 (Parallel GC Threads)" os_prio=2 tid=0x0000000002248000
> nid=0x3c0 runnable
>
> "Gang worker#7 (Parallel GC Threads)" os_prio=2 tid=0x0000000002249000
> nid=0x1c7c runnable
>
> "Concurrent Mark-Sweep GC Thread" os_prio=2 tid=0x00000000022be000
> nid=0x1190 runnable
>
> "Gang worker#0 (Parallel CMS Threads)" os_prio=2 tid=0x00000000022b7000
> nid=0x1ac runnable
>
> "Gang worker#1 (Parallel CMS Threads)" os_prio=2 tid=0x00000000022ba800
> nid=0x3cb8 runnable
>
> "VM Periodic Task Thread" os_prio=2 tid=0x0000000019c45800 nid=0x147c
> waiting on condition
>
> JNI global references: 735
>
>
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>
>

Re: service deploy cluster singleton lock application

Posted by "sergey.dolinkov" <se...@billing.ru>.
it is threddump for locked application


2018-07-26 13:50:15
Full thread dump Java HotSpot(TM) 64-Bit Server VM (25.152-b16 mixed mode):

"sys-#72" #148 daemon prio=5 os_prio=0 tid=0x00000000229fd800 nid=0x2eb4
waiting on condition [0x00000000266af000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000a1a0e008> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"sys-#71" #147 daemon prio=5 os_prio=0 tid=0x0000000022a06800 nid=0x28c
waiting on condition [0x0000000026eae000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000a1a0e008> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"sys-#70" #145 daemon prio=5 os_prio=0 tid=0x0000000022a06000 nid=0x1e00
waiting on condition [0x0000000026aae000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000a1a0e008> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"sys-#69" #144 daemon prio=5 os_prio=0 tid=0x0000000022a05000 nid=0x30c0
waiting on condition [0x000000002734e000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000a1a0e008> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"sys-#68" #143 daemon prio=5 os_prio=0 tid=0x0000000022a03800 nid=0x91c
waiting on condition [0x0000000026baf000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000a1a0e008> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"sys-#67" #142 daemon prio=5 os_prio=0 tid=0x0000000022a03000 nid=0x3c94
waiting on condition [0x000000005058f000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000a1a0e008> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"RMI TCP Connection(4)-172.21.98.254" #133 daemon prio=5 os_prio=0
tid=0x00000000229ff000 nid=0x1dc0 in Object.wait() [0x000000001c79c000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at
com.sun.jmx.remote.internal.ArrayNotificationBuffer.fetchNotifications(ArrayNotificationBuffer.java:449)
        - locked <0x0000000090accb90> (a
com.sun.jmx.remote.internal.ArrayNotificationBuffer)
        at
com.sun.jmx.remote.internal.ArrayNotificationBuffer$ShareBuffer.fetchNotifications(ArrayNotificationBuffer.java:227)
        at
com.sun.jmx.remote.internal.ServerNotifForwarder.fetchNotifs(ServerNotifForwarder.java:274)
        at
javax.management.remote.rmi.RMIConnectionImpl$4.run(RMIConnectionImpl.java:1270)
        at
javax.management.remote.rmi.RMIConnectionImpl$4.run(RMIConnectionImpl.java:1268)
        at
javax.management.remote.rmi.RMIConnectionImpl.fetchNotifications(RMIConnectionImpl.java:1274)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at
sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:357)
        at sun.rmi.transport.Transport$1.run(Transport.java:200)
        at sun.rmi.transport.Transport$1.run(Transport.java:197)
        at java.security.AccessController.doPrivileged(Native Method)
        at sun.rmi.transport.Transport.serviceCall(Transport.java:196)
        at
sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:568)
        at
sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:826)
        at
sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$0(TCPTransport.java:683)
        at
sun.rmi.transport.tcp.TCPTransport$ConnectionHandler$$Lambda$6/1406961078.run(Unknown
Source)
        at java.security.AccessController.doPrivileged(Native Method)
        at
sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:682)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - <0x000000008f243620> (a
java.util.concurrent.ThreadPoolExecutor$Worker)

"JMX server connection timeout 132" #132 daemon prio=5 os_prio=0
tid=0x00000000229fe800 nid=0x3eb8 in Object.wait() [0x00000000268ff000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at
com.sun.jmx.remote.internal.ServerCommunicatorAdmin$Timeout.run(ServerCommunicatorAdmin.java:168)
        - locked <0x000000008fd21260> (a [I)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"RMI TCP Connection(3)-172.21.98.254" #131 daemon prio=5 os_prio=0
tid=0x0000000022a02000 nid=0x2894 runnable [0x000000001c02e000]
   java.lang.Thread.State: RUNNABLE
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:171)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
        - locked <0x000000008fce5e20> (a java.io.BufferedInputStream)
        at java.io.FilterInputStream.read(FilterInputStream.java:83)
        at
sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:550)
        at
sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:826)
        at
sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$0(TCPTransport.java:683)
        at
sun.rmi.transport.tcp.TCPTransport$ConnectionHandler$$Lambda$6/1406961078.run(Unknown
Source)
        at java.security.AccessController.doPrivileged(Native Method)
        at
sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:682)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - <0x000000008f241040> (a
java.util.concurrent.ThreadPoolExecutor$Worker)

"logback-2" #125 daemon prio=5 os_prio=0 tid=0x0000000022a04800 nid=0x3250
waiting on condition [0x000000006f68e000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ad3b84c0> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"session-timeout-worker-#34" #94 daemon prio=5 os_prio=0
tid=0x0000000022a01800 nid=0x19b0 waiting on condition [0x00000000702ef000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
        at java.lang.Thread.sleep(Native Method)
        at
org.apache.ignite.internal.processors.rest.GridRestProcessor$4.body(GridRestProcessor.java:476)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"srvc-deploy-#53" #120 daemon prio=5 os_prio=0 tid=0x0000000022a00800
nid=0x2fd4 waiting on condition [0x000000007010e000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x000000008310d018> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"checkpoint-runner-#49" #116 daemon prio=5 os_prio=0 tid=0x00000000229fd000
nid=0x3be8 waiting on condition [0x000000006f9ae000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000880a6278> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"checkpoint-runner-#48" #115 daemon prio=5 os_prio=0 tid=0x00000000229fc000
nid=0xee0 waiting on condition [0x000000006ed3f000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000880a6278> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"checkpoint-runner-#47" #114 daemon prio=5 os_prio=0 tid=0x00000000229fb800
nid=0x1a20 waiting on condition [0x00000000356ae000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000880a6278> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"checkpoint-runner-#46" #113 daemon prio=5 os_prio=0 tid=0x00000000229fa800
nid=0x18d0 waiting on condition [0x00000000507ee000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000880a6278> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"db-checkpoint-thread-#45" #112 daemon prio=5 os_prio=0
tid=0x00000000229fa000 nid=0x2cd0 in Object.wait() [0x000000005069f000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager$Checkpointer.waitCheckpointEvent(GridCacheDatabaseSharedManager.java:3338)
        - locked <0x0000000081d0af20> (a
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager$Checkpointer)
        at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager$Checkpointer.body(GridCacheDatabaseSharedManager.java:2933)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"ttl-cleanup-worker-#43" #110 daemon prio=5 os_prio=0 tid=0x00000000229f8800
nid=0x1490 waiting on condition [0x000000002a5cf000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
        at java.lang.Thread.sleep(Native Method)
        at
org.apache.ignite.internal.util.IgniteUtils.sleep(IgniteUtils.java:7629)
        at
org.apache.ignite.internal.processors.cache.GridCacheSharedTtlCleanupManager$CleanupWorker.body(GridCacheSharedTtlCleanupManager.java:145)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"wal-file-archiver%null" #108 daemon prio=5 os_prio=0 tid=0x000000001ab1c800
nid=0x2b7c in Object.wait() [0x000000002a75f000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java:502)
        at
org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$FileArchiver.run(FileWriteAheadLogManager.java:1558)
        - locked <0x00000000880a4e50> (a
org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$FileArchiver)

   Locked ownable synchronizers:
        - None

"exchange-worker-#42" #107 daemon prio=5 os_prio=0 tid=0x000000001ab1b800
nid=0x2284 waiting on condition [0x000000002a49f000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x0000000081f8a4c0> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.LinkedBlockingDeque.pollFirst(LinkedBlockingDeque.java:522)
        at
java.util.concurrent.LinkedBlockingDeque.poll(LinkedBlockingDeque.java:684)
        at
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body0(GridCachePartitionExchangeManager.java:2365)
        at
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:2299)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"ignite-update-notifier-timer" #106 daemon prio=5 os_prio=0
tid=0x000000001ab1b000 nid=0x353c in Object.wait() [0x000000002a28e000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at java.util.TimerThread.mainLoop(Timer.java:552)
        - locked <0x0000000086597608> (a java.util.TaskQueue)
        at java.util.TimerThread.run(Timer.java:505)

   Locked ownable synchronizers:
        - None

"upd-ver-checker" #105 daemon prio=5 os_prio=0 tid=0x000000001ab1a000
nid=0x1a30 waiting on condition [0x000000002a11e000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
        at java.lang.Thread.sleep(Native Method)
        at
org.apache.ignite.internal.processors.cluster.GridUpdateNotifier$1.run(GridUpdateNotifier.java:115)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"disco-event-worker-#41" #104 daemon prio=5 os_prio=0 tid=0x000000001ab19800
nid=0x3190 waiting on condition [0x0000000029d8f000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000a1b7e830> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at
org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$DiscoveryWorker.body0(GridDiscoveryManager.java:2758)
        at
org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$DiscoveryWorker.body(GridDiscoveryManager.java:2732)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"tcp-disco-ip-finder-cleaner-#5" #103 daemon prio=10 os_prio=2
tid=0x000000001ab18800 nid=0x3c2c waiting on condition [0x0000000029aaf000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
        at java.lang.Thread.sleep(Native Method)
        at
org.apache.ignite.spi.discovery.tcp.ServerImpl$IpFinderCleaner.body(ServerImpl.java:1900)
        at
org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)

   Locked ownable synchronizers:
        - None

"tcp-disco-sock-reader-#4" #102 daemon prio=10 os_prio=2
tid=0x000000001ab18000 nid=0x3f58 runnable [0x0000000029c3e000]
   java.lang.Thread.State: RUNNABLE
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:171)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
        at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
        - locked <0x00000000873e95b0> (a java.io.BufferedInputStream)
        at
org.apache.ignite.marshaller.jdk.JdkMarshallerInputStreamWrapper.read(JdkMarshallerInputStreamWrapper.java:53)
        at
java.io.ObjectInputStream$PeekInputStream.read(ObjectInputStream.java:2657)
        at
java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2673)
        at
java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:3150)
        at
java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:859)
        at java.io.ObjectInputStream.<init>(ObjectInputStream.java:355)
        at
org.apache.ignite.marshaller.jdk.JdkMarshallerObjectInputStream.<init>(JdkMarshallerObjectInputStream.java:43)
        at
org.apache.ignite.marshaller.jdk.JdkMarshaller.unmarshal0(JdkMarshaller.java:137)
        at
org.apache.ignite.marshaller.AbstractNodeNameAwareMarshaller.unmarshal(AbstractNodeNameAwareMarshaller.java:94)
        at
org.apache.ignite.internal.util.IgniteUtils.unmarshal(IgniteUtils.java:9907)
        at
org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:5981)
        at
org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)

   Locked ownable synchronizers:
        - None

"tcp-disco-srvr-#2" #77 daemon prio=10 os_prio=2 tid=0x000000001ab17000
nid=0x21dc runnable [0x000000002925f000]
   java.lang.Thread.State: RUNNABLE
        at java.net.DualStackPlainSocketImpl.accept0(Native Method)
        at
java.net.DualStackPlainSocketImpl.socketAccept(DualStackPlainSocketImpl.java:131)
        at
java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
        at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:199)
        - locked <0x00000000a1e1b158> (a java.net.SocksSocketImpl)
        at java.net.ServerSocket.implAccept(ServerSocket.java:545)
        at java.net.ServerSocket.accept(ServerSocket.java:513)
        at
org.apache.ignite.spi.discovery.tcp.ServerImpl$TcpServer.body(ServerImpl.java:5641)
        at
org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)

   Locked ownable synchronizers:
        - None

"tcp-disco-msg-worker-#3" #101 daemon prio=10 os_prio=2
tid=0x000000001ab16800 nid=0x3ac8 runnable [0x0000000028c0f000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000846c9108> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.LinkedBlockingDeque.pollFirst(LinkedBlockingDeque.java:522)
        at
java.util.concurrent.LinkedBlockingDeque.poll(LinkedBlockingDeque.java:684)
        at
org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorkerAdapter.body(ServerImpl.java:6770)
        at
org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.body(ServerImpl.java:2621)
        at
org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)

   Locked ownable synchronizers:
        - None

"grid-data-loader-flusher-#40" #100 daemon prio=5 os_prio=0
tid=0x000000001ab15800 nid=0x36ac waiting on condition [0x00000000297ae000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x0000000083c2cea8> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.DelayQueue.take(DelayQueue.java:211)
        at
org.apache.ignite.internal.processors.datastreamer.DataStreamProcessor$2.body(DataStreamProcessor.java:109)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"grid-nio-worker-tcp-rest-3-#39" #99 prio=5 os_prio=0 tid=0x000000001ab15000
nid=0x160c runnable [0x000000002961e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x0000000083bf7af8> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x0000000083bf4090> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x0000000083bf3f40> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"grid-nio-worker-tcp-rest-2-#38" #98 prio=5 os_prio=0 tid=0x000000001ab14000
nid=0x3fe4 runnable [0x000000002949f000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x0000000083bef3a8> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x0000000083beb918> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x0000000083beb7c8> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"grid-nio-worker-tcp-rest-1-#37" #97 prio=5 os_prio=0 tid=0x000000001ab13800
nid=0x32e0 runnable [0x000000002937e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x0000000083be6c30> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x0000000083be31a0> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x0000000083be3050> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"grid-nio-worker-tcp-rest-0-#36" #96 prio=5 os_prio=0 tid=0x000000001ab12800
nid=0x3f98 runnable [0x000000002910e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x0000000083bde4b8> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x0000000083bdaa28> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x0000000083bda8d8> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"nio-acceptor-#35" #95 daemon prio=5 os_prio=0 tid=0x000000001ab12000
nid=0x3524 runnable [0x0000000028e2e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x0000000083bd63d0> (a sun.nio.ch.Util$3)
        - locked <0x0000000083bd63c0> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x0000000083bd6270> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$GridNioAcceptWorker.accept(GridNioServer.java:2870)
        at
org.apache.ignite.internal.util.nio.GridNioServer$GridNioAcceptWorker.body(GridNioServer.java:2822)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"cron4j::scheduler[9143bc2244bd91995fb9294600000164d633145b499aba8d]::timer[9143bc2244bd91995fb9294600000164d633145d3aa746fa]"
#93 prio=5 os_prio=0 tid=0x000000001ab11000 nid=0x2054 waiting on condition
[0x0000000028f6f000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
        at java.lang.Thread.sleep(Native Method)
        at it.sauronsoftware.cron4j.TimerThread.safeSleep(Unknown Source)
        at it.sauronsoftware.cron4j.TimerThread.run(Unknown Source)

   Locked ownable synchronizers:
        - None

"grid-nio-worker-client-listener-3-#33" #92 prio=5 os_prio=0
tid=0x000000001ab10800 nid=0xbf0 runnable [0x0000000028d0e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000830a2720> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x000000008309ec90> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x000000008309eb40> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"grid-nio-worker-client-listener-2-#32" #91 prio=5 os_prio=0
tid=0x000000001ab0f800 nid=0x210c runnable [0x0000000028aae000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x0000000083099ee8> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x0000000083096458> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x0000000083096308> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"grid-nio-worker-client-listener-1-#31" #90 prio=5 os_prio=0
tid=0x000000001ab0f000 nid=0x2b4c runnable [0x00000000289ae000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000830916b0> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x000000008308dc20> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x000000008308dad0> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"grid-nio-worker-client-listener-0-#30" #89 prio=5 os_prio=0
tid=0x000000001ab0e000 nid=0x24d8 runnable [0x00000000287de000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x0000000083088e78> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000000830853e8> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x0000000083085298> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"nio-acceptor-#29" #88 daemon prio=5 os_prio=0 tid=0x000000001ab0d800
nid=0x3de4 runnable [0x00000000286df000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x0000000083080da0> (a sun.nio.ch.Util$3)
        - locked <0x0000000083080d90> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x0000000083080c40> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$GridNioAcceptWorker.accept(GridNioServer.java:2870)
        at
org.apache.ignite.internal.util.nio.GridNioServer$GridNioAcceptWorker.body(GridNioServer.java:2822)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"Thread-10" #87 daemon prio=5 os_prio=0 tid=0x0000000022093000 nid=0x32f0
runnable [0x000000003580e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
        at sun.nio.ch.Iocp.access$300(Iocp.java:46)
        at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
        at
sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:112)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - <0x0000000081f40588> (a
java.util.concurrent.ThreadPoolExecutor$Worker)

"Thread-9" #86 daemon prio=5 os_prio=0 tid=0x0000000022092800 nid=0x2d30
runnable [0x000000003544e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
        at sun.nio.ch.Iocp.access$300(Iocp.java:46)
        at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
        at
sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:112)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - <0x0000000081f401f8> (a
java.util.concurrent.ThreadPoolExecutor$Worker)

"Thread-8" #85 daemon prio=5 os_prio=0 tid=0x0000000022091800 nid=0x3d50
runnable [0x0000000034e8f000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
        at sun.nio.ch.Iocp.access$300(Iocp.java:46)
        at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
        at
sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:112)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - <0x0000000081f3fe68> (a
java.util.concurrent.ThreadPoolExecutor$Worker)

"Thread-7" #84 daemon prio=5 os_prio=0 tid=0x0000000022091000 nid=0x2160
runnable [0x00000000355af000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
        at sun.nio.ch.Iocp.access$300(Iocp.java:46)
        at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
        at
sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:112)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - <0x0000000081f3fad8> (a
java.util.concurrent.ThreadPoolExecutor$Worker)

"Thread-6" #83 daemon prio=5 os_prio=0 tid=0x0000000022090000 nid=0x22a0
runnable [0x000000003534f000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
        at sun.nio.ch.Iocp.access$300(Iocp.java:46)
        at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
        at
sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:112)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - <0x0000000081f3f748> (a
java.util.concurrent.ThreadPoolExecutor$Worker)

"Thread-5" #82 daemon prio=5 os_prio=0 tid=0x000000002208f800 nid=0x1068
runnable [0x000000003514e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
        at sun.nio.ch.Iocp.access$300(Iocp.java:46)
        at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
        at
sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:112)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - <0x0000000081f3f3b8> (a
java.util.concurrent.ThreadPoolExecutor$Worker)

"Thread-4" #81 daemon prio=5 os_prio=0 tid=0x000000002208e800 nid=0x3668
runnable [0x0000000034f9e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
        at sun.nio.ch.Iocp.access$300(Iocp.java:46)
        at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
        at
sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:112)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - <0x0000000081f3f028> (a
java.util.concurrent.ThreadPoolExecutor$Worker)

"Thread-3" #80 daemon prio=5 os_prio=0 tid=0x000000002208e000 nid=0x2ee8
runnable [0x0000000034d6e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
        at sun.nio.ch.Iocp.access$300(Iocp.java:46)
        at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
        at
sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:112)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - <0x0000000081f3ec48> (a
java.util.concurrent.ThreadPoolExecutor$Worker)

"Thread-2" #79 daemon prio=5 os_prio=0 tid=0x000000002208d000 nid=0x1d0c
runnable [0x0000000034c6f000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
        at sun.nio.ch.Iocp.access$300(Iocp.java:46)
        at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"tcp-comm-worker-#1" #76 daemon prio=5 os_prio=0 tid=0x000000002208c800
nid=0x3b34 waiting on condition [0x0000000027edf000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000a15653e0> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
        at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi$CommunicationWorker.body(TcpCommunicationSpi.java:4207)
        at
org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)

   Locked ownable synchronizers:
        - None

"grid-nio-worker-tcp-comm-3-#28" #72 prio=5 os_prio=0 tid=0x000000002208b800
nid=0x37ac runnable [0x0000000027c5e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000a15686e8> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000000a15686d8> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000a1568658> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"grid-nio-worker-tcp-comm-2-#27" #71 prio=5 os_prio=0 tid=0x000000002208b000
nid=0x3334 runnable [0x0000000027d8e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000a156ba08> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000000a156b9f8> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000a156b978> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"grid-nio-worker-tcp-comm-1-#26" #70 prio=5 os_prio=0 tid=0x0000000022088800
nid=0x2e70 runnable [0x0000000027aee000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000a156ed10> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000000a156ed00> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000a156ec80> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"grid-nio-worker-tcp-comm-0-#25" #69 prio=5 os_prio=0 tid=0x0000000022089800
nid=0x3f90 runnable [0x0000000026d1e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000a1572018> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000000a1572008> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000a1571f88> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"nio-acceptor-#24" #68 daemon prio=5 os_prio=0 tid=0x000000002208a000
nid=0x2fbc runnable [0x000000002795e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000a1575320> (a sun.nio.ch.Util$3)
        - locked <0x00000000a1575310> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000a1575290> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$GridNioAcceptWorker.accept(GridNioServer.java:2870)
        at
org.apache.ignite.internal.util.nio.GridNioServer$GridNioAcceptWorker.body(GridNioServer.java:2822)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"grid-timeout-worker-#23" #67 daemon prio=5 os_prio=0 tid=0x0000000022088000
nid=0x1974 in Object.wait() [0x000000002776f000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at
org.apache.ignite.internal.processors.timeout.GridTimeoutProcessor$TimeoutWorker.body(GridTimeoutProcessor.java:203)
        - locked <0x00000000a15754e8> (a java.lang.Object)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"ignite-clock" #66 daemon prio=10 os_prio=2 tid=0x0000000022087000
nid=0x2aa4 waiting on condition [0x00000000274fe000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
        at java.lang.Thread.sleep(Native Method)
        at
org.apache.ignite.internal.util.IgniteUtils$22.run(IgniteUtils.java:3308)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"jvm-pause-detector-worker" #59 daemon prio=5 os_prio=0
tid=0x0000000021dba000 nid=0x2034 waiting on condition [0x000000002656f000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
        at java.lang.Thread.sleep(Native Method)
        at
org.apache.ignite.internal.LongJVMPauseDetector$1.run(LongJVMPauseDetector.java:90)

   Locked ownable synchronizers:
        - None

"data-streamer-stripe-7-#16" #58 daemon prio=5 os_prio=0
tid=0x0000000021db9800 nid=0x2f60 waiting on condition [0x00000000262ae000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"data-streamer-stripe-6-#15" #57 daemon prio=5 os_prio=0
tid=0x0000000021db8800 nid=0x3d74 waiting on condition [0x00000000263ff000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"data-streamer-stripe-5-#14" #56 daemon prio=5 os_prio=0
tid=0x0000000021db8000 nid=0x25e8 waiting on condition [0x0000000025dfe000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"data-streamer-stripe-4-#13" #55 daemon prio=5 os_prio=0
tid=0x0000000021db7000 nid=0x3450 waiting on condition [0x000000002604e000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"data-streamer-stripe-3-#12" #54 daemon prio=5 os_prio=0
tid=0x0000000021db6800 nid=0x2b24 waiting on condition [0x000000002615e000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"data-streamer-stripe-2-#11" #53 daemon prio=5 os_prio=0
tid=0x0000000021db5800 nid=0xdd8 waiting on condition [0x0000000025f4f000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"data-streamer-stripe-1-#10" #52 daemon prio=5 os_prio=0
tid=0x0000000021db5000 nid=0xb74 waiting on condition [0x0000000025cdf000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"data-streamer-stripe-0-#9" #51 daemon prio=5 os_prio=0
tid=0x0000000021db4000 nid=0x3474 waiting on condition [0x0000000025b0e000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"sys-stripe-7-#8" #50 daemon prio=5 os_prio=0 tid=0x0000000021db3000
nid=0x6cc waiting on condition [0x00000000259df000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"sys-stripe-6-#7" #49 daemon prio=5 os_prio=0 tid=0x0000000021db2800
nid=0x169c waiting on condition [0x00000000250bf000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"sys-stripe-5-#6" #48 daemon prio=5 os_prio=0 tid=0x0000000021db1800
nid=0x183c waiting on condition [0x00000000258ce000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"sys-stripe-4-#5" #47 daemon prio=5 os_prio=0 tid=0x0000000021db1000
nid=0x214c waiting on condition [0x0000000024cce000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"sys-stripe-3-#4" #46 daemon prio=5 os_prio=0 tid=0x0000000021db0000
nid=0x870 waiting on condition [0x000000002573e000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"sys-stripe-2-#3" #45 daemon prio=5 os_prio=0 tid=0x0000000021daf800
nid=0x26ec waiting on condition [0x00000000255ef000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"sys-stripe-1-#2" #44 daemon prio=5 os_prio=0 tid=0x0000000021dae800
nid=0x1688 waiting on condition [0x000000002018f000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"sys-stripe-0-#1" #43 daemon prio=5 os_prio=0 tid=0x0000000021dae000
nid=0x38ac waiting on condition [0x000000002467f000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"Curator-Framework-0" #42 daemon prio=5 os_prio=0 tid=0x0000000021dad000
nid=0x1be8 waiting on condition [0x00000000242fe000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000a1576500> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.DelayQueue.take(DelayQueue.java:211)
        at java.util.concurrent.DelayQueue.take(DelayQueue.java:70)
        at
org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:804)
        at
org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:64)
        at
org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:267)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - <0x00000000a15768b0> (a
java.util.concurrent.ThreadPoolExecutor$Worker)

"localhost-startStop-1-EventThread" #41 daemon prio=5 os_prio=0
tid=0x0000000021dac800 nid=0x3504 waiting on condition [0x000000002454f000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000a18ba970> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)

   Locked ownable synchronizers:
        - None

"localhost-startStop-1-SendThread(srv7-ngxeko.net.billing.ru:2181)" #40
daemon prio=5 os_prio=0 tid=0x000000001b4f2800 nid=0x3e18 runnable
[0x000000002418e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000a17e7d80> (a sun.nio.ch.Util$3)
        - locked <0x00000000a17e7d70> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000a17e7cf0> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
        at
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)

   Locked ownable synchronizers:
        - None

"Curator-ConnectionStateManager-0" #39 daemon prio=5 os_prio=0
tid=0x000000001b4f1800 nid=0x3dc0 waiting on condition [0x000000001c46e000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000a170fa18> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403)
        at
org.apache.curator.framework.state.ConnectionStateManager.processEvents(ConnectionStateManager.java:245)
        at
org.apache.curator.framework.state.ConnectionStateManager.access$000(ConnectionStateManager.java:43)
        at
org.apache.curator.framework.state.ConnectionStateManager$1.call(ConnectionStateManager.java:111)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - <0x00000000a170fb40> (a
java.util.concurrent.ThreadPoolExecutor$Worker)

"I/O dispatcher 8" #38 prio=5 os_prio=0 tid=0x000000001b4f0000 nid=0x185c
runnable [0x0000000024f2e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000a1576c60> (a sun.nio.ch.Util$3)
        - locked <0x00000000a1576c50> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000a1576b80> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:257)
        at
org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:106)
        at
org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:590)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"I/O dispatcher 7" #37 prio=5 os_prio=0 tid=0x000000001b4ef800 nid=0x14f4
runnable [0x0000000024a6e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000a1712de0> (a sun.nio.ch.Util$3)
        - locked <0x00000000a1712dd0> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000a1712d50> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:257)
        at
org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:106)
        at
org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:590)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"I/O dispatcher 6" #36 prio=5 os_prio=0 tid=0x000000001b4ee800 nid=0x3604
runnable [0x0000000024dce000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000a17eb130> (a sun.nio.ch.Util$3)
        - locked <0x00000000a17eb120> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000a17eb0a0> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:257)
        at
org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:106)
        at
org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:590)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"I/O dispatcher 5" #35 prio=5 os_prio=0 tid=0x000000001b4ee000 nid=0x278c
runnable [0x000000001c66f000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000a17ee418> (a sun.nio.ch.Util$3)
        - locked <0x00000000a17ee408> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000a17ee388> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:257)
        at
org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:106)
        at
org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:590)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"I/O dispatcher 4" #34 prio=5 os_prio=0 tid=0x000000001b4ed000 nid=0x2fe0
runnable [0x0000000024b7f000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000a17f1700> (a sun.nio.ch.Util$3)
        - locked <0x00000000a17f16f0> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000a17f1670> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:257)
        at
org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:106)
        at
org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:590)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"I/O dispatcher 3" #33 prio=5 os_prio=0 tid=0x000000001b4ec800 nid=0x367c
runnable [0x000000001bdbf000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000a17f49e8> (a sun.nio.ch.Util$3)
        - locked <0x00000000a17f49d8> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000a17f4958> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:257)
        at
org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:106)
        at
org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:590)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"I/O dispatcher 2" #32 prio=5 os_prio=0 tid=0x000000001b4eb800 nid=0x3108
runnable [0x000000002494f000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000a17f7cd0> (a sun.nio.ch.Util$3)
        - locked <0x00000000a17f7cc0> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000a17f7c40> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:257)
        at
org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:106)
        at
org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:590)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"I/O dispatcher 1" #31 prio=5 os_prio=0 tid=0x000000001b4ea000 nid=0x3cf4
runnable [0x000000002479e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000a17fafb8> (a sun.nio.ch.Util$3)
        - locked <0x00000000a17fafa8> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000a17faf28> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:257)
        at
org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:106)
        at
org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:590)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"pool-4-thread-1" #30 prio=5 os_prio=0 tid=0x000000001b4e8000 nid=0x1d88
runnable [0x000000001c9df000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000a17fe2f0> (a sun.nio.ch.Util$3)
        - locked <0x00000000a17fe2e0> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000a17fe210> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor.execute(AbstractMultiworkerIOReactor.java:342)
        at
org.apache.http.impl.nio.conn.PoolingNHttpClientConnectionManager.execute(PoolingNHttpClientConnectionManager.java:194)
        at
org.apache.http.impl.nio.client.CloseableHttpAsyncClientBase$1.run(CloseableHttpAsyncClientBase.java:64)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"logback-1" #25 daemon prio=5 os_prio=0 tid=0x000000001b4e5000 nid=0x39f4
waiting on condition [0x000000001effe000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ad3b84c0> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"localhost-startStop-1" #24 daemon prio=5 os_prio=0 tid=0x000000001b4e3800
nid=0x1478 waiting on condition [0x000000001cb1c000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:177)
        at
org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:140)
        at
org.apache.ignite.internal.AsyncSupportAdapter.saveOrGet(AsyncSupportAdapter.java:112)
        at
org.apache.ignite.internal.IgniteServicesImpl.cancel(IgniteServicesImpl.java:269)
        at
com.peterservice.openapi.b2b.datamart.datagrid.impl.IgniteFsOperations.<init>(IgniteFsOperations.java:97)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)
        at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
        at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
        at
org.springframework.beans.BeanUtils.instantiateClass(BeanUtils.java:142)
        at
org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:122)
        at
org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:271)
        at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1154)
        at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1056)
        at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:513)
        at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:483)
        at
org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306)
        at
org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
        - locked <0x00000000ad3a4818> (a
java.util.concurrent.ConcurrentHashMap)
        at
org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302)
        at
org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
        at
org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:351)
        at
org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:108)
        at
org.springframework.beans.factory.support.ConstructorResolver.resolveConstructorArguments(ConstructorResolver.java:648)
        at
org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:145)
        at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1154)
        at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1056)
        at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:513)
        at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:483)
        at
org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306)
        at
org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
        - locked <0x00000000ad3a4818> (a
java.util.concurrent.ConcurrentHashMap)
        at
org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302)
        at
org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:202)
        at
org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:207)
        at
org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1136)
        at
org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1064)
        at
org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredMethodElement.inject(AutowiredAnnotationBeanPostProcessor.java:659)
        at
org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:88)
        at
org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessPropertyValues(AutowiredAnnotationBeanPostProcessor.java:366)
        at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1225)
        at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:552)
        at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:483)
        at
org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:306)
        at
org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230)
        - locked <0x00000000ad3a4818> (a
java.util.concurrent.ConcurrentHashMap)
        at
org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:302)
        at
org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:197)
        at
org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:759)
        at
org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:866)
        at
org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:542)
        - locked <0x00000000aaaac210> (a java.lang.Object)
        at
org.springframework.web.context.ContextLoader.configureAndRefreshWebApplicationContext(ContextLoader.java:444)
        at
org.springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:326)
        at
org.springframework.web.context.ContextLoaderListener.contextInitialized(ContextLoaderListener.java:107)
        at
org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:5068)
        at
org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5584)
        - locked <0x00000000aa25b5b8> (a
org.apache.catalina.core.StandardContext)
        at
org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:147)
        - locked <0x00000000aa25b5b8> (a
org.apache.catalina.core.StandardContext)
        at
org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:899)
        at
org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:875)
        at
org.apache.catalina.core.StandardHost.addChild(StandardHost.java:652)
        at
org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:1091)
        at
org.apache.catalina.startup.HostConfig$DeployWar.run(HostConfig.java:1980)
        at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - <0x00000000aa6a26e8> (a
java.util.concurrent.ThreadPoolExecutor$Worker)

"Catalina-startStop-1" #23 daemon prio=5 os_prio=0 tid=0x000000001b078800
nid=0x2d90 waiting on condition [0x000000001c8be000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000aa23c568> (a
java.util.concurrent.FutureTask)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.FutureTask.awaitDone(FutureTask.java:429)
        at java.util.concurrent.FutureTask.get(FutureTask.java:191)
        at
org.apache.catalina.startup.HostConfig.deployWARs(HostConfig.java:830)
        at
org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:493)
        at
org.apache.catalina.startup.HostConfig.start(HostConfig.java:1709)
        at
org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:335)
        at
org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:117)
        at
org.apache.catalina.util.LifecycleBase.fireLifecycleEvent(LifecycleBase.java:90)
        at
org.apache.catalina.util.LifecycleBase.setStateInternal(LifecycleBase.java:394)
        - locked <0x00000000aa021668> (a
org.apache.catalina.core.StandardHost)
        at
org.apache.catalina.util.LifecycleBase.setState(LifecycleBase.java:339)
        - locked <0x00000000aa021668> (a
org.apache.catalina.core.StandardHost)
        at
org.apache.catalina.core.ContainerBase.startInternal(ContainerBase.java:1137)
        - locked <0x00000000aa021668> (a
org.apache.catalina.core.StandardHost)
        at
org.apache.catalina.core.StandardHost.startInternal(StandardHost.java:819)
        - locked <0x00000000aa021668> (a
org.apache.catalina.core.StandardHost)
        at
org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:147)
        - locked <0x00000000aa021668> (a
org.apache.catalina.core.StandardHost)
        at
org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1572)
        at
org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1562)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - <0x00000000aa2d2250> (a
java.util.concurrent.ThreadPoolExecutor$Worker)

"RMI RenewClean-[172.21.98.254:29005]" #21 daemon prio=5 os_prio=0
tid=0x000000001b1b9000 nid=0x9a4 in Object.wait() [0x000000001c56e000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000000aa66a7b8> (a
java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
        - locked <0x00000000aa66a7b8> (a java.lang.ref.ReferenceQueue$Lock)
        at
sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:563)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"RMI Scheduler(0)" #20 daemon prio=5 os_prio=0 tid=0x000000001b03e800
nid=0x1c90 waiting on condition [0x000000001a5ee000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000a9ad7340> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"RMI Reaper" #18 prio=5 os_prio=0 tid=0x000000001aead800 nid=0x700 in
Object.wait() [0x000000001c15f000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000000a9ad61a0> (a
java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
        - locked <0x00000000a9ad61a0> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
        at sun.rmi.transport.ObjectTable$Reaper.run(ObjectTable.java:351)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"RMI TCP Accept-29005" #17 daemon prio=5 os_prio=0 tid=0x000000001aeac800
nid=0x340c runnable [0x000000001bece000]
   java.lang.Thread.State: RUNNABLE
        at java.net.DualStackPlainSocketImpl.accept0(Native Method)
        at
java.net.DualStackPlainSocketImpl.socketAccept(DualStackPlainSocketImpl.java:131)
        at
java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
        at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:199)
        - locked <0x00000000aa1e53b0> (a java.net.SocksSocketImpl)
        at java.net.ServerSocket.implAccept(ServerSocket.java:545)
        at java.net.ServerSocket.accept(ServerSocket.java:513)
        at
sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:400)
        at
sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:372)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"RMI TCP Accept-29004" #16 daemon prio=5 os_prio=0 tid=0x000000001b2be800
nid=0x1fac runnable [0x000000001950e000]
   java.lang.Thread.State: RUNNABLE
        at java.net.DualStackPlainSocketImpl.accept0(Native Method)
        at
java.net.DualStackPlainSocketImpl.socketAccept(DualStackPlainSocketImpl.java:131)
        at
java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
        at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:199)
        - locked <0x00000000aa1e3410> (a java.net.SocksSocketImpl)
        at java.net.ServerSocket.implAccept(ServerSocket.java:545)
        at java.net.ServerSocket.accept(ServerSocket.java:513)
        at
sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:400)
        at
sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:372)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"GC Daemon" #15 daemon prio=2 os_prio=-2 tid=0x000000001aef7000 nid=0x329c
in Object.wait() [0x0000000018fcf000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000000aa08bef8> (a sun.misc.GC$LatencyLock)
        at sun.misc.GC$Daemon.run(GC.java:117)
        - locked <0x00000000aa08bef8> (a sun.misc.GC$LatencyLock)

   Locked ownable synchronizers:
        - None

"RMI TCP Accept-0" #14 daemon prio=5 os_prio=0 tid=0x0000000019a1d800
nid=0x3d1c runnable [0x000000001a4be000]
   java.lang.Thread.State: RUNNABLE
        at java.net.DualStackPlainSocketImpl.accept0(Native Method)
        at
java.net.DualStackPlainSocketImpl.socketAccept(DualStackPlainSocketImpl.java:131)
        at
java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
        at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:199)
        - locked <0x00000000a9b0c148> (a java.net.SocksSocketImpl)
        at java.net.ServerSocket.implAccept(ServerSocket.java:545)
        at java.net.ServerSocket.accept(ServerSocket.java:513)
        at
sun.management.jmxremote.LocalRMIServerSocketFactory$1.accept(LocalRMIServerSocketFactory.java:52)
        at
sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:400)
        at
sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:372)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"Service Thread" #12 daemon prio=9 os_prio=0 tid=0x00000000180ef000
nid=0x3cdc runnable [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
        - None

"C1 CompilerThread3" #11 daemon prio=9 os_prio=2 tid=0x00000000180ee800
nid=0x838 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
        - None

"C2 CompilerThread2" #10 daemon prio=9 os_prio=2 tid=0x00000000180ea000
nid=0x3728 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
        - None

"C2 CompilerThread1" #9 daemon prio=9 os_prio=2 tid=0x00000000195bf000
nid=0x3950 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
        - None

"C2 CompilerThread0" #8 daemon prio=9 os_prio=2 tid=0x0000000019698800
nid=0x1bc4 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
        - None

"Attach Listener" #6 daemon prio=5 os_prio=2 tid=0x0000000017ff4000
nid=0x3e5c waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
        - None

"Signal Dispatcher" #5 daemon prio=9 os_prio=2 tid=0x0000000017feb000
nid=0x1c44 runnable [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
        - None

"Surrogate Locker Thread (Concurrent GC)" #4 daemon prio=9 os_prio=0
tid=0x0000000017fe9800 nid=0x1cd4 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
        - None

"Finalizer" #3 daemon prio=8 os_prio=1 tid=0x0000000017fc8800 nid=0x2264 in
Object.wait() [0x0000000018c1f000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
        - locked <0x00000000a9997fc8> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
        at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)

   Locked ownable synchronizers:
        - None

"Reference Handler" #2 daemon prio=10 os_prio=2 tid=0x0000000017f81000
nid=0x3fb4 in Object.wait() [0x00000000189ff000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java:502)
        at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
        - locked <0x00000000a9996568> (a java.lang.ref.Reference$Lock)
        at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)

   Locked ownable synchronizers:
        - None

"main" #1 prio=5 os_prio=0 tid=0x000000000226c800 nid=0x2094 waiting on
condition [0x00000000026ae000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000aa23c608> (a
java.util.concurrent.FutureTask)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.FutureTask.awaitDone(FutureTask.java:429)
        at java.util.concurrent.FutureTask.get(FutureTask.java:191)
        at
org.apache.catalina.core.ContainerBase.startInternal(ContainerBase.java:1120)
        - locked <0x00000000a9fe3720> (a
org.apache.catalina.core.StandardEngine)
        at
org.apache.catalina.core.StandardEngine.startInternal(StandardEngine.java:300)
        - locked <0x00000000a9fe3720> (a
org.apache.catalina.core.StandardEngine)
        at
org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:147)
        - locked <0x00000000a9fe3720> (a
org.apache.catalina.core.StandardEngine)
        at
org.apache.catalina.core.StandardService.startInternal(StandardService.java:444)
        - locked <0x00000000a9fe3720> (a
org.apache.catalina.core.StandardEngine)
        at
org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:147)
        - locked <0x00000000a9f2f330> (a
org.apache.catalina.core.StandardService)
        at
org.apache.catalina.core.StandardServer.startInternal(StandardServer.java:738)
        - locked <0x00000000a9e043d0> (a java.lang.Object)
        at
org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:147)
        - locked <0x00000000a9e026a0> (a
org.apache.catalina.core.StandardServer)
        at org.apache.catalina.startup.Catalina.start(Catalina.java:693)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:294)
        at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:428)

   Locked ownable synchronizers:
        - None

"VM Thread" os_prio=2 tid=0x0000000017f75800 nid=0x2e04 runnable 

"Gang worker#0 (Parallel GC Threads)" os_prio=2 tid=0x000000000227d800
nid=0x2b00 runnable 

"Gang worker#1 (Parallel GC Threads)" os_prio=2 tid=0x000000000227e000
nid=0x39d0 runnable 

"Gang worker#2 (Parallel GC Threads)" os_prio=2 tid=0x0000000002280000
nid=0x2c08 runnable 

"Gang worker#3 (Parallel GC Threads)" os_prio=2 tid=0x0000000002282800
nid=0x1e8 runnable 

"Gang worker#4 (Parallel GC Threads)" os_prio=2 tid=0x0000000002285800
nid=0x3a5c runnable 

"Gang worker#5 (Parallel GC Threads)" os_prio=2 tid=0x0000000002287000
nid=0x37c4 runnable 

"Gang worker#6 (Parallel GC Threads)" os_prio=2 tid=0x0000000002288000
nid=0x15f8 runnable 

"Gang worker#7 (Parallel GC Threads)" os_prio=2 tid=0x0000000002289000
nid=0x1b84 runnable 

"Concurrent Mark-Sweep GC Thread" os_prio=2 tid=0x00000000022fe000
nid=0x3d20 runnable 

"Gang worker#0 (Parallel CMS Threads)" os_prio=2 tid=0x00000000022f7000
nid=0x2cf8 runnable 

"Gang worker#1 (Parallel CMS Threads)" os_prio=2 tid=0x00000000022fa800
nid=0x3afc runnable 

"VM Periodic Task Thread" os_prio=2 tid=0x00000000199b6800 nid=0x3138
waiting on condition 

JNI global references: 447









thred dump for worked node :


2018-07-26 13:52:22
Full thread dump Java HotSpot(TM) 64-Bit Server VM (25.152-b16 mixed mode):

"sys-#99" #324 daemon prio=5 os_prio=0 tid=0x0000000020e32000 nid=0x23f4
waiting on condition [0x000000004e1fe000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ab5672e8> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"sys-#98" #323 daemon prio=5 os_prio=0 tid=0x000000001d521800 nid=0x2c20
waiting on condition [0x000000002731e000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ab5672e8> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"sys-#97" #321 daemon prio=5 os_prio=0 tid=0x0000000020e38000 nid=0x3b10
waiting on condition [0x000000004dc0e000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ab5672e8> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"sys-#96" #320 daemon prio=5 os_prio=0 tid=0x000000001d086800 nid=0x35f8
waiting on condition [0x000000001ca6e000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ab5672e8> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"sys-#95" #319 daemon prio=5 os_prio=0 tid=0x0000000020e36800 nid=0x33b4
waiting on condition [0x000000001c07f000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ab5672e8> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"sys-#94" #318 daemon prio=5 os_prio=0 tid=0x0000000020e37800 nid=0x26d0
waiting on condition [0x000000001c57e000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ab5672e8> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"RMI TCP Connection(6)-172.21.98.254" #294 daemon prio=5 os_prio=0
tid=0x000000001d087800 nid=0x2e8c in Object.wait() [0x000000004fa3c000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at
com.sun.jmx.remote.internal.ArrayNotificationBuffer.fetchNotifications(ArrayNotificationBuffer.java:449)
        - locked <0x00000000a578bfa8> (a
com.sun.jmx.remote.internal.ArrayNotificationBuffer)
        at
com.sun.jmx.remote.internal.ArrayNotificationBuffer$ShareBuffer.fetchNotifications(ArrayNotificationBuffer.java:227)
        at
com.sun.jmx.remote.internal.ServerNotifForwarder.fetchNotifs(ServerNotifForwarder.java:274)
        at
javax.management.remote.rmi.RMIConnectionImpl$4.run(RMIConnectionImpl.java:1270)
        at
javax.management.remote.rmi.RMIConnectionImpl$4.run(RMIConnectionImpl.java:1268)
        at
javax.management.remote.rmi.RMIConnectionImpl.fetchNotifications(RMIConnectionImpl.java:1274)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at
sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:357)
        at sun.rmi.transport.Transport$1.run(Transport.java:200)
        at sun.rmi.transport.Transport$1.run(Transport.java:197)
        at java.security.AccessController.doPrivileged(Native Method)
        at sun.rmi.transport.Transport.serviceCall(Transport.java:196)
        at
sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:568)
        at
sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:826)
        at
sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$0(TCPTransport.java:683)
        at
sun.rmi.transport.tcp.TCPTransport$ConnectionHandler$$Lambda$6/918386799.run(Unknown
Source)
        at java.security.AccessController.doPrivileged(Native Method)
        at
sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:682)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - <0x00000000a578c460> (a
java.util.concurrent.ThreadPoolExecutor$Worker)

"RMI TCP Connection(7)-172.21.98.254" #292 daemon prio=5 os_prio=0
tid=0x000000001d085000 nid=0x1308 runnable [0x0000000112fae000]
   java.lang.Thread.State: RUNNABLE
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:171)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
        - locked <0x00000000a5750430> (a java.io.BufferedInputStream)
        at java.io.FilterInputStream.read(FilterInputStream.java:83)
        at
sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:550)
        at
sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:826)
        at
sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$0(TCPTransport.java:683)
        at
sun.rmi.transport.tcp.TCPTransport$ConnectionHandler$$Lambda$6/918386799.run(Unknown
Source)
        at java.security.AccessController.doPrivileged(Native Method)
        at
sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:682)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - <0x00000000a57505f0> (a
java.util.concurrent.ThreadPoolExecutor$Worker)

"JMX server connection timeout 291" #291 daemon prio=5 os_prio=0
tid=0x000000001d084800 nid=0x3c3c in Object.wait() [0x0000000111b6f000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at
com.sun.jmx.remote.internal.ServerCommunicatorAdmin$Timeout.run(ServerCommunicatorAdmin.java:168)
        - locked <0x00000000a57cbd30> (a [I)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"http-bio-18080-exec-4" #285 daemon prio=5 os_prio=0 tid=0x000000001d083000
nid=0x2d98 waiting on condition [0x000000002773e000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000afdbbbf8> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:104)
        at org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:32)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"http-bio-18080-exec-3" #277 daemon prio=5 os_prio=0 tid=0x000000001d082000
nid=0x1dcc waiting on condition [0x00000000359fe000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000afdbbbf8> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:104)
        at org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:32)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"http-bio-18080-exec-2" #276 daemon prio=5 os_prio=0 tid=0x0000000020e34800
nid=0x31c8 waiting on condition [0x000000002720e000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000afdbbbf8> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:104)
        at org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:32)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"http-bio-18080-exec-1" #275 daemon prio=5 os_prio=0 tid=0x0000000020e35000
nid=0xa68 waiting on condition [0x00000000274ce000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000afdbbbf8> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:104)
        at org.apache.tomcat.util.threads.TaskQueue.take(TaskQueue.java:32)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"tcp-disco-sock-reader-#6" #270 daemon prio=10 os_prio=2
tid=0x000000001d522800 nid=0x2ee4 runnable [0x0000000026fce000]
   java.lang.Thread.State: RUNNABLE
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:171)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
        at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
        - locked <0x00000000af465708> (a java.io.BufferedInputStream)
        at
org.apache.ignite.marshaller.jdk.JdkMarshallerInputStreamWrapper.read(JdkMarshallerInputStreamWrapper.java:53)
        at
java.io.ObjectInputStream$PeekInputStream.read(ObjectInputStream.java:2657)
        at
java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2673)
        at
java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:3150)
        at
java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:859)
        at java.io.ObjectInputStream.<init>(ObjectInputStream.java:355)
        at
org.apache.ignite.marshaller.jdk.JdkMarshallerObjectInputStream.<init>(JdkMarshallerObjectInputStream.java:43)
        at
org.apache.ignite.marshaller.jdk.JdkMarshaller.unmarshal0(JdkMarshaller.java:137)
        at
org.apache.ignite.marshaller.AbstractNodeNameAwareMarshaller.unmarshal(AbstractNodeNameAwareMarshaller.java:94)
        at
org.apache.ignite.internal.util.IgniteUtils.unmarshal(IgniteUtils.java:9907)
        at
org.apache.ignite.spi.discovery.tcp.ServerImpl$SocketReader.body(ServerImpl.java:5981)
        at
org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)

   Locked ownable synchronizers:
        - None

"logback-2" #266 daemon prio=5 os_prio=0 tid=0x000000001d07d000 nid=0x3300
waiting on condition [0x00000001125af000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ae0d8870> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"ajp-bio-18009-AsyncTimeout" #264 daemon prio=5 os_prio=0
tid=0x000000001d07c000 nid=0x25b8 waiting on condition [0x00000001123af000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
        at java.lang.Thread.sleep(Native Method)
        at
org.apache.tomcat.util.net.JIoEndpoint$AsyncTimeout.run(JIoEndpoint.java:152)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"ajp-bio-18009-Acceptor-0" #263 daemon prio=5 os_prio=0
tid=0x0000000021a07800 nid=0x2310 runnable [0x0000000111fde000]
   java.lang.Thread.State: RUNNABLE
        at java.net.DualStackPlainSocketImpl.accept0(Native Method)
        at
java.net.DualStackPlainSocketImpl.socketAccept(DualStackPlainSocketImpl.java:131)
        at
java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
        at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:199)
        - locked <0x00000000aa1b4440> (a java.net.SocksSocketImpl)
        at java.net.ServerSocket.implAccept(ServerSocket.java:545)
        at java.net.ServerSocket.accept(ServerSocket.java:513)
        at
org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(DefaultServerSocketFactory.java:60)
        at
org.apache.tomcat.util.net.JIoEndpoint$Acceptor.run(JIoEndpoint.java:222)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"http-bio-18080-AsyncTimeout" #262 daemon prio=5 os_prio=0
tid=0x0000000021a06800 nid=0x2a98 waiting on condition [0x000000011216f000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
        at java.lang.Thread.sleep(Native Method)
        at
org.apache.tomcat.util.net.JIoEndpoint$AsyncTimeout.run(JIoEndpoint.java:152)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"http-bio-18080-Acceptor-0" #261 daemon prio=5 os_prio=0
tid=0x0000000021a06000 nid=0x2458 runnable [0x0000000111a6e000]
   java.lang.Thread.State: RUNNABLE
        at java.net.DualStackPlainSocketImpl.accept0(Native Method)
        at
java.net.DualStackPlainSocketImpl.socketAccept(DualStackPlainSocketImpl.java:131)
        at
java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
        at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:199)
        - locked <0x00000000aa1afe90> (a java.net.SocksSocketImpl)
        at java.net.ServerSocket.implAccept(ServerSocket.java:545)
        at java.net.ServerSocket.accept(ServerSocket.java:513)
        at
org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(DefaultServerSocketFactory.java:60)
        at
org.apache.tomcat.util.net.JIoEndpoint$Acceptor.run(JIoEndpoint.java:222)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"ContainerBackgroundProcessor[StandardEngine[Catalina]]" #260 daemon prio=5
os_prio=0 tid=0x0000000021a05000 nid=0xf14 waiting on condition
[0x000000004f4ce000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
        at java.lang.Thread.sleep(Native Method)
        at
org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1510)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"javamelody manager" #259 daemon prio=5 os_prio=0 tid=0x0000000021a04800
nid=0x558 in Object.wait() [0x0000000111e9f000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at java.util.TimerThread.mainLoop(Timer.java:552)
        - locked <0x00000000afcecae0> (a java.util.TaskQueue)
        at java.util.TimerThread.run(Timer.java:505)

   Locked ownable synchronizers:
        - None

"javamelody host-manager" #258 daemon prio=5 os_prio=0
tid=0x00000000213aa000 nid=0x2260 in Object.wait() [0x000000004eace000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at java.util.TimerThread.mainLoop(Timer.java:552)
        - locked <0x00000000afcd3978> (a java.util.TaskQueue)
        at java.util.TimerThread.run(Timer.java:505)

   Locked ownable synchronizers:
        - None

"javamelody examples" #257 daemon prio=5 os_prio=0 tid=0x000000001b2be000
nid=0x2f0c in Object.wait() [0x000000011196f000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at java.util.TimerThread.mainLoop(Timer.java:552)
        - locked <0x00000000af6f4df0> (a java.util.TaskQueue)
        at java.util.TimerThread.run(Timer.java:505)

   Locked ownable synchronizers:
        - None

"javamelody docs" #256 daemon prio=5 os_prio=0 tid=0x000000001d521000
nid=0x3cb0 in Object.wait() [0x000000011185f000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at java.util.TimerThread.mainLoop(Timer.java:552)
        - locked <0x00000000afb7ef00> (a java.util.TaskQueue)
        at java.util.TimerThread.run(Timer.java:505)

   Locked ownable synchronizers:
        - None

"javamelody b2b-datamart-loader-8.6.0" #250 daemon prio=5 os_prio=0
tid=0x000000001b2bc000 nid=0x3a54 in Object.wait() [0x0000000076bee000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at java.util.TimerThread.mainLoop(Timer.java:552)
        - locked <0x00000000acd3fa08> (a java.util.TaskQueue)
        at java.util.TimerThread.run(Timer.java:505)

   Locked ownable synchronizers:
        - None

"pool-41-thread-1" #249 prio=5 os_prio=0 tid=0x000000001b2bb000 nid=0x1f24
waiting on condition [0x00000001107af000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000acd5c448> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"pool-39-thread-3" #248 prio=5 os_prio=0 tid=0x000000001b2ba800 nid=0x21a0
waiting on condition [0x000000011043f000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000acd3abd8> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"metrics.messages.payments_doc_add.pool-22" #247 prio=5 os_prio=0
tid=0x000000001b2b9800 nid=0x38e8 waiting on condition [0x00000001102bf000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac7ca0c0> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"elastic-evictor-21" #246 daemon prio=5 os_prio=0 tid=0x000000001b2b9000
nid=0x25ec waiting on condition [0x000000011017f000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac7cd330> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"pool-39-thread-2" #245 prio=5 os_prio=0 tid=0x000000001b2b8000 nid=0x1de0
waiting on condition [0x0000000076aee000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000acd3fa38> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"AMQP Connection 172.30.176.163:5672" #244 prio=5 os_prio=0
tid=0x000000001de49800 nid=0x32d8 runnable [0x000000007699e000]
   java.lang.Thread.State: RUNNABLE
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:171)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
        - locked <0x00000000ac75b290> (a java.io.BufferedInputStream)
        at
java.io.DataInputStream.readUnsignedByte(DataInputStream.java:288)
        at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:91)
        at
com.rabbitmq.client.impl.SocketFrameHandler.readFrame(SocketFrameHandler.java:164)
        - locked <0x00000000ac700580> (a java.io.DataInputStream)
        at
com.rabbitmq.client.impl.AMQConnection$MainLoop.run(AMQConnection.java:571)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"pool-37-thread-3" #243 prio=5 os_prio=0 tid=0x000000001de49000 nid=0x180c
waiting on condition [0x000000007679f000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac78a248> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"metrics.messages.adjustment_rollback.pool-20" #242 prio=5 os_prio=0
tid=0x000000001de48000 nid=0x3b58 waiting on condition [0x000000007659e000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000acd3fa68> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"elastic-evictor-19" #241 daemon prio=5 os_prio=0 tid=0x000000001de47800
nid=0x364 waiting on condition [0x000000007631f000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000acd3fa98> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"pool-37-thread-2" #240 prio=5 os_prio=0 tid=0x000000001de46800 nid=0x3794
waiting on condition [0x000000004e04f000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac78a290> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"AMQP Connection 172.30.176.163:5672" #239 prio=5 os_prio=0
tid=0x000000001de46000 nid=0x17f0 runnable [0x000000007648e000]
   java.lang.Thread.State: RUNNABLE
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:171)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
        - locked <0x00000000acd35400> (a java.io.BufferedInputStream)
        at
java.io.DataInputStream.readUnsignedByte(DataInputStream.java:288)
        at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:91)
        at
com.rabbitmq.client.impl.SocketFrameHandler.readFrame(SocketFrameHandler.java:164)
        - locked <0x00000000ac76bc40> (a java.io.DataInputStream)
        at
com.rabbitmq.client.impl.AMQConnection$MainLoop.run(AMQConnection.java:571)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"pool-35-thread-3" #238 prio=5 os_prio=0 tid=0x000000001de45000 nid=0x384c
waiting on condition [0x000000007225e000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac78a2c0> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"metrics.messages.adjustment_add.pool-18" #237 prio=5 os_prio=0
tid=0x000000001de44800 nid=0x910 waiting on condition [0x0000000071e0e000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac78a308> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"elastic-evictor-17" #236 daemon prio=5 os_prio=0 tid=0x000000001de43800
nid=0x31c4 waiting on condition [0x0000000071cde000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000acd3fae0> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"pool-35-thread-2" #235 prio=5 os_prio=0 tid=0x000000001de43000 nid=0x4ac
waiting on condition [0x0000000071b2e000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac78a338> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"AMQP Connection 172.30.176.163:5672" #234 prio=5 os_prio=0
tid=0x000000001f057000 nid=0x1770 runnable [0x000000007186f000]
   java.lang.Thread.State: RUNNABLE
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:171)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
        - locked <0x00000000acd35450> (a java.io.BufferedInputStream)
        at
java.io.DataInputStream.readUnsignedByte(DataInputStream.java:288)
        at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:91)
        at
com.rabbitmq.client.impl.SocketFrameHandler.readFrame(SocketFrameHandler.java:164)
        - locked <0x00000000ac76bcc0> (a java.io.DataInputStream)
        at
com.rabbitmq.client.impl.AMQConnection$MainLoop.run(AMQConnection.java:571)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"pool-33-thread-3" #233 prio=5 os_prio=0 tid=0x000000001f056000 nid=0x1f20
waiting on condition [0x00000000719de000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac78a368> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"metrics.messages.receipt_annul.pool-16" #232 prio=5 os_prio=0
tid=0x000000001f055800 nid=0x13d8 waiting on condition [0x0000000070ffe000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac5c7338> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"elastic-evictor-15" #231 daemon prio=5 os_prio=0 tid=0x000000001f054800
nid=0x3af8 waiting on condition [0x000000007176f000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac78a3b0> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"pool-33-thread-2" #230 prio=5 os_prio=0 tid=0x000000001f054000 nid=0x31d0
waiting on condition [0x00000000715ce000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000acd3fb28> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"AMQP Connection 172.30.176.163:5672" #229 prio=5 os_prio=0
tid=0x000000001f053000 nid=0x107c runnable [0x000000007141f000]
   java.lang.Thread.State: RUNNABLE
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:171)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
        - locked <0x00000000ac72c978> (a java.io.BufferedInputStream)
        at
java.io.DataInputStream.readUnsignedByte(DataInputStream.java:288)
        at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:91)
        at
com.rabbitmq.client.impl.SocketFrameHandler.readFrame(SocketFrameHandler.java:164)
        - locked <0x00000000acd6c1b8> (a java.io.DataInputStream)
        at
com.rabbitmq.client.impl.AMQConnection$MainLoop.run(AMQConnection.java:571)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"pool-31-thread-3" #228 prio=5 os_prio=0 tid=0x000000001f052800 nid=0x1af4
waiting on condition [0x000000007131e000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000acd3fb58> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"metrics.messages.receipt_add.pool-14" #227 prio=5 os_prio=0
tid=0x000000001f051800 nid=0x2e2c waiting on condition [0x000000004fe5e000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac5c72d8> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"elastic-evictor-13" #226 daemon prio=5 os_prio=0 tid=0x000000001f051000
nid=0x3fa8 waiting on condition [0x000000007112f000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000acd3fba0> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"pool-31-thread-2" #225 prio=5 os_prio=0 tid=0x000000001f050000 nid=0x15a8
waiting on condition [0x0000000070eef000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac5c7308> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"AMQP Connection 172.30.176.163:5672" #224 prio=5 os_prio=0
tid=0x0000000020018800 nid=0x3cd4 runnable [0x0000000070dae000]
   java.lang.Thread.State: RUNNABLE
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:171)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
        - locked <0x00000000ac75b1f0> (a java.io.BufferedInputStream)
        at
java.io.DataInputStream.readUnsignedByte(DataInputStream.java:288)
        at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:91)
        at
com.rabbitmq.client.impl.SocketFrameHandler.readFrame(SocketFrameHandler.java:164)
        - locked <0x00000000ac7004e0> (a java.io.DataInputStream)
        at
com.rabbitmq.client.impl.AMQConnection$MainLoop.run(AMQConnection.java:571)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"pool-29-thread-3" #223 prio=5 os_prio=0 tid=0x0000000020018000 nid=0x30dc
waiting on condition [0x000000007051f000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000acd3fbd0> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"metrics.messages.subscriber_change_owner.pool-12" #222 prio=5 os_prio=0
tid=0x0000000020017000 nid=0x39ec waiting on condition [0x0000000070bee000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac5c72c0> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"elastic-evictor-11" #221 daemon prio=5 os_prio=0 tid=0x0000000020016800
nid=0x1c78 waiting on condition [0x0000000070a7e000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac78a3f8> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"pool-29-thread-2" #220 prio=5 os_prio=0 tid=0x0000000020015800 nid=0x1c58
waiting on condition [0x00000000708ee000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac5c7260> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"AMQP Connection 172.30.176.163:5672" #219 prio=5 os_prio=0
tid=0x0000000020015000 nid=0x39dc runnable [0x000000007076f000]
   java.lang.Thread.State: RUNNABLE
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:171)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
        - locked <0x00000000acd35838> (a java.io.BufferedInputStream)
        at
java.io.DataInputStream.readUnsignedByte(DataInputStream.java:288)
        at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:91)
        at
com.rabbitmq.client.impl.SocketFrameHandler.readFrame(SocketFrameHandler.java:164)
        - locked <0x00000000aafd3e80> (a java.io.DataInputStream)
        at
com.rabbitmq.client.impl.AMQConnection$MainLoop.run(AMQConnection.java:571)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"pool-27-thread-3" #218 prio=5 os_prio=0 tid=0x0000000020014000 nid=0x3418
waiting on condition [0x000000007064f000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac5c7200> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"metrics.messages.phone_number_change.pool-10" #217 prio=5 os_prio=0
tid=0x0000000020013800 nid=0x2590 waiting on condition [0x00000000703ef000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac78a428> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"elastic-evictor-9" #216 daemon prio=5 os_prio=0 tid=0x0000000020012800
nid=0x3f88 waiting on condition [0x000000007025f000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac5c71b8> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"pool-27-thread-2" #215 prio=5 os_prio=0 tid=0x0000000020012000 nid=0x13dc
waiting on condition [0x000000006fccf000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac78a458> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"AMQP Connection 172.30.176.163:5672" #214 prio=5 os_prio=0
tid=0x000000001fc8b000 nid=0x352c runnable [0x000000007008e000]
   java.lang.Thread.State: RUNNABLE
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:171)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
        - locked <0x00000000ac75b240> (a java.io.BufferedInputStream)
        at
java.io.DataInputStream.readUnsignedByte(DataInputStream.java:288)
        at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:91)
        at
com.rabbitmq.client.impl.SocketFrameHandler.readFrame(SocketFrameHandler.java:164)
        - locked <0x00000000ac7003e0> (a java.io.DataInputStream)
        at
com.rabbitmq.client.impl.AMQConnection$MainLoop.run(AMQConnection.java:571)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"pool-25-thread-3" #213 prio=5 os_prio=0 tid=0x000000001fc8a800 nid=0x1a5c
waiting on condition [0x000000006ff1f000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac5c7170> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"metrics.messages.payments_rollback.pool-8" #212 prio=5 os_prio=0
tid=0x000000001fc89800 nid=0x363c waiting on condition [0x000000006fddf000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac7cd360> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"elastic-evictor-7" #211 daemon prio=5 os_prio=0 tid=0x000000001fc89000
nid=0x1f44 waiting on condition [0x000000006fb4e000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac5c7050> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"pool-25-thread-2" #210 prio=5 os_prio=0 tid=0x000000001fc88000 nid=0x1660
waiting on condition [0x000000004f34e000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac7cd390> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"AMQP Connection 172.30.176.163:5672" #209 prio=5 os_prio=0
tid=0x000000001fc87800 nid=0x33e0 runnable [0x000000004de4f000]
   java.lang.Thread.State: RUNNABLE
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:171)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
        - locked <0x00000000aaf29040> (a java.io.BufferedInputStream)
        at
java.io.DataInputStream.readUnsignedByte(DataInputStream.java:288)
        at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:91)
        at
com.rabbitmq.client.impl.SocketFrameHandler.readFrame(SocketFrameHandler.java:164)
        - locked <0x00000000ac7bc730> (a java.io.DataInputStream)
        at
com.rabbitmq.client.impl.AMQConnection$MainLoop.run(AMQConnection.java:571)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"pool-22-thread-3" #208 prio=5 os_prio=0 tid=0x000000001fc86800 nid=0x2bf8
waiting on condition [0x000000006f9cf000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac78a5d8> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"metrics.messages.payments.ps-bisrt_addon-payment-1.pool-6" #207 prio=5
os_prio=0 tid=0x000000001fc86000 nid=0x3658 waiting on condition
[0x000000006f84f000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac7cd3c0> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"elastic-evictor-5" #206 daemon prio=5 os_prio=0 tid=0x000000001fc85000
nid=0x3880 waiting on condition [0x000000006f6df000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac7cd2a0> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"pool-22-thread-2" #205 prio=5 os_prio=0 tid=0x000000001fc84800 nid=0x1b7c
waiting on condition [0x000000006f58f000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac7cd2d0> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"AMQP Connection 172.30.176.163:5672" #204 prio=5 os_prio=0
tid=0x0000000020e83000 nid=0x1610 runnable [0x000000006f3ae000]
   java.lang.Thread.State: RUNNABLE
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:171)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
        - locked <0x00000000aaa49e18> (a java.io.BufferedInputStream)
        at
java.io.DataInputStream.readUnsignedByte(DataInputStream.java:288)
        at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:91)
        at
com.rabbitmq.client.impl.SocketFrameHandler.readFrame(SocketFrameHandler.java:164)
        - locked <0x00000000ac75ebb8> (a java.io.DataInputStream)
        at
com.rabbitmq.client.impl.AMQConnection$MainLoop.run(AMQConnection.java:571)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"pool-20-thread-3" #203 prio=5 os_prio=0 tid=0x0000000020e82000 nid=0x2d60
waiting on condition [0x000000006f1ee000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000acd5c490> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"metrics.messages.subscriber_activations.pool-4" #202 prio=5 os_prio=0
tid=0x0000000020e81800 nid=0x3704 waiting on condition [0x000000004f5ee000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000acd5c3b8> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"elastic-evictor-3" #201 daemon prio=5 os_prio=0 tid=0x0000000020e80800
nid=0x2888 waiting on condition [0x000000006f0ce000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac7cd318> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"pool-20-thread-2" #200 prio=5 os_prio=0 tid=0x0000000020e80000 nid=0x219c
waiting on condition [0x000000006eefe000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000acd5c3e8> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"AMQP Connection 172.30.176.163:5672" #199 prio=5 os_prio=0
tid=0x00000000213a8800 nid=0x1fd4 runnable [0x000000006edef000]
   java.lang.Thread.State: RUNNABLE
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:171)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
        - locked <0x00000000aaa49e68> (a java.io.BufferedInputStream)
        at
java.io.DataInputStream.readUnsignedByte(DataInputStream.java:288)
        at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:91)
        at
com.rabbitmq.client.impl.SocketFrameHandler.readFrame(SocketFrameHandler.java:164)
        - locked <0x00000000ac75eab8> (a java.io.DataInputStream)
        at
com.rabbitmq.client.impl.AMQConnection$MainLoop.run(AMQConnection.java:571)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"pool-18-thread-2" #198 prio=5 os_prio=0 tid=0x0000000020e7f000 nid=0x31d4
waiting on condition [0x000000005079f000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac78a788> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"AMQP Connection 172.30.176.163:5672" #197 prio=5 os_prio=0
tid=0x0000000020e7e800 nid=0x245c runnable [0x000000005062f000]
   java.lang.Thread.State: RUNNABLE
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:171)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
        - locked <0x00000000aaf29090> (a java.io.BufferedInputStream)
        at
java.io.DataInputStream.readUnsignedByte(DataInputStream.java:288)
        at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:91)
        at
com.rabbitmq.client.impl.SocketFrameHandler.readFrame(SocketFrameHandler.java:164)
        - locked <0x00000000ac7bc5f0> (a java.io.DataInputStream)
        at
com.rabbitmq.client.impl.AMQConnection$MainLoop.run(AMQConnection.java:571)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"pool-15-thread-3" #196 prio=5 os_prio=0 tid=0x0000000020e7d800 nid=0x33dc
waiting on condition [0x000000005043f000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac7cd210> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"metrics.messages.chargesrpc.pool-2" #195 prio=5 os_prio=0
tid=0x0000000020e7d000 nid=0x34dc waiting on condition [0x000000005027e000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac7cd258> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"elastic-evictor-1" #194 daemon prio=5 os_prio=0 tid=0x0000000020e7c000
nid=0x26bc waiting on condition [0x000000005014f000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000acd5c430> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"pool-15-thread-2" #193 prio=5 os_prio=0 tid=0x000000001d526000 nid=0x37f0
waiting on condition [0x000000004ff6e000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ac7cd168> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"AMQP Connection 172.30.176.163:5672" #192 prio=5 os_prio=0
tid=0x000000001d525800 nid=0x67c runnable [0x000000004fd5e000]
   java.lang.Thread.State: RUNNABLE
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:171)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
        at java.io.BufferedInputStream.read(BufferedInputStream.java:265)
        - locked <0x00000000aaf290e0> (a java.io.BufferedInputStream)
        at
java.io.DataInputStream.readUnsignedByte(DataInputStream.java:288)
        at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:91)
        at
com.rabbitmq.client.impl.SocketFrameHandler.readFrame(SocketFrameHandler.java:164)
        - locked <0x00000000ac7bc650> (a java.io.DataInputStream)
        at
com.rabbitmq.client.impl.AMQConnection$MainLoop.run(AMQConnection.java:571)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"resources.DB.b2b_datamart_1155218999 housekeeper" #156 daemon prio=5
os_prio=0 tid=0x000000001d520000 nid=0x148c waiting on condition
[0x000000004f93e000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ab549c60> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"resources.DB.b2b_datamart_3277181263 housekeeper" #146 daemon prio=5
os_prio=0 tid=0x00000000213a9800 nid=0x1698 waiting on condition
[0x000000004ebde000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ab567168> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"resources.DB.bis_4206841024 housekeeper" #138 daemon prio=5 os_prio=0
tid=0x00000000213a8000 nid=0x4f8 waiting on condition [0x000000003552e000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ab549e28> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"Curator-Framework-0" #134 daemon prio=5 os_prio=0 tid=0x00000000213a7000
nid=0x21fc waiting on condition [0x0000000024ade000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ab567198> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.DelayQueue.take(DelayQueue.java:211)
        at java.util.concurrent.DelayQueue.take(DelayQueue.java:70)
        at
org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:804)
        at
org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:64)
        at
org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:267)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - <0x00000000ab3f2480> (a
java.util.concurrent.ThreadPoolExecutor$Worker)

"localhost-startStop-1-EventThread" #133 daemon prio=5 os_prio=0
tid=0x00000000213a6800 nid=0x3fe0 waiting on condition [0x000000004e9be000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ab5671e0> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)

   Locked ownable synchronizers:
        - None

"localhost-startStop-1-SendThread(srv7-ngxeko.net.billing.ru:2181)" #132
daemon prio=5 os_prio=0 tid=0x00000000213a5800 nid=0x1a0c runnable
[0x000000004e5ce000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000ab567240> (a sun.nio.ch.Util$3)
        - locked <0x00000000ab567228> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000ab526de0> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
        at
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)

   Locked ownable synchronizers:
        - None

"Curator-ConnectionStateManager-0" #131 daemon prio=5 os_prio=0
tid=0x00000000213a5000 nid=0xf70 waiting on condition [0x000000004e7ee000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ab5672a0> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403)
        at
org.apache.curator.framework.state.ConnectionStateManager.processEvents(ConnectionStateManager.java:245)
        at
org.apache.curator.framework.state.ConnectionStateManager.access$000(ConnectionStateManager.java:43)
        at
org.apache.curator.framework.state.ConnectionStateManager$1.call(ConnectionStateManager.java:111)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - <0x00000000ab3f4cc0> (a
java.util.concurrent.ThreadPoolExecutor$Worker)

"ttl-cleanup-worker-#50" #117 daemon prio=5 os_prio=0 tid=0x0000000020e33800
nid=0x1574 waiting on condition [0x000000004d80f000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
        at java.lang.Thread.sleep(Native Method)
        at
org.apache.ignite.internal.util.IgniteUtils.sleep(IgniteUtils.java:7629)
        at
org.apache.ignite.internal.processors.cache.GridCacheSharedTtlCleanupManager$CleanupWorker.body(GridCacheSharedTtlCleanupManager.java:145)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"srvc-deploy-#49" #116 daemon prio=5 os_prio=0 tid=0x0000000020e33000
nid=0x2bc0 waiting on condition [0x000000002a20e000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ab5a25a8> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"checkpoint-runner-#47" #114 daemon prio=5 os_prio=0 tid=0x0000000020e31800
nid=0x1bf4 waiting on condition [0x000000004d44f000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ab5a25f0> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"checkpoint-runner-#46" #113 daemon prio=5 os_prio=0 tid=0x0000000020e30800
nid=0x36c4 waiting on condition [0x000000004d28f000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ab5a25f0> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"checkpoint-runner-#45" #112 daemon prio=5 os_prio=0 tid=0x0000000020e30000
nid=0x1db0 waiting on condition [0x000000004d10e000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ab5a25f0> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"checkpoint-runner-#44" #111 daemon prio=5 os_prio=0 tid=0x0000000020e2f000
nid=0x318c waiting on condition [0x000000002aa9f000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ab5a25f0> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"db-checkpoint-thread-#43" #110 daemon prio=5 os_prio=0
tid=0x0000000020e2e800 nid=0x35ac in Object.wait() [0x0000000035daf000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager$Checkpointer.waitCheckpointEvent(GridCacheDatabaseSharedManager.java:3338)
        - locked <0x00000000ae097068> (a
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager$Checkpointer)
        at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager$Checkpointer.body(GridCacheDatabaseSharedManager.java:2933)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"wal-file-archiver%null" #108 daemon prio=5 os_prio=0 tid=0x0000000020e2d800
nid=0x1be4 in Object.wait() [0x000000002acae000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java:502)
        at
org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$FileArchiver.run(FileWriteAheadLogManager.java:1558)
        - locked <0x00000000a9a4c938> (a
org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$FileArchiver)

   Locked ownable synchronizers:
        - None

"session-timeout-worker-#34" #94 daemon prio=5 os_prio=0
tid=0x0000000020e2d000 nid=0x30c8 waiting on condition [0x000000002ab9f000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
        at java.lang.Thread.sleep(Native Method)
        at
org.apache.ignite.internal.processors.rest.GridRestProcessor$4.body(GridRestProcessor.java:476)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"exchange-worker-#42" #106 daemon prio=5 os_prio=0 tid=0x0000000020e2c000
nid=0x3594 waiting on condition [0x0000000027aaf000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ab5a2638> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.LinkedBlockingDeque.pollFirst(LinkedBlockingDeque.java:522)
        at
java.util.concurrent.LinkedBlockingDeque.poll(LinkedBlockingDeque.java:684)
        at
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body0(GridCachePartitionExchangeManager.java:2365)
        at
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:2299)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"ignite-update-notifier-timer" #105 daemon prio=5 os_prio=0
tid=0x0000000020e2b800 nid=0x3b68 in Object.wait() [0x000000002a92f000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at java.util.TimerThread.mainLoop(Timer.java:552)
        - locked <0x00000000ab5a2668> (a java.util.TaskQueue)
        at java.util.TimerThread.run(Timer.java:505)

   Locked ownable synchronizers:
        - None

"upd-ver-checker" #104 daemon prio=5 os_prio=0 tid=0x0000000020e2a800
nid=0x290c waiting on condition [0x0000000029ebf000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
        at java.lang.Thread.sleep(Native Method)
        at
org.apache.ignite.internal.processors.cluster.GridUpdateNotifier$1.run(GridUpdateNotifier.java:115)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"disco-event-worker-#41" #103 daemon prio=5 os_prio=0 tid=0x0000000020e2a000
nid=0x10e0 waiting on condition [0x000000002a79e000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ab5a2d30> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at
org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$DiscoveryWorker.body0(GridDiscoveryManager.java:2758)
        at
org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$DiscoveryWorker.body(GridDiscoveryManager.java:2732)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"tcp-disco-ip-finder-cleaner-#4" #102 daemon prio=10 os_prio=2
tid=0x00000000206f0800 nid=0x3d0 waiting on condition [0x000000002a68f000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
        at java.lang.Thread.sleep(Native Method)
        at
org.apache.ignite.spi.discovery.tcp.ServerImpl$IpFinderCleaner.body(ServerImpl.java:1900)
        at
org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)

   Locked ownable synchronizers:
        - None

"tcp-disco-srvr-#2" #77 daemon prio=10 os_prio=2 tid=0x00000000206f0000
nid=0x20c8 runnable [0x000000002a31e000]
   java.lang.Thread.State: RUNNABLE
        at java.net.DualStackPlainSocketImpl.accept0(Native Method)
        at
java.net.DualStackPlainSocketImpl.socketAccept(DualStackPlainSocketImpl.java:131)
        at
java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
        at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:199)
        - locked <0x00000000aaacd640> (a java.net.SocksSocketImpl)
        at java.net.ServerSocket.implAccept(ServerSocket.java:545)
        at java.net.ServerSocket.accept(ServerSocket.java:513)
        at
org.apache.ignite.spi.discovery.tcp.ServerImpl$TcpServer.body(ServerImpl.java:5641)
        at
org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)

   Locked ownable synchronizers:
        - None

"tcp-disco-msg-worker-#3" #101 daemon prio=10 os_prio=2
tid=0x00000000206ef000 nid=0x39ac runnable [0x000000002a0ee000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ab5a2da8> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.LinkedBlockingDeque.pollFirst(LinkedBlockingDeque.java:522)
        at
java.util.concurrent.LinkedBlockingDeque.poll(LinkedBlockingDeque.java:684)
        at
org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorkerAdapter.body(ServerImpl.java:6770)
        at
org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.body(ServerImpl.java:2621)
        at
org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)

   Locked ownable synchronizers:
        - None

"grid-data-loader-flusher-#40" #100 daemon prio=5 os_prio=0
tid=0x00000000206ee800 nid=0x13a0 waiting on condition [0x00000000294df000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ab5a2e38> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.DelayQueue.take(DelayQueue.java:211)
        at
org.apache.ignite.internal.processors.datastreamer.DataStreamProcessor$2.body(DataStreamProcessor.java:109)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"grid-nio-worker-tcp-rest-3-#39" #99 prio=5 os_prio=0 tid=0x00000000206ed800
nid=0x26d8 runnable [0x0000000029b0e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000aa4ba250> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000000ab5f2e20> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000ab2e77c8> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"grid-nio-worker-tcp-rest-2-#38" #98 prio=5 os_prio=0 tid=0x00000000206ed000
nid=0x2a08 runnable [0x0000000029fbe000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000ab6b54d0> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000000ab5a3390> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000ad945838> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"grid-nio-worker-tcp-rest-1-#37" #97 prio=5 os_prio=0 tid=0x00000000206ec000
nid=0x2fc4 runnable [0x0000000029d8e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000aa4ba3b0> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000000ab5f43f8> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000ab2f8d38> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"grid-nio-worker-tcp-rest-0-#36" #96 prio=5 os_prio=0 tid=0x00000000206eb800
nid=0x3fc4 runnable [0x0000000029c2e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000aa4ba4f0> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000000ab5f53a0> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000ab2f8db8> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"nio-acceptor-#35" #95 daemon prio=5 os_prio=0 tid=0x00000000206ea800
nid=0xd24 runnable [0x000000002999f000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000ab5f71c8> (a sun.nio.ch.Util$3)
        - locked <0x00000000ab5f71b0> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000ab2f8e38> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$GridNioAcceptWorker.accept(GridNioServer.java:2870)
        at
org.apache.ignite.internal.util.nio.GridNioServer$GridNioAcceptWorker.body(GridNioServer.java:2822)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"cron4j::scheduler[9143bc22115d37ab01b8a97d00000164d631fe61675fc033]::timer[9143bc22115d37ab01b8a97d00000164d631fe6307e35966]"
#93 prio=5 os_prio=0 tid=0x00000000206ea000 nid=0x3dc4 waiting on condition
[0x00000000297df000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
        at java.lang.Thread.sleep(Native Method)
        at it.sauronsoftware.cron4j.TimerThread.safeSleep(Unknown Source)
        at it.sauronsoftware.cron4j.TimerThread.run(Unknown Source)

   Locked ownable synchronizers:
        - None

"grid-nio-worker-client-listener-3-#33" #92 prio=5 os_prio=0
tid=0x00000000206e9000 nid=0x364c runnable [0x000000002962e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000ab2afae8> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000000ab646950> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000ab5e1840> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"grid-nio-worker-client-listener-2-#32" #91 prio=5 os_prio=0
tid=0x00000000206e8800 nid=0x3a84 runnable [0x00000000293de000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000aa4ba970> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000000ab5f8298> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000ab2f8eb8> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"grid-nio-worker-client-listener-1-#31" #90 prio=5 os_prio=0
tid=0x00000000206e7800 nid=0x3b7c runnable [0x000000002920e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000ab2afb28> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000000ab646968> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000ab5e18c0> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"grid-nio-worker-client-listener-0-#30" #89 prio=5 os_prio=0
tid=0x00000000206e7000 nid=0xc0c runnable [0x000000002834e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000aa4bacb0> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000000ab646980> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000ab2f8f38> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"nio-acceptor-#29" #88 daemon prio=5 os_prio=0 tid=0x00000000206e6000
nid=0x132c runnable [0x000000002909e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000ab5fd470> (a sun.nio.ch.Util$3)
        - locked <0x00000000ab5fd458> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000ab2f8fb8> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$GridNioAcceptWorker.accept(GridNioServer.java:2870)
        at
org.apache.ignite.internal.util.nio.GridNioServer$GridNioAcceptWorker.body(GridNioServer.java:2822)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"Thread-10" #87 daemon prio=5 os_prio=0 tid=0x00000000206e5800 nid=0x23bc
runnable [0x000000003618f000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
        at sun.nio.ch.Iocp.access$300(Iocp.java:46)
        at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
        at
sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:112)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - <0x00000000ab5768b0> (a
java.util.concurrent.ThreadPoolExecutor$Worker)

"Thread-9" #86 daemon prio=5 os_prio=0 tid=0x00000000206e4800 nid=0x2fd0
runnable [0x000000003607f000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
        at sun.nio.ch.Iocp.access$300(Iocp.java:46)
        at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
        at
sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:112)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - <0x00000000ab478f30> (a
java.util.concurrent.ThreadPoolExecutor$Worker)

"Thread-8" #85 daemon prio=5 os_prio=0 tid=0x00000000206e4000 nid=0x2464
runnable [0x0000000035eff000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
        at sun.nio.ch.Iocp.access$300(Iocp.java:46)
        at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
        at
sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:112)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - <0x00000000ab5768e0> (a
java.util.concurrent.ThreadPoolExecutor$Worker)

"Thread-7" #84 daemon prio=5 os_prio=0 tid=0x00000000206e3000 nid=0x369c
runnable [0x0000000035cae000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
        at sun.nio.ch.Iocp.access$300(Iocp.java:46)
        at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
        at
sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:112)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - <0x00000000ab576910> (a
java.util.concurrent.ThreadPoolExecutor$Worker)

"Thread-6" #83 daemon prio=5 os_prio=0 tid=0x00000000206e2800 nid=0xf78
runnable [0x0000000035b1e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
        at sun.nio.ch.Iocp.access$300(Iocp.java:46)
        at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
        at
sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:112)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - <0x00000000ab576940> (a
java.util.concurrent.ThreadPoolExecutor$Worker)

"Thread-5" #82 daemon prio=5 os_prio=0 tid=0x00000000206e1800 nid=0x34a8
runnable [0x000000003563f000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
        at sun.nio.ch.Iocp.access$300(Iocp.java:46)
        at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
        at
sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:112)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - <0x00000000ab576970> (a
java.util.concurrent.ThreadPoolExecutor$Worker)

"Thread-4" #81 daemon prio=5 os_prio=0 tid=0x0000000019b5c000 nid=0x1d14
runnable [0x00000000358df000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
        at sun.nio.ch.Iocp.access$300(Iocp.java:46)
        at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
        at
sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:112)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - <0x00000000ab5769a0> (a
java.util.concurrent.ThreadPoolExecutor$Worker)

"Thread-3" #80 daemon prio=5 os_prio=0 tid=0x0000000019b5b800 nid=0xe04
runnable [0x00000000357af000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
        at sun.nio.ch.Iocp.access$300(Iocp.java:46)
        at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
        at
sun.nio.ch.AsynchronousChannelGroupImpl$1.run(AsynchronousChannelGroupImpl.java:112)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - <0x00000000ab47b030> (a
java.util.concurrent.ThreadPoolExecutor$Worker)

"Thread-2" #79 daemon prio=5 os_prio=0 tid=0x0000000019b5a800 nid=0x3890
runnable [0x00000000285bf000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.Iocp.getQueuedCompletionStatus(Native Method)
        at sun.nio.ch.Iocp.access$300(Iocp.java:46)
        at sun.nio.ch.Iocp$EventHandlerTask.run(Iocp.java:333)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"tcp-comm-worker-#1" #76 daemon prio=5 os_prio=0 tid=0x0000000019b5a000
nid=0x3958 waiting on condition [0x00000000288af000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ab646a58> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
        at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi$CommunicationWorker.body(TcpCommunicationSpi.java:4207)
        at
org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)

   Locked ownable synchronizers:
        - None

"grid-nio-worker-tcp-comm-3-#28" #72 prio=5 os_prio=0 tid=0x0000000019b59000
nid=0xfe8 runnable [0x00000000286ff000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000aa4bb450> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000000ab6026f8> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000ab2f9038> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"grid-nio-worker-tcp-comm-2-#27" #71 prio=5 os_prio=0 tid=0x0000000019b58800
nid=0x1960 runnable [0x00000000280ae000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000ab2afca8> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000000ab6471a8> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000ab5e19c0> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"grid-nio-worker-tcp-comm-1-#26" #70 prio=5 os_prio=0 tid=0x0000000019b57000
nid=0xa78 runnable [0x000000002845f000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000aa4bb590> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000000aa6269e8> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000ab2f90b8> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"grid-nio-worker-tcp-comm-0-#25" #69 prio=5 os_prio=0 tid=0x0000000019b56000
nid=0x2c84 runnable [0x000000002763e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000aa4bb710> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000000aa627138> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000ab2f9138> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"nio-acceptor-#24" #68 daemon prio=5 os_prio=0 tid=0x0000000019b57800
nid=0x3614 runnable [0x000000002824f000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000aa627768> (a sun.nio.ch.Util$3)
        - locked <0x00000000aa627750> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000ab2f91b8> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$GridNioAcceptWorker.accept(GridNioServer.java:2870)
        at
org.apache.ignite.internal.util.nio.GridNioServer$GridNioAcceptWorker.body(GridNioServer.java:2822)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"grid-timeout-worker-#23" #67 daemon prio=5 os_prio=0 tid=0x0000000019b55800
nid=0x2b48 in Object.wait() [0x000000002788f000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at
org.apache.ignite.internal.processors.timeout.GridTimeoutProcessor$TimeoutWorker.body(GridTimeoutProcessor.java:203)
        - locked <0x00000000ab576f50> (a java.lang.Object)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"ignite-clock" #66 daemon prio=10 os_prio=2 tid=0x0000000019b54800 nid=0x650
waiting on condition [0x0000000027f9e000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
        at java.lang.Thread.sleep(Native Method)
        at
org.apache.ignite.internal.util.IgniteUtils$22.run(IgniteUtils.java:3308)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"jvm-pause-detector-worker" #59 daemon prio=5 os_prio=0
tid=0x0000000019b4e800 nid=0x804 waiting on condition [0x00000000268bf000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
        at java.lang.Thread.sleep(Native Method)
        at
org.apache.ignite.internal.LongJVMPauseDetector$1.run(LongJVMPauseDetector.java:90)

   Locked ownable synchronizers:
        - None

"data-streamer-stripe-7-#16" #58 daemon prio=5 os_prio=0
tid=0x0000000019b4e000 nid=0x794 waiting on condition [0x0000000026e6e000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"data-streamer-stripe-6-#15" #57 daemon prio=5 os_prio=0
tid=0x0000000019b4d000 nid=0x3708 waiting on condition [0x0000000026c6e000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"data-streamer-stripe-5-#14" #56 daemon prio=5 os_prio=0
tid=0x0000000021c36800 nid=0x37a4 waiting on condition [0x0000000026b4f000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"data-streamer-stripe-4-#13" #55 daemon prio=5 os_prio=0
tid=0x0000000021c36000 nid=0x554 waiting on condition [0x00000000269cf000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"data-streamer-stripe-3-#12" #54 daemon prio=5 os_prio=0
tid=0x0000000021c35000 nid=0x32a0 waiting on condition [0x00000000261df000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"data-streamer-stripe-2-#11" #53 daemon prio=5 os_prio=0
tid=0x0000000021c34800 nid=0x3274 waiting on condition [0x000000002674f000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"data-streamer-stripe-1-#10" #52 daemon prio=5 os_prio=0
tid=0x0000000021c33800 nid=0x560 waiting on condition [0x00000000265cf000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"data-streamer-stripe-0-#9" #51 daemon prio=5 os_prio=0
tid=0x0000000021c33000 nid=0x1a50 waiting on condition [0x000000002648f000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"sys-stripe-7-#8" #50 daemon prio=5 os_prio=0 tid=0x0000000021c32000
nid=0x155c waiting on condition [0x00000000262df000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"sys-stripe-6-#7" #49 daemon prio=5 os_prio=0 tid=0x0000000021c31800
nid=0x3584 waiting on condition [0x000000002603e000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"sys-stripe-5-#6" #48 daemon prio=5 os_prio=0 tid=0x0000000021c30800
nid=0x3cbc waiting on condition [0x0000000025e6f000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"sys-stripe-4-#5" #47 daemon prio=5 os_prio=0 tid=0x0000000021c30000
nid=0x14b4 waiting on condition [0x0000000025c8e000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"sys-stripe-3-#4" #46 daemon prio=5 os_prio=0 tid=0x000000001b2fc000
nid=0x550 waiting on condition [0x0000000025b1e000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"sys-stripe-2-#3" #45 daemon prio=5 os_prio=0 tid=0x000000001b2fb800
nid=0x14cc waiting on condition [0x00000000256af000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"sys-stripe-1-#2" #44 daemon prio=5 os_prio=0 tid=0x000000001b2fa800
nid=0x3a80 waiting on condition [0x0000000025a1f000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"sys-stripe-0-#1" #43 daemon prio=5 os_prio=0 tid=0x000000001b2fa000
nid=0xfdc waiting on condition [0x000000002411e000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"Curator-Framework-0" #42 daemon prio=5 os_prio=0 tid=0x000000001b2f9000
nid=0x3810 waiting on condition [0x00000000254be000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ab63da78> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.DelayQueue.take(DelayQueue.java:211)
        at java.util.concurrent.DelayQueue.take(DelayQueue.java:70)
        at
org.apache.curator.framework.imps.CuratorFrameworkImpl.backgroundOperationsLoop(CuratorFrameworkImpl.java:804)
        at
org.apache.curator.framework.imps.CuratorFrameworkImpl.access$300(CuratorFrameworkImpl.java:64)
        at
org.apache.curator.framework.imps.CuratorFrameworkImpl$4.call(CuratorFrameworkImpl.java:267)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - <0x00000000ab46a3a0> (a
java.util.concurrent.ThreadPoolExecutor$Worker)

"localhost-startStop-1-EventThread" #41 daemon prio=5 os_prio=0
tid=0x000000001b2f8800 nid=0x1558 waiting on condition [0x00000000242df000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ab644d40> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)

   Locked ownable synchronizers:
        - None

"localhost-startStop-1-SendThread(srv7-ngxeko.net.billing.ru:2181)" #40
daemon prio=5 os_prio=0 tid=0x000000001b2f7800 nid=0x2ecc runnable
[0x000000001294f000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000ab645220> (a sun.nio.ch.Util$3)
        - locked <0x00000000ab645208> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000aaa21bd8> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
        at
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)

   Locked ownable synchronizers:
        - None

"Curator-ConnectionStateManager-0" #39 daemon prio=5 os_prio=0
tid=0x000000001b2f7000 nid=0x34f0 waiting on condition [0x000000002527f000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ab642210> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:403)
        at
org.apache.curator.framework.state.ConnectionStateManager.processEvents(ConnectionStateManager.java:245)
        at
org.apache.curator.framework.state.ConnectionStateManager.access$000(ConnectionStateManager.java:43)
        at
org.apache.curator.framework.state.ConnectionStateManager$1.call(ConnectionStateManager.java:111)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - <0x00000000ab4ac700> (a
java.util.concurrent.ThreadPoolExecutor$Worker)

"I/O dispatcher 8" #38 prio=5 os_prio=0 tid=0x000000001b2f6000 nid=0xec8
runnable [0x000000002537f000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000aa627df8> (a sun.nio.ch.Util$3)
        - locked <0x00000000aa627de0> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000ab2f9238> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:257)
        at
org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:106)
        at
org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:590)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"I/O dispatcher 7" #37 prio=5 os_prio=0 tid=0x000000001b2f5800 nid=0x27c4
runnable [0x000000002445e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000aa678338> (a sun.nio.ch.Util$3)
        - locked <0x00000000aa678320> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000aa5dc8e8> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:257)
        at
org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:106)
        at
org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:590)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"I/O dispatcher 6" #36 prio=5 os_prio=0 tid=0x000000001b2f4800 nid=0x3ba4
runnable [0x000000002510e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000aa62a700> (a sun.nio.ch.Util$3)
        - locked <0x00000000aa62a6e8> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000ab307170> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:257)
        at
org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:106)
        at
org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:590)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"I/O dispatcher 5" #35 prio=5 os_prio=0 tid=0x000000001b2f4000 nid=0x3040
runnable [0x0000000023a9f000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000aa633168> (a sun.nio.ch.Util$3)
        - locked <0x00000000aa633150> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000ab3071f0> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:257)
        at
org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:106)
        at
org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:590)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"I/O dispatcher 4" #34 prio=5 os_prio=0 tid=0x000000001b2f3000 nid=0x19c8
runnable [0x0000000024f2e000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000aa63fab0> (a sun.nio.ch.Util$3)
        - locked <0x00000000aa63fa98> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000aa3f0e70> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:257)
        at
org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:106)
        at
org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:590)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"I/O dispatcher 3" #33 prio=5 os_prio=0 tid=0x000000001b2f1800 nid=0x3940
runnable [0x0000000024d4f000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000aa6466c0> (a sun.nio.ch.Util$3)
        - locked <0x00000000aa6466a8> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000aa3f0ef0> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:257)
        at
org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:106)
        at
org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:590)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"I/O dispatcher 2" #32 prio=5 os_prio=0 tid=0x000000001b2ef800 nid=0x3c14
runnable [0x0000000024bde000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000aa646c78> (a sun.nio.ch.Util$3)
        - locked <0x00000000aa646c60> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000aa3f0f70> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:257)
        at
org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:106)
        at
org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:590)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"I/O dispatcher 1" #31 prio=5 os_prio=0 tid=0x000000001b2f1000 nid=0x37e0
runnable [0x00000000249de000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000aa647230> (a sun.nio.ch.Util$3)
        - locked <0x00000000aa647218> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000aa3f0ff0> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:257)
        at
org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:106)
        at
org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:590)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"pool-4-thread-1" #30 prio=5 os_prio=0 tid=0x000000001b2f0000 nid=0x29f4
runnable [0x0000000023b9f000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
        at
sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
        at
sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000000aa647788> (a sun.nio.ch.Util$3)
        - locked <0x00000000aa647770> (a
java.util.Collections$UnmodifiableSet)
        - locked <0x00000000aa565820> (a sun.nio.ch.WindowsSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor.execute(AbstractMultiworkerIOReactor.java:342)
        at
org.apache.http.impl.nio.conn.PoolingNHttpClientConnectionManager.execute(PoolingNHttpClientConnectionManager.java:194)
        at
org.apache.http.impl.nio.client.CloseableHttpAsyncClientBase$1.run(CloseableHttpAsyncClientBase.java:64)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"logback-1" #25 daemon prio=5 os_prio=0 tid=0x000000001b2ee800 nid=0x3d24
waiting on condition [0x000000002211f000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000ae0d8870> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"RMI RenewClean-[172.21.98.254:19005]" #21 daemon prio=5 os_prio=0
tid=0x000000001b169000 nid=0x1374 in Object.wait() [0x000000001c7ef000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
        - locked <0x00000000aa216fa0> (a java.lang.ref.ReferenceQueue$Lock)
        at
sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:563)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"RMI Scheduler(0)" #20 daemon prio=5 os_prio=0 tid=0x000000001ae37000
nid=0x38a4 waiting on condition [0x000000001c69f000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000000a9ad7068> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"RMI Reaper" #18 prio=5 os_prio=0 tid=0x000000001af87000 nid=0x15a0 in
Object.wait() [0x000000001c1ef000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000000a9ad5ec8> (a
java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
        - locked <0x00000000a9ad5ec8> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
        at sun.rmi.transport.ObjectTable$Reaper.run(ObjectTable.java:351)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"RMI TCP Accept-19005" #17 daemon prio=5 os_prio=0 tid=0x000000001b03a000
nid=0x3fec runnable [0x000000001bf4e000]
   java.lang.Thread.State: RUNNABLE
        at java.net.DualStackPlainSocketImpl.accept0(Native Method)
        at
java.net.DualStackPlainSocketImpl.socketAccept(DualStackPlainSocketImpl.java:131)
        at
java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
        at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:199)
        - locked <0x00000000aa1e5198> (a java.net.SocksSocketImpl)
        at java.net.ServerSocket.implAccept(ServerSocket.java:545)
        at java.net.ServerSocket.accept(ServerSocket.java:513)
        at
sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:400)
        at
sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:372)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"RMI TCP Accept-19004" #16 daemon prio=5 os_prio=0 tid=0x000000001ae07800
nid=0x36c0 runnable [0x000000001a60e000]
   java.lang.Thread.State: RUNNABLE
        at java.net.DualStackPlainSocketImpl.accept0(Native Method)
        at
java.net.DualStackPlainSocketImpl.socketAccept(DualStackPlainSocketImpl.java:131)
        at
java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
        at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:199)
        - locked <0x00000000aa1e31f8> (a java.net.SocksSocketImpl)
        at java.net.ServerSocket.implAccept(ServerSocket.java:545)
        at java.net.ServerSocket.accept(ServerSocket.java:513)
        at
sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:400)
        at
sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:372)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"GC Daemon" #15 daemon prio=2 os_prio=-2 tid=0x000000001ae11000 nid=0x1500
in Object.wait() [0x000000001bc2f000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000000aa08b960> (a sun.misc.GC$LatencyLock)
        at sun.misc.GC$Daemon.run(GC.java:117)
        - locked <0x00000000aa08b960> (a sun.misc.GC$LatencyLock)

   Locked ownable synchronizers:
        - None

"RMI TCP Accept-0" #14 daemon prio=5 os_prio=0 tid=0x0000000019c03000
nid=0xdf0 runnable [0x000000001a48f000]
   java.lang.Thread.State: RUNNABLE
        at java.net.DualStackPlainSocketImpl.accept0(Native Method)
        at
java.net.DualStackPlainSocketImpl.socketAccept(DualStackPlainSocketImpl.java:131)
        at
java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
        at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:199)
        - locked <0x00000000a9b0c148> (a java.net.SocksSocketImpl)
        at java.net.ServerSocket.implAccept(ServerSocket.java:545)
        at java.net.ServerSocket.accept(ServerSocket.java:513)
        at
sun.management.jmxremote.LocalRMIServerSocketFactory$1.accept(LocalRMIServerSocketFactory.java:52)
        at
sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:400)
        at
sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:372)
        at java.lang.Thread.run(Thread.java:748)

   Locked ownable synchronizers:
        - None

"Service Thread" #12 daemon prio=9 os_prio=0 tid=0x000000001821f800
nid=0x3588 runnable [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
        - None

"C1 CompilerThread3" #11 daemon prio=9 os_prio=2 tid=0x000000001981f000
nid=0x2308 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
        - None

"C2 CompilerThread2" #10 daemon prio=9 os_prio=2 tid=0x000000001820c800
nid=0x2fb0 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
        - None

"C2 CompilerThread1" #9 daemon prio=9 os_prio=2 tid=0x00000000198fb800
nid=0x25cc waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
        - None

"C2 CompilerThread0" #8 daemon prio=9 os_prio=2 tid=0x00000000198a5000
nid=0x3074 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
        - None

"Attach Listener" #6 daemon prio=5 os_prio=2 tid=0x0000000018111800
nid=0x32f4 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
        - None

"Signal Dispatcher" #5 daemon prio=9 os_prio=2 tid=0x0000000018109000
nid=0x308 runnable [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
        - None

"Surrogate Locker Thread (Concurrent GC)" #4 daemon prio=9 os_prio=0
tid=0x0000000018107800 nid=0x2560 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

   Locked ownable synchronizers:
        - None

"Finalizer" #3 daemon prio=8 os_prio=1 tid=0x00000000180e6000 nid=0x20b4 in
Object.wait() [0x000000001909f000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
        - locked <0x00000000a9997fc8> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
        at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)

   Locked ownable synchronizers:
        - None

"Reference Handler" #2 daemon prio=10 os_prio=2 tid=0x000000001809e800
nid=0xff0 in Object.wait() [0x0000000018e8f000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java:502)
        at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
        - locked <0x00000000a9996568> (a java.lang.ref.Reference$Lock)
        at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)

   Locked ownable synchronizers:
        - None

"main" #1 prio=5 os_prio=0 tid=0x000000000222c800 nid=0x130c runnable
[0x000000000248e000]
   java.lang.Thread.State: RUNNABLE
        at java.net.DualStackPlainSocketImpl.accept0(Native Method)
        at
java.net.DualStackPlainSocketImpl.socketAccept(DualStackPlainSocketImpl.java:131)
        at
java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
        at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:199)
        - locked <0x00000000afcb66e8> (a java.net.SocksSocketImpl)
        at java.net.ServerSocket.implAccept(ServerSocket.java:545)
        at java.net.ServerSocket.accept(ServerSocket.java:513)
        at
org.apache.catalina.core.StandardServer.await(StandardServer.java:452)
        at org.apache.catalina.startup.Catalina.await(Catalina.java:781)
        at org.apache.catalina.startup.Catalina.start(Catalina.java:727)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:294)
        at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:428)

   Locked ownable synchronizers:
        - None

"VM Thread" os_prio=2 tid=0x0000000018097800 nid=0x19f4 runnable 

"Gang worker#0 (Parallel GC Threads)" os_prio=2 tid=0x000000000223d800
nid=0x36b8 runnable 

"Gang worker#1 (Parallel GC Threads)" os_prio=2 tid=0x000000000223e000
nid=0x197c runnable 

"Gang worker#2 (Parallel GC Threads)" os_prio=2 tid=0x0000000002240000
nid=0x2acc runnable 

"Gang worker#3 (Parallel GC Threads)" os_prio=2 tid=0x0000000002242800
nid=0x1014 runnable 

"Gang worker#4 (Parallel GC Threads)" os_prio=2 tid=0x0000000002245800
nid=0x20dc runnable 

"Gang worker#5 (Parallel GC Threads)" os_prio=2 tid=0x0000000002247000
nid=0x2b5c runnable 

"Gang worker#6 (Parallel GC Threads)" os_prio=2 tid=0x0000000002248000
nid=0x3c0 runnable 

"Gang worker#7 (Parallel GC Threads)" os_prio=2 tid=0x0000000002249000
nid=0x1c7c runnable 

"Concurrent Mark-Sweep GC Thread" os_prio=2 tid=0x00000000022be000
nid=0x1190 runnable 

"Gang worker#0 (Parallel CMS Threads)" os_prio=2 tid=0x00000000022b7000
nid=0x1ac runnable 

"Gang worker#1 (Parallel CMS Threads)" os_prio=2 tid=0x00000000022ba800
nid=0x3cb8 runnable 

"VM Periodic Task Thread" os_prio=2 tid=0x0000000019c45800 nid=0x147c
waiting on condition 

JNI global references: 735





--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/


Re: service deploy cluster singleton lock application

Posted by Evgenii Zhuravlev <e....@gmail.com>.
Well, then, do you have a mall reproducer for your issue? Or at least
thread dumps, that I've mentioned in my previous message?

Evgenii

2018-07-26 13:19 GMT+03:00 sergey.dolinkov <se...@billing.ru>:

> This is an example.
> The original code is more complicated.
> For configuration, we convert megabytes to bytes.
> In this example, there are no errors in the logs.
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>

Re: service deploy cluster singleton lock application

Posted by "sergey.dolinkov" <se...@billing.ru>.
This is an example.
The original code is more complicated.
For configuration, we convert megabytes to bytes.
In this example, there are no errors in the logs.



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: service deploy cluster singleton lock application

Posted by "sergey.dolinkov" <se...@billing.ru>.
After a little analysis of the source code, I found out that 
when I called the method deployClusterSingleton
I get GridServiceDeploymentCompoundFuture and it is never complite.



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: service deploy cluster singleton lock application

Posted by ezhuravlev <e....@gmail.com>.
Hi,

As per java doc of DataRegionConfiguration.setMaxSize - maxSize Maximum data
region size in bytes. For sure, it won't work properly with such a small
memory size(128 and 1024 bytes). Ignite even have validation for this
parameter and it should be not less than 10mb at least.

Have you checked your logs? Do you have any exceptions? Have you checked
thread dumps? Where was it hanged?

Regards,
Evgenii



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/