You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by googy <mg...@bistel.com> on 2020/01/29 06:13:00 UTC

High CPU usage on sun.nio.ch.EPollArrayWrapper.epollWait when Node Failover

Hi,
I have problem in some Ignite (version 1.9) thread.

Issue detail process
1. Ignite Running on Multi Server Machine 
 - Linux and JDK 1.7.0_95 environment, Over 2 Ignite process run on the
Machine
2. One Machine Shutdown
3. Ignite Failover and Rebalanced
4. Ignite seemingly normal behavior but...
5. Some grid-nio-worker-tcp-comm-xx Thread have high CPU usage
6. grid-nio-worker-tcp-comm-xx Thread total count is 29, High CPU usage
Thread count is 3
7. High CPU usage Thread consume a CPU 1 core (thread) 100%
8. Problem solution is Ignite process restart only
9. Below is part of Thread Dump Stack (High CPU Usage and Normal Stack is
equally)
"grid-nio-worker-tcp-comm-14-#79%null%" prio=10 tid=0x00007f3e24c0b000
nid=0x412cb runnable [0x00007f3df6ae5000]
   java.lang.Thread.State: RUNNABLE
	at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
	at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
	at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
	at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
	- locked <0x000000061f8b5df0> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
	- locked <0x000000061f8c5210> (a java.util.Collections$UnmodifiableSet)
	- locked <0x000000061f8b5d58> (a sun.nio.ch.EPollSelectorImpl)
	at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
	at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:1858)
	at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1568)
	at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
	at java.lang.Thread.run(Thread.java:745)


When searching a similar problem, epollWait bug fixed in Java 1.6 but i'm
already use Java 1.7.0_95 version
Can i have a solution?

Thank you.



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: High CPU usage on sun.nio.ch.EPollArrayWrapper.epollWait when Node Failover

Posted by Ilya Kasnacheev <il...@gmail.com>.
Hello!

epollWait() is basically waiting on condition. It consumes no CPU - the
thread is simply idle and yields to other processes.

Please also node that not many expertise is left here for 1.x branch.
Please consider upgrading.

Regards,
-- 
Ilya Kasnacheev


ср, 29 янв. 2020 г. в 09:13, googy <mg...@bistel.com>:

> Hi,
> I have problem in some Ignite (version 1.9) thread.
>
> Issue detail process
> 1. Ignite Running on Multi Server Machine
>  - Linux and JDK 1.7.0_95 environment, Over 2 Ignite process run on the
> Machine
> 2. One Machine Shutdown
> 3. Ignite Failover and Rebalanced
> 4. Ignite seemingly normal behavior but...
> 5. Some grid-nio-worker-tcp-comm-xx Thread have high CPU usage
> 6. grid-nio-worker-tcp-comm-xx Thread total count is 29, High CPU usage
> Thread count is 3
> 7. High CPU usage Thread consume a CPU 1 core (thread) 100%
> 8. Problem solution is Ignite process restart only
> 9. Below is part of Thread Dump Stack (High CPU Usage and Normal Stack is
> equally)
> "grid-nio-worker-tcp-comm-14-#79%null%" prio=10 tid=0x00007f3e24c0b000
> nid=0x412cb runnable [0x00007f3df6ae5000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
>         - locked <0x000000061f8b5df0> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x000000061f8c5210> (a
> java.util.Collections$UnmodifiableSet)
>         - locked <0x000000061f8b5d58> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
>         at
>
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:1858)
>         at
>
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1568)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:745)
>
>
> When searching a similar problem, epollWait bug fixed in Java 1.6 but i'm
> already use Java 1.7.0_95 version
> Can i have a solution?
>
> Thank you.
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>