You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by boomi <bo...@moodys.com> on 2018/08/06 22:48:31 UTC
Public thread pool starvation detected
Hello,
We are having a possible deadlock issue with Apache Ignite .NET 2.5.0. We
have setup a cluster with 5-server nodes and 1-client node. We try to
execute ICompute action from the client node. And we see in one server node
log, there was single line in the log file, indicates that some kind of
thread pool starvation as below:
Line 586: [22:14:34,834][WARNING][grid-timeout-worker-#23][IgniteKernal]
Possible thread pool starvation detected (no task completed in last 30000ms,
is public thread pool size large enough?)
And all nodes,including client node, not responsive, when this happens.
We've been stuck with problem and any help to resolve this issue would be
appreciated.
We setup the cluster on a VM with 4-core cpus and 32G memory.
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Public thread pool starvation detected
Posted by Anil <an...@gmail.com>.
how did you guys resolve this ? thanks.
On Tue, 7 Aug 2018 at 13:03, Evgenii Zhuravlev <e....@gmail.com>
wrote:
> Hi,
>
> What kind of compute jobs do you run? Do you start new jobs inside jobs?
> Can you share thread dumps?
>
> Evgenii
>
> 2018-08-07 1:48 GMT+03:00 boomi <bo...@moodys.com>:
>
>> Hello,
>>
>> We are having a possible deadlock issue with Apache Ignite .NET 2.5.0. We
>> have setup a cluster with 5-server nodes and 1-client node. We try to
>> execute ICompute action from the client node. And we see in one server
>> node
>> log, there was single line in the log file, indicates that some kind of
>> thread pool starvation as below:
>>
>> Line 586: [22:14:34,834][WARNING][grid-timeout-worker-#23][IgniteKernal]
>> Possible thread pool starvation detected (no task completed in last
>> 30000ms,
>> is public thread pool size large enough?)
>>
>> And all nodes,including client node, not responsive, when this happens.
>> We've been stuck with problem and any help to resolve this issue would be
>> appreciated.
>>
>> We setup the cluster on a VM with 4-core cpus and 32G memory.
>>
>>
>>
>>
>> --
>> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>>
>
>
Re: Public thread pool starvation detected
Posted by Evgenii Zhuravlev <e....@gmail.com>.
Hi,
What kind of compute jobs do you run? Do you start new jobs inside jobs?
Can you share thread dumps?
Evgenii
2018-08-07 1:48 GMT+03:00 boomi <bo...@moodys.com>:
> Hello,
>
> We are having a possible deadlock issue with Apache Ignite .NET 2.5.0. We
> have setup a cluster with 5-server nodes and 1-client node. We try to
> execute ICompute action from the client node. And we see in one server
> node
> log, there was single line in the log file, indicates that some kind of
> thread pool starvation as below:
>
> Line 586: [22:14:34,834][WARNING][grid-timeout-worker-#23][IgniteKernal]
> Possible thread pool starvation detected (no task completed in last
> 30000ms,
> is public thread pool size large enough?)
>
> And all nodes,including client node, not responsive, when this happens.
> We've been stuck with problem and any help to resolve this issue would be
> appreciated.
>
> We setup the cluster on a VM with 4-core cpus and 32G memory.
>
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>