You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Brandon DeVries (JIRA)" <ji...@apache.org> on 2019/02/21 21:51:00 UTC
[jira] [Updated] (NIFI-6065) Root Group Ports "waiting" too long
[ https://issues.apache.org/jira/browse/NIFI-6065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brandon DeVries updated NIFI-6065:
----------------------------------
Description:
In NIFI-408, a change was made to StandardRootGroupPort to poll for 100 millis instead of doing a non-blocking poll, and yielding if there were no results. While I don't know the initial motivation for this change (thoughts, [~markap14]?), the current implementation is resulting in an excessive number of Timer-Driven threads stuck in the TIMED_WAITING state. Essentially, if you have a high number of low traffic remote ports, you lose a substantial chunk of your timer driven thread pool to simply "waiting".
My first thought would be to revert the change, possibly even without the context.yield. Second would be to drastically reduce the poll timeout... 10 or 5 millis, although any choice is somewhat arbitrary and flow-dependent. EDIT: which probably makes it a candidate for a nifi.property
Any other thoughts or suggestions would be appreciated.
was:
In NIFI-408, a change was made to StandardRootGroupPort to poll for 100 millis instead of doing a non-blocking poll, and yielding if there were no results. While I don't know the initial motivation for this change (thoughts, [~markap14]?), the current implementation is resulting in an excessive number of Timer-Driven threads stuck in the TIMED_WAITING state. Essentially, if you have a high number of low traffic remote ports, you lose a substantial chunk of your timer driven thread pool to simply "waiting".
My first thought would be to revert the change, possibly even without the context.yield. Second would be to drastically reduce the poll timeout... 10 or 5 millis, although any choice is somewhat arbitrary and flow-dependent.
Any other thoughts or suggestions would be appreciated.
> Root Group Ports "waiting" too long
> -----------------------------------
>
> Key: NIFI-6065
> URL: https://issues.apache.org/jira/browse/NIFI-6065
> Project: Apache NiFi
> Issue Type: Improvement
> Components: Core Framework
> Affects Versions: 1.9.0
> Reporter: Brandon DeVries
> Priority: Major
>
> In NIFI-408, a change was made to StandardRootGroupPort to poll for 100 millis instead of doing a non-blocking poll, and yielding if there were no results. While I don't know the initial motivation for this change (thoughts, [~markap14]?), the current implementation is resulting in an excessive number of Timer-Driven threads stuck in the TIMED_WAITING state. Essentially, if you have a high number of low traffic remote ports, you lose a substantial chunk of your timer driven thread pool to simply "waiting".
> My first thought would be to revert the change, possibly even without the context.yield. Second would be to drastically reduce the poll timeout... 10 or 5 millis, although any choice is somewhat arbitrary and flow-dependent. EDIT: which probably makes it a candidate for a nifi.property
> Any other thoughts or suggestions would be appreciated.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)