You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@nifi.apache.org by "Joseph Witt (JIRA)" <ji...@apache.org> on 2015/12/14 14:55:46 UTC

[jira] [Commented] (NIFI-1281) Investigate performance when queues are swapping heavily

    [ https://issues.apache.org/jira/browse/NIFI-1281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15055998#comment-15055998 ] 

Joseph Witt commented on NIFI-1281:
-----------------------------------

this comment will be admittedly a little nonsense but here goes.

As it was occurring it 'felt like lock contention'.



> Investigate performance when queues are swapping heavily
> --------------------------------------------------------
>
>                 Key: NIFI-1281
>                 URL: https://issues.apache.org/jira/browse/NIFI-1281
>             Project: Apache NiFi
>          Issue Type: Task
>          Components: Core Framework
>            Reporter: Mark Payne
>             Fix For: 0.5.0
>
>
> If we have a queue that has a huge amount of swapping going on (in and out), the ability to pull records from that queue is poor. When running a test, we had a producer continually pushing records into a queue with no backpressure. The consumer was very fast until swapping started to occur. At that point, the ability to consume dropped to only a few thousand events/second. Stopping the producer provided much better performance on the consuming side, which is problematic.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)