You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Mark Payne (JIRA)" <ji...@apache.org> on 2018/08/20 18:30:00 UTC

[jira] [Created] (NIFI-5539) ConsumeKafka* processors should use a default yield duration much smaller than the typical default of 1 second

Mark Payne created NIFI-5539:
--------------------------------

             Summary: ConsumeKafka* processors should use a default yield duration much smaller than the typical default of 1 second
                 Key: NIFI-5539
                 URL: https://issues.apache.org/jira/browse/NIFI-5539
             Project: Apache NiFi
          Issue Type: Improvement
          Components: Extensions
            Reporter: Mark Payne
            Assignee: Mark Payne


ConsumeKafka* processors work by requesting a batch of records from Kafka, then waiting up to 10 milliseconds to receive the data. If not received by then, the processor will yield. However, for high volume flows this can happen pretty often, especially with small batch sizes, and that can result in a lot of time spent yielding when it could be pulling data. We should instead use a default of "0 millis" or "10 millis"



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)