You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@nifi.apache.org by "Mark Payne (JIRA)" <ji...@apache.org> on 2017/05/23 19:10:04 UTC

[jira] [Updated] (NIFI-3962) Update ConsumeKafkaRecord_0_10 to better batch together messages into fewer flowfiles

     [ https://issues.apache.org/jira/browse/NIFI-3962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mark Payne updated NIFI-3962:
-----------------------------
    Assignee: Mark Payne
      Status: Patch Available  (was: Open)

> Update ConsumeKafkaRecord_0_10 to better batch together messages into fewer flowfiles
> -------------------------------------------------------------------------------------
>
>                 Key: NIFI-3962
>                 URL: https://issues.apache.org/jira/browse/NIFI-3962
>             Project: Apache NiFi
>          Issue Type: Improvement
>          Components: Extensions
>            Reporter: Mark Payne
>            Assignee: Mark Payne
>
> Currently, ConsumeKafkaRecord will batch together only as many records in a FlowFile as it is able to obtain for a single partition & topic. This should be updated to allow for multiple iterations of KafkaConsumer.poll() in the same way that ConsumeKafka does with a Demarcator configured.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)