You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@nifi.apache.org by "Brendan (Jira)" <ji...@apache.org> on 2022/09/16 05:58:00 UTC

[jira] [Created] (NIFI-10511) Group Processor Option to Set Batch Rules from Attributes

Brendan created NIFI-10511:
------------------------------

             Summary: Group Processor Option to Set Batch Rules from Attributes
                 Key: NIFI-10511
                 URL: https://issues.apache.org/jira/browse/NIFI-10511
             Project: Apache NiFi
          Issue Type: New Feature
            Reporter: Brendan


The process group has an input strategy of *Single Batch Per Node* which follows a fixed batch rule defined by nifi itself

It would be nice to have the option to specify the batch conditions like the attribute which has the identifier, the counts/fragments to allow 

This is helpful for example if you want to set the input batch strategy but you want it to wait for those to complete, example files that get picked up from and SFTP every 5 min would each get a new batch ID and then at the processor it waits for all parts and then will wait until a past batch is complete before letting only a batch for one identifier through rather than everything currently queued in the inbound queue.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)