[jira] [Created] (NIFI-2590) Added the FlowFileAggregationController Processor

["Alex Halldin (JIRA)" <ji...@apache.org>]

Alex Halldin created NIFI-2590:
----------------------------------

             Summary: Added the FlowFileAggregationController Processor
                 Key: NIFI-2590
                 URL: https://issues.apache.org/jira/browse/NIFI-2590
             Project: Apache NiFi
          Issue Type: New Feature
            Reporter: Alex Halldin


This processor is used to aggregate flowfiles and continuously feed them into another processor. This processor will keep track of the individual flow files, as well as an entire batch of flowfiles, and will throw away old flow files when a new batch is detected in an event driven fashion. The processor will also create and update a "startTime" attribute on all flowfiles that is controlled by the "Data Retrieval Time Delay" property.

An example of usage would be a query use case. The FlowFileAggregationController will aggregate a number of flowfiles representing query attributes, and will update the startTime's on each flowfile. As each flowfile is processed by the query processor and returned to the Aggregator, the Aggregator will update the startTime's once again with the end time of the previous query execution and will feed them back into the query processor. In other words, this processor will allows us to continually query using timestamps that are updated after each previous processing attempt.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)