You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@nifi.apache.org by "Tamas Palfy (Jira)" <ji...@apache.org> on 2020/01/08 15:04:00 UTC

[jira] [Created] (NIFI-6992) Add "Batch Size" property to GetHDFSFileInfo processor

Tamas Palfy created NIFI-6992:
---------------------------------

             Summary: Add "Batch Size" property to GetHDFSFileInfo processor
                 Key: NIFI-6992
                 URL: https://issues.apache.org/jira/browse/NIFI-6992
             Project: Apache NiFi
          Issue Type: Improvement
          Components: Extensions
            Reporter: Tamas Palfy
            Assignee: Tamas Palfy


GetHDFSFileInfo creates 1 output flowfile for every HDFS file when Grouping is set to None.
Other grouping strategies are adding a tree structure to the result instead of a flat structure.

I solution is required to be able to stream HDFS file info results into output but batched, so that huge amount of flowfiles residing in a single session can be prevented.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)