You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@nifi.apache.org by "Peter Turcsanyi (Jira)" <ji...@apache.org> on 2020/01/13 17:05:00 UTC

[jira] [Resolved] (NIFI-6992) Add "Batch Size" property to GetHDFSFileInfo processor

     [ https://issues.apache.org/jira/browse/NIFI-6992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Peter Turcsanyi resolved NIFI-6992.
-----------------------------------
    Fix Version/s: 1.11.0
       Resolution: Fixed

> Add "Batch Size" property to GetHDFSFileInfo processor
> ------------------------------------------------------
>
>                 Key: NIFI-6992
>                 URL: https://issues.apache.org/jira/browse/NIFI-6992
>             Project: Apache NiFi
>          Issue Type: Improvement
>          Components: Extensions
>            Reporter: Tamas Palfy
>            Assignee: Tamas Palfy
>            Priority: Major
>             Fix For: 1.11.0
>
>          Time Spent: 3h 10m
>  Remaining Estimate: 0h
>
> GetHDFSFileInfo creates 1 output flowfile for every HDFS file when Grouping is set to None.
> Other grouping strategies are adding a tree structure to the result instead of a flat structure.
> I solution is required to be able to stream HDFS file info results into output but batched, so that huge amount of flowfiles residing in a single session can be prevented.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)