You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@nifi.apache.org by "Joseph Witt (JIRA)" <ji...@apache.org> on 2015/05/04 07:07:06 UTC

[jira] [Created] (NIFI-579) MergeContent should handle 10s of thousands+ item merges more efficiently

Joseph Witt created NIFI-579:
--------------------------------

             Summary: MergeContent should handle 10s of thousands+ item merges more efficiently
                 Key: NIFI-579
                 URL: https://issues.apache.org/jira/browse/NIFI-579
             Project: Apache NiFi
          Issue Type: Improvement
          Components: Extensions
            Reporter: Joseph Witt
            Priority: Minor
             Fix For: 0.1.1


The way MergeContent works it opens the file handles for all items to be merged then writes all their content to a new resulting output file.

It creates problems when merging thousands, tens of thousands, and more objects as it means there are massive amounts of open file handles.  This seems avoidable and users should not be required to leave unlimited number of open file handles for it to work nicely.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)