You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Joseph Witt (JIRA)" <ji...@apache.org> on 2017/12/05 03:25:00 UTC

[jira] [Commented] (NIFI-4658) MergeContent Max Number of Entries resetting to default value

    [ https://issues.apache.org/jira/browse/NIFI-4658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16277951#comment-16277951 ] 

Joseph Witt commented on NIFI-4658:
-----------------------------------

The issue occurred with this change https://github.com/apache/nifi/commit/6e77933

Having a default value of 1000 is a very good idea.  What should have happened is the description should have changed from

             .description("The maximum number of files to include in a bundle. If not specified, there is no maximum.")

To

             .description("The maximum number of files to include in a bundle. If not specified, the default will be used.")

Any component property which has a default value specified in the property descriptor will have that default value used whenever the property is not set.  So, if you'd like a large number of merged items you'll need to specify the value.  Please note thought that arbitrarily large numbers are not recommended either as that would mean that many flowfile objects (not the content) in a single process session which could lead to heap exhaustion. For such cases two phase MergeContent chains are recommended such that say two in a row with max of 1000 entries means you can safely merge 1,000,000 objects with no memory issues.

Thanks


> MergeContent Max Number of Entries resetting to default value
> -------------------------------------------------------------
>
>                 Key: NIFI-4658
>                 URL: https://issues.apache.org/jira/browse/NIFI-4658
>             Project: Apache NiFi
>          Issue Type: Bug
>    Affects Versions: 1.4.0
>            Reporter: Brian Ghigiarelli
>
> Prior to and including 1.4.0, the MergeContent processor supports a property called "Maximum Number of Entries". It has a default value of 1,000. Prior to 1.4.0 and in the description of this property, if the property is not set, there will be no maximum number of files to include in a bundle.
> However, with the release of 1.4.0, if you clear the value of this property in order to have an unlimited number of files in the bundle and "Apply" the change, the next time that you open the configuration of the processor, it will again be set to the default value of 1,000. The expectation is that the cleared value will remain cleared, maintaining a configuration for an unlimited number of files in a merge bundle.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)