[jira] [Updated] (NIFI-697) MergeContent and queue swapping

["Joseph Witt (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/NIFI-697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Joseph Witt updated NIFI-697:
-----------------------------
    Fix Version/s: 0.4.0

> MergeContent and queue swapping
> -------------------------------
>
>                 Key: NIFI-697
>                 URL: https://issues.apache.org/jira/browse/NIFI-697
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Core Framework
>    Affects Versions: 0.1.0
>            Reporter: Michael Moser
>            Priority: Minor
>             Fix For: 0.4.0
>
>
> MergeContent will not place more files into bins than the nifi.properties nifi.queue.swap.threshold (default 20,000).  This is probably worth a documentation note.  Perhaps in the Maximum Number of Entries description in BinFiles.  It says "The maximum number of files to include in a bundle. If not specified, there is no maximum."  The maximum seems to be = nifi.queue.swap.threshold.
> Test Case: GenerateFlowFile and put about 81,000 files into a queue to MergeContent.  Wait for most of them to be swapped out.  Set Minimum Number of Entries to 25000.  Set Max Bin Age to 1 min.  When you start MergeContent, it will wait the Max Bin Age duration, then it will merge 20,000 files (the nifi.queue.swap.threshold).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)