You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@nifi.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2019/02/15 17:01:00 UTC

[jira] [Commented] (NIFI-6037) MergeRecord, when configured with a small bin size, does not merge based solely on min requirements.

    [ https://issues.apache.org/jira/browse/NIFI-6037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769507#comment-16769507 ] 

ASF subversion and git services commented on NIFI-6037:
-------------------------------------------------------

Commit b508d6bfbc2b6a68fe2ab152de96611f06a8724a in nifi's branch refs/heads/master from Mark Payne
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=b508d6b ]

NIFI-6033, NIFI-6034, NIFI-6035, NIFI-6036, NIFI-6037: Fixed bugs that were found during 1.9.0-RC1 validation. If multiple FlowFiles were written to same Content Claim, and a Processor attempted to read two of them wi within a single session, it would seek to the wrong part of the content or else throw a ContentNotFoundException. Updated logic for considering a processor to be 'running' / having 'active threads' if the processor is invalid upon NiFi restart but scheduled to run. Fixed NPE in FreeFormTextWriter. If MergeRecord reaches minimum number of records, flush writer after writing content out so that its minimum size can accurately be checked.

This closes #3309.

Signed-off-by: Bryan Bende <bb...@apache.org>


> MergeRecord, when configured with a small bin size, does not merge based solely on min requirements.
> ----------------------------------------------------------------------------------------------------
>
>                 Key: NIFI-6037
>                 URL: https://issues.apache.org/jira/browse/NIFI-6037
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Extensions
>            Reporter: Mark Payne
>            Assignee: Mark Payne
>            Priority: Major
>             Fix For: 1.9.0
>
>
> Create a MergeRecord processor. Set Min Records = 1, Max Records = 1,000,000, Min Size = 1 B, Max Size = 64 MB. Feed in a few records. No bins will be created. Once the size of the records has reached 4-8 KB or so, it does create the bin, but very small bins won't be created. It appears to be related to buffered output not being counted in the bin's size.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)