[jira] [Comment Edited] (NIFI-6349) MergeRecord does not merge fragmented files correctly

["Evan Reynolds (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/NIFI-6349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16856211#comment-16856211 ] 

Evan Reynolds edited comment on NIFI-6349 at 6/5/19 5:38 AM:
-------------------------------------------------------------

I created a pull request with a fix for this - 
https://github.com/apache/nifi/pull/3517


was (Author: evanthx):
I've got a code fix for this and will be submitting it shortly.

> MergeRecord does not merge fragmented files correctly
> -----------------------------------------------------
>
>                 Key: NIFI-6349
>                 URL: https://issues.apache.org/jira/browse/NIFI-6349
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Extensions
>    Affects Versions: 1.9.2
>            Reporter: Evan Reynolds
>            Priority: Major
>         Attachments: Merge_Test_Flow.xml
>
>   Original Estimate: 24h
>          Time Spent: 10m
>  Remaining Estimate: 23h 50m
>
> When MergeRecords tries to merge fragments it will close the bin after a single run. This means that fragments that come in seconds apart will not be merged.
> To replicate this, import the attached flow template and run the GenerateFlowFile processor. It will generate 2000 flow files. MergeRecord should merge them back but a number of them will fail.
> To replicate this in a unit test, go to the testDefragment method and change "runner.run(1)" to "runner.run(2)". It will fail.
> In code - it is using the minimum number of records, which defaults to 1, to see if the bin is full. Once a single fragment comes in, the bin will show full and will be marked complete. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)