You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@nifi.apache.org by "Evan Reynolds (JIRA)" <ji...@apache.org> on 2019/06/05 00:21:00 UTC

[jira] [Created] (NIFI-6349) MergeRecord does not merge fragmented files correctly

Evan Reynolds created NIFI-6349:
-----------------------------------

             Summary: MergeRecord does not merge fragmented files correctly
                 Key: NIFI-6349
                 URL: https://issues.apache.org/jira/browse/NIFI-6349
             Project: Apache NiFi
          Issue Type: Bug
          Components: Extensions
    Affects Versions: 1.9.2
            Reporter: Evan Reynolds
         Attachments: Merge_Test_Flow.xml

When MergeRecords tries to merge fragments it will close the bin after a single run. This means that fragments that come in seconds apart will not be merged.

To replicate this, import the attached flow template and run the GenerateFlowFile processor. It will generate 2000 flow files. MergeRecord should merge them back but a number of them will fail.

To replicate this in a unit test, go to the testDefragment method and change "runner.run(1)" to "runner.run(2)". It will fail.

In code - it is using the minimum number of records, which defaults to 1, to see if the bin is full. Once a single fragment comes in, the bin will show full and will be marked complete. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)