You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@nifi.apache.org by "Alan Jackoway (Jira)" <ji...@apache.org> on 2020/05/05 20:09:00 UTC

[jira] [Created] (NIFI-7426) ReplaceText Line-by-Line Does Not Respect Maximum Buffer Size

Alan Jackoway created NIFI-7426:
-----------------------------------

             Summary: ReplaceText Line-by-Line Does Not Respect Maximum Buffer Size
                 Key: NIFI-7426
                 URL: https://issues.apache.org/jira/browse/NIFI-7426
             Project: Apache NiFi
          Issue Type: Improvement
    Affects Versions: 1.11.4
            Reporter: Alan Jackoway
         Attachments: LineByLineBuffer.xml

According to the docs on Maximum Buffer Size:
{quote}Specifies the maximum amount of data to buffer (per file or per line, depending on the Evaluation Mode) in order to apply the replacement. If 'Entire Text' (in Evaluation Mode) is selected and the FlowFile is larger than this value, the FlowFile will be routed to 'failure'. In 'Line-by-Line' Mode, if a single line is larger than this value, the FlowFile will be routed to 'failure'.
{quote}
While working on NIFI-7425, I wanted to see if the single line larger than the buffer case resulted in an error message that I could reuse when the entire text didn't fit in the buffer.

A far as I can tell, it is not the case that a single line larger than the buffer in line-by-line mode will send the file to the failure relationship. Or at least not with small values of the buffer. It may be different when the max buffer size is larger than the 8KB INIT_BUFFER_SIZE in AbstractTextDemarcator.

We should either change the docs to reflect how that parameter is used in line-by-line mode, or change the code to work the way the docs say.

I attached a template from 1.11.4 where the buffer size is 5 bytes, but a file with longer lines makes it through.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)