You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@nifi.apache.org by Tomislav Novosel <to...@clearpeaks.com> on 2021/05/20 13:25:50 UTC

Delete FlowFile content

Hi to all,

what is the best way to delete flowfiles content so that flowfile
keeps attributes, but to not take space in next relationship between
two processors?

I found this:

https://stackoverflow.com/questions/53312069/what-is-a-fastest-way-to-remove-nifi-flowfile-content

But then flowfile will be striped off the attributes and lineage is lost.

I tried also ReplaceText to replace with Empty string, but I have large files
in the flow, so it is extremely slow.

Thanks,

Tom

AW: Delete FlowFile content

Posted by "Dobbernack, Harald (Key-Work)" <ha...@key-work.de>.
My choice in the past for such a case was  AttributesToJSON with Destination=flowfile-content thinking that this really quickly gets rid of large content, albeit replacing it with a small json …  don’t know  if this is better or worse performance wise than ReplaceText, but it does get the job done…

Von: Mark Payne <ma...@hotmail.com>
Gesendet: Donnerstag, 20. Mai 2021 15:32
An: users@nifi.apache.org
Betreff: Re: Delete FlowFile content

Easiest way is to use ReplaceText. But put the replacement strategy (may not be exactly the name of the property) to Always Replace instead of Regex Replace. That should be extremely fast.
Sent from my iPhone


On May 20, 2021, at 9:26 AM, Tomislav Novosel <to...@clearpeaks.com>> wrote:

Hi to all,

what is the best way to delete flowfiles content so that flowfile
keeps attributes, but to not take space in next relationship between
two processors?

I found this:

https://stackoverflow.com/questions/53312069/what-is-a-fastest-way-to-remove-nifi-flowfile-content

But then flowfile will be striped off the attributes and lineage is lost.

I tried also ReplaceText to replace with Empty string, but I have large files
in the flow, so it is extremely slow.

Thanks,

Tom


Harald Dobbernack

Key-Work Consulting GmbH | Kriegsstr. 100 | 76133 | Karlsruhe | Germany | www.key-work.de<https://www.key-work.de> | Datenschutz<https://www.key-work.de/de/footer/datenschutz.html>
Fon: +49-721-78203-264 | E-Mail: harald.dobbernack@key-work.de

Key-Work Consulting GmbH, Karlsruhe, HRB 108695, HRG Mannheim
Geschäftsführer: Andreas Stappert, Tobin Wotring

Re: Delete FlowFile content

Posted by Mark Payne <ma...@hotmail.com>.
Easiest way is to use ReplaceText. But put the replacement strategy (may not be exactly the name of the property) to Always Replace instead of Regex Replace. That should be extremely fast.

Sent from my iPhone

On May 20, 2021, at 9:26 AM, Tomislav Novosel <to...@clearpeaks.com> wrote:


Hi to all,

what is the best way to delete flowfiles content so that flowfile
keeps attributes, but to not take space in next relationship between
two processors?

I found this:

https://stackoverflow.com/questions/53312069/what-is-a-fastest-way-to-remove-nifi-flowfile-content

But then flowfile will be striped off the attributes and lineage is lost.

I tried also ReplaceText to replace with Empty string, but I have large files
in the flow, so it is extremely slow.

Thanks,

Tom