You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@nifi.apache.org by Tomislav Novosel <to...@clearpeaks.com> on 2021/05/20 13:25:50 UTC
Delete FlowFile content
Hi to all,
what is the best way to delete flowfiles content so that flowfile
keeps attributes, but to not take space in next relationship between
two processors?
I found this:
https://stackoverflow.com/questions/53312069/what-is-a-fastest-way-to-remove-nifi-flowfile-content
But then flowfile will be striped off the attributes and lineage is lost.
I tried also ReplaceText to replace with Empty string, but I have large files
in the flow, so it is extremely slow.
Thanks,
Tom
AW: Delete FlowFile content
Posted by "Dobbernack, Harald (Key-Work)" <ha...@key-work.de>.
My choice in the past for such a case was AttributesToJSON with Destination=flowfile-content thinking that this really quickly gets rid of large content, albeit replacing it with a small json … don’t know if this is better or worse performance wise than ReplaceText, but it does get the job done…
Von: Mark Payne <ma...@hotmail.com>
Gesendet: Donnerstag, 20. Mai 2021 15:32
An: users@nifi.apache.org
Betreff: Re: Delete FlowFile content
Easiest way is to use ReplaceText. But put the replacement strategy (may not be exactly the name of the property) to Always Replace instead of Regex Replace. That should be extremely fast.
Sent from my iPhone
On May 20, 2021, at 9:26 AM, Tomislav Novosel <to...@clearpeaks.com>> wrote:
Hi to all,
what is the best way to delete flowfiles content so that flowfile
keeps attributes, but to not take space in next relationship between
two processors?
I found this:
https://stackoverflow.com/questions/53312069/what-is-a-fastest-way-to-remove-nifi-flowfile-content
But then flowfile will be striped off the attributes and lineage is lost.
I tried also ReplaceText to replace with Empty string, but I have large files
in the flow, so it is extremely slow.
Thanks,
Tom
Harald Dobbernack
Key-Work Consulting GmbH | Kriegsstr. 100 | 76133 | Karlsruhe | Germany | www.key-work.de<https://www.key-work.de> | Datenschutz<https://www.key-work.de/de/footer/datenschutz.html>
Fon: +49-721-78203-264 | E-Mail: harald.dobbernack@key-work.de
Key-Work Consulting GmbH, Karlsruhe, HRB 108695, HRG Mannheim
Geschäftsführer: Andreas Stappert, Tobin Wotring
Re: Delete FlowFile content
Posted by Mark Payne <ma...@hotmail.com>.
Easiest way is to use ReplaceText. But put the replacement strategy (may not be exactly the name of the property) to Always Replace instead of Regex Replace. That should be extremely fast.
Sent from my iPhone
On May 20, 2021, at 9:26 AM, Tomislav Novosel <to...@clearpeaks.com> wrote:
Hi to all,
what is the best way to delete flowfiles content so that flowfile
keeps attributes, but to not take space in next relationship between
two processors?
I found this:
https://stackoverflow.com/questions/53312069/what-is-a-fastest-way-to-remove-nifi-flowfile-content
But then flowfile will be striped off the attributes and lineage is lost.
I tried also ReplaceText to replace with Empty string, but I have large files
in the flow, so it is extremely slow.
Thanks,
Tom