You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@nifi.apache.org by si...@vonos.net on 2017/04/19 10:50:45 UTC

provenance events and performance

Hi All,

In some parts of the NiFi documentation, it is stated that a provenance 
event is emitted for each flowfile for each processor. However elsewhere 
it is stated that no provenance-event is generated for a flowfile sent 
to the \u201csuccess\u201d output of a processor - which is true?

And are there mechanisms for reducing the number of provenance events 
generated by a NiFi flow? When a dataflow is processing large numbers of 
events, it would seem to me that the generation of provenance events 
will be the limiting factor for performance. When processing 1 million 
records per day, generating 1 million provenance events (or worse) is 
not helpful..

Thanks in advance,

Simon