You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@nifi.apache.org by si...@vonos.net on 2017/04/19 10:50:45 UTC
provenance events and performance
Hi All,
In some parts of the NiFi documentation, it is stated that a provenance
event is emitted for each flowfile for each processor. However elsewhere
it is stated that no provenance-event is generated for a flowfile sent
to the \u201csuccess\u201d output of a processor - which is true?
And are there mechanisms for reducing the number of provenance events
generated by a NiFi flow? When a dataflow is processing large numbers of
events, it would seem to me that the generation of provenance events
will be the limiting factor for performance. When processing 1 million
records per day, generating 1 million provenance events (or worse) is
not helpful..
Thanks in advance,
Simon