You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nifi.apache.org by Erik Anderson <ea...@pobox.com> on 2018/12/19 15:22:24 UTC

NiFi provenance events written to external systems?

For NiFi provenance events, whats the best way to dual write those provenance events (Provenance Repository?) to external systems?

In particular openstracing API's

https://github.com/opentracing

Any 3rd party ad-ons? Lower level hooks to the Provenance Repository? Writing of all provenance events to a Kafka pipe? etc....

I see some old hits about

http://mail-archives.apache.org/mod_mbox/nifi-users/201606.mbox/%3CCALo_M1-cGhEKj+2SztdpB53pAPkeZv0BeKxx5T5cv7cKVsB12Q@mail.gmail.com%3E

 SiteToSiteProvenanceReportingTask.java on the mailing lists but the hits are old.

Anyone have an example of doing this? There are zero hits on github.com for SiteToSiteProvenanceReporting.

Erik Anderson
Bloomberg

Re: NiFi provenance events written to external systems?

Posted by Mark Payne <ma...@hotmail.com>.
Hi Erik,

The Site To Site Provenance Reporting Task is the recommended approach. There's a post on how to get started with that [1].
I don't know of any other 3rd party additions to provide anything beyond this. Is there an issue that you're running into with this
approach?

Thanks
-Mark

[1] https://community.hortonworks.com/articles/72727/extracting-nifi-provenance-data-using-sitetositepr.html


On Dec 19, 2018, at 10:22 AM, Erik Anderson <ea...@pobox.com>> wrote:

For NiFi provenance events, whats the best way to dual write those provenance events (Provenance Repository?) to external systems?

In particular openstracing API's

https://github.com/opentracing

Any 3rd party ad-ons? Lower level hooks to the Provenance Repository? Writing of all provenance events to a Kafka pipe? etc....

I see some old hits about

http://mail-archives.apache.org/mod_mbox/nifi-users/201606.mbox/%3CCALo_M1-cGhEKj+2SztdpB53pAPkeZv0BeKxx5T5cv7cKVsB12Q@mail.gmail.com%3E

SiteToSiteProvenanceReportingTask.java on the mailing lists but the hits are old.

Anyone have an example of doing this? There are zero hits on github.com for SiteToSiteProvenanceReporting.

Erik Anderson
Bloomberg