You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nifi.apache.org by Erik Anderson <ea...@pobox.com> on 2018/12/19 15:22:24 UTC
NiFi provenance events written to external systems?
For NiFi provenance events, whats the best way to dual write those provenance events (Provenance Repository?) to external systems?
In particular openstracing API's
https://github.com/opentracing
Any 3rd party ad-ons? Lower level hooks to the Provenance Repository? Writing of all provenance events to a Kafka pipe? etc....
I see some old hits about
http://mail-archives.apache.org/mod_mbox/nifi-users/201606.mbox/%3CCALo_M1-cGhEKj+2SztdpB53pAPkeZv0BeKxx5T5cv7cKVsB12Q@mail.gmail.com%3E
SiteToSiteProvenanceReportingTask.java on the mailing lists but the hits are old.
Anyone have an example of doing this? There are zero hits on github.com for SiteToSiteProvenanceReporting.
Erik Anderson
Bloomberg
Re: NiFi provenance events written to external systems?
Posted by Mark Payne <ma...@hotmail.com>.
Hi Erik,
The Site To Site Provenance Reporting Task is the recommended approach. There's a post on how to get started with that [1].
I don't know of any other 3rd party additions to provide anything beyond this. Is there an issue that you're running into with this
approach?
Thanks
-Mark
[1] https://community.hortonworks.com/articles/72727/extracting-nifi-provenance-data-using-sitetositepr.html
On Dec 19, 2018, at 10:22 AM, Erik Anderson <ea...@pobox.com>> wrote:
For NiFi provenance events, whats the best way to dual write those provenance events (Provenance Repository?) to external systems?
In particular openstracing API's
https://github.com/opentracing
Any 3rd party ad-ons? Lower level hooks to the Provenance Repository? Writing of all provenance events to a Kafka pipe? etc....
I see some old hits about
http://mail-archives.apache.org/mod_mbox/nifi-users/201606.mbox/%3CCALo_M1-cGhEKj+2SztdpB53pAPkeZv0BeKxx5T5cv7cKVsB12Q@mail.gmail.com%3E
SiteToSiteProvenanceReportingTask.java on the mailing lists but the hits are old.
Anyone have an example of doing this? There are zero hits on github.com for SiteToSiteProvenanceReporting.
Erik Anderson
Bloomberg