You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@atlas.apache.org by "Dennis Jaheruddin (Jira)" <ji...@apache.org> on 2020/08/25 12:40:00 UTC

[jira] [Created] (ATLAS-3929) Kafka hook for Atlas

Dennis Jaheruddin created ATLAS-3929:
----------------------------------------

             Summary: Kafka hook for Atlas
                 Key: ATLAS-3929
                 URL: https://issues.apache.org/jira/browse/ATLAS-3929
             Project: Atlas
          Issue Type: Improvement
          Components: kafka-integration
            Reporter: Dennis Jaheruddin


Currently we already have hooks for many engines (such as Spark, Nifi, Flink). We also have a hook into the classical storage (HDFS). However, with streaming becoming more and more dominant, we should also get a hook into the streaming storage: Kafka.

Currently producers and consumers need to explicitly take atlas into account, but for stronger governance and auditability, it should be possible to capture every interaction with Kafka, regardless of how consumption or production is done.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)