You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@kafka.apache.org by "Dennis Jaheruddin (Jira)" <ji...@apache.org> on 2020/08/25 13:06:00 UTC

[jira] [Created] (KAFKA-10430) Hook support

Dennis Jaheruddin created KAFKA-10430:
-----------------------------------------

             Summary: Hook support
                 Key: KAFKA-10430
                 URL: https://issues.apache.org/jira/browse/KAFKA-10430
             Project: Kafka
          Issue Type: Improvement
            Reporter: Dennis Jaheruddin


Currently big data storage (like HDFS and HBASE) allows other tooling to hook into it, for instance atlas.

As data movement tools become more open to Kafka as well, it makes sense to shift significant amounts of storage to Kafka, for instance when one just needs a buffer.

However, this may be blocked due to governance constraints. As currently producers and consumers would need to actively make an effort to log governance (where something like HDFS can guarantee its capture).

Hence I believe we should make it possible to hook into kafka as well so one does not simply depend on the integrity of the producers and consumers.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)