You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Brian Hawkins (JIRA)" <ji...@apache.org> on 2017/09/06 20:42:01 UTC
[jira] [Created] (KAFKA-5847) Plugin option to filter consumer and
producer messages on the broker
Brian Hawkins created KAFKA-5847:
------------------------------------
Summary: Plugin option to filter consumer and producer messages on the broker
Key: KAFKA-5847
URL: https://issues.apache.org/jira/browse/KAFKA-5847
Project: Kafka
Issue Type: Wish
Components: core
Affects Versions: 0.10.2.1
Reporter: Brian Hawkins
The idea is that I could specify a plugin that would receive a message, after authorization but before it is written to the log. The plugin could then modify or reject the message before passing it on. A good place for this would be in KafkaApis.scala in handleProducerRequest.
Similarly a message could be modified before it is sent to the consumer.
I have two use cases in mind:
1. deal with large messages, the interceptor/filter would write the message to a large storage server (think s3).
2. encrypt data before being written to the log.
I'm planning on doing this work, just curious if others are interested so I can make a pull request of it.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)