[jira] [Created] (KAFKA-1448) Filter-plugins for messages

["Moritz Möller (JIRA)" <ji...@apache.org>]

Moritz Möller created KAFKA-1448:
------------------------------------

             Summary: Filter-plugins for messages
                 Key: KAFKA-1448
                 URL: https://issues.apache.org/jira/browse/KAFKA-1448
             Project: Kafka
          Issue Type: Wish
          Components: consumer
            Reporter: Moritz Möller
            Assignee: Neha Narkhede


Hi,
we use Kafka to transmit different events that occur on different products, and would like to be able to subscribe only to a certain set of events for certain products.
Using one topic for each event * product combination would yield around 2000 topics, which seems to be not what kafka is designed for.
What we would need is a way to add a consumer filter plugin to kafka (a simple class that can accept or reject a message) and to pass a parameter from the consumer to that filter class.
Is there a better way to do this already, or if not, would you accept a patch upstream that adds such a mechanism?
Thanks,
Mo




--
This message was sent by Atlassian JIRA
(v6.2#6252)