[GitHub] [incubator-druid] satybald opened a new issue #7366: Add custom Json extractors for kafka-extraction-namespace

[GitBox <gi...@apache.org>]

satybald opened a new issue #7366: Add custom Json extractors for kafka-extraction-namespace
URL: https://github.com/apache/incubator-druid/issues/7366
 
 
   ### Description
   
   Provide functionality to use JSON payloads for `kafka-extraction-namespace`, with option specifying key and values objects in the payload.
   
   ### Motivation
   
   Small Kafka topics are quite dynamic and useful concept to have as a data source for lookups(aka facts tables). However, the current implementation of [Kafka Lookups](http://druid.io/docs/latest/development/extensions-core/kafka-extraction-namespace.html) uses only topic message payload as values and topic key as the key for druid lookup map. This a rigid setup, requires a team to transform existing topics to plain key/value topic.
   
   It would be better to have flexibility and extract values and keys from the message payload as UriExtractionNamespace in druid does.
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org