[GitHub] [pinot] Jackie-Jiang commented on issue #8399: Persist raw data from kafka topic as it is

[GitBox <gi...@apache.org>]

Jackie-Jiang commented on issue #8399:
URL: https://github.com/apache/pinot/issues/8399#issuecomment-1116686955

   > @Jackie-Jiang If this property is set to true, then we should just ignore the filter and transform configs? Or should be provide a way to store the record as a JSON AFTER applying the filters and the transforms? IMO, most users would just want to store their records as-is, so we should just ignore any transform or filter configs.
   
   @suddendust IMO we should still honor the filter and transform configs. This new config means we want to store the whole record into a configured field, but we should still support filtering/extracting fields from the records. User might choose to use this new config to capture the whole record, but still extract the fields that are commonly used in the query for performance reason.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org