[GitHub] [pinot] walterddr commented on issue #7652: Add system/metadata table

[GitBox <gi...@apache.org>]

walterddr commented on issue #7652:
URL: https://github.com/apache/pinot/issues/7652#issuecomment-957968337


   > Have you considered adding an interface to publishing such metadata to a stream? You can then consume it in Pinot and get analytics on it.
   
   this sounds like a great idea. in fact I was thinking about making the `collect(metadata)` as a stream interface or something similar to real-time segment upload logic. 
   
   The main idea for this SPI is to 
   1. create a separate user-facing API to log "important" logs that are different from the normal info/warn/error
   2. enforce some type of schema on the log itself instead of a generic JSON blob
   3. separate the "collect" and the "flush".
   
   I was not my intention to limit the interface to publish to disk/database but not a stream.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org