[GitHub] [incubator-pinot] kishoreg commented on issue #5220: pinot-recipes module

[GitBox <gi...@apache.org>]

kishoreg commented on issue #5220: pinot-recipes module
URL: https://github.com/apache/incubator-pinot/issues/5220#issuecomment-612656868
 
 
   This is a good idea. can we come up with a convention for adding recipes.
   What do we need to create a recipe
   - Table(s) REALTIME/OFFLINE
   - Config.json and schema.json for each table 
   - Raw data for REALTIME and OFFLINE table
   
   If all these things are placed in the appropriate folder structure. The recipe driver should do the following
   - start all in one pinot process (ZK, controller, server, broker)
   - create the tables with schema and config
   - For batch tables - generate segment and push to segment
   - For realtime tables - start Kafka as a separate process and write the raw data to Kafka
   - run a predefined set of queries
   - launch the pinot console
   
   
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org