You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2019/11/07 09:59:08 UTC

[GitHub] [incubator-pinot] fx19880617 opened a new pull request #4800: Pinot Ingestion Jobs Refactor

fx19880617 opened a new pull request #4800: Pinot Ingestion Jobs Refactor
URL: https://github.com/apache/incubator-pinot/pull/4800
 
 
   We are adding pinot-spark module which shares a lot of common code with pinot-hadoop.
   This refactor merges pinot-hadoop and pinot-spark into pinot-ingestion-jobs module and extracts common methods/jobs/utils into common module.
   
   Major refactors:
   - Move `BaseSegmentJob`,`SegmentCreationJob`,`SegmentPreprocessingJob`,`SegmentTarPushJob`,`SegmentUriPushJob` to common module.
   - Make `SegmentCreationJob` and `SegmentPreprocessingJob` an abstract class, and have each module to implement its own `run()` function.
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org