You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@pinot.apache.org by xi...@apache.org on 2019/11/13 06:23:42 UTC

[incubator-pinot] branch pinot-ingestion-refactor updated (58d423e -> a494ceb)

This is an automated email from the ASF dual-hosted git repository.

xiangfu pushed a change to branch pinot-ingestion-refactor
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.


    from 58d423e  Address comments
     add a494ceb  Make spark job an option to parallel push segments

No new revisions were added by this update.

Summary of changes:
 .../pinot/ingestion/common/JobConfigConstants.java |  3 ++
 .../pinot/ingestion/jobs/SegmentTarPushJob.java    |  8 ++--
 .../pinot/ingestion/jobs/SegmentUriPushJob.java    | 10 ++--
 .../apache/pinot/spark/PinotSparkJobLauncher.java  | 12 ++---
 .../pinot/spark/jobs/SparkSegmentTarPushJob.java   | 54 ++++++++++++++++++++++
 .../pinot/spark/jobs/SparkSegmentUriPushJob.java   | 46 ++++++++++++++++++
 6 files changed, 118 insertions(+), 15 deletions(-)
 create mode 100644 pinot-ingestion-jobs/pinot-spark/src/main/java/org/apache/pinot/spark/jobs/SparkSegmentTarPushJob.java
 create mode 100644 pinot-ingestion-jobs/pinot-spark/src/main/java/org/apache/pinot/spark/jobs/SparkSegmentUriPushJob.java


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org