You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2019/12/05 07:03:41 UTC

[GitHub] [incubator-druid] jon-wei commented on a change in pull request #8982: Add DruidInputSource (replacement for IngestSegmentFirehose)

jon-wei commented on a change in pull request #8982: Add DruidInputSource (replacement for IngestSegmentFirehose)
URL: https://github.com/apache/incubator-druid/pull/8982#discussion_r354137196
 
 

 ##########
 File path: docs/ingestion/native-batch.md
 ##########
 @@ -890,3 +890,31 @@ This Firehose can be used to combine and merge data from a list of different Fir
 |--------|-----------|---------|
 |type|This should be "combining"|yes|
 |delegates|List of Firehoses to combine data from|yes|
+
+
+## Input Sources
+
+### DruidInputSource
+
+This InputSource can be used to read data from existing Druid segments, potentially using a new schema and changing the name, dimensions, metrics, rollup, etc. of the segment.
+This InputSource is _splittable_ and can be used by [native parallel index tasks](native-batch.md#parallel-task).
+This InputSource has a fixed InputFormat for reading from Druid segments; no InputFormat needs to be specified in the ingestion spec when using this InputSource.
+
+A sample DruidInputSource spec is shown below:
+
+```json
+{
+    "type": "druid",
+    "dataSource": "wikipedia",
+    "interval": "2013-01-01/2013-01-02"
 
 Review comment:
   Added a second example with more explanation of what the example specs do

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org