Batch Ingestion

I am looking for details on how can I ingest the data in Druid cluster. I need to collect the data and push the same via REST, from the document it appears the HTTPFirehose would be the best option however I am not able to get more details on it.

Can anyone point me to sample config and detailed steps on how to configure the same?

I would very much appreciate your help.

Thanks 

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@druid.apache.org
For additional commands, e-mail: dev-help@druid.apache.org

Re: Batch Ingestion

[Gian Merlino <gi...@apache.org>]

Hey Satya,

The easiest way to ingest data is to ask Druid to pull it from Kafka (
http://druid.io/docs/latest/tutorials/tutorial-kafka.html) or Hadoop (
http://druid.io/docs/latest/tutorials/tutorial-batch-hadoop.html).
Tranquility Server (
https://github.com/druid-io/tranquility/blob/master/docs/server.md) is the
closest thing to what you are looking for, but I'd prefer going with the
Kafka method at this point, since it has a number of advantages. See
https://imply.io/post/exactly-once-streaming-ingestion for more details on
that.

On Wed, Jan 2, 2019 at 3:44 PM satya0@gmail.com <sa...@gmail.com> wrote:

> I am looking for details on how can I ingest the data in Druid cluster. I
> need to collect the data and push the same via REST, from the document it
> appears the HTTPFirehose would be the best option however I am not able to
> get more details on it.
>
> Can anyone point me to sample config and detailed steps on how to
> configure the same?
>
> I would very much appreciate your help.
>
> Thanks
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@druid.apache.org
> For additional commands, e-mail: dev-help@druid.apache.org
>
>