You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@kafka.apache.org by sanjeeb kumar <sa...@gmail.com> on 2014/12/05 21:31:36 UTC

Need to use Kafka with spark

Hi Team,
I am able to install Kafka in Ubuntu and also Kafka. I need to read data
from facebook and do some filter and send it to Mongo db  and create a
report which will be used analytics team.

I would like to know how can i read data from web and the kafka can send it
to spark for transformation.

Regards
Sanjeeb

Re: Need to use Kafka with spark

Posted by David Morales de Frías <dm...@paradigmatecnologico.com>.

This is a very nice intro to spark and kafka, with some valuable details
about partitioning and parallelism



http://www.michael-noll.com/blog/2014/10/01/kafka-spark-streaming-integration-example-tutorial/



2014-12-05 21:31 GMT+01:00 sanjeeb kumar <sa...@gmail.com>:

> Hi Team,
> I am able to install Kafka in Ubuntu and also Kafka. I need to read data
> from facebook and do some filter and send it to Mongo db  and create a
> report which will be used analytics team.
>
> I would like to know how can i read data from web and the kafka can send it
> to spark for transformation.
>
> Regards
> Sanjeeb
>