You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by miki haiat <mi...@gmail.com> on 2015/01/21 14:52:53 UTC

Receive Facebook real time updates into Kafka

im pretty new to kafka  and i'm  wondering  if i'm heading in the right
direction.

I want to recive Facebook real time update [facebook subscriptions][1] into
kafka .

To get the data back from Facebook you need to provide URL that you will be
receiving the data back.

So i figured out the the best way to recive the data is to implement
 [dropwizard-kafka-http][2] and push the data into kafka ,
 or creating Services with spray  and Scala DSL ....



 - Is it the best way to recive the data or you recomend a better way?

thanks,

miki

  [1]:
https://developers.facebook.com/docs/graph-api/reference/v2.2/app/subscriptions
  [2]: https://github.com/stealthly/dropwizard-kafka-http

Re: Receive Facebook real time updates into Kafka

Posted by Shannon Lloyd <sh...@gmail.com>.
FB will require specific endpoints to POST data to (and it looks like it
also requires a GET endpoint that it can query to validate your service),
and the data won't be in the format expected by the Dropwizard Kafka API.
The amount of work required in implementing a simple REST API to do this
yourself (especially if you only want to submit data, and not consume it)
is so small that you may as well just do it yourself using whatever stack
you prefer. Dropwizard itself would certainly work, but you may as well
write your own resource class with endpoints that correspond to what FB
wants to send you.

On 21 January 2015 at 23:52, miki haiat <mi...@gmail.com> wrote:

> im pretty new to kafka  and i'm  wondering  if i'm heading in the right
> direction.
>
> I want to recive Facebook real time update [facebook subscriptions][1] into
> kafka .
>
> To get the data back from Facebook you need to provide URL that you will be
> receiving the data back.
>
> So i figured out the the best way to recive the data is to implement
>  [dropwizard-kafka-http][2] and push the data into kafka ,
>  or creating Services with spray  and Scala DSL ....
>
>
>
>  - Is it the best way to recive the data or you recomend a better way?
>
> thanks,
>
> miki
>
>   [1]:
>
> https://developers.facebook.com/docs/graph-api/reference/v2.2/app/subscriptions
>   [2]: https://github.com/stealthly/dropwizard-kafka-http
>