You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Xi Shen <da...@gmail.com> on 2016/08/17 09:39:13 UTC

How to implement a InputDStream like the twitter stream in Spark?

Hi,

First I am not sure if I should inherit from InputDStream, or
ReceiverInputDStream. For ReceiverInputDStream, why would I want to run a
receiver on each worker nodes?

If I want to inherit InputDStream, what should I do in the comput() method?

-- 


Thanks,
David S.