Data interaction between various RDDs in Spark Streaming

[swetha <sw...@gmail.com>]

Hi,

Suppose I want the data to be grouped by and Id named "12345" and I have
certain amount of data coming out from one batch for "12345" and I have data
related to "12345" coming after 5 hours, how do I group by "12345" and have
a single RDD of list?

Thanks,
Swetha



--
View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Data-interaction-between-various-RDDs-in-Spark-Streaming-tp13058.html
Sent from the Apache Spark Developers List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org

Re: Data interaction between various RDDs in Spark Streaming

[Akhil Das <ak...@sigmoidanalytics.com>]

UpdatestateByKey?

Thanks
Best Regards

On Wed, Jul 8, 2015 at 1:05 AM, swetha <sw...@gmail.com> wrote:

> Hi,
>
> Suppose I want the data to be grouped by and Id named "12345" and I have
> certain amount of data coming out from one batch for "12345" and I have
> data
> related to "12345" coming after 5 hours, how do I group by "12345" and have
> a single RDD of list?
>
> Thanks,
> Swetha
>
>
>
> --
> View this message in context:
> http://apache-spark-developers-list.1001551.n3.nabble.com/Data-interaction-between-various-RDDs-in-Spark-Streaming-tp13058.html
> Sent from the Apache Spark Developers List mailing list archive at
> Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>
>