You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by swetha <sw...@gmail.com> on 2015/08/04 03:32:31 UTC

Multiple UpdateStateByKey Functions in the same job?

Hi,

Can I use multiple UpdateStateByKey Functions in the Streaming job? Suppose
I need to maintain the state of the user session in the form of a Json and
counts of various other metrics which has different keys ? Can I use
multiple updateStateByKey functions to maintain the state for different keys
with different return values?

Thanks,
Swetha



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Multiple-UpdateStateByKey-Functions-in-the-same-job-tp24119.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org

Re: Multiple UpdateStateByKey Functions in the same job?

Posted by Akhil Das <ak...@sigmoidanalytics.com>.

I think you can. Give it a try and see.

Thanks
Best Regards

On Tue, Aug 4, 2015 at 7:02 AM, swetha <sw...@gmail.com> wrote:

> Hi,
>
> Can I use multiple UpdateStateByKey Functions in the Streaming job? Suppose
> I need to maintain the state of the user session in the form of a Json and
> counts of various other metrics which has different keys ? Can I use
> multiple updateStateByKey functions to maintain the state for different
> keys
> with different return values?
>
> Thanks,
> Swetha
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Multiple-UpdateStateByKey-Functions-in-the-same-job-tp24119.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>