You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Sunil Yarram <yv...@gmail.com> on 2014/11/27 08:12:22 UTC

updateStateByKey

I have a use case where it requires a huge number of keys' state to be
stored and updated with the latest values from the stream. I am planning to
use updateStateByKey with checkpointing.
I would like to know the performance implication on updateStateByKey as the
keys stored in the state grows rapidly. Please share your
thoughts/experience.

Thanks,
Sunil.