You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Ben Teeuwen <bt...@gmail.com> on 2016/07/28 08:30:45 UTC

Materializing mapWithState .stateSnapshot() after ssc.stop

Hi all,

I’ve posted a question regarding sessionizing events using scala and mapWithState at http://stackoverflow.com/questions/38541958/materialize-mapwithstate-statesnapshots-to-database-for-later-resume-of-spark-st <http://stackoverflow.com/questions/38541958/materialize-mapwithstate-statesnapshots-to-database-for-later-resume-of-spark-st>. 

The context is to be able to pause and resume a streaming app while not losing the state information. So I want to save and reload (initialize) the state snapshot. Has anyone of you already been able to do this?

Thanks,

Ben