You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@spark.apache.org by tpawlowski <t....@mimuw.edu.pl> on 2018/07/03 12:48:37 UTC

[Spark Streaming] mapStateByKey Python SDK

I am a user of Spark Streaming Python SDK. In many cases stateful operations
are the only way to approach problems I am solving. UpdateStateByKey method,
which I believe is the only way to introduce a stateful operator, requires
some extra code to extract result from the states and to remove values for
keys not updated for a long time. Yet I can see there is a method in Scala
SDK, mapStateByKey, which solves this problems. Is there a plan to introduce
it into Python SDK?

Thanks!
Tomasz



--
Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org