You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by forece85 <fo...@gmail.com> on 2021/03/09 07:50:01 UTC
Spark Streaming - Routing rdd to Executor based on Key
We are doing batch processing using Spark Streaming with Kinesis with a batch
size of 5 mins. We want to send all events with same eventId to same
executor for a batch so that we can do multiple events based grouping
operations based on eventId. No previous batch or future batch data is
concerned. Only Current batch keyed operation needed.
Please help me how to achieve this.
Thanks.
--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org