You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@spark.apache.org by Renjie Liu <li...@gmail.com> on 2015/11/03 08:06:29 UTC

Re: Guaranteed processing orders of each batch in Spark Streaming

Hi, all:
I have given a detailed description of my proposal in this jira
<https://issues.apache.org/jira/browse/SPARK-11308>.

On Mon, Oct 19, 2015 at 2:58 PM Renjie Liu <li...@gmail.com> wrote:

> Hi, all:
> I've read source code and it seems that there is no guarantee that the
> order of processing of each RDD is guaranteed since jobs are just submitted
> to a thread pool. I  believe that this is quite important in streaming
> since updates should be ordered.
>
> --
Liu, Renjie
Software Engineer, MVAD