You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by forough <fo...@gmail.com> on 2014/11/01 09:53:11 UTC

deterministic D-Stream mode

Hi all, 
I have 2 questions:

1. I found out the meaning of "deterministic" in D-Stream model is :
given a particular input, will always produce the same output that is
necessary for recomputation in lineage.
Is it right? 

2. Why spark stream needs to replicate input data for making deterministic
state? what is the relation between deterministic tasks or operations and
replication?

Thanks.



--
View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/deterministic-D-Stream-mode-tp9054.html
Sent from the Apache Spark Developers List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org