You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Theodore Si <sj...@gmail.com> on 2014/10/22 13:00:08 UTC

Which part of the code deals with communication?

Hi all,

Workers will exchange data in between, right?

What classes are in charge of these actions?

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org


Re: Which part of the code deals with communication?

Posted by Patrick Wendell <pw...@gmail.com>.
The best documentation about communication interfaces is the
SecurityManager doc written by Tom Graves. With this as a starting
point I'd recommend digging through the code for each component.

https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/SecurityManager.scala#L59

On Wed, Oct 22, 2014 at 4:00 AM, Theodore Si <sj...@gmail.com> wrote:
> Hi all,
>
> Workers will exchange data in between, right?
>
> What classes are in charge of these actions?
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
> For additional commands, e-mail: dev-help@spark.apache.org
>

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org