You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@reef.apache.org by Dhruv Mahajan <dh...@gmail.com> on 2015/11/18 00:46:54 UTC
An informative question
Hi
I was wondering if driver container is multi threaded. Exactly this is the
motivation:
Say I have 1000 evaluators. And I need to set up driver configuration, set
up communication operators between them and so on. All this takes a lot of
time. In my experience the time consuming step can be following: a) Wiring
up group communication between evaluators and/or b) shipping dlls to each
evaluator if number of dlls are large of large size which is case for my
application.
Now regarding b), I was discussing with Markus and understanding I got was
that even the dlls that are common to all evaluators are shipped separately
to each evaluator, rather than putting them in to some common location.
Will it help if we put it in some common location from which evaluators
know how to get them?
Just to give you an example, I ran c# code for 400 evaluators with group
communications. It took 7 mins for task to actually begin.
Dhruv
Re: An informative question
Posted by Byung-Gon Chun <bg...@gmail.com>.
Hi,
Can I ask you a clarification question?
Are you asking that you'd like to ship a dll once for all the evaluators
running in one machine but this is not the case?
-Gon
On Wed, Nov 18, 2015 at 8:46 AM, Dhruv Mahajan <dh...@gmail.com>
wrote:
> Hi
>
> I was wondering if driver container is multi threaded. Exactly this is the
> motivation:
>
> Say I have 1000 evaluators. And I need to set up driver configuration, set
> up communication operators between them and so on. All this takes a lot of
> time. In my experience the time consuming step can be following: a) Wiring
> up group communication between evaluators and/or b) shipping dlls to each
> evaluator if number of dlls are large of large size which is case for my
> application.
>
> Now regarding b), I was discussing with Markus and understanding I got was
> that even the dlls that are common to all evaluators are shipped separately
> to each evaluator, rather than putting them in to some common location.
> Will it help if we put it in some common location from which evaluators
> know how to get them?
>
> Just to give you an example, I ran c# code for 400 evaluators with group
> communications. It took 7 mins for task to actually begin.
>
> Dhruv
>
--
Byung-Gon Chun