You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hama.apache.org by Diot Sebastien <s....@eurodata.de> on 2012/09/22 15:30:06 UTC
Job placement
Hi.
Do you have any way of specifying how many jobs should run on how many nodes, and be able to find specifically the other jobs on the same node, under the assumption that the communication would be faster? This should allow a reduction in network communication by having one job act as a proxy/manager that talks to the proxy/managers on the other nodes, to balance load, and then split batches of work within the local job slaves on the same node.
MfG / Regards,
Sebastien Diot
Grossblittersdorferstrasse 257-259
66119 Saarbruecken
Germany
Tel.: +49 (681) 8808-0
Fax.: +49 (681) 8808-300
E-Mail.: s.diot@eurodata.de
-----------------------------------------------------
EURO DATA GmbH & Co. KG
Datenverarbeitungsdienst
HR A 6448 Amtsgericht Saarbrücken
Komplementär: A. Reiß & Sohn GmbH
HR B 4965 Amtsgericht Saarbrücken
Geschäftsführer: Dipl.-Kfm. Karl-Heinz Siebenpfeiffer
-----------------------------------------------------
Re: Job placement
Posted by Suraj Menon <su...@apache.org>.
You can configure the number of tasks per job. You can also configure the
number of tasks you can run on a single GroomServer.
Scheduling based on network health could be tracked here.-
https://issues.apache.org/jira/browse/HAMA-519
We have graph algorithms implemented using a master task with slave tasks
following Pregel model. Please check the graph package and example package.
Thanks,
Suraj
On Sat, Sep 22, 2012 at 9:30 AM, Diot Sebastien <s....@eurodata.de> wrote:
> Hi.
>
> Do you have any way of specifying how many jobs should run on how many
> nodes, and be able to find specifically the other jobs on the same node,
> under the assumption that the communication would be faster? This should
> allow a reduction in network communication by having one job act as a
> proxy/manager that talks to the proxy/managers on the other nodes, to
> balance load, and then split batches of work within the local job slaves on
> the same node.
>
>
> MfG / Regards,
> Sebastien Diot
>
> Grossblittersdorferstrasse 257-259
> 66119 Saarbruecken
> Germany
> Tel.: +49 (681) 8808-0
> Fax.: +49 (681) 8808-300
> E-Mail.: s.diot@eurodata.de
> -----------------------------------------------------
> EURO DATA GmbH & Co. KG
> Datenverarbeitungsdienst
> HR A 6448 Amtsgericht Saarbrücken
> Komplementär: A. Reiß & Sohn GmbH
> HR B 4965 Amtsgericht Saarbrücken
> Geschäftsführer: Dipl.-Kfm. Karl-Heinz Siebenpfeiffer
> -----------------------------------------------------
>
>
>