You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hama.apache.org by Chris Willmore <ch...@yahoo.com> on 2011/05/10 11:32:51 UTC
Running mutiple tasks in local mode
Hi All,
I am playing around with the examples in local mode, but cannot figure out how, or if it is even possible, to run more than 2 peers for a job.
I'ved tried running:
bin/hama jar hama-examples.jar pi <num>
with various values of num, but it seems it is disregarded and always 2 are run (one master peer and one additional).
Can I run and test locally with num > 2?
Also, I was wondering how the number of peers concurrently running on a given groom server are controlled. Is it configurable?
Regards,
Chris
Re: Running mutiple tasks in local mode
Posted by "Edward J. Yoon" <ed...@apache.org>.
GroomServers can be run on different port numbers.
But I don't recommend you to do it.
On Thu, May 19, 2011 at 1:26 AM, Chris Willmore
<ch...@yahoo.com> wrote:
> Hi Edward,
>
> Thank you for the new conf property. I can confirm it works as advertised.
>
> Regarding distributed mode - you mention one groom server can run one task at a time. Can a host run multiple grooms, or is this limited to one as well?
>
> Regards,
> Chris
>
>
>
> ________________________________
> From: Edward J. Yoon <ed...@apache.org>
> To: hama-user@incubator.apache.org; Chris Willmore <ch...@yahoo.com>
> Sent: Tuesday, May 17, 2011 4:01 AM
> Subject: Re: Running mutiple tasks in local mode
>
> Hi chris,
>
> Now you can configure the maximum size of tasks by adding
> 'bsp.local.tasks.maximum' property to hama-site.xml.
>
> <property>
> <name>bsp.local.tasks.maximum</name>
> <value>100</value>
> <description>Number of tasks that run in parallel when in local
> mode.</description>
> </property>
>
> P.S., in distributed mode, currently we provides only one task per groomserver.
>
> Thanks.
>
> On Tue, May 10, 2011 at 6:32 PM, Chris Willmore
> <ch...@yahoo.com> wrote:
>> Hi All,
>>
>> I am playing around with the examples in local mode, but cannot figure out how, or if it is even possible, to run more than 2 peers for a job.
>>
>> I'ved tried running:
>> bin/hama jar hama-examples.jar pi <num>
>>
>> with various values of num, but it seems it is disregarded and always 2 are run (one master peer and one additional).
>> Can I run and test locally with num > 2?
>>
>> Also, I was wondering how the number of peers concurrently running on a given groom server are controlled. Is it configurable?
>>
>> Regards,
>> Chris
>
>
>
> --
> Best Regards, Edward J. Yoon
--
Best Regards, Edward J. Yoon
Re: Running mutiple tasks in local mode
Posted by Chris Willmore <ch...@yahoo.com>.
Hi Edward,
Thank you for the new conf property. I can confirm it works as advertised.
Regarding distributed mode - you mention one groom server can run one task at a time. Can a host run multiple grooms, or is this limited to one as well?
Regards,
Chris
________________________________
From: Edward J. Yoon <ed...@apache.org>
To: hama-user@incubator.apache.org; Chris Willmore <ch...@yahoo.com>
Sent: Tuesday, May 17, 2011 4:01 AM
Subject: Re: Running mutiple tasks in local mode
Hi chris,
Now you can configure the maximum size of tasks by adding
'bsp.local.tasks.maximum' property to hama-site.xml.
<property>
<name>bsp.local.tasks.maximum</name>
<value>100</value>
<description>Number of tasks that run in parallel when in local
mode.</description>
</property>
P.S., in distributed mode, currently we provides only one task per groomserver.
Thanks.
On Tue, May 10, 2011 at 6:32 PM, Chris Willmore
<ch...@yahoo.com> wrote:
> Hi All,
>
> I am playing around with the examples in local mode, but cannot figure out how, or if it is even possible, to run more than 2 peers for a job.
>
> I'ved tried running:
> bin/hama jar hama-examples.jar pi <num>
>
> with various values of num, but it seems it is disregarded and always 2 are run (one master peer and one additional).
> Can I run and test locally with num > 2?
>
> Also, I was wondering how the number of peers concurrently running on a given groom server are controlled. Is it configurable?
>
> Regards,
> Chris
--
Best Regards, Edward J. Yoon
Re: Running mutiple tasks in local mode
Posted by "Edward J. Yoon" <ed...@apache.org>.
Hi chris,
Now you can configure the maximum size of tasks by adding
'bsp.local.tasks.maximum' property to hama-site.xml.
<property>
<name>bsp.local.tasks.maximum</name>
<value>100</value>
<description>Number of tasks that run in parallel when in local
mode.</description>
</property>
P.S., in distributed mode, currently we provides only one task per groomserver.
Thanks.
On Tue, May 10, 2011 at 6:32 PM, Chris Willmore
<ch...@yahoo.com> wrote:
> Hi All,
>
> I am playing around with the examples in local mode, but cannot figure out how, or if it is even possible, to run more than 2 peers for a job.
>
> I'ved tried running:
> bin/hama jar hama-examples.jar pi <num>
>
> with various values of num, but it seems it is disregarded and always 2 are run (one master peer and one additional).
> Can I run and test locally with num > 2?
>
> Also, I was wondering how the number of peers concurrently running on a given groom server are controlled. Is it configurable?
>
> Regards,
> Chris
--
Best Regards, Edward J. Yoon
Re: Running mutiple tasks in local mode
Posted by "Edward J. Yoon" <ed...@apache.org>.
> How if let the setting be configured through conf file?
+1
Sent from my iPhone
On 2011. 5. 13., at 오후 12:22, "ChiaHung Lin" <ch...@nuk.edu.tw> wrote:
> How if let the setting be configured through conf file?
Re: Running mutiple tasks in local mode
Posted by ChiaHung Lin <ch...@nuk.edu.tw>.
How if let the setting be configured through conf file?
Basically increasing thread pool size looks ok. +1
-----Original message-----
From:Thomas Jungblut <th...@googlemail.com>
To:hama-dev@incubator.apache.org
Cc:chris.willmore@yahoo.com <ch...@yahoo.com>
Date:Thu, 12 May 2011 18:47:15 +0200
Subject:Re: Running mutiple tasks in local mode
Actually I'm +1 with that, I wanted to implement this right from the start,
but there were some issues why I didn't do that.
In fact you can change the path, so the threadpoolsize wouldn't be a problem
(I hope so :D).
2011/5/12 Edward J. Yoon <ed...@apache.org>
> Hi all
>
> In LocalBSPRunner, Runtime.availableProcessor will retuns the num of
> logical CPU's. Too small number.
>
> What do u think about increasing the num of threadPoolSize to ten times?
>
> Thanks
>
> Sent from my iPhone
>
> Begin forwarded message:
>
> > From: Chris Willmore <ch...@yahoo.com>
> > Date: 2011년 5월 10일 오후 6시 32분 51초 KST
> > To: "hama-user@incubator.apache.org" <ha...@incubator.apache.org>
> > Subject: Running mutiple tasks in local mode
> > Reply-To: hama-user@incubator.apache.org
> > Reply-To: Chris Willmore <ch...@yahoo.com>
> >
>
> > Hi All,
> >
> > I am playing around with the examples in local mode, but cannot figure
> out how, or if it is even possible, to run more than 2 peers for a job.
> >
> > I'ved tried running:
> > bin/hama jar hama-examples.jar pi <num>
> >
> > with various values of num, but it seems it is disregarded and always 2
> are run (one master peer and one additional).
> > Can I run and test locally with num > 2?
> >
> > Also, I was wondering how the number of peers concurrently running on a
> given groom server are controlled. Is it configurable?
> >
> > Regards,
> > Chris
>
--
Thomas Jungblut
Berlin
mobile: 0170-3081070
business: thomas.jungblut@testberichte.de
private: thomas.jungblut@gmail.com
--
ChiaHung Lin
Department of Information Management
National University of Kaohsiung
Taiwan
Re: Running mutiple tasks in local mode
Posted by Thomas Jungblut <th...@googlemail.com>.
Actually I'm +1 with that, I wanted to implement this right from the start,
but there were some issues why I didn't do that.
In fact you can change the path, so the threadpoolsize wouldn't be a problem
(I hope so :D).
2011/5/12 Edward J. Yoon <ed...@apache.org>
> Hi all
>
> In LocalBSPRunner, Runtime.availableProcessor will retuns the num of
> logical CPU's. Too small number.
>
> What do u think about increasing the num of threadPoolSize to ten times?
>
> Thanks
>
> Sent from my iPhone
>
> Begin forwarded message:
>
> > From: Chris Willmore <ch...@yahoo.com>
> > Date: 2011년 5월 10일 오후 6시 32분 51초 KST
> > To: "hama-user@incubator.apache.org" <ha...@incubator.apache.org>
> > Subject: Running mutiple tasks in local mode
> > Reply-To: hama-user@incubator.apache.org
> > Reply-To: Chris Willmore <ch...@yahoo.com>
> >
>
> > Hi All,
> >
> > I am playing around with the examples in local mode, but cannot figure
> out how, or if it is even possible, to run more than 2 peers for a job.
> >
> > I'ved tried running:
> > bin/hama jar hama-examples.jar pi <num>
> >
> > with various values of num, but it seems it is disregarded and always 2
> are run (one master peer and one additional).
> > Can I run and test locally with num > 2?
> >
> > Also, I was wondering how the number of peers concurrently running on a
> given groom server are controlled. Is it configurable?
> >
> > Regards,
> > Chris
>
--
Thomas Jungblut
Berlin
mobile: 0170-3081070
business: thomas.jungblut@testberichte.de
private: thomas.jungblut@gmail.com
Fwd: Running mutiple tasks in local mode
Posted by "Edward J. Yoon" <ed...@apache.org>.
Hi all
In LocalBSPRunner, Runtime.availableProcessor will retuns the num of logical CPU's. Too small number.
What do u think about increasing the num of threadPoolSize to ten times?
Thanks
Sent from my iPhone
Begin forwarded message:
> From: Chris Willmore <ch...@yahoo.com>
> Date: 2011년 5월 10일 오후 6시 32분 51초 KST
> To: "hama-user@incubator.apache.org" <ha...@incubator.apache.org>
> Subject: Running mutiple tasks in local mode
> Reply-To: hama-user@incubator.apache.org
> Reply-To: Chris Willmore <ch...@yahoo.com>
>
> Hi All,
>
> I am playing around with the examples in local mode, but cannot figure out how, or if it is even possible, to run more than 2 peers for a job.
>
> I'ved tried running:
> bin/hama jar hama-examples.jar pi <num>
>
> with various values of num, but it seems it is disregarded and always 2 are run (one master peer and one additional).
> Can I run and test locally with num > 2?
>
> Also, I was wondering how the number of peers concurrently running on a given groom server are controlled. Is it configurable?
>
> Regards,
> Chris