You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by xi yang <co...@gmail.com> on 2011/03/12 17:40:36 UTC

Can we specify the map task capacity value for each node ?

Thanks in advance

                                                      xyang

Re: Can we specify the map task capacity value for each node ?

Posted by Ken <ke...@gmail.com>.

If your cluster is heterogeneous like that, the you will most likely need to have different configurations per node.  In other words, not every node needs to use the same mapred-site.xml. 

On Mar 12, 2011, at 9:34 AM, xi yang <co...@gmail.com> wrote:

> Thanks, Harsh.
> I need to set node-A with 4 slots for map tasks, and node-B with 3 ...  I
> mean I want to specify different map task capacity for different nodes, how
> to distinguish different nodes .... can we do that ?
> 
> 2011/3/12 Harsh J <qw...@gmail.com>
> 
>> Q: Can we specify the map task capacity value for each node
>> A: Yes, they are task-tracker properties after all.
>> 
>> --
>> Harsh J
>> www.harshj.com
>>

Re: Can we specify the map task capacity value for each node ?

Posted by xi yang <co...@gmail.com>.

Thanks, Harsh.
I need to set node-A with 4 slots for map tasks, and node-B with 3 ...  I
mean I want to specify different map task capacity for different nodes, how
to distinguish different nodes .... can we do that ?

2011/3/12 Harsh J <qw...@gmail.com>

> Q: Can we specify the map task capacity value for each node
> A: Yes, they are task-tracker properties after all.
>
> --
> Harsh J
> www.harshj.com
>

Re: Can we specify the map task capacity value for each node ?

Posted by Harsh J <qw...@gmail.com>.

Q: Can we specify the map task capacity value for each node
A: Yes, they are task-tracker properties after all.

-- 
Harsh J
www.harshj.com