You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Azuryy Yu <az...@gmail.com> on 2013/08/08 03:49:15 UTC
specify Mapred tasks and slots
Hi Dears,
Can I specify how many slots to use for reduce?
I know we can specify reduces tasks, but is there one task occupy one slot?
it it possible that one tak occupy more than one slot in Hadoop-1.1.2.
Thanks.
Re: specify Mapred tasks and slots
Posted by Azuryy Yu <az...@gmail.com>.
Thanks Harsh and all friends response. That's helpful.
On Thu, Aug 8, 2013 at 11:55 AM, Harsh J <ha...@cloudera.com> wrote:
> What Devaraj said. Except that if you use CapacityScheduler, then you
> can bind together memory requests and slot concepts, and be able to have a
> task
> grab more than one slot for itself when needed. We've discussed this
> aspect previously at http://search-hadoop.com/m/gnFs91yIg1e
>
> On Thu, Aug 8, 2013 at 8:34 AM, Devaraj k <de...@huawei.com> wrote:
> > One task can use only one slot, It cannot use more than one slot. If the
> > task is Map task then it will use one map slot and if the task is reduce
> > task the it will use one reduce slot from the configured ones.
> >
> >
> >
> > Thanks
> >
> > Devaraj k
> >
> >
> >
> > From: Azuryy Yu [mailto:azuryyyu@gmail.com]
> > Sent: 08 August 2013 08:27
> > To: user@hadoop.apache.org
> > Subject: Re: specify Mapred tasks and slots
> >
> >
> >
> > My question is can I specify how many slots to be used for each M/R task?
> >
> >
> >
> > On Thu, Aug 8, 2013 at 10:29 AM, Shekhar Sharma <sh...@gmail.com>
> > wrote:
> >
> > Slots are decided upon the configuration of machines, RAM etc...
> >
> >
> > Regards,
> >
> > Som Shekhar Sharma
> >
> > +91-8197243810
> >
> >
> >
> > On Thu, Aug 8, 2013 at 7:19 AM, Azuryy Yu <az...@gmail.com> wrote:
> >
> > Hi Dears,
> >
> >
> >
> > Can I specify how many slots to use for reduce?
> >
> >
> >
> > I know we can specify reduces tasks, but is there one task occupy one
> slot?
> >
> >
> >
> > it it possible that one tak occupy more than one slot in Hadoop-1.1.2.
> >
> >
> >
> > Thanks.
> >
> >
> >
> >
>
>
>
> --
> Harsh J
>
Re: specify Mapred tasks and slots
Posted by Azuryy Yu <az...@gmail.com>.
Thanks Harsh and all friends response. That's helpful.
On Thu, Aug 8, 2013 at 11:55 AM, Harsh J <ha...@cloudera.com> wrote:
> What Devaraj said. Except that if you use CapacityScheduler, then you
> can bind together memory requests and slot concepts, and be able to have a
> task
> grab more than one slot for itself when needed. We've discussed this
> aspect previously at http://search-hadoop.com/m/gnFs91yIg1e
>
> On Thu, Aug 8, 2013 at 8:34 AM, Devaraj k <de...@huawei.com> wrote:
> > One task can use only one slot, It cannot use more than one slot. If the
> > task is Map task then it will use one map slot and if the task is reduce
> > task the it will use one reduce slot from the configured ones.
> >
> >
> >
> > Thanks
> >
> > Devaraj k
> >
> >
> >
> > From: Azuryy Yu [mailto:azuryyyu@gmail.com]
> > Sent: 08 August 2013 08:27
> > To: user@hadoop.apache.org
> > Subject: Re: specify Mapred tasks and slots
> >
> >
> >
> > My question is can I specify how many slots to be used for each M/R task?
> >
> >
> >
> > On Thu, Aug 8, 2013 at 10:29 AM, Shekhar Sharma <sh...@gmail.com>
> > wrote:
> >
> > Slots are decided upon the configuration of machines, RAM etc...
> >
> >
> > Regards,
> >
> > Som Shekhar Sharma
> >
> > +91-8197243810
> >
> >
> >
> > On Thu, Aug 8, 2013 at 7:19 AM, Azuryy Yu <az...@gmail.com> wrote:
> >
> > Hi Dears,
> >
> >
> >
> > Can I specify how many slots to use for reduce?
> >
> >
> >
> > I know we can specify reduces tasks, but is there one task occupy one
> slot?
> >
> >
> >
> > it it possible that one tak occupy more than one slot in Hadoop-1.1.2.
> >
> >
> >
> > Thanks.
> >
> >
> >
> >
>
>
>
> --
> Harsh J
>
Re: specify Mapred tasks and slots
Posted by Azuryy Yu <az...@gmail.com>.
Thanks Harsh and all friends response. That's helpful.
On Thu, Aug 8, 2013 at 11:55 AM, Harsh J <ha...@cloudera.com> wrote:
> What Devaraj said. Except that if you use CapacityScheduler, then you
> can bind together memory requests and slot concepts, and be able to have a
> task
> grab more than one slot for itself when needed. We've discussed this
> aspect previously at http://search-hadoop.com/m/gnFs91yIg1e
>
> On Thu, Aug 8, 2013 at 8:34 AM, Devaraj k <de...@huawei.com> wrote:
> > One task can use only one slot, It cannot use more than one slot. If the
> > task is Map task then it will use one map slot and if the task is reduce
> > task the it will use one reduce slot from the configured ones.
> >
> >
> >
> > Thanks
> >
> > Devaraj k
> >
> >
> >
> > From: Azuryy Yu [mailto:azuryyyu@gmail.com]
> > Sent: 08 August 2013 08:27
> > To: user@hadoop.apache.org
> > Subject: Re: specify Mapred tasks and slots
> >
> >
> >
> > My question is can I specify how many slots to be used for each M/R task?
> >
> >
> >
> > On Thu, Aug 8, 2013 at 10:29 AM, Shekhar Sharma <sh...@gmail.com>
> > wrote:
> >
> > Slots are decided upon the configuration of machines, RAM etc...
> >
> >
> > Regards,
> >
> > Som Shekhar Sharma
> >
> > +91-8197243810
> >
> >
> >
> > On Thu, Aug 8, 2013 at 7:19 AM, Azuryy Yu <az...@gmail.com> wrote:
> >
> > Hi Dears,
> >
> >
> >
> > Can I specify how many slots to use for reduce?
> >
> >
> >
> > I know we can specify reduces tasks, but is there one task occupy one
> slot?
> >
> >
> >
> > it it possible that one tak occupy more than one slot in Hadoop-1.1.2.
> >
> >
> >
> > Thanks.
> >
> >
> >
> >
>
>
>
> --
> Harsh J
>
Re: specify Mapred tasks and slots
Posted by Azuryy Yu <az...@gmail.com>.
Thanks Harsh and all friends response. That's helpful.
On Thu, Aug 8, 2013 at 11:55 AM, Harsh J <ha...@cloudera.com> wrote:
> What Devaraj said. Except that if you use CapacityScheduler, then you
> can bind together memory requests and slot concepts, and be able to have a
> task
> grab more than one slot for itself when needed. We've discussed this
> aspect previously at http://search-hadoop.com/m/gnFs91yIg1e
>
> On Thu, Aug 8, 2013 at 8:34 AM, Devaraj k <de...@huawei.com> wrote:
> > One task can use only one slot, It cannot use more than one slot. If the
> > task is Map task then it will use one map slot and if the task is reduce
> > task the it will use one reduce slot from the configured ones.
> >
> >
> >
> > Thanks
> >
> > Devaraj k
> >
> >
> >
> > From: Azuryy Yu [mailto:azuryyyu@gmail.com]
> > Sent: 08 August 2013 08:27
> > To: user@hadoop.apache.org
> > Subject: Re: specify Mapred tasks and slots
> >
> >
> >
> > My question is can I specify how many slots to be used for each M/R task?
> >
> >
> >
> > On Thu, Aug 8, 2013 at 10:29 AM, Shekhar Sharma <sh...@gmail.com>
> > wrote:
> >
> > Slots are decided upon the configuration of machines, RAM etc...
> >
> >
> > Regards,
> >
> > Som Shekhar Sharma
> >
> > +91-8197243810
> >
> >
> >
> > On Thu, Aug 8, 2013 at 7:19 AM, Azuryy Yu <az...@gmail.com> wrote:
> >
> > Hi Dears,
> >
> >
> >
> > Can I specify how many slots to use for reduce?
> >
> >
> >
> > I know we can specify reduces tasks, but is there one task occupy one
> slot?
> >
> >
> >
> > it it possible that one tak occupy more than one slot in Hadoop-1.1.2.
> >
> >
> >
> > Thanks.
> >
> >
> >
> >
>
>
>
> --
> Harsh J
>
Re: specify Mapred tasks and slots
Posted by Harsh J <ha...@cloudera.com>.
What Devaraj said. Except that if you use CapacityScheduler, then you
can bind together memory requests and slot concepts, and be able to have a task
grab more than one slot for itself when needed. We've discussed this
aspect previously at http://search-hadoop.com/m/gnFs91yIg1e
On Thu, Aug 8, 2013 at 8:34 AM, Devaraj k <de...@huawei.com> wrote:
> One task can use only one slot, It cannot use more than one slot. If the
> task is Map task then it will use one map slot and if the task is reduce
> task the it will use one reduce slot from the configured ones.
>
>
>
> Thanks
>
> Devaraj k
>
>
>
> From: Azuryy Yu [mailto:azuryyyu@gmail.com]
> Sent: 08 August 2013 08:27
> To: user@hadoop.apache.org
> Subject: Re: specify Mapred tasks and slots
>
>
>
> My question is can I specify how many slots to be used for each M/R task?
>
>
>
> On Thu, Aug 8, 2013 at 10:29 AM, Shekhar Sharma <sh...@gmail.com>
> wrote:
>
> Slots are decided upon the configuration of machines, RAM etc...
>
>
> Regards,
>
> Som Shekhar Sharma
>
> +91-8197243810
>
>
>
> On Thu, Aug 8, 2013 at 7:19 AM, Azuryy Yu <az...@gmail.com> wrote:
>
> Hi Dears,
>
>
>
> Can I specify how many slots to use for reduce?
>
>
>
> I know we can specify reduces tasks, but is there one task occupy one slot?
>
>
>
> it it possible that one tak occupy more than one slot in Hadoop-1.1.2.
>
>
>
> Thanks.
>
>
>
>
--
Harsh J
Re: specify Mapred tasks and slots
Posted by Harsh J <ha...@cloudera.com>.
What Devaraj said. Except that if you use CapacityScheduler, then you
can bind together memory requests and slot concepts, and be able to have a task
grab more than one slot for itself when needed. We've discussed this
aspect previously at http://search-hadoop.com/m/gnFs91yIg1e
On Thu, Aug 8, 2013 at 8:34 AM, Devaraj k <de...@huawei.com> wrote:
> One task can use only one slot, It cannot use more than one slot. If the
> task is Map task then it will use one map slot and if the task is reduce
> task the it will use one reduce slot from the configured ones.
>
>
>
> Thanks
>
> Devaraj k
>
>
>
> From: Azuryy Yu [mailto:azuryyyu@gmail.com]
> Sent: 08 August 2013 08:27
> To: user@hadoop.apache.org
> Subject: Re: specify Mapred tasks and slots
>
>
>
> My question is can I specify how many slots to be used for each M/R task?
>
>
>
> On Thu, Aug 8, 2013 at 10:29 AM, Shekhar Sharma <sh...@gmail.com>
> wrote:
>
> Slots are decided upon the configuration of machines, RAM etc...
>
>
> Regards,
>
> Som Shekhar Sharma
>
> +91-8197243810
>
>
>
> On Thu, Aug 8, 2013 at 7:19 AM, Azuryy Yu <az...@gmail.com> wrote:
>
> Hi Dears,
>
>
>
> Can I specify how many slots to use for reduce?
>
>
>
> I know we can specify reduces tasks, but is there one task occupy one slot?
>
>
>
> it it possible that one tak occupy more than one slot in Hadoop-1.1.2.
>
>
>
> Thanks.
>
>
>
>
--
Harsh J
Re: specify Mapred tasks and slots
Posted by Harsh J <ha...@cloudera.com>.
What Devaraj said. Except that if you use CapacityScheduler, then you
can bind together memory requests and slot concepts, and be able to have a task
grab more than one slot for itself when needed. We've discussed this
aspect previously at http://search-hadoop.com/m/gnFs91yIg1e
On Thu, Aug 8, 2013 at 8:34 AM, Devaraj k <de...@huawei.com> wrote:
> One task can use only one slot, It cannot use more than one slot. If the
> task is Map task then it will use one map slot and if the task is reduce
> task the it will use one reduce slot from the configured ones.
>
>
>
> Thanks
>
> Devaraj k
>
>
>
> From: Azuryy Yu [mailto:azuryyyu@gmail.com]
> Sent: 08 August 2013 08:27
> To: user@hadoop.apache.org
> Subject: Re: specify Mapred tasks and slots
>
>
>
> My question is can I specify how many slots to be used for each M/R task?
>
>
>
> On Thu, Aug 8, 2013 at 10:29 AM, Shekhar Sharma <sh...@gmail.com>
> wrote:
>
> Slots are decided upon the configuration of machines, RAM etc...
>
>
> Regards,
>
> Som Shekhar Sharma
>
> +91-8197243810
>
>
>
> On Thu, Aug 8, 2013 at 7:19 AM, Azuryy Yu <az...@gmail.com> wrote:
>
> Hi Dears,
>
>
>
> Can I specify how many slots to use for reduce?
>
>
>
> I know we can specify reduces tasks, but is there one task occupy one slot?
>
>
>
> it it possible that one tak occupy more than one slot in Hadoop-1.1.2.
>
>
>
> Thanks.
>
>
>
>
--
Harsh J
Re: specify Mapred tasks and slots
Posted by Harsh J <ha...@cloudera.com>.
What Devaraj said. Except that if you use CapacityScheduler, then you
can bind together memory requests and slot concepts, and be able to have a task
grab more than one slot for itself when needed. We've discussed this
aspect previously at http://search-hadoop.com/m/gnFs91yIg1e
On Thu, Aug 8, 2013 at 8:34 AM, Devaraj k <de...@huawei.com> wrote:
> One task can use only one slot, It cannot use more than one slot. If the
> task is Map task then it will use one map slot and if the task is reduce
> task the it will use one reduce slot from the configured ones.
>
>
>
> Thanks
>
> Devaraj k
>
>
>
> From: Azuryy Yu [mailto:azuryyyu@gmail.com]
> Sent: 08 August 2013 08:27
> To: user@hadoop.apache.org
> Subject: Re: specify Mapred tasks and slots
>
>
>
> My question is can I specify how many slots to be used for each M/R task?
>
>
>
> On Thu, Aug 8, 2013 at 10:29 AM, Shekhar Sharma <sh...@gmail.com>
> wrote:
>
> Slots are decided upon the configuration of machines, RAM etc...
>
>
> Regards,
>
> Som Shekhar Sharma
>
> +91-8197243810
>
>
>
> On Thu, Aug 8, 2013 at 7:19 AM, Azuryy Yu <az...@gmail.com> wrote:
>
> Hi Dears,
>
>
>
> Can I specify how many slots to use for reduce?
>
>
>
> I know we can specify reduces tasks, but is there one task occupy one slot?
>
>
>
> it it possible that one tak occupy more than one slot in Hadoop-1.1.2.
>
>
>
> Thanks.
>
>
>
>
--
Harsh J
RE: specify Mapred tasks and slots
Posted by Devaraj k <de...@huawei.com>.
One task can use only one slot, It cannot use more than one slot. If the task is Map task then it will use one map slot and if the task is reduce task the it will use one reduce slot from the configured ones.
Thanks
Devaraj k
From: Azuryy Yu [mailto:azuryyyu@gmail.com]
Sent: 08 August 2013 08:27
To: user@hadoop.apache.org
Subject: Re: specify Mapred tasks and slots
My question is can I specify how many slots to be used for each M/R task?
On Thu, Aug 8, 2013 at 10:29 AM, Shekhar Sharma <sh...@gmail.com>> wrote:
Slots are decided upon the configuration of machines, RAM etc...
Regards,
Som Shekhar Sharma
+91-8197243810
On Thu, Aug 8, 2013 at 7:19 AM, Azuryy Yu <az...@gmail.com>> wrote:
Hi Dears,
Can I specify how many slots to use for reduce?
I know we can specify reduces tasks, but is there one task occupy one slot?
it it possible that one tak occupy more than one slot in Hadoop-1.1.2.
Thanks.
RE: specify Mapred tasks and slots
Posted by Devaraj k <de...@huawei.com>.
One task can use only one slot, It cannot use more than one slot. If the task is Map task then it will use one map slot and if the task is reduce task the it will use one reduce slot from the configured ones.
Thanks
Devaraj k
From: Azuryy Yu [mailto:azuryyyu@gmail.com]
Sent: 08 August 2013 08:27
To: user@hadoop.apache.org
Subject: Re: specify Mapred tasks and slots
My question is can I specify how many slots to be used for each M/R task?
On Thu, Aug 8, 2013 at 10:29 AM, Shekhar Sharma <sh...@gmail.com>> wrote:
Slots are decided upon the configuration of machines, RAM etc...
Regards,
Som Shekhar Sharma
+91-8197243810
On Thu, Aug 8, 2013 at 7:19 AM, Azuryy Yu <az...@gmail.com>> wrote:
Hi Dears,
Can I specify how many slots to use for reduce?
I know we can specify reduces tasks, but is there one task occupy one slot?
it it possible that one tak occupy more than one slot in Hadoop-1.1.2.
Thanks.
RE: specify Mapred tasks and slots
Posted by Devaraj k <de...@huawei.com>.
One task can use only one slot, It cannot use more than one slot. If the task is Map task then it will use one map slot and if the task is reduce task the it will use one reduce slot from the configured ones.
Thanks
Devaraj k
From: Azuryy Yu [mailto:azuryyyu@gmail.com]
Sent: 08 August 2013 08:27
To: user@hadoop.apache.org
Subject: Re: specify Mapred tasks and slots
My question is can I specify how many slots to be used for each M/R task?
On Thu, Aug 8, 2013 at 10:29 AM, Shekhar Sharma <sh...@gmail.com>> wrote:
Slots are decided upon the configuration of machines, RAM etc...
Regards,
Som Shekhar Sharma
+91-8197243810
On Thu, Aug 8, 2013 at 7:19 AM, Azuryy Yu <az...@gmail.com>> wrote:
Hi Dears,
Can I specify how many slots to use for reduce?
I know we can specify reduces tasks, but is there one task occupy one slot?
it it possible that one tak occupy more than one slot in Hadoop-1.1.2.
Thanks.
RE: specify Mapred tasks and slots
Posted by Devaraj k <de...@huawei.com>.
One task can use only one slot, It cannot use more than one slot. If the task is Map task then it will use one map slot and if the task is reduce task the it will use one reduce slot from the configured ones.
Thanks
Devaraj k
From: Azuryy Yu [mailto:azuryyyu@gmail.com]
Sent: 08 August 2013 08:27
To: user@hadoop.apache.org
Subject: Re: specify Mapred tasks and slots
My question is can I specify how many slots to be used for each M/R task?
On Thu, Aug 8, 2013 at 10:29 AM, Shekhar Sharma <sh...@gmail.com>> wrote:
Slots are decided upon the configuration of machines, RAM etc...
Regards,
Som Shekhar Sharma
+91-8197243810
On Thu, Aug 8, 2013 at 7:19 AM, Azuryy Yu <az...@gmail.com>> wrote:
Hi Dears,
Can I specify how many slots to use for reduce?
I know we can specify reduces tasks, but is there one task occupy one slot?
it it possible that one tak occupy more than one slot in Hadoop-1.1.2.
Thanks.
Re: specify Mapred tasks and slots
Posted by Azuryy Yu <az...@gmail.com>.
My question is can I specify how many slots to be used for each M/R task?
On Thu, Aug 8, 2013 at 10:29 AM, Shekhar Sharma <sh...@gmail.com>wrote:
> Slots are decided upon the configuration of machines, RAM etc...
>
> Regards,
> Som Shekhar Sharma
> +91-8197243810
>
>
> On Thu, Aug 8, 2013 at 7:19 AM, Azuryy Yu <az...@gmail.com> wrote:
>
>> Hi Dears,
>>
>> Can I specify how many slots to use for reduce?
>>
>> I know we can specify reduces tasks, but is there one task occupy one
>> slot?
>>
>> it it possible that one tak occupy more than one slot in Hadoop-1.1.2.
>>
>> Thanks.
>>
>
>
Re: specify Mapred tasks and slots
Posted by Azuryy Yu <az...@gmail.com>.
My question is can I specify how many slots to be used for each M/R task?
On Thu, Aug 8, 2013 at 10:29 AM, Shekhar Sharma <sh...@gmail.com>wrote:
> Slots are decided upon the configuration of machines, RAM etc...
>
> Regards,
> Som Shekhar Sharma
> +91-8197243810
>
>
> On Thu, Aug 8, 2013 at 7:19 AM, Azuryy Yu <az...@gmail.com> wrote:
>
>> Hi Dears,
>>
>> Can I specify how many slots to use for reduce?
>>
>> I know we can specify reduces tasks, but is there one task occupy one
>> slot?
>>
>> it it possible that one tak occupy more than one slot in Hadoop-1.1.2.
>>
>> Thanks.
>>
>
>
Re: specify Mapred tasks and slots
Posted by Azuryy Yu <az...@gmail.com>.
My question is can I specify how many slots to be used for each M/R task?
On Thu, Aug 8, 2013 at 10:29 AM, Shekhar Sharma <sh...@gmail.com>wrote:
> Slots are decided upon the configuration of machines, RAM etc...
>
> Regards,
> Som Shekhar Sharma
> +91-8197243810
>
>
> On Thu, Aug 8, 2013 at 7:19 AM, Azuryy Yu <az...@gmail.com> wrote:
>
>> Hi Dears,
>>
>> Can I specify how many slots to use for reduce?
>>
>> I know we can specify reduces tasks, but is there one task occupy one
>> slot?
>>
>> it it possible that one tak occupy more than one slot in Hadoop-1.1.2.
>>
>> Thanks.
>>
>
>
Re: specify Mapred tasks and slots
Posted by Azuryy Yu <az...@gmail.com>.
My question is can I specify how many slots to be used for each M/R task?
On Thu, Aug 8, 2013 at 10:29 AM, Shekhar Sharma <sh...@gmail.com>wrote:
> Slots are decided upon the configuration of machines, RAM etc...
>
> Regards,
> Som Shekhar Sharma
> +91-8197243810
>
>
> On Thu, Aug 8, 2013 at 7:19 AM, Azuryy Yu <az...@gmail.com> wrote:
>
>> Hi Dears,
>>
>> Can I specify how many slots to use for reduce?
>>
>> I know we can specify reduces tasks, but is there one task occupy one
>> slot?
>>
>> it it possible that one tak occupy more than one slot in Hadoop-1.1.2.
>>
>> Thanks.
>>
>
>
Re: specify Mapred tasks and slots
Posted by Shekhar Sharma <sh...@gmail.com>.
Slots are decided upon the configuration of machines, RAM etc...
Regards,
Som Shekhar Sharma
+91-8197243810
On Thu, Aug 8, 2013 at 7:19 AM, Azuryy Yu <az...@gmail.com> wrote:
> Hi Dears,
>
> Can I specify how many slots to use for reduce?
>
> I know we can specify reduces tasks, but is there one task occupy one slot?
>
> it it possible that one tak occupy more than one slot in Hadoop-1.1.2.
>
> Thanks.
>
Re: specify Mapred tasks and slots
Posted by Shekhar Sharma <sh...@gmail.com>.
Slots are decided upon the configuration of machines, RAM etc...
Regards,
Som Shekhar Sharma
+91-8197243810
On Thu, Aug 8, 2013 at 7:19 AM, Azuryy Yu <az...@gmail.com> wrote:
> Hi Dears,
>
> Can I specify how many slots to use for reduce?
>
> I know we can specify reduces tasks, but is there one task occupy one slot?
>
> it it possible that one tak occupy more than one slot in Hadoop-1.1.2.
>
> Thanks.
>
Re: specify Mapred tasks and slots
Posted by Shekhar Sharma <sh...@gmail.com>.
use mapred.tasktracker.reduce.tasks in mapred-site.xml
the default value is 2...Which means that on this task tracker it will not
run more than 2 reducer tasks at any given point of time..
Regards,
Som Shekhar Sharma
+91-8197243810
On Thu, Aug 8, 2013 at 7:19 AM, Azuryy Yu <az...@gmail.com> wrote:
> Hi Dears,
>
> Can I specify how many slots to use for reduce?
>
> I know we can specify reduces tasks, but is there one task occupy one slot?
>
> it it possible that one tak occupy more than one slot in Hadoop-1.1.2.
>
> Thanks.
>
Re: specify Mapred tasks and slots
Posted by Shekhar Sharma <sh...@gmail.com>.
Slots are decided upon the configuration of machines, RAM etc...
Regards,
Som Shekhar Sharma
+91-8197243810
On Thu, Aug 8, 2013 at 7:19 AM, Azuryy Yu <az...@gmail.com> wrote:
> Hi Dears,
>
> Can I specify how many slots to use for reduce?
>
> I know we can specify reduces tasks, but is there one task occupy one slot?
>
> it it possible that one tak occupy more than one slot in Hadoop-1.1.2.
>
> Thanks.
>
Re: specify Mapred tasks and slots
Posted by Shekhar Sharma <sh...@gmail.com>.
use mapred.tasktracker.reduce.tasks in mapred-site.xml
the default value is 2...Which means that on this task tracker it will not
run more than 2 reducer tasks at any given point of time..
Regards,
Som Shekhar Sharma
+91-8197243810
On Thu, Aug 8, 2013 at 7:19 AM, Azuryy Yu <az...@gmail.com> wrote:
> Hi Dears,
>
> Can I specify how many slots to use for reduce?
>
> I know we can specify reduces tasks, but is there one task occupy one slot?
>
> it it possible that one tak occupy more than one slot in Hadoop-1.1.2.
>
> Thanks.
>
Re: specify Mapred tasks and slots
Posted by Shekhar Sharma <sh...@gmail.com>.
use mapred.tasktracker.reduce.tasks in mapred-site.xml
the default value is 2...Which means that on this task tracker it will not
run more than 2 reducer tasks at any given point of time..
Regards,
Som Shekhar Sharma
+91-8197243810
On Thu, Aug 8, 2013 at 7:19 AM, Azuryy Yu <az...@gmail.com> wrote:
> Hi Dears,
>
> Can I specify how many slots to use for reduce?
>
> I know we can specify reduces tasks, but is there one task occupy one slot?
>
> it it possible that one tak occupy more than one slot in Hadoop-1.1.2.
>
> Thanks.
>
Re: specify Mapred tasks and slots
Posted by Shekhar Sharma <sh...@gmail.com>.
use mapred.tasktracker.reduce.tasks in mapred-site.xml
the default value is 2...Which means that on this task tracker it will not
run more than 2 reducer tasks at any given point of time..
Regards,
Som Shekhar Sharma
+91-8197243810
On Thu, Aug 8, 2013 at 7:19 AM, Azuryy Yu <az...@gmail.com> wrote:
> Hi Dears,
>
> Can I specify how many slots to use for reduce?
>
> I know we can specify reduces tasks, but is there one task occupy one slot?
>
> it it possible that one tak occupy more than one slot in Hadoop-1.1.2.
>
> Thanks.
>
Re: specify Mapred tasks and slots
Posted by Shekhar Sharma <sh...@gmail.com>.
Slots are decided upon the configuration of machines, RAM etc...
Regards,
Som Shekhar Sharma
+91-8197243810
On Thu, Aug 8, 2013 at 7:19 AM, Azuryy Yu <az...@gmail.com> wrote:
> Hi Dears,
>
> Can I specify how many slots to use for reduce?
>
> I know we can specify reduces tasks, but is there one task occupy one slot?
>
> it it possible that one tak occupy more than one slot in Hadoop-1.1.2.
>
> Thanks.
>