You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by xeon <xe...@gmail.com> on 2014/01/21 15:54:58 UTC
Set number of mappers
Hi,
I want to set the number of map tasks in the Wordcount example. Is is
possible to set this variable in MRv2?
Thanks,
Re: Set number of mappers
Posted by sudhakara st <su...@gmail.com>.
Hey sorry for previous answer i thought it reducer. we can't set number
mappers for a job it determined by number of input splits as Shekhar said.
On Tue, Jan 21, 2014 at 9:44 PM, Shekhar Sharma <sh...@gmail.com>wrote:
> nO of map tasks is determined by number of input splits.you can change the
> NUM Of map tasks by changing the input split size
>
> But you can set to num of reducertasks explicitly
> On 21 Jan 2014 20:25, "xeon" <xe...@gmail.com> wrote:
>
>> Hi,
>>
>> I want to set the number of map tasks in the Wordcount example. Is is
>> possible to set this variable in MRv2?
>>
>> Thanks,
>>
>
--
Regards,
...Sudhakara.st
Re: Set number of mappers
Posted by sudhakara st <su...@gmail.com>.
Hey sorry for previous answer i thought it reducer. we can't set number
mappers for a job it determined by number of input splits as Shekhar said.
On Tue, Jan 21, 2014 at 9:44 PM, Shekhar Sharma <sh...@gmail.com>wrote:
> nO of map tasks is determined by number of input splits.you can change the
> NUM Of map tasks by changing the input split size
>
> But you can set to num of reducertasks explicitly
> On 21 Jan 2014 20:25, "xeon" <xe...@gmail.com> wrote:
>
>> Hi,
>>
>> I want to set the number of map tasks in the Wordcount example. Is is
>> possible to set this variable in MRv2?
>>
>> Thanks,
>>
>
--
Regards,
...Sudhakara.st
Re: Set number of mappers
Posted by sudhakara st <su...@gmail.com>.
Hey sorry for previous answer i thought it reducer. we can't set number
mappers for a job it determined by number of input splits as Shekhar said.
On Tue, Jan 21, 2014 at 9:44 PM, Shekhar Sharma <sh...@gmail.com>wrote:
> nO of map tasks is determined by number of input splits.you can change the
> NUM Of map tasks by changing the input split size
>
> But you can set to num of reducertasks explicitly
> On 21 Jan 2014 20:25, "xeon" <xe...@gmail.com> wrote:
>
>> Hi,
>>
>> I want to set the number of map tasks in the Wordcount example. Is is
>> possible to set this variable in MRv2?
>>
>> Thanks,
>>
>
--
Regards,
...Sudhakara.st
Re: Set number of mappers
Posted by sudhakara st <su...@gmail.com>.
Hey sorry for previous answer i thought it reducer. we can't set number
mappers for a job it determined by number of input splits as Shekhar said.
On Tue, Jan 21, 2014 at 9:44 PM, Shekhar Sharma <sh...@gmail.com>wrote:
> nO of map tasks is determined by number of input splits.you can change the
> NUM Of map tasks by changing the input split size
>
> But you can set to num of reducertasks explicitly
> On 21 Jan 2014 20:25, "xeon" <xe...@gmail.com> wrote:
>
>> Hi,
>>
>> I want to set the number of map tasks in the Wordcount example. Is is
>> possible to set this variable in MRv2?
>>
>> Thanks,
>>
>
--
Regards,
...Sudhakara.st
Re: Set number of mappers
Posted by Shekhar Sharma <sh...@gmail.com>.
nO of map tasks is determined by number of input splits.you can change the
NUM Of map tasks by changing the input split size
But you can set to num of reducertasks explicitly
On 21 Jan 2014 20:25, "xeon" <xe...@gmail.com> wrote:
> Hi,
>
> I want to set the number of map tasks in the Wordcount example. Is is
> possible to set this variable in MRv2?
>
> Thanks,
>
Re: Set number of mappers
Posted by sudhakara st <su...@gmail.com>.
use “-D mapreduce.job.reduces=number”
On Tue, Jan 21, 2014 at 8:24 PM, xeon <xe...@gmail.com> wrote:
> Hi,
>
> I want to set the number of map tasks in the Wordcount example. Is is
> possible to set this variable in MRv2?
>
> Thanks,
>
--
Regards,
...Sudhakara.st
Re: Set number of mappers
Posted by sudhakara st <su...@gmail.com>.
use “-D mapreduce.job.reduces=number”
On Tue, Jan 21, 2014 at 8:24 PM, xeon <xe...@gmail.com> wrote:
> Hi,
>
> I want to set the number of map tasks in the Wordcount example. Is is
> possible to set this variable in MRv2?
>
> Thanks,
>
--
Regards,
...Sudhakara.st
Re: Set number of mappers
Posted by sudhakara st <su...@gmail.com>.
use “-D mapreduce.job.reduces=number”
On Tue, Jan 21, 2014 at 8:24 PM, xeon <xe...@gmail.com> wrote:
> Hi,
>
> I want to set the number of map tasks in the Wordcount example. Is is
> possible to set this variable in MRv2?
>
> Thanks,
>
--
Regards,
...Sudhakara.st
Re: Set number of mappers
Posted by Shekhar Sharma <sh...@gmail.com>.
nO of map tasks is determined by number of input splits.you can change the
NUM Of map tasks by changing the input split size
But you can set to num of reducertasks explicitly
On 21 Jan 2014 20:25, "xeon" <xe...@gmail.com> wrote:
> Hi,
>
> I want to set the number of map tasks in the Wordcount example. Is is
> possible to set this variable in MRv2?
>
> Thanks,
>
Re: Set number of mappers
Posted by Shekhar Sharma <sh...@gmail.com>.
nO of map tasks is determined by number of input splits.you can change the
NUM Of map tasks by changing the input split size
But you can set to num of reducertasks explicitly
On 21 Jan 2014 20:25, "xeon" <xe...@gmail.com> wrote:
> Hi,
>
> I want to set the number of map tasks in the Wordcount example. Is is
> possible to set this variable in MRv2?
>
> Thanks,
>
Re: Set number of mappers
Posted by Shekhar Sharma <sh...@gmail.com>.
nO of map tasks is determined by number of input splits.you can change the
NUM Of map tasks by changing the input split size
But you can set to num of reducertasks explicitly
On 21 Jan 2014 20:25, "xeon" <xe...@gmail.com> wrote:
> Hi,
>
> I want to set the number of map tasks in the Wordcount example. Is is
> possible to set this variable in MRv2?
>
> Thanks,
>
Re: Set number of mappers
Posted by sudhakara st <su...@gmail.com>.
use “-D mapreduce.job.reduces=number”
On Tue, Jan 21, 2014 at 8:24 PM, xeon <xe...@gmail.com> wrote:
> Hi,
>
> I want to set the number of map tasks in the Wordcount example. Is is
> possible to set this variable in MRv2?
>
> Thanks,
>
--
Regards,
...Sudhakara.st