You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Debbie Fu <fu...@gmail.com> on 2011/03/14 09:27:22 UTC
io.sort.mb and io.sort.factor
Hi,
I want to know that io.sort.mb and io.sort.factor are properties that set
for the whole cluster, or can be set differently per node?
--
Best regards!
Re: io.sort.mb and io.sort.factor
Posted by Harsh J <qw...@gmail.com>.
Both of those properties are job-specifiable.
I have not tried this, but they should be settable at tasktracker conf
levels as finals (since the localized jobconf prepared for the task
still loads defaults [and thus the final policies too?]).
On Mon, Mar 14, 2011 at 1:57 PM, Debbie Fu <fu...@gmail.com> wrote:
> Hi,
> I want to know that io.sort.mb and io.sort.factor are properties that set
> for the whole cluster, or can be set differently per node?
>
> --
> Best regards!
>
>
--
Harsh J
http://harshj.com
Re: io.sort.mb and io.sort.factor
Posted by Debbie Fu <fu...@gmail.com>.
I mean if I have cluster consists of 1 master node and 3 slave nodes, can
these 3 slave nodes have different io.sort.mb and io.sort.factor?
2011/3/14 Ravi Gummadi <gr...@yahoo-inc.com>
> They are configured per MR job.
>
> -Ravi
>
> On 3/14/11 Monday 1:57 PM, "Debbie Fu" <fu...@gmail.com> wrote:
>
> > Hi,
> > I want to know that io.sort.mb and io.sort.factor are properties that set
> for
> > the whole cluster, or can be set differently per node?
>
>
--
Best regards!
Re: io.sort.mb and io.sort.factor
Posted by Ravi Gummadi <gr...@yahoo-inc.com>.
They are configured per MR job.
-Ravi
On 3/14/11 Monday 1:57 PM, "Debbie Fu" <fu...@gmail.com> wrote:
> Hi,
> I want to know that io.sort.mb and io.sort.factor are properties that set for
> the whole cluster, or can be set differently per node?