You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-user@hadoop.apache.org by Hrishikesh Gadre <ga...@gmail.com> on 2011/04/13 14:58:42 UTC

Hadoop scheduler and number of reducers config

Hello All,

I have a question regarding configuring the number of reducers property in
case of a non FIFO scheduler (either Capacity/Fair-share scheduler).

As per the guidelines on the Hadoop wiki page, we should set number of
reducers = 0.75 * maximum_reduce_slots_available_in_cluster (minimum)
http://wiki.apache.org/hadoop/HowManyMapsAndReduces

Is it also valid for non FIFO schedulers? If not what is the general
configuration used in such cases?

Regards
Hrishikesh