You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by "James Graham (Greywolf)" <gr...@searchme.com> on 2008/08/08 02:57:25 UTC

mapred/map only at 2, always?

hadoop 0.16.4

Why are mapred.reduce.tasks and mapred.map.tasks always showing up
as "2"?

I have the same config on all nodes.
hadoop-site.xml contains the following parameters:

<property>
    <name>mapred.map.tasks</name>
    <value>67</value>
    <description>The default number of map tasks per job.  Typically set
    to a prime several times greater than number of available hosts.
    Ignored when mapred.job.tracker is "local".
    </description>
</property>

<property>
    <name>mapred.reduce.tasks</name>
    <value>23</value>
    <description>The default number of reduce tasks per job.  Typically set
    to a prime close to the number of available hosts.  Ignored when
    mapred.job.tracker is "local".
    </description>
</property>

<property>
   <name>mapred.job.tracker</name>
   <value>idx1-r70:50030</value>  <!-- mapred.job.tracker -->
   <description>The host and port that the MapReduce job tracker runs
   at.  If "local", then jobs are run in-process as a single map
   and reduce task.
   </description>
</property>

-- 
James Graham (Greywolf)							      |
650.930.1138|925.768.4053						      *
greywolf@searchme.com							      |
Check out what people are saying about SearchMe! -- click below
	http://www.searchme.com/stack/109aa