You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Fumio Nakajima (JIRA)" <ji...@apache.org> on 2018/08/18 06:00:00 UTC

[jira] [Created] (NUTCH-2637) Number of fetcher reducers is misconfigured when the arg not passed

Fumio Nakajima created NUTCH-2637:
-------------------------------------

             Summary: Number of fetcher reducers is misconfigured when the arg not passed
                 Key: NUTCH-2637
                 URL: https://issues.apache.org/jira/browse/NUTCH-2637
             Project: Nutch
          Issue Type: Bug
          Components: fetcher
    Affects Versions: 2.3.1, 2.3
            Reporter: Fumio Nakajima


I'm kind a new to this, so sorry if i'm wrong.
 The thing is the number of fetcher reducers are currently set to the value of "mapred.map.tasks" when the arg not passed. It should be "mapred.reduce.tasks".

 

Line: 199, branch-2.X
{code:java}
if (numTasks == null || numTasks < 1) {
currentJob.setNumReduceTasks(currentJob.getConfiguration().getInt(
"mapred.map.tasks", currentJob.getNumReduceTasks()));
} else {
currentJob.setNumReduceTasks(numTasks);
}
{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)