You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by "teng wang (Jira)" <ji...@apache.org> on 2022/10/19 07:05:00 UTC

[jira] [Created] (MAPREDUCE-7423) The check for maxtaskfailures.per.tracker is missing

teng wang created MAPREDUCE-7423:
------------------------------------

             Summary: The check for maxtaskfailures.per.tracker is missing
                 Key: MAPREDUCE-7423
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7423
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: tasktracker
    Affects Versions: 3.3.4
            Reporter: teng wang


In the conf file mapred-default.xml, the description of *mapreduce.job.maxtaskfailures.per.tracker* is:

The number of task-failures on a node manager of a given job after which new tasks of that job aren't assigned to it. It *MUST be less* than mapreduce.map.maxattempts and mapreduce.reduce.maxattempts otherwise the failed task will never be tried on a different node.

However, there is no checking implement in source code. Violations of the dependency will prevent failed tasks from trying on different nodes. So, it is suggested to check the dependency of the two configuration parameters before using maxtaskfailures.per.tracker.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org