You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by "Mit Desai (JIRA)" <ji...@apache.org> on 2014/09/10 23:14:34 UTC
[jira] [Created] (MAPREDUCE-6082) Excessive logging by
org.apache.hadoop.util.Progress when value is NaN
Mit Desai created MAPREDUCE-6082:
------------------------------------
Summary: Excessive logging by org.apache.hadoop.util.Progress when value is NaN
Key: MAPREDUCE-6082
URL: https://issues.apache.org/jira/browse/MAPREDUCE-6082
Project: Hadoop Map/Reduce
Issue Type: Bug
Reporter: Mit Desai
Assignee: Mit Desai
MAPREDUCE-5671 fixed the "illegal" progress values that do not fall into (0,1) interval when the progress value is given. Whenever illegal value was encountered, LOG.warn would log that incident.
As a result, each of the task's syslog will be full of WARN [main] org.apache.hadoop.util.Progress: Illegal progress value found, progress is Float.NaN. Progress will be changed to 0
Each input record will contribute to one line of such log, leading to most
of the tasks' syslog > 1GB.
We will need to change the log level to debug to avoid such excessive logging.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)