You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-dev@hadoop.apache.org by "Adam Kramer (JIRA)" <ji...@apache.org> on 2011/07/27 02:05:09 UTC

[jira] [Created] (MAPREDUCE-2731) Jobtracker should report 99% until the query is done.

Jobtracker should report 99% until the query is done.
-----------------------------------------------------

                 Key: MAPREDUCE-2731
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2731
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: jobtracker
            Reporter: Adam Kramer


Hadoop reporting 100% complete is a lie whenever the job, task, or node is not FULLY complete. Reports of 100% due to rounding should get explicitly stuck at 99.99% until the job is complete. The current system gets things stuck at 100%, which is simply wrong.

Even when the true % complete rounds to 100, 100% is still not appropriate to report in the form of a percentage due to the semantics of percentages.

This bug occurs frequently when a small number of nodes from a task with many nodes are running very slowly (i.e., the "one overloaded reducer" problem).

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira