You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by "Vinod K V (JIRA)" <ji...@apache.org> on 2010/04/22 08:14:52 UTC

[jira] Created: (MAPREDUCE-1719) Wrong map-output estimates by ResourceEstimator because of overflow errors in 'long' calculations

Wrong map-output estimates by ResourceEstimator because of overflow errors in 'long' calculations
-------------------------------------------------------------------------------------------------

                 Key: MAPREDUCE-1719
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1719
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: jobtracker
            Reporter: Vinod K V


On a cluster with disks nearly full, while running a simple sort job on a 10TBdata with ~100 maps, ResourceEstimator is not getting triggered even after 10%maps are completed. Instead, maps keep on getting scheduled till the disks became full and then eventually when the disk size becomes zero, the ResourceEstimator finally comes back alive saying it can find only zero bytes instead of the estimated '9642' bytes. The estimate should have be close to 10GB.


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.