You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by "Vinod K V (JIRA)" <ji...@apache.org> on 2010/04/22 08:14:52 UTC
[jira] Created: (MAPREDUCE-1719) Wrong map-output estimates by
ResourceEstimator because of overflow errors in 'long' calculations
Wrong map-output estimates by ResourceEstimator because of overflow errors in 'long' calculations
-------------------------------------------------------------------------------------------------
Key: MAPREDUCE-1719
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1719
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: jobtracker
Reporter: Vinod K V
On a cluster with disks nearly full, while running a simple sort job on a 10TBdata with ~100 maps, ResourceEstimator is not getting triggered even after 10%maps are completed. Instead, maps keep on getting scheduled till the disks became full and then eventually when the disk size becomes zero, the ResourceEstimator finally comes back alive saying it can find only zero bytes instead of the estimated '9642' bytes. The estimate should have be close to 10GB.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.