You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "SuYan (JIRA)" <ji...@apache.org> on 2017/07/06 03:18:00 UTC
[jira] [Updated] (MAPREDUCE-6912) CompletedMapTask contains failed
and killed will lead mapreduce.job.reduce.slowstart.completedmaps not work
properly
[ https://issues.apache.org/jira/browse/MAPREDUCE-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
SuYan updated MAPREDUCE-6912:
-----------------------------
Affects Version/s: 2.6.2
Component/s: mrv2
> CompletedMapTask contains failed and killed will lead mapreduce.job.reduce.slowstart.completedmaps not work properly
> --------------------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-6912
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6912
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 2.6.2
> Reporter: SuYan
>
> if the conf is set to 1, is about to make reduce task to be scheduled only after all map task success
> {code}
> int completedMapsForReduceSlowstart = (int)Math.ceil(reduceSlowStart *
> totalMaps);
> if(completedMaps < completedMapsForReduceSlowstart) {}
> ///////////////////////////
> int completedMaps = getJob().getCompletedMaps();
> ///////////////////////////
> JobImpl
> @Override
> public int getCompletedMaps() {
> readLock.lock();
> try {
> return succeededMapTaskCount + failedMapTaskCount + killedMapTaskCount;
> } finally {
> readLock.unlock();
> }
> }
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org