You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Gergő Pásztor (JIRA)" <ji...@apache.org> on 2017/05/24 14:11:04 UTC
[jira] [Assigned] (MAPREDUCE-6501) Improve reducer preemption
[ https://issues.apache.org/jira/browse/MAPREDUCE-6501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Gergő Pásztor reassigned MAPREDUCE-6501:
----------------------------------------
Assignee: Peter Bacsko (was: Gergő Pásztor)
> Improve reducer preemption
> --------------------------
>
> Key: MAPREDUCE-6501
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6501
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: applicationmaster
> Affects Versions: 2.7.1
> Reporter: Karthik Kambatla
> Assignee: Peter Bacsko
>
> As discussed on MAPREDUCE-6302, we could improve the reducer preemption as follows:
> # preempt enough reducers so there are enough mappers to match slowstart
> # prioritize preempting reducers that are still in SHUFFLE phase
> # add an option to not preempt reducers that are past SHUFFLE phase irrespective of slowstart as long as one mapper can run
> We could do it all in one patch or create subtasks as necessary.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org