You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-issues@hadoop.apache.org by "Augusto Souza (JIRA)" <ji...@apache.org> on 2015/08/06 00:55:04 UTC

[jira] [Work started] (MAPREDUCE-6444) Add a checkpointable version of shuffle and reduce context supported by a checkpoint manager which uses the HDFS

     [ https://issues.apache.org/jira/browse/MAPREDUCE-6444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Work on MAPREDUCE-6444 started by Augusto Souza.
------------------------------------------------
> Add a checkpointable version of shuffle and reduce context supported by a checkpoint manager which uses the HDFS
> ----------------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-6444
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6444
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>            Reporter: Augusto Souza
>            Assignee: Augusto Souza
>
> Patch to add classes to provide a checkpointable version of shuffle and reduce context. Also, add a classe which makes possible to save a checkpoint of a task in HDFS. Those classes are respectively: CheckpointableShuffle, CheckpointableReduceContextImpl and TaskCheckpointManager.
> This improvement also helps in the splitting of patch in MAPREDUCE-5269 that is too large for being reviewed or accepted by Jenkins CI scripts.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)