You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-issues@hadoop.apache.org by "Augusto Souza (JIRA)" <ji...@apache.org> on 2015/08/06 00:53:04 UTC

[jira] [Created] (MAPREDUCE-6444) Add a checkpointable version of shuffle and reduce context supported by a checkpoint manager which uses the HDFS

Augusto Souza created MAPREDUCE-6444:
----------------------------------------

             Summary: Add a checkpointable version of shuffle and reduce context supported by a checkpoint manager which uses the HDFS
                 Key: MAPREDUCE-6444
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6444
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
            Reporter: Augusto Souza
            Assignee: Augusto Souza


Patch to add classes to provide a checkpointable version of shuffle and reduce context. Also, add a classe which makes possible to save a checkpoint of a task in HDFS. Those classes are respectively: CheckpointableShuffle, CheckpointableReduceContextImpl and TaskCheckpointManager.

This issue also helps in the splitting of patch in MAPREDUCE-5269 that is too large for being reviewed or accepted by Jenkins CI scripts.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)