You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Varun Saxena (JIRA)" <ji...@apache.org> on 2018/03/15 08:50:00 UTC

[jira] [Commented] (MAPREDUCE-6332) Provide facility to users for writting custom MergeManager implementation when custom shuffleconsumerPluggin is used

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16400092#comment-16400092 ] 

Varun Saxena commented on MAPREDUCE-6332:
-----------------------------------------

[~rohithsharma] , are we planning to get this JIRA in?

> Provide facility to users for writting custom MergeManager implementation when custom shuffleconsumerPluggin is used
> --------------------------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-6332
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6332
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>            Reporter: Rohith Sharma K S
>            Assignee: Rohith Sharma K S
>            Priority: Major
>         Attachments: 0001-MAPREDUCE-6332.patch, 0002-MAPREDUCE-6332.patch, 0003-MAPREDUCE-6332.patch, 0004-MAPREDUCE-6332.patch
>
>
> MR provides ability to the user for plugin custom ShuffleConsumerPlugin using *mapreduce.job.reduce.shuffle.consumer.plugin.class*.  When the user is allowed to use this configuration as plugin, user also interest in implementing his own MergeManagerImpl. 
> But now , user is forced to use MR provided MergeManagerImpl instead of custom MergeManagerImpl when user is using shuffle.consumer.plugin class. There should be well defined API's in MergeManager that can be used for any implementation without much effort to user for custom implementation.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org