You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tinkerpop.apache.org by "Marko A. Rodriguez (JIRA)" <ji...@apache.org> on 2015/09/11 22:51:45 UTC

[jira] [Created] (TINKERPOP3-842) MapReduceHelper should sort respective of the number of reduce tasks

Marko A. Rodriguez created TINKERPOP3-842:
---------------------------------------------

             Summary: MapReduceHelper should sort respective of the number of reduce tasks
                 Key: TINKERPOP3-842
                 URL: https://issues.apache.org/jira/browse/TINKERPOP3-842
             Project: TinkerPop 3
          Issue Type: Improvement
          Components: hadoop
            Reporter: Marko A. Rodriguez
            Assignee: Marko A. Rodriguez
             Fix For: 3.1.0-incubating


In Hadoop2, sorting reduce output is more complex than simply setting an {{IdentityReducer}}. Right now, to get sorted map and reduce output, the number of reduce tasks needs to be set to 1. This is not a good long term solution. Figure out how to make it work for an arbitrary number of reducers.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)