You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Sergey Shelukhin (JIRA)" <ji...@apache.org> on 2013/10/24 01:24:43 UTC

[jira] [Created] (HIVE-5634) use ReduceSinkOperator when outputting for client-side reducer

Sergey Shelukhin created HIVE-5634:
--------------------------------------

             Summary: use ReduceSinkOperator when outputting for client-side reducer
                 Key: HIVE-5634
                 URL: https://issues.apache.org/jira/browse/HIVE-5634
             Project: Hive
          Issue Type: Improvement
            Reporter: Sergey Shelukhin


See HIVE-4002.
We can replace OutputCollector in ReduceSink to output to say a sequence file. Then instead of fetching file output written by file sinks in map tasks, the client-side reducer can fetch reducer output via some simple task and work the same way as normal reducer.
It can also take advantage of additional ReduceSink functionality.



--
This message was sent by Atlassian JIRA
(v6.1#6144)