[jira] [Commented] (TEZ-145) Support a combiner processor that can run non-local to map/reduce nodes

["Tsuyoshi OZAWA (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TEZ-145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14118030#comment-14118030 ] 

Tsuyoshi OZAWA commented on TEZ-145:
------------------------------------

Thanks for good suggestions, [~gopalv] and [~bikassaha]. I took some days to benchmark base line of Tez. Now I started to implement this feature in {{YARNRunner#createDAG}} with TaskLocationHint - host-local R and racklocal R as Gopal mentioned. I'll share you when I have any progress. Thanks!

> Support a combiner processor that can run non-local to map/reduce nodes
> -----------------------------------------------------------------------
>
>                 Key: TEZ-145
>                 URL: https://issues.apache.org/jira/browse/TEZ-145
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Hitesh Shah
>            Assignee: Tsuyoshi OZAWA
>              Labels: TEZ-1
>
> For aggregate operators that can benefit by running in multi-level trees, support of being able to run a combiner in a non-local mode would allow performance efficiencies to be gained by running a combiner at a rack-level. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)