You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Rajesh Balamohan (JIRA)" <ji...@apache.org> on 2014/05/02 00:58:16 UTC

[jira] [Created] (TEZ-1095) Enable tez.runtime.shuffle.memory-to-memory.enable for mem-to-mem merging

Rajesh Balamohan created TEZ-1095:
-------------------------------------

             Summary: Enable tez.runtime.shuffle.memory-to-memory.enable for mem-to-mem merging
                 Key: TEZ-1095
                 URL: https://issues.apache.org/jira/browse/TEZ-1095
             Project: Apache Tez
          Issue Type: Bug
            Reporter: Rajesh Balamohan


Currently tez.runtime.shuffle.memory-to-memory.enable is set to false by default.  We need to evaluate the usefulness of this parameter and enable it by default if it provides good perf boosts.  

There is also a possibility that waitForInMemoryMerge() will return in sub milliseconds when this parameter is enabled, causing pressure on network resources.  Related JIRA: https://issues.apache.org/jira/browse/TEZ-1091



--
This message was sent by Atlassian JIRA
(v6.2#6252)