You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@tez.apache.org by "Rajesh Balamohan (JIRA)" <ji...@apache.org> on 2015/01/14 10:16:34 UTC

[jira] [Created] (TEZ-1945) Remove 2 GB memlimit restriction in MergeManager

Rajesh Balamohan created TEZ-1945:
-------------------------------------

             Summary: Remove 2 GB memlimit restriction in MergeManager
                 Key: TEZ-1945
                 URL: https://issues.apache.org/jira/browse/TEZ-1945
             Project: Apache Tez
          Issue Type: Bug
            Reporter: Rajesh Balamohan


In certain situations (data coming in larger chunks, but yet to complete), fetchers might wait in MerManager.waitForShuffleToMergeMemory() for memory to become available.  

Removing the 2 GB resitrction on MergeManager.memlimit would help in such situations.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)