[jira] [Updated] (TEZ-3244) Allow overlap of input and output memory when they are not concurrent

["Jason Lowe (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/TEZ-3244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jason Lowe updated TEZ-3244:
----------------------------
    Attachment: TEZ-3244.002.patch

Trying to resurrect this, since we've been running this with great success in production for quite some time and [~rohini] would like to add support for this feature in Apache Pig.

Updating the patch to also add a config that allows the extra memory obtainable via non-concurrent I/O to be distributed just to the outputs rather than both the inputs and the outputs.


> Allow overlap of input and output memory when they are not concurrent
> ---------------------------------------------------------------------
>
>                 Key: TEZ-3244
>                 URL: https://issues.apache.org/jira/browse/TEZ-3244
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Jason Lowe
>            Assignee: Jason Lowe
>         Attachments: TEZ-3244.001.patch, TEZ-3244.002.patch
>
>
> For cases when memory for inputs and outputs are not needed simultaneously it would be more efficient to allow inputs to use the memory normally set aside for outputs and vice-versa.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)