[jira] [Updated] (TEZ-3244) Allow overlap of input and output memory when they are not concurrent

["Jason Lowe (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/TEZ-3244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jason Lowe updated TEZ-3244:
----------------------------
    Attachment: TEZ-3244.003.patch

Updated the patch to change the config property scopes from AM to VERTEX and also changed the config from non-concurrent-inputs-disable to non-concurrent-inputs.enabled.  I updated the documentation to state that they are not supported by the ScalingAllocator.

I was going to update ScalingAllocator to be a degenerate derivation of the WeightedScalingMemoryDistributor but the dependencies are backwards for that.  We'd either have to replicate the code or refactor the code from the weighted distributor up into runtime-internals, and I thought that was a bit much for this patch.

> Allow overlap of input and output memory when they are not concurrent
> ---------------------------------------------------------------------
>
>                 Key: TEZ-3244
>                 URL: https://issues.apache.org/jira/browse/TEZ-3244
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Jason Lowe
>            Assignee: Jason Lowe
>         Attachments: TEZ-3244.001.patch, TEZ-3244.002.patch, TEZ-3244.003.patch
>
>
> For cases when memory for inputs and outputs are not needed simultaneously it would be more efficient to allow inputs to use the memory normally set aside for outputs and vice-versa.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)