[jira] [Comment Edited] (TEZ-932) Add a type aware Initial memory distributor

["Siddharth Seth (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TEZ-932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13948774#comment-13948774 ] 

Siddharth Seth edited comment on TEZ-932 at 3/27/14 2:13 AM:
-------------------------------------------------------------

Updated patch. Shares unit tests with the default linear scaler. Added an option to reserve additional memory per request.

Also removed separate initial defaults - based on whether the processor asked or not. Configuring the value should be sufficient.

[~hitesh], please review. Would like to get this in soon.


was (Author: sseth):
Updated patch. Shares unit tests with the default linear scaler. Added an option to reserve additional memory per request.

[~hitesh], please review. Would like to get this in soon.

> Add a type aware Initial memory distributor
> -------------------------------------------
>
>                 Key: TEZ-932
>                 URL: https://issues.apache.org/jira/browse/TEZ-932
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: Siddharth Seth
>            Assignee: Siddharth Seth
>         Attachments: TEZ-932.1.txt, TEZ-932.2.txt
>
>
> The current memory scaler has not idea about the requirements of the underlying components (broadcast, shfufle etc). This jira is to add a scaler which can take the types into consideration.



--
This message was sent by Atlassian JIRA
(v6.2#6252)