You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Hitesh Shah (JIRA)" <ji...@apache.org> on 2015/04/09 01:10:12 UTC

[jira] [Commented] (TEZ-2290) Scale memory for Default Sorter down to a max of 2047 MB if configured higher

    [ https://issues.apache.org/jira/browse/TEZ-2290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14486288#comment-14486288 ] 

Hitesh Shah commented on TEZ-2290:
----------------------------------

Minor comment: 

Code could be simpler if "int sortMB = Math.max(0, (int) availableMemoryMB);" was removed and a simple <=0 check done in the next step. 

+1 pending pre-commit ( please refer to mail on dev@tez on how to pull this as pre-commit updates are currently broken )

> Scale memory for Default Sorter down to a max of 2047 MB if configured higher
> -----------------------------------------------------------------------------
>
>                 Key: TEZ-2290
>                 URL: https://issues.apache.org/jira/browse/TEZ-2290
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Hitesh Shah
>            Assignee: Rajesh Balamohan
>            Priority: Blocker
>         Attachments: TEZ-2290.1.patch
>
>
> Given that Pipeline sorter is now the default, the memory configured may likely be more than 2 GB. If a user switches from pipeline to default, they will hit problems straight away. We should scale default sorter's memory config to a max of 2 GB and log a warning. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)