You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Hitesh Shah (JIRA)" <ji...@apache.org> on 2015/04/09 01:10:12 UTC
[jira] [Commented] (TEZ-2290) Scale memory for Default Sorter down
to a max of 2047 MB if configured higher
[ https://issues.apache.org/jira/browse/TEZ-2290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14486288#comment-14486288 ]
Hitesh Shah commented on TEZ-2290:
----------------------------------
Minor comment:
Code could be simpler if "int sortMB = Math.max(0, (int) availableMemoryMB);" was removed and a simple <=0 check done in the next step.
+1 pending pre-commit ( please refer to mail on dev@tez on how to pull this as pre-commit updates are currently broken )
> Scale memory for Default Sorter down to a max of 2047 MB if configured higher
> -----------------------------------------------------------------------------
>
> Key: TEZ-2290
> URL: https://issues.apache.org/jira/browse/TEZ-2290
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Hitesh Shah
> Assignee: Rajesh Balamohan
> Priority: Blocker
> Attachments: TEZ-2290.1.patch
>
>
> Given that Pipeline sorter is now the default, the memory configured may likely be more than 2 GB. If a user switches from pipeline to default, they will hit problems straight away. We should scale default sorter's memory config to a max of 2 GB and log a warning.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)