You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Hitesh Shah (JIRA)" <ji...@apache.org> on 2015/03/26 01:25:53 UTC
[jira] [Commented] (TEZ-2235) Tasks throwing OOM before reaching
memory limits
[ https://issues.apache.org/jira/browse/TEZ-2235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381107#comment-14381107 ]
Hitesh Shah commented on TEZ-2235:
----------------------------------
Is this only with master or also in 0.5/0.6 branches?
> Tasks throwing OOM before reaching memory limits
> ------------------------------------------------
>
> Key: TEZ-2235
> URL: https://issues.apache.org/jira/browse/TEZ-2235
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Rajesh Balamohan
> Attachments: Screen Shot 2015-03-26 at 5.04.46 AM.png, Screen Shot 2015-03-26 at 5.05.06 AM.png
>
>
> - Ran query13 in tpcds with hive (1.2.0-SNAPSHOT) at 10 TB scale with Tez (0.7 master)
> - tez.runtime.io.sort.mb=1800 on 4 GB container.
> - OOM was thrown in lots of tasks when allocating memory to sorter.
> - Heapdump reveals memory allocated to sorter. And other objects do not take up that much space.
> Need more investigation.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)