You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Hitesh Shah (JIRA)" <ji...@apache.org> on 2015/03/26 01:25:53 UTC

[jira] [Commented] (TEZ-2235) Tasks throwing OOM before reaching memory limits

    [ https://issues.apache.org/jira/browse/TEZ-2235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381107#comment-14381107 ] 

Hitesh Shah commented on TEZ-2235:
----------------------------------

Is this only with master or also in 0.5/0.6 branches?

> Tasks throwing OOM before reaching memory limits
> ------------------------------------------------
>
>                 Key: TEZ-2235
>                 URL: https://issues.apache.org/jira/browse/TEZ-2235
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Rajesh Balamohan
>         Attachments: Screen Shot 2015-03-26 at 5.04.46 AM.png, Screen Shot 2015-03-26 at 5.05.06 AM.png
>
>
> - Ran query13 in tpcds with hive (1.2.0-SNAPSHOT) at 10 TB scale with Tez (0.7 master)
> - tez.runtime.io.sort.mb=1800 on 4 GB container.
> - OOM was thrown in lots of tasks when allocating memory to sorter.  
> - Heapdump reveals memory allocated to sorter.  And other objects do not take up that much space.
> Need more investigation.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)