You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Gunther Hagleitner (JIRA)" <ji...@apache.org> on 2014/09/03 13:01:51 UTC

[jira] [Commented] (HIVE-7924) auto_sortmerge_join_8 sometimes fails with OOM

    [ https://issues.apache.org/jira/browse/HIVE-7924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14119750#comment-14119750 ] 

Gunther Hagleitner commented on HIVE-7924:
------------------------------------------

LGTM +1. Won't hurt - did you see it fix the issue though?

> auto_sortmerge_join_8 sometimes fails with OOM
> ----------------------------------------------
>
>                 Key: HIVE-7924
>                 URL: https://issues.apache.org/jira/browse/HIVE-7924
>             Project: Hive
>          Issue Type: Test
>          Components: Tests
>            Reporter: Szehon Ho
>            Assignee: Szehon Ho
>         Attachments: HIVE-7294.patch
>
>
> Saw in some runs of this test, the following in the [log|http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-572/failed/TestCliDriver-rcfile_merge1.q-fileformat_text.q-stats2.q-and-12-more/hive.log]:
> {noformat}
> (MapredLocalTask.java:executeInProcess(321)) - Hive Runtime Error: Map local work exhausted memory
> org.apache.hadoop.hive.ql.exec.mapjoin.MapJoinMemoryExhaustionException: 2014-08-29 08:31:56	Processing rows:	4	Hashtable size:	3	Memory usage:	1531884480	percentage:	0.802
> 	at org.apache.hadoop.hive.ql.exec.mapjoin.MapJoinMemoryExhaustionHandler.checkMemoryStatus(MapJoinMemoryExhaustionHandler.java:91)
> 	at org.apache.hadoop.hive.ql.exec.HashTableSinkOperator.processOp(HashTableSinkOperator.java:251)
> 	at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:800)
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)