You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Rajesh Balamohan (JIRA)" <ji...@apache.org> on 2015/04/30 11:13:05 UTC
[jira] [Updated] (HIVE-10551) OOM when running query_89 with
vectorization on & hybridgrace=false
[ https://issues.apache.org/jira/browse/HIVE-10551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rajesh Balamohan updated HIVE-10551:
------------------------------------
Attachment: hive_10551.png
Snapshot shows 680 MB of data already present, and it ends up throwing OOM when it tries to allocate 1800+MB for sorter.
> OOM when running query_89 with vectorization on & hybridgrace=false
> -------------------------------------------------------------------
>
> Key: HIVE-10551
> URL: https://issues.apache.org/jira/browse/HIVE-10551
> Project: Hive
> Issue Type: Bug
> Reporter: Rajesh Balamohan
> Attachments: hive_10551.png
>
>
> - TPC-DS Query_89 @ 10 TB scale
> - Trunk version of Hive + Tez 0.7.0-SNAPSHOT
> - Additional settings ( "hive.vectorized.groupby.maxentries=1024 , tez.runtime.io.sort.factor=200 tez.runtime.io.sort.mb=1800 hive.tez.container.size=4096 ,hive.mapjoin.hybridgrace.hashtable=false" )
> Will attach the profiler snapshot asap.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)