You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Mostafa Mokhtar (JIRA)" <ji...@apache.org> on 2015/04/30 17:50:07 UTC

[jira] [Commented] (HIVE-10551) OOM when running query_89 with vectorization on & hybridgrace=false

    [ https://issues.apache.org/jira/browse/HIVE-10551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14521695#comment-14521695 ] 

Mostafa Mokhtar commented on HIVE-10551:
----------------------------------------

[~rajesh.balamohan]

Can you please attach the explain plan?
Also what was hive.auto.convert.join.noconditionaltask.size set to?

I tend to not increase io.sort.mb beyond 1024.

> OOM when running query_89 with vectorization on & hybridgrace=false
> -------------------------------------------------------------------
>
>                 Key: HIVE-10551
>                 URL: https://issues.apache.org/jira/browse/HIVE-10551
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Rajesh Balamohan
>         Attachments: hive_10551.png
>
>
> - TPC-DS Query_89 @ 10 TB scale
> - Trunk version of Hive + Tez 0.7.0-SNAPSHOT
> - Additional settings ( "hive.vectorized.groupby.maxentries=1024 , tez.runtime.io.sort.factor=200  tez.runtime.io.sort.mb=1800 hive.tez.container.size=4096 ,hive.mapjoin.hybridgrace.hashtable=false" )
> Will attach the profiler snapshot asap.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)