You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by "Siddharth Wagle (JIRA)" <ji...@apache.org> on 2013/05/14 22:19:16 UTC

[jira] [Reopened] (AMBARI-2116) Add parameters to improve HIVE performance

     [ https://issues.apache.org/jira/browse/AMBARI-2116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Siddharth Wagle reopened AMBARI-2116:
-------------------------------------

    
> Add parameters to improve HIVE performance
> ------------------------------------------
>
>                 Key: AMBARI-2116
>                 URL: https://issues.apache.org/jira/browse/AMBARI-2116
>             Project: Ambari
>          Issue Type: Bug
>          Components: controller
>    Affects Versions: 1.3.1
>            Reporter: Siddharth Wagle
>            Assignee: Siddharth Wagle
>             Fix For: 1.3.1
>
>         Attachments: AMBARI-2116-1.patch, AMBARI-2116-2.patch, AMBARI-2116.patch
>
>
> This bug captures the set of configurations for hive and hadoop and the default values that are required for better/correct performance.
> Here are the setting Ambari should use for hive-site.xml.
> set hive.enforce.bucketing=true;
> set hive.enforce.sorting=true;
> set hive.map.aggr=true;
> set hive.optimize.bucketmapjoin=true;
> set hive.optimize.bucketmapjoin.sortedmerge=true;
> set hive.mapred.reduce.tasks.speculative.execution=false;
> set hive.auto.convert.join=true;
> set hive.auto.convert.sortmerge.join=true;
> set hive.auto.convert.sortmerge.join.noconditionaltask=true;
> set hive.auto.convert.join.noconditionaltask=true;
> set hive.auto.convert.join.noconditionaltask.size=1000000000;
> set hive.optimize.reducededuplication.min.reducer=1;
> set hive.optimize.mapjoin.mapreduce=true;
> set hive.mapjoin.bucket.cache.size=10000;

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira