You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Lefty Leverenz (JIRA)" <ji...@apache.org> on 2014/08/12 07:55:13 UTC

[jira] [Commented] (HIVE-1642) Convert join queries to map-join based on size of table/row

    [ https://issues.apache.org/jira/browse/HIVE-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14093773#comment-14093773 ] 

Lefty Leverenz commented on HIVE-1642:
--------------------------------------

For the record (and searchability):  This added several configuration parameters in HiveConf.java for 0.7.0.

*  hive.smalltable.filesize
*  hive.auto.convert.join
*  hive.hashtable.initialCapacity
*  hive.hashtable.loadfactor
*  hive.hashtable.max.memory.usage
(_later renamed_ hive.mapjoin.localtask.max.memory.usage)
*  hive.hashtable.scale
(_later renamed_ hive.mapjoin.check.memory.rows)
*  hive.debug.localtask

The patch gave parameter descriptions in hive-default.xml but three of them had wrong names, not counting the two that were renamed later:

*  hive.mapjoin.hashtable.initialCapacity (vs. hive.hashtable.initialCapacity)
*  hive.mapjoin.hashtable.loadfactor (vs. hive.hashtable.loadfactor)
*  hive.mapjoin.smalltable.filesize (vs. hive.smalltable.filesize)

> Convert join queries to map-join based on size of table/row
> -----------------------------------------------------------
>
>                 Key: HIVE-1642
>                 URL: https://issues.apache.org/jira/browse/HIVE-1642
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>            Reporter: Namit Jain
>            Assignee: Liyin Tang
>             Fix For: 0.7.0
>
>         Attachments: hive-1642_10.patch, hive-1642_11.patch, hive-1642_5.patch, hive-1642_6.patch, hive-1642_7.patch, hive-1642_9.patch, hive_1642_1.patch, hive_1642_2.patch, hive_1642_4.patch
>
>
> Based on the number of rows and size of each table, Hive should automatically be able to convert a join into map-join.



--
This message was sent by Atlassian JIRA
(v6.2#6252)