You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Lefty Leverenz (JIRA)" <ji...@apache.org> on 2014/08/12 07:55:13 UTC
[jira] [Commented] (HIVE-1642) Convert join queries to map-join
based on size of table/row
[ https://issues.apache.org/jira/browse/HIVE-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14093773#comment-14093773 ]
Lefty Leverenz commented on HIVE-1642:
--------------------------------------
For the record (and searchability): This added several configuration parameters in HiveConf.java for 0.7.0.
* hive.smalltable.filesize
* hive.auto.convert.join
* hive.hashtable.initialCapacity
* hive.hashtable.loadfactor
* hive.hashtable.max.memory.usage
(_later renamed_ hive.mapjoin.localtask.max.memory.usage)
* hive.hashtable.scale
(_later renamed_ hive.mapjoin.check.memory.rows)
* hive.debug.localtask
The patch gave parameter descriptions in hive-default.xml but three of them had wrong names, not counting the two that were renamed later:
* hive.mapjoin.hashtable.initialCapacity (vs. hive.hashtable.initialCapacity)
* hive.mapjoin.hashtable.loadfactor (vs. hive.hashtable.loadfactor)
* hive.mapjoin.smalltable.filesize (vs. hive.smalltable.filesize)
> Convert join queries to map-join based on size of table/row
> -----------------------------------------------------------
>
> Key: HIVE-1642
> URL: https://issues.apache.org/jira/browse/HIVE-1642
> Project: Hive
> Issue Type: Improvement
> Components: Query Processor
> Reporter: Namit Jain
> Assignee: Liyin Tang
> Fix For: 0.7.0
>
> Attachments: hive-1642_10.patch, hive-1642_11.patch, hive-1642_5.patch, hive-1642_6.patch, hive-1642_7.patch, hive-1642_9.patch, hive_1642_1.patch, hive_1642_2.patch, hive_1642_4.patch
>
>
> Based on the number of rows and size of each table, Hive should automatically be able to convert a join into map-join.
--
This message was sent by Atlassian JIRA
(v6.2#6252)