You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Prasanth Jayachandran (JIRA)" <ji...@apache.org> on 2018/10/12 23:43:00 UTC
[jira] [Commented] (HIVE-20713) Use percentage for join conversion
size thresholds
[ https://issues.apache.org/jira/browse/HIVE-20713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16648591#comment-16648591 ]
Prasanth Jayachandran commented on HIVE-20713:
----------------------------------------------
[~ashutoshc] can you please review? the change is small ignoring the qfile changes.
> Use percentage for join conversion size thresholds
> --------------------------------------------------
>
> Key: HIVE-20713
> URL: https://issues.apache.org/jira/browse/HIVE-20713
> Project: Hive
> Issue Type: Improvement
> Affects Versions: 4.0.0
> Reporter: Prasanth Jayachandran
> Assignee: Prasanth Jayachandran
> Priority: Major
> Attachments: HIVE-20713.1.patch
>
>
> There are many places in join conversion that rely on absolute byte sizes for join conversions (mapjoin, dynamic hashjoin etc.). When container sizes change, these join conversion thresholds have to be tuned accordingly according to the new container size. Instead, make the join conversions byte sizes a percentage/fraction of container size.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)