You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Zoltan Haindrich (Jira)" <ji...@apache.org> on 2020/04/24 04:23:00 UTC

[jira] [Commented] (HIVE-21304) Make bucketing version usage more robust

    [ https://issues.apache.org/jira/browse/HIVE-21304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17091161#comment-17091161 ] 

Zoltan Haindrich commented on HIVE-21304:
-----------------------------------------

[~jcamachorodriguez], [~vgarg] Could you please take a look?
https://github.com/apache/hive/pull/994

> Make bucketing version usage more robust
> ----------------------------------------
>
>                 Key: HIVE-21304
>                 URL: https://issues.apache.org/jira/browse/HIVE-21304
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Deepak Jaiswal
>            Assignee: Zoltan Haindrich
>            Priority: Major
>         Attachments: HIVE-21304.01.patch, HIVE-21304.02.patch, HIVE-21304.03.patch, HIVE-21304.04.patch, HIVE-21304.05.patch, HIVE-21304.06.patch, HIVE-21304.07.patch, HIVE-21304.08.patch, HIVE-21304.09.patch, HIVE-21304.10.patch, HIVE-21304.11.patch, HIVE-21304.12.patch, HIVE-21304.13.patch, HIVE-21304.14.patch, HIVE-21304.15.patch, HIVE-21304.16.patch, HIVE-21304.17.patch, HIVE-21304.18.patch, HIVE-21304.19.patch, HIVE-21304.20.patch, HIVE-21304.21.patch, HIVE-21304.22.patch, HIVE-21304.23.patch, HIVE-21304.24.patch, HIVE-21304.25.patch, HIVE-21304.26.patch, HIVE-21304.27.patch, HIVE-21304.28.patch, HIVE-21304.29.patch, HIVE-21304.30.patch, HIVE-21304.31.patch, HIVE-21304.32.patch
>
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> * Show Bucketing version for ReduceSinkOp in explain extended plan - this helps identify what hashing algorithm is being used by by ReduceSinkOp.
> * move the actually selected version to the "conf" so that it doesn't get lost
> * replace trait related logic with a separate optimizer rule
> * do version selection based on a group of operator - this is more reliable
> * skip bucketingversion selection for tables with 1 buckets
> * prefer to use version 2 if possible
> * fix operator creations which didn't set a new conf



--
This message was sent by Atlassian Jira
(v8.3.4#803005)