You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "katty he (Jira)" <ji...@apache.org> on 2022/06/02 01:33:00 UTC

[jira] [Commented] (HIVE-21304) Make bucketing version usage more robust

    [ https://issues.apache.org/jira/browse/HIVE-21304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17545226#comment-17545226 ] 

katty he commented on HIVE-21304:
---------------------------------

this patch cannot be used on hive 3.1.2 version? when i use this patch on hive 3.1.2, the test testMergeOnTezEdges cannot be passed, is there some other patch i should pick?

> Make bucketing version usage more robust
> ----------------------------------------
>
>                 Key: HIVE-21304
>                 URL: https://issues.apache.org/jira/browse/HIVE-21304
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Deepak Jaiswal
>            Assignee: Zoltan Haindrich
>            Priority: Major
>             Fix For: 4.0.0, 4.0.0-alpha-1
>
>         Attachments: HIVE-21304.01.patch, HIVE-21304.02.patch, HIVE-21304.03.patch, HIVE-21304.04.patch, HIVE-21304.05.patch, HIVE-21304.06.patch, HIVE-21304.07.patch, HIVE-21304.08.patch, HIVE-21304.09.patch, HIVE-21304.10.patch, HIVE-21304.11.patch, HIVE-21304.12.patch, HIVE-21304.13.patch, HIVE-21304.14.patch, HIVE-21304.15.patch, HIVE-21304.16.patch, HIVE-21304.17.patch, HIVE-21304.18.patch, HIVE-21304.19.patch, HIVE-21304.20.patch, HIVE-21304.21.patch, HIVE-21304.22.patch, HIVE-21304.23.patch, HIVE-21304.24.patch, HIVE-21304.25.patch, HIVE-21304.26.patch, HIVE-21304.27.patch, HIVE-21304.28.patch, HIVE-21304.29.patch, HIVE-21304.30.patch, HIVE-21304.31.patch, HIVE-21304.32.patch, HIVE-21304.33.patch, HIVE-21304.33.patch, HIVE-21304.33.patch, HIVE-21304.34.patch, HIVE-21304.34.patch, HIVE-21304.35.patch, HIVE-21304.35.patch, HIVE-21304.36.patch, HIVE-21304.37.patch, HIVE-21304.38.patch, HIVE-21304.38.patch, HIVE-21304.38.patch, HIVE-21304.39.patch, HIVE-21304.40.patch
>
>          Time Spent: 50m
>  Remaining Estimate: 0h
>
> * Show Bucketing version for ReduceSinkOp in explain extended plan - this helps identify what hashing algorithm is being used by by ReduceSinkOp.
> * move the actually selected version to the "conf" so that it doesn't get lost
> * replace trait related logic with a separate optimizer rule
> * do version selection based on a group of operator - this is more reliable
> * skip bucketingversion selection for tables with 1 buckets
> * prefer to use version 2 if possible
> * fix operator creations which didn't set a new conf



--
This message was sent by Atlassian Jira
(v8.20.7#820007)