You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "mahesh kumar behera (Jira)" <ji...@apache.org> on 2021/05/24 01:59:00 UTC

[jira] [Updated] (HIVE-25042) Add support for map data type in Common merge join and SMB Join

     [ https://issues.apache.org/jira/browse/HIVE-25042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

mahesh kumar behera updated HIVE-25042:
---------------------------------------
        Parent:     (was: HIVE-24883)
    Issue Type: Bug  (was: Sub-task)

> Add support for map data type in Common merge join and SMB Join
> ---------------------------------------------------------------
>
>                 Key: HIVE-25042
>                 URL: https://issues.apache.org/jira/browse/HIVE-25042
>             Project: Hive
>          Issue Type: Bug
>          Components: Hive, HiveServer2
>            Reporter: mahesh kumar behera
>            Priority: Major
>
> Merge join results depends on the underlying sorter used by the mapper task as we need to judge the direction after each key comparison. So the comparison done during join has to match the way the records are sorted by the mapper. As per the sorter used by mapper task (PipelinedSorter), hash-maps with same key-value pair in different order are not equal. So the merge join also behaves the same way. But map join treats them as equal. We have to modify the pipelined sorter code to handle the map datatype. Then support has to be added in the Join code to support map types.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)