You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hive.apache.org by "Matt McCline (JIRA)" <ji...@apache.org> on 2017/11/22 22:58:00 UTC

[jira] [Assigned] (HIVE-17994) Vectorization: Serialization bottlenecked on irrelevant hashmap lookup

     [ https://issues.apache.org/jira/browse/HIVE-17994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Matt McCline reassigned HIVE-17994:
-----------------------------------

    Assignee: Matt McCline

> Vectorization: Serialization bottlenecked on irrelevant hashmap lookup
> ----------------------------------------------------------------------
>
>                 Key: HIVE-17994
>                 URL: https://issues.apache.org/jira/browse/HIVE-17994
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Gopal V
>            Assignee: Matt McCline
>            Priority: Minor
>         Attachments: vec-serialize-hashmap.png
>
>
> On machines with slower NUMA, the hashmap lookup for TypeInfo::getPrimitiveCategory is the slowest part of the vectorized serialization loops. The static object references run hot with the NUMA access speeds penalizing half the threads.
> This lookup is done for every column, for every row - though vectorization enforces that this type cannot change at all.
> !vec-serialize-hashmap.png!



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)