You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Gopal V (JIRA)" <ji...@apache.org> on 2015/04/01 06:10:52 UTC
[jira] [Commented] (HIVE-10174) LLAP: ORC MemoryManager is
singleton synchronized
[ https://issues.apache.org/jira/browse/HIVE-10174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14389958#comment-14389958 ]
Gopal V commented on HIVE-10174:
--------------------------------
Performance difference is somewhere along the lines of 34s with the MemoryManager + addRow synchronized blocks vs 9s without the MemoryManager and the addRow synchronized(this).
To be looked at when we're writing ORC out of LLAP.
> LLAP: ORC MemoryManager is singleton synchronized
> -------------------------------------------------
>
> Key: HIVE-10174
> URL: https://issues.apache.org/jira/browse/HIVE-10174
> Project: Hive
> Issue Type: Sub-task
> Components: File Formats
> Affects Versions: llap
> Reporter: Gopal V
> Attachments: orc-memorymanager-1.png, orc-memorymanager-2.png
>
>
> ORC MemoryManager::addedRow() checks are bad for LLAP multi-threaded performance.
> !orc-memorymanager-1.png!
> !orc-memorymanager-2.png!
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)