You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Todd Lipcon (JIRA)" <ji...@apache.org> on 2018/06/29 15:40:00 UTC
[jira] [Commented] (IMPALA-7219) 7.5% of Catalog Server heap wasted
by empty HashMaps and ArrayLists
[ https://issues.apache.org/jira/browse/IMPALA-7219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16527833#comment-16527833 ]
Todd Lipcon commented on IMPALA-7219:
-------------------------------------
[~misha@cloudera.com] this heap was from a catalog server that had a huge number (~8M) of tables, right? I don't disagree with the optimization (seems like an easy win) but I think in most cases the win will be less than the 7% seen here.
> 7.5% of Catalog Server heap wasted by empty HashMaps and ArrayLists
> -------------------------------------------------------------------
>
> Key: IMPALA-7219
> URL: https://issues.apache.org/jira/browse/IMPALA-7219
> Project: IMPALA
> Issue Type: Improvement
> Reporter: Misha Dmitriev
> Priority: Major
> Attachments: bad-colls-screenshot.png
>
>
> I recently analyzed a ~16GB heap dump of Catalog Server with jxray ([www.jxray.com).|http://www.jxray.com)./] It turns out that 7.5% of the heap is wasted by empty HashMap and ArrayList instances.
> !bad-colls-screenshot.png|width=464,height=531!
> These objects come from just four data fields in two classes: {{IncompleteTable}} and {{StructType}}. It should be easy to get rid of the overhead of these objects by initializing them lazily.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org