You are viewing a plain text version of this content. The canonical link for it is here.

Posted to notifications@accumulo.apache.org by "marco polo (JIRA)" <ji...@apache.org> on 2016/08/22 15:59:21 UTC

[jira] [Commented] (ACCUMULO-624) iterators may open lots of compressors

    [ https://issues.apache.org/jira/browse/ACCUMULO-624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15431063#comment-15431063 ] 

marco polo commented on ACCUMULO-624:
-------------------------------------

I was not able to replicate Eric's results. In fact I found that using no Pool was beneficial to us. As a result I made Accumulo-4419 which I will use to demonstrate my changes. 

> iterators may open lots of compressors
> --------------------------------------
>
>                 Key: ACCUMULO-624
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-624
>             Project: Accumulo
>          Issue Type: Bug
>          Components: tserver
>            Reporter: Eric Newton
>
> A large iterator tree may create many instances of Compressors.  These instances are pulled from a pool that never decreases in size.  So, if 50 simultaneous queries are run over dozens of files, each with a complex iterator stack, there will be thousands of compressors created.  Each of these holds a large buffer.  This can cause the server to run out of memory.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)