You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Jarek Jarcec Cecho (JIRA)" <ji...@apache.org> on 2014/06/27 05:59:24 UTC
[jira] [Commented] (FLUME-2416) Use CodecPool in compressed stream
to prevent leak of direct buffers
[ https://issues.apache.org/jira/browse/FLUME-2416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14045493#comment-14045493 ]
Jarek Jarcec Cecho commented on FLUME-2416:
-------------------------------------------
+1
> Use CodecPool in compressed stream to prevent leak of direct buffers
> --------------------------------------------------------------------
>
> Key: FLUME-2416
> URL: https://issues.apache.org/jira/browse/FLUME-2416
> Project: Flume
> Issue Type: Bug
> Reporter: Hari Shreedharan
> Assignee: Hari Shreedharan
> Attachments: FLUME-2416.patch
>
>
> Even though they may no longer be references, Java only cleans up direct buffers on full gc. If there is enough heap available, a full GC is never hit and these buffers are leaked. Hadoop keeps creating new compressors instead of using the pools causing a leak - which is a bug in itself which is being addressed by HADOOP-10591
--
This message was sent by Atlassian JIRA
(v6.2#6252)