You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Jun Rao (JIRA)" <ji...@apache.org> on 2013/06/07 17:30:19 UTC

[jira] [Commented] (KAFKA-936) Kafka Metrics Memory Leak

    [ https://issues.apache.org/jira/browse/KAFKA-936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13678088#comment-13678088 ] 

Jun Rao commented on KAFKA-936:
-------------------------------

Is the OOME on the broker or the consumer? How many topics and partitions do you have? We maintain some stats per partition. So the more partitions you have, the more memory is needed.
                
> Kafka Metrics Memory Leak 
> --------------------------
>
>                 Key: KAFKA-936
>                 URL: https://issues.apache.org/jira/browse/KAFKA-936
>             Project: Kafka
>          Issue Type: Bug
>          Components: consumer
>    Affects Versions: 0.8
>         Environment: centos linux, jdk 1.6, jboss
>            Reporter: Senthil Chittibabu
>            Assignee: Neha Narkhede
>            Priority: Critical
>
> I am using kafka_2.8.0-0.8.0-SNAPSHOT version. I am running into OutOfMemoryError in PermGen Space. I have set the -XX:MaxPermSize=512m, but I still get the same error. I used profiler to trace the memory leak, and found the following kafka classes to be the cause for the memory leak. Please let me know if you need any additional information to debug this issue. 
> kafka.server.FetcherLagMetrics
> kafka.consumer.FetchRequestAndResponseMetrics
> kafka.consumer.FetchRequestAndResponseStats
> kafka.metrics.KafkaTimer
> kafka.utils.Pool

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira