You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Michael Shuler (JIRA)" <ji...@apache.org> on 2014/11/06 18:10:34 UTC

[jira] [Commented] (CASSANDRA-8248) Possible memory leak

    [ https://issues.apache.org/jira/browse/CASSANDRA-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200472#comment-14200472 ] 

Michael Shuler commented on CASSANDRA-8248:
-------------------------------------------

Repair is an expensive process. After repair has completed and the JVM has garbage collected, what are you seeing? If things return to expected resource use, this sounds like expected behavior.

> Possible memory leak 
> ---------------------
>
>                 Key: CASSANDRA-8248
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-8248
>             Project: Cassandra
>          Issue Type: Bug
>            Reporter: Alexander Sterligov
>
> Sometimes during repair cassandra starts to consume more memory than expected.
> Total amount of data on node is about 20GB.
> Size of the data directory is 66GC because of snapshots.
> Top reports: 
> {quote}
>   PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
> 15724 loadbase  20   0  493g  55g  44g S   28 44.2   4043:24 java
> {quote}
> At the /proc/15724/maps there are a lot of deleted file maps
> {quote}
> 7f63a6102000-7f63a6332000 r--s 00000000 08:21 9442763                    /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a6332000-7f63a6562000 r--s 00000000 08:21 9442763                    /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a6562000-7f63a6792000 r--s 00000000 08:21 9442763                    /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a6792000-7f63a69c2000 r--s 00000000 08:21 9442763                    /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a69c2000-7f63a6bf2000 r--s 00000000 08:21 9442763                    /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a6bf2000-7f63a6e22000 r--s 00000000 08:21 9442763                    /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a6e22000-7f63a7052000 r--s 00000000 08:21 9442763                    /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a7052000-7f63a7282000 r--s 00000000 08:21 9442763                    /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a7282000-7f63a74b2000 r--s 00000000 08:21 9442763                    /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a74b2000-7f63a76e2000 r--s 00000000 08:21 9442763                    /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a76e2000-7f63a7912000 r--s 00000000 08:21 9442763                    /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a7912000-7f63a7b42000 r--s 00000000 08:21 9442763                    /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a7b42000-7f63a7d72000 r--s 00000000 08:21 9442763                    /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a7d72000-7f63a7fa2000 r--s 00000000 08:21 9442763                    /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a7fa2000-7f63a81d2000 r--s 00000000 08:21 9442763                    /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a81d2000-7f63a8402000 r--s 00000000 08:21 9442763                    /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a8402000-7f63a8622000 r--s 00000000 08:21 9442763                    /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a8622000-7f63a8842000 r--s 00000000 08:21 9442763                    /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a8842000-7f63a8a62000 r--s 00000000 08:21 9442763                    /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a8a62000-7f63a8c82000 r--s 00000000 08:21 9442763                    /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a8c82000-7f63a8ea2000 r--s 00000000 08:21 9442763                    /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a8ea2000-7f63a90c2000 r--s 00000000 08:21 9442763                    /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a90c2000-7f63a92e2000 r--s 00000000 08:21 9442763                    /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> {quote}
> {quote}
> $ sudo grep deleted /proc/15724/maps | wc -l
> 640118
> {quote}
> {quote}
> $ sudo grep -v deleted /proc/15724/maps | wc -l
> 303340
> {quote}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)