You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Rahul Bhardwaj (JIRA)" <ji...@apache.org> on 2015/01/07 06:46:37 UTC
[jira] [Commented] (CASSANDRA-8248) Possible memory leak
[ https://issues.apache.org/jira/browse/CASSANDRA-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267300#comment-14267300 ]
Rahul Bhardwaj commented on CASSANDRA-8248:
-------------------------------------------
I was also facing the same issue, as whole 64 G memory was getting consumed by cassandra. Some one suggested me to apply this patch . After applying it now i am noticing below error very frequently in my system.log. Please help in analyzing it.
INFO [Service Thread] 2015-01-07 10:56:26,172 GCInspector.java:142 - ParNew GC in 255ms. CMS Old Gen: 4660118640 -> 4727753888; Par Eden Space: 1718091776 -> 0; Par Survivor Space: 95561024 -> 58883904
ERROR [NonPeriodicTasks:1] 2015-01-07 10:56:27,465 CassandraDaemon.java:153 - Exception in thread Thread[NonPeriodicTasks:1,5,main]
java.lang.AssertionError: null
at org.apache.cassandra.io.util.Memory.free(Memory.java:300) ~[apache-cassandra-2.1.2.jar:2.1.2-SNAPSHOT]
at org.apache.cassandra.utils.obs.OffHeapBitSet.close(OffHeapBitSet.java:143) ~[apache-cassandra-2.1.2.jar:2.1.2-SNAPSHOT]
at org.apache.cassandra.utils.BloomFilter.close(BloomFilter.java:116) ~[apache-cassandra-2.1.2.jar:2.1.2-SNAPSHOT]
at org.apache.cassandra.io.sstable.SSTableReader$6.run(SSTableReader.java:645) ~[apache-cassandra-2.1.2.jar:2.1.2-SNAPSHOT]
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:1.7.0_71]
at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.7.0_71]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(Unknown Source) ~[na:1.7.0_71]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:1.7.0_71]
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) [na:1.7.0_71]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) [na:1.7.0_71]
at java.lang.Thread.run(Unknown Source) [na:1.7.0_71]
INFO [CompactionExecutor:9] 2015-01-07 10:56:27,467 ColumnFamilyStore.java:840 - Enqueuing flush of compactions_in_progress: 164 (0%) on-heap, 0 (0%) off-heap
INFO [MemtableFlushWriter:4] 2015-01-07 10:56:27,468 Memtable.java:325 - Writing Memtable-compactions_in_progress@1148337401(0 serialized bytes, 1 ops, 0%/0% of on/off-heap limit)
INFO [MemtableFlushWriter:4] 2015-01-07 10:56:27,476 Memtable.java:364 - Completed flushing /var/lib/cassandra/data/system/compactions_in_progress-55080ab05d9c388690a4acb25fe1f77b/system-compactions_in_progress-ka-1331-Data.db (42 bytes) for commitlog position ReplayPosition(segmentId=1420608014522, position=60129547)
ERROR [CompactionExecutor:9] 2015-01-07 10:56:27,477 CassandraDaemon.java:153 - Exception in thread Thread[CompactionExecutor:9,1,main]
java.lang.AssertionError: null
at org.apache.cassandra.io.util.Memory.free(Memory.java:300) ~[apache-cassandra-2.1.2.jar:2.1.2-SNAPSHOT]
at org.apache.cassandra.utils.obs.OffHeapBitSet.close(OffHeapBitSet.java:143) ~[apache-cassandra-2.1.2.jar:2.1.2-SNAPSHOT]
at org.apache.cassandra.utils.BloomFilter.close(BloomFilter.java:116) ~[apache-cassandra-2.1.2.jar:2.1.2-SNAPSHOT]
at org.apache.cassandra.io.sstable.SSTableWriter.abort(SSTableWriter.java:345) ~[apache-cassandra-2.1.2.jar:2.1.2-SNAPSHOT]
at org.apache.cassandra.io.sstable.SSTableRewriter.abort(SSTableRewriter.java:198) ~[apache-cassandra-2.1.2.jar:2.1.2-SNAPSHOT]
at org.apache.cassandra.db.compaction.CompactionTask.runWith(CompactionTask.java:204) ~[apache-cassandra-2.1.2.jar:2.1.2-SNAPSHOT]
at org.apache.cassandra.io.util.DiskAwareRunnable.runMayThrow(DiskAwareRunnable.java:48) ~[apache-cassandra-2.1.2.jar:2.1.2-SNAPSHOT]
at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) ~[apache-cassandra-2.1.2.jar:2.1.2-SNAPSHOT]
at org.apache.cassandra.db.compaction.CompactionTask.executeInternal(CompactionTask.java:75) ~[apache-cassandra-2.1.2.jar:2.1.2-SNAPSHOT]
at org.apache.cassandra.db.compaction.AbstractCompactionTask.execute(AbstractCompactionTask.java:59) ~[apache-cassandra-2.1.2.jar:2.1.2-SNAPSHOT]
at org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionTask.run(CompactionManager.java:232) ~[apache-cassandra-2.1.2.jar:2.1.2-SNAPSHOT]
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:1.7.0_71]
at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.7.0_71]
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) [na:1.7.0_71]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) [na:1.7.0_71]
at java.lang.Thread.run(Unknown Source) [na:1.7.0_71]
INFO [CompactionExecutor:10] 2015-01-07 10:56:27,478 CompactionTask.java:136 - Compacting [SSTableReader(path='/var/lib/cassandra/data/system/compactions_in_progress-55080ab05d9c388690a4acb25fe1f77b/system-compactions_in_progress-ka-1328-Data.db'), SSTableReader(path='/var/lib/cassandra/data/system/compactions_in_progress-55080ab05d9c388690a4acb25fe1f77b/system-compactions_in_progress-ka-1331-Data.db'), SSTableReader(path='/var/lib/cassandra/data/system/compactions_in_progress-55080ab05d9c388690a4acb25fe1f77b/system-compactions_in_progress-ka-1330-Data.db'), SSTableReader(path='/var/lib/cassandra/data/system/compactions_in_progress-55080ab05d9c388690a4acb25fe1f77b/system-compactions_in_progress-ka-1329-Data.db')]
INFO [CompactionExecutor:10] 2015-01-07 10:56:27,492 CompactionTask.java:251 - Compacted 4 sstables to [/var/lib/cassandra/data/system/compactions_in_progress-55080ab05d9c388690a4acb25fe1f77b/system-compactions_in_progress-ka-1332,]. 414 bytes to 42 (~10% of original) in 11ms = 0.003641MB/s. 4 total partitions merged to 1. Partition merge counts were {2:2, }
INFO [CompactionExecutor:8] 2015-01-07 10:56:32,716 CompactionTask.java:136 - Compacting [SSTableReader(path='/var/lib/cassandra/data/system/batchlog-0290003c977e397cac3efdfdc01d626b/system-batchlog-ka-6436-Data.db')]
INFO [CompactionExecutor:8] 2015-01-07 10:56:32,786 CompactionTask.java:251 - Compacted 1 sstables to [/var/lib/cassandra/data/system/batchlog-0290003c977e397cac3efdfdc01d626b/system-batchlog-ka-6437,]. 3,048,848 bytes to 3,048,848 (~100% of original) in 69ms = 42.139247MB/s. 28 total partitions merged to 28. Partition merge counts were {1:28, }
WARN [Thrift:8] 2015-01-07 10:57:18,911 BatchStatement.java:255 - Batch of prepared statements for [clickstream.im_csl_log] is of size 11397845, exceeding specified threshold of 5120 by 11392725.
INFO [CompactionExecutor:11] 2015-01-07 10:57:32,813 CompactionTask.java:136 - Compacting [SSTableReader(path='/var/lib/cassandra/data/system/batchlog-0290003c977e397cac3efdfdc01d626b/system-batchlog-ka-6437-Data.db')]
INFO [CompactionExecutor:11] 2015-01-07 10:57:32,879 CompactionTask.java:251 - Compacted 1 sstables to [/var/lib/cassandra/data/system/batchlog-0290003c977e397cac3efdfdc01d626b/system-batchlog-ka-6438,]. 3,048,848 bytes to 3,048,848 (~100% of original) in 64ms = 45.431376MB/s. 28 total partitions merged to 28. Partition merge counts were {1:28, }
WARN [Thrift:11] 2015-01-07 10:58:02,499 BatchStatement.java:255 - Batch of prepared statements for [clickstream.im_csl_glusr_daily_activity_count] is of size 50559, exceeding specified threshold of 5120 by 45439.
INFO [CompactionExecutor:12] 2015-01-07 10:58:32,907 CompactionTask.java:136 - Compacting [SSTableReader(path='/var/lib/cassandra/data/system/batchlog-0290003c977e397cac3efdfdc01d626b/system-batchlog-ka-6438-Data.db')]
INFO [CompactionExecutor:12] 2015-01-07 10:58:32,975 CompactionTask.java:251 - Compacted 1 sstables to [/var/lib/cassandra/data/system/batchlog-0290003c977e397cac3efdfdc01d626b/system-batchlog-ka-6439,]. 3,048,848 bytes to 3,048,848 (~100% of original) in 66ms = 44.054667MB/s. 28 total partitions merged to 28. Partition merge counts were {1:28, }
WARN [Thrift:14] 2015-01-07 10:59:02,648 BatchStatement.java:255 - Batch of prepared statements for [clickstream.im_csl_glusr_daily_activity_count] is of size 47424, exceeding specified threshold of 5120 by 42304.
INFO [Service Thread] 2015-01-07 10:59:12,654 GCInspector.java:142 - ConcurrentMarkSweep GC in 8149ms. CMS Old Gen: 4883123208 -> 454636000; CMS Perm Gen: 30016296 -> 30000360; Code Cache: 8618432 -> 8619264; Par Eden Space: 1313384 -> 230386176; Par Survivor Space: 54790344 -> 3442848
INFO [Service Thread] 2015-01-07 10:59:12,655 StatusLogger.java:51 - Pool Name Active Pending Completed Blocked All Time Blocked
INFO [Service Thread] 2015-01-07 10:59:12,656 StatusLogger.java:66 - CounterMutationStage 0 0 2 0 0
INFO [Service Thread] 2015-01-07 10:59:12,657 StatusLogger.java:66 - ReadStage 0 0 515342 0 0
INFO [Service Thread] 2015-01-07 10:59:12,658 StatusLogger.java:66 - RequestResponseStage 0 0 382566 0 0
INFO [Service Thread] 2015-01-07 10:59:12,658 StatusLogger.java:66 - ReadRepairStage 0 0 1334 0 0
INFO [Service Thread] 2015-01-07 10:59:12,659 StatusLogger.java:66 - MutationStage 0 0 40529 0 0
INFO [Service Thread] 2015-01-07 10:59:12,660 StatusLogger.java:66 - GossipStage 0 0 2605 0 0
INFO [Service Thread] 2015-01-07 10:59:12,660 StatusLogger.java:66 - AntiEntropyStage 0 0 0 0 0
INFO [Service Thread] 2015-01-07 10:59:12,661 StatusLogger.java:66 - CacheCleanupExecutor 0 0 0 0 0
INFO [Service Thread] 2015-01-07 10:59:12,662 StatusLogger.java:66 - MigrationStage 0 0 0 0 0
INFO [Service Thread] 2015-01-07 10:59:12,662 StatusLogger.java:66 - ValidationExecutor 0 0 0 0 0
INFO [Service Thread] 2015-01-07 10:59:12,663 StatusLogger.java:66 - MiscStage 0 0 0 0 0
INFO [Service Thread] 2015-01-07 10:59:12,664 StatusLogger.java:66 - CommitLogArchiver 0 0 0 0 0
INFO [Service Thread] 2015-01-07 10:59:12,664 StatusLogger.java:66 - MemtableFlushWriter 0 0 26 0 0
INFO [Service Thread] 2015-01-07 10:59:12,665 StatusLogger.java:66 - PendingRangeCalculator 0 0 4 0 0
INFO [Service Thread] 2015-01-07 10:59:12,665 StatusLogger.java:66 - MemtableReclaimMemory 0 0 39 0 0
INFO [Service Thread] 2015-01-07 10:59:12,665 StatusLogger.java:66 - MemtablePostFlush 0 0 56 0 0
INFO [Service Thread] 2015-01-07 10:59:12,666 StatusLogger.java:66 - CompactionExecutor 0 0 156 0 0
INFO [Service Thread] 2015-01-07 10:59:12,666 StatusLogger.java:66 - InternalResponseStage 0 0 0 0 0
INFO [Service Thread] 2015-01-07 10:59:12,666 StatusLogger.java:66 - HintedHandoff 0 0 2 0 0
INFO [Service Thread] 2015-01-07 10:59:12,667 StatusLogger.java:75 - CompactionManager 0 0
INFO [Service Thread] 2015-01-07 10:59:12,667 StatusLogger.java:87 - MessagingService n/a 0/0
INFO [Service Thread] 2015-01-07 10:59:12,667 StatusLogger.java:97 - Cache Type Size Capacity KeysToSave
INFO [Service Thread] 2015-01-07 10:59:12,667 StatusLogger.java:99 - KeyCache 3170416 104857600 all
INFO [Service Thread] 2015-01-07 10:59:12,667 StatusLogger.java:105 - RowCache 0 0 all
INFO [Service Thread] 2015-01-07 10:59:12,667 StatusLogger.java:112 - ColumnFamily Memtable ops,data
INFO [Service Thread] 2015-01-07 10:59:12,667 StatusLogger.java:115 - system.schema_triggers 0,0
INFO [Service Thread] 2015-01-07 10:59:12,668 StatusLogger.java:115 - system.local 0,0
INFO [Service Thread] 2015-01-07 10:59:12,668 StatusLogger.java:115 - system.peers 850,110558
INFO [Service Thread] 2015-01-07 10:59:12,668 StatusLogger.java:115 - system.batchlog 0,0
INFO [Service Thread] 2015-01-07 10:59:12,668 StatusLogger.java:115 - system.compactions_in_progress 0,0
INFO [Service Thread] 2015-01-07 10:59:12,668 StatusLogger.java:115 - system.schema_usertypes 0,0
INFO [Service Thread] 2015-01-07 10:59:12,668 StatusLogger.java:115 - system.schema_keyspaces 4,471
INFO [Service Thread] 2015-01-07 10:59:12,668 StatusLogger.java:115 - system.compaction_history 172,23510
INFO [Service Thread] 2015-01-07 10:59:12,668 StatusLogger.java:115 - system.paxos 0,0
INFO [Service Thread] 2015-01-07 10:59:12,668 StatusLogger.java:115 - system.schema_columns 792,215617
INFO [Service Thread] 2015-01-07 10:59:12,669 StatusLogger.java:115 - system.schema_columnfamilies 433,97089
INFO [Service Thread] 2015-01-07 10:59:12,669 StatusLogger.java:115 - system.IndexInfo 0,0
INFO [Service Thread] 2015-01-07 10:59:12,669 StatusLogger.java:115 - system.range_xfers 0,0
INFO [Service Thread] 2015-01-07 10:59:12,669 StatusLogger.java:115 - system.peer_events 0,0
INFO [Service Thread] 2015-01-07 10:59:12,669 StatusLogger.java:115 - system.hints 0,0
INFO [Service Thread] 2015-01-07 10:59:12,669 StatusLogger.java:115 - system.sstable_activity 1282,138432
INFO [Service Thread] 2015-01-07 10:59:12,669 StatusLogger.java:115 - clickstream.im_csl_log 586090,160314221
INFO [Service Thread] 2015-01-07 10:59:12,669 StatusLogger.java:115 - clickstream.glusr_email_mapping 74,16408
INFO [Service Thread] 2015-01-07 10:59:12,670 StatusLogger.java:115 - clickstream.im_csl_glusr_daily_score 0,0
INFO [Service Thread] 2015-01-07 10:59:12,670 StatusLogger.java:115 - clickstream.im_csl_activity 0,0
INFO [Service Thread] 2015-01-07 10:59:12,670 StatusLogger.java:115 - clickstream.glusr_usr_mv 2613,382668
INFO [Service Thread] 2015-01-07 10:59:12,670 StatusLogger.java:115 - clickstream.im_csl_glusr_weekly_score 0,0
INFO [Service Thread] 2015-01-07 10:59:12,670 StatusLogger.java:115 - clickstream.im_csl_glusr_daily_activity_count 23164,4835800
INFO [Service Thread] 2015-01-07 10:59:12,670 StatusLogger.java:115 - clickstream.business_feed 70905,19467422
INFO [Service Thread] 2015-01-07 10:59:12,670 StatusLogger.java:115 - clickstream.im_csl_daily_report 1176,64380
INFO [Service Thread] 2015-01-07 10:59:12,670 StatusLogger.java:115 - clickstream.im_csl_week_id 0,0
INFO [Service Thread] 2015-01-07 10:59:12,670 StatusLogger.java:115 - clickstream.im_csl_glusr_90_days_score 0,0
INFO [Service Thread] 2015-01-07 10:59:12,671 StatusLogger.java:115 - system_traces.sessions 0,0
INFO [Service Thread] 2015-01-07 10:59:12,671 StatusLogger.java:115 - system_traces.events 0,0
WARN [Thrift:12] 2015-01-07 10:59:19,169 BatchStatement.java:255 - Batch of prepared statements for [clickstream.im_csl_log] is of size 12117102, exceeding specified threshold of 5120 by 12111982.
INFO [CompactionExecutor:13] 2015-01-07 10:59:33,005 CompactionTask.java:136 - Compacting [SSTableReader(path='/var/lib/cassandra/data/system/batchlog-0290003c977e397cac3efdfdc01d626b/system-batchlog-ka-6439-Data.db')]
INFO [CompactionExecutor:13] 2015-01-07 10:59:33,074 CompactionTask.java:251 - Compacted 1 sstables to [/var/lib/cassandra/data/system/batchlog-0290003c977e397cac3efdfdc01d626b/system-batchlog-ka-6440,]. 3,048,848 bytes to 3,048,848 (~100% of original) in 67ms = 43.397135MB/s. 28 total partitions merged to 28. Partition merge counts were {1:28, }
WARN [Thrift:16] 2015-01-07 11:00:21,201 BatchStatement.java:255 - Batch of prepared statements for [clickstream.im_csl_log] is of size 11882804, exceeding specified threshold of 5120 by 11877684.
^C
[root@csdb2-dl cassandra]# tail -f system.log
INFO [CompactionExecutor:14] 2015-01-07 11:00:33,099 CompactionTask.java:136 - Compacting [SSTableReader(path='/var/lib/cassandra/data/system/batchlog-0290003c977e397cac3efdfdc01d626b/system-batchlog-ka-6440-Data.db')]
INFO [CompactionExecutor:14] 2015-01-07 11:00:33,166 CompactionTask.java:251 - Compacted 1 sstables to [/var/lib/cassandra/data/system/batchlog-0290003c977e397cac3efdfdc01d626b/system-batchlog-ka-6441,]. 3,048,848 bytes to 3,048,848 (~100% of original) in 65ms = 44.732431MB/s. 28 total partitions merged to 28. Partition merge counts were {1:28, }
INFO [CompactionExecutor:15] 2015-01-07 11:01:33,191 CompactionTask.java:136 - Compacting [SSTableReader(path='/var/lib/cassandra/data/system/batchlog-0290003c977e397cac3efdfdc01d626b/system-batchlog-ka-6441-Data.db')]
INFO [CompactionExecutor:15] 2015-01-07 11:01:33,263 CompactionTask.java:251 - Compacted 1 sstables to [/var/lib/cassandra/data/system/batchlog-0290003c977e397cac3efdfdc01d626b/system-batchlog-ka-6442,]. 3,048,848 bytes to 3,048,848 (~100% of original) in 70ms = 41.537258MB/s. 28 total partitions merged to 28. Partition merge counts were {1:28, }
INFO [CompactionExecutor:16] 2015-01-07 11:02:33,289 CompactionTask.java:136 - Compacting [SSTableReader(path='/var/lib/cassandra/data/system/batchlog-0290003c977e397cac3efdfdc01d626b/system-batchlog-ka-6442-Data.db')]
INFO [CompactionExecutor:16] 2015-01-07 11:02:33,356 CompactionTask.java:251 - Compacted 1 sstables to [/var/lib/cassandra/data/system/batchlog-0290003c977e397cac3efdfdc01d626b/system-batchlog-ka-6443,]. 3,048,848 bytes to 3,048,848 (~100% of original) in 65ms = 44.732431MB/s. 28 total partitions merged to 28. Partition merge counts were {1:28, }
WARN [Thrift:16] 2015-01-07 11:03:02,858 BatchStatement.java:255 - Batch of prepared statements for [clickstream.im_csl_glusr_daily_activity_count] is of size 50103, exceeding specified threshold of 5120 by 44983.
INFO [CompactionExecutor:17] 2015-01-07 11:03:33,384 CompactionTask.java:136 - Compacting [SSTableReader(path='/var/lib/cassandra/data/system/batchlog-0290003c977e397cac3efdfdc01d626b/system-batchlog-ka-6443-Data.db')]
INFO [CompactionExecutor:17] 2015-01-07 11:03:33,454 CompactionTask.java:251 - Compacted 1 sstables to [/var/lib/cassandra/data/system/batchlog-0290003c977e397cac3efdfdc01d626b/system-batchlog-ka-6444,]. 3,048,848 bytes to 3,048,848 (~100% of original) in 68ms = 42.758942MB/s. 28 total partitions merged to 28. Partition merge counts were {1:28, }
WARN [Thrift:15] 2015-01-07 11:04:23,433 BatchStatement.java:255 - Batch of prepared statements for [clickstream.im_csl_log] is of size 12495400, exceeding specified threshold of 5120 by 12490280.
INFO [CompactionExecutor:18] 2015-01-07 11:04:33,479 CompactionTask.java:136 - Compacting [SSTableReader(path='/var/lib/cassandra/data/system/batchlog-0290003c977e397cac3efdfdc01d626b/system-batchlog-ka-6444-Data.db')]
INFO [CompactionExecutor:18] 2015-01-07 11:04:33,546 CompactionTask.java:251 - Compacted 1 sstables to [/var/lib/cassandra/data/system/batchlog-0290003c977e397cac3efdfdc01d626b/system-batchlog-ka-6445,]. 3,048,848 bytes to 3,048,848 (~100% of original) in 65ms = 44.732431MB/s. 28 total partitions merged to 28. Partition merge counts were {1:28, }
WARN [Thrift:1] 2015-01-07 11:05:01,888 BatchStatement.java:255 - Batch of prepared statements for [clickstream.business_feed] is of size 440216, exceeding specified threshold of 5120 by 435096.
INFO [SlabPoolCleaner] 2015-01-07 11:05:23,518 ColumnFamilyStore.java:840 - Enqueuing flush of im_csl_log: 669536350 (32%) on-heap, 0 (0%) off-heap
INFO [MemtableFlushWriter:5] 2015-01-07 11:05:23,519 Memtable.java:325 - Writing Memtable-im_csl_log@1372914317(119531344 serialized bytes, 2029072 ops, 27%/0% of on/off-heap limit)
INFO [MemtableFlushWriter:5] 2015-01-07 11:05:27,020 Memtable.java:364 - Completed flushing /var/lib/cassandra/data/clickstream/im_csl_log-22207f2081bb11e4abd4a9d4f1e0b940/clickstream-im_csl_log-ka-2780-Data.db (28322670 bytes) for commitlog position ReplayPosition(segmentId=1420608014525, position=15795547)
INFO [MemtableFlushWriter:5] 2015-01-07 11:05:27,022 Memtable.java:325 - Writing Memtable-im_csl_log.im_csl_log_modid_idx@81439989(2798720 serialized bytes, 69968 ops, 1%/0% of on/off-heap limit)
INFO [CompactionExecutor:19] 2015-01-07 11:05:27,036 ColumnFamilyStore.java:840 - Enqueuing flush of compactions_in_progress: 1321 (0%) on-heap, 0 (0%) off-heap
INFO [MemtableFlushWriter:6] 2015-01-07 11:05:27,037 Memtable.java:325 - Writing Memtable-compactions_in_progress@1500434495(147 serialized bytes, 9 ops, 0%/0% of on/off-heap limit)
INFO [MemtableFlushWriter:6] 2015-01-07 11:05:27,046 Memtable.java:364 - Completed flushing /var/lib/cassandra/data/system/compactions_in_progress-55080ab05d9c388690a4acb25fe1f77b/system-compactions_in_progress-ka-1333-Data.db (170 bytes) for commitlog position ReplayPosition(segmentId=1420608014525, position=15796783)
INFO [MemtableFlushWriter:5] 2015-01-07 11:05:27,155 Memtable.java:364 - Completed flushing /var/lib/cassandra/data/clickstream/im_csl_log-22207f2081bb11e4abd4a9d4f1e0b940/clickstream-im_csl_log.im_csl_log_modid_idx-ka-2487-Data.db (481375 bytes) for commitlog position ReplayPosition(segmentId=1420608014525, position=15795547)
INFO [MemtableFlushWriter:5] 2015-01-07 11:05:27,156 Memtable.java:325 - Writing Memtable-im_csl_log.im_csl_log_v4iilex_glusr_id_idx@1758946370(2798720 serialized bytes, 69968 ops, 1%/0% of on/off-heap limit)
INFO [MemtableFlushWriter:5] 2015-01-07 11:05:27,308 Memtable.java:364 - Completed flushing /var/lib/cassandra/data/clickstream/im_csl_log-22207f2081bb11e4abd4a9d4f1e0b940/clickstream-im_csl_log.im_csl_log_v4iilex_glusr_id_idx-ka-2066-Data.db (621480 bytes) for commitlog position ReplayPosition(segmentId=1420608014525, position=15795547)
INFO [MemtableFlushWriter:5] 2015-01-07 11:05:27,310 Memtable.java:325 - Writing Memtable-im_csl_log.im_csl_log_catalog_owner_glusr_id_idx@351755988(2798720 serialized bytes, 69968 ops, 1%/0% of on/off-heap limit)
INFO [MemtableFlushWriter:5] 2015-01-07 11:05:27,510 Memtable.java:364 - Completed flushing /var/lib/cassandra/data/clickstream/im_csl_log-22207f2081bb11e4abd4a9d4f1e0b940/clickstream-im_csl_log.im_csl_log_catalog_owner_glusr_id_idx-ka-384-Data.db (650279 bytes) for commitlog position ReplayPosition(segmentId=1420608014525, position=15795547)
INFO [MemtableFlushWriter:5] 2015-01-07 11:05:27,511 Memtable.java:325 - Writing Memtable-im_csl_log.im_csl_log_imeshvisitor_glusr_email_idx@2087893772(2798720 serialized bytes, 69968 ops, 1%/0% of on/off-heap limit)
INFO [MemtableFlushWriter:5] 2015-01-07 11:05:27,672 Memtable.java:364 - Completed flushing /var/lib/cassandra/data/clickstream/im_csl_log-22207f2081bb11e4abd4a9d4f1e0b940/clickstream-im_csl_log.im_csl_log_imeshvisitor_glusr_email_idx-ka-2107-Data.db (714171 bytes) for commitlog position ReplayPosition(segmentId=1420608014525, position=15795547)
INFO [MemtableFlushWriter:5] 2015-01-07 11:05:27,673 Memtable.java:325 - Writing Memtable-im_csl_log.im_csl_log_imeshvisitor_glusr_id_idx@1347834024(2798720 serialized bytes, 69968 ops, 1%/0% of on/off-heap limit)
INFO [CompactionExecutor:18] 2015-01-07 11:05:27,677 ColumnFamilyStore.java:840 - Enqueuing flush of compactions_in_progress: 1361 (0%) on-heap, 0 (0%) off-heap
INFO [MemtableFlushWriter:6] 2015-01-07 11:05:27,677 Memtable.java:325 - Writing Memtable-compactions_in_progress@1388932812(187 serialized bytes, 9 ops, 0%/0% of on/off-heap limit)
INFO [MemtableFlushWriter:6] 2015-01-07 11:05:27,685 Memtable.java:364 - Completed flushing /var/lib/cassandra/data/system/compactions_in_progress-55080ab05d9c388690a4acb25fe1f77b/system-compactions_in_progress-ka-1334-Data.db (203 bytes) for commitlog position ReplayPosition(segmentId=1420608014525, position=15797157)
INFO [MemtableFlushWriter:5] 2015-01-07 11:05:27,815 Memtable.java:364 - Completed flushing /var/lib/cassandra/data/clickstream/im_csl_log-22207f2081bb11e4abd4a9d4f1e0b940/clickstream-im_csl_log.im_csl_log_imeshvisitor_glusr_id_idx-ka-2422-Data.db (525258 bytes) for commitlog position ReplayPosition(segmentId=1420608014525, position=15795547)
INFO [CompactionExecutor:19] 2015-01-07 11:05:27,818 CompactionTask.java:136 - Compacting [SSTableReader(path='/var/lib/cassandra/data/clickstream/im_csl_log-22207f2081bb11e4abd4a9d4f1e0b940/clickstream-im_csl_log-ka-2778-Data.db'), SSTableReader(path='/var/lib/cassandra/data/clickstream/im_csl_log-22207f2081bb11e4abd4a9d4f1e0b940/clickstream-im_csl_log-ka-2777-Data.db'), SSTableReader(path='/var/lib/cassandra/data/clickstream/im_csl_log-22207f2081bb11e4abd4a9d4f1e0b940/clickstream-im_csl_log-ka-2776-Data.db'), SSTableReader(path='/var/lib/cassandra/data/clickstream/im_csl_log-22207f2081bb11e4abd4a9d4f1e0b940/clickstream-im_csl_log-ka-2779-Data.db')]
INFO [CompactionExecutor:18] 2015-01-07 11:05:27,819 CompactionTask.java:136 - Compacting [SSTableReader(path='/var/lib/cassandra/data/clickstream/im_csl_log-22207f2081bb11e4abd4a9d4f1e0b940/clickstream-im_csl_log.im_csl_log_imeshvisitor_glusr_email_idx-ka-2105-Data.db'), SSTableReader(path='/var/lib/cassandra/data/clickstream/im_csl_log-22207f2081bb11e4abd4a9d4f1e0b940/clickstream-im_csl_log.im_csl_log_imeshvisitor_glusr_email_idx-ka-2106-Data.db'), SSTableReader(path='/var/lib/cassandra/data/clickstream/im_csl_log-22207f2081bb11e4abd4a9d4f1e0b940/clickstream-im_csl_log.im_csl_log_imeshvisitor_glusr_email_idx-ka-2104-Data.db'), SSTableReader(path='/var/lib/cassandra/data/clickstream/im_csl_log-22207f2081bb11e4abd4a9d4f1e0b940/clickstream-im_csl_log.im_csl_log_imeshvisitor_glusr_email_idx-ka-2107-Data.db')]
INFO [CompactionExecutor:21] 2015-01-07 11:05:27,823 ColumnFamilyStore.java:840 - Enqueuing flush of compactions_in_progress: 1726 (0%) on-heap, 0 (0%) off-heap
INFO [MemtableFlushWriter:6] 2015-01-07 11:05:27,824 Memtable.java:325 - Writing Memtable-compactions_in_progress@815842958(220 serialized bytes, 11 ops, 0%/0% of on/off-heap limit)
INFO [MemtableFlushWriter:6] 2015-01-07 11:05:27,831 Memtable.java:364 - Completed flushing /var/lib/cassandra/data/system/compactions_in_progress-55080ab05d9c388690a4acb25fe1f77b/system-compactions_in_progress-ka-1335-Data.db (210 bytes) for commitlog position ReplayPosition(segmentId=1420608014525, position=15797590)
INFO [CompactionExecutor:21] 2015-01-07 11:05:27,833 CompactionTask.java:136 - Compacting [SSTableReader(path='/var/lib/cassandra/data/clickstream/im_csl_log-22207f2081bb11e4abd4a9d4f1e0b940/clickstream-im_csl_log.im_csl_log_imeshvisitor_glusr_id_idx-ka-2415-Data.db'), SSTableReader(path='/var/lib/cassandra/data/clickstream/im_csl_log-22207f2081bb11e4abd4a9d4f1e0b940/clickstream-im_csl_log.im_csl_log_imeshvisitor_glusr_id_idx-ka-2422-Data.db'), SSTableReader(path='/var/lib/cassandra/data/clickstream/im_csl_log-22207f2081bb11e4abd4a9d4f1e0b940/clickstream-im_csl_log.im_csl_log_imeshvisitor_glusr_id_idx-ka-2416-Data.db'), SSTableReader(path='/var/lib/cassandra/data/clickstream/im_csl_log-22207f2081bb11e4abd4a9d4f1e0b940/clickstream-im_csl_log.im_csl_log_imeshvisitor_glusr_id_idx-ka-2419-Data.db'), SSTableReader(path='/var/lib/cassandra/data/clickstream/im_csl_log-22207f2081bb11e4abd4a9d4f1e0b940/clickstream-im_csl_log.im_csl_log_imeshvisitor_glusr_id_idx-ka-2414-Data.db'), SSTableReader(path='/var/lib/cassandra/data/clickstream/im_csl_log-22207f2081bb11e4abd4a9d4f1e0b940/clickstream-im_csl_log.im_csl_log_imeshvisitor_glusr_id_idx-ka-2417-Data.db')]
INFO [CompactionExecutor:20] 2015-01-07 11:05:27,833 CompactionTask.java:136 - Compacting [SSTableReader(path='/var/lib/cassandra/data/system/compactions_in_progress-55080ab05d9c388690a4acb25fe1f77b/system-compactions_in_progress-ka-1335-Data.db'), SSTableReader(path='/var/lib/cassandra/data/system/compactions_in_progress-55080ab05d9c388690a4acb25fe1f77b/system-compactions_in_progress-ka-1333-Data.db'), SSTableReader(path='/var/lib/cassandra/data/system/compactions_in_progress-55080ab05d9c388690a4acb25fe1f77b/system-compactions_in_progress-ka-1334-Data.db'), SSTableReader(path='/var/lib/cassandra/data/system/compactions_in_progress-55080ab05d9c388690a4acb25fe1f77b/system-compactions_in_progress-ka-1332-Data.db')]
INFO [CompactionExecutor:20] 2015-01-07 11:05:27,841 CompactionTask.java:251 - Compacted 4 sstables to [/var/lib/cassandra/data/system/compactions_in_progress-55080ab05d9c388690a4acb25fe1f77b/system-compactions_in_progress-ka-1336,]. 625 bytes to 372 (~59% of original) in 7ms = 0.050681MB/s. 3 total partitions merged to 3. Partition merge counts were {1:3, }
INFO [CompactionExecutor:18] 2015-01-07 11:05:29,669 ColumnFamilyStore.java:840 - Enqueuing flush of compactions_in_progress: 164 (0%) on-heap, 0 (0%) off-heap
INFO [MemtableFlushWriter:5] 2015-01-07 11:05:29,670 Memtable.java:325 - Writing Memtable-compactions_in_progress@516649974(0 serialized bytes, 1 ops, 0%/0% of on/off-heap limit)
INFO [MemtableFlushWriter:5] 2015-01-07 11:05:29,677 Memtable.java:364 - Completed flushing /var/lib/cassandra/data/system/compactions_in_progress-55080ab05d9c388690a4acb25fe1f77b/system-compactions_in_progress-ka-1337-Data.db (42 bytes) for commitlog position ReplayPosition(segmentId=1420608014525, position=15798096)
INFO [CompactionExecutor:18] 2015-01-07 11:05:29,679 CompactionTask.java:251 - Compacted 4 sstables to [/var/lib/cassandra/data/clickstream/im_csl_log-22207f2081bb11e4abd4a9d4f1e0b940/clickstream-im_csl_log.im_csl_log_imeshvisitor_glusr_email_idx-ka-2108,]. 2,508,263 bytes to 2,474,736 (~98% of original) in 1,859ms = 1.269549MB/s. 11,297 total partitions merged to 7,445. Partition merge counts were {1:4835, 2:1673, 3:632, 4:305, }
INFO [CompactionExecutor:18] 2015-01-07 11:05:33,586 CompactionTask.java:136 - Compacting [SSTableReader(path='/var/lib/cassandra/data/system/batchlog-0290003c977e397cac3efdfdc01d626b/system-batchlog-ka-6445-Data.db')]
INFO [CompactionExecutor:18] 2015-01-07 11:05:35,449 CompactionTask.java:251 - Compacted 1 sstables to [/var/lib/cassandra/data/system/batchlog-0290003c977e397cac3efdfdc01d626b/system-batchlog-ka-6446,]. 3,048,848 bytes to 3,048,848 (~100% of original) in 1,861ms = 1.562390MB/s. 28 total partitions merged to 28. Partition merge counts were {1:28, }
ERROR [NonPeriodicTasks:1] 2015-01-07 11:06:01,761 CassandraDaemon.java:153 - Exception in thread Thread[NonPeriodicTasks:1,5,main]
java.lang.AssertionError: null
at org.apache.cassandra.io.util.Memory.free(Memory.java:300) ~[apache-cassandra-2.1.2.jar:2.1.2-SNAPSHOT]
at org.apache.cassandra.utils.obs.OffHeapBitSet.close(OffHeapBitSet.java:143) ~[apache-cassandra-2.1.2.jar:2.1.2-SNAPSHOT]
at org.apache.cassandra.utils.BloomFilter.close(BloomFilter.java:116) ~[apache-cassandra-2.1.2.jar:2.1.2-SNAPSHOT]
at org.apache.cassandra.io.sstable.SSTableReader$6.run(SSTableReader.java:645) ~[apache-cassandra-2.1.2.jar:2.1.2-SNAPSHOT]
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:1.7.0_71]
at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.7.0_71]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(Unknown Source) ~[na:1.7.0_71]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown Source) ~[na:1.7.0_71]
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) [na:1.7.0_71]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) [na:1.7.0_71]
at java.lang.Thread.run(Unknown Source) [na:1.7.0_71]
INFO [CompactionExecutor:21] 2015-01-07 11:06:01,763 ColumnFamilyStore.java:840 - Enqueuing flush of compactions_in_progress: 164 (0%) on-heap, 0 (0%) off-heap
INFO [MemtableFlushWriter:6] 2015-01-07 11:06:01,763 Memtable.java:325 - Writing Memtable-compactions_in_progress@1965572171(0 serialized bytes, 1 ops, 0%/0% of on/off-heap limit)
INFO [MemtableFlushWriter:6] 2015-01-07 11:06:01,773 Memtable.java:364 - Completed flushing /var/lib/cassandra/data/system/compactions_in_progress-55080ab05d9c388690a4acb25fe1f77b/system-compactions_in_progress-ka-1338-Data.db (42 bytes) for commitlog position ReplayPosition(segmentId=1420608014525, position=15802648)
ERROR [CompactionExecutor:21] 2015-01-07 11:06:01,774 CassandraDaemon.java:153 - Exception in thread Thread[CompactionExecutor:21,1,main]
java.lang.AssertionError: null
at org.apache.cassandra.io.util.Memory.free(Memory.java:300) ~[apache-cassandra-2.1.2.jar:2.1.2-SNAPSHOT]
at org.apache.cassandra.utils.obs.OffHeapBitSet.close(OffHeapBitSet.java:143) ~[apache-cassandra-2.1.2.jar:2.1.2-SNAPSHOT]
at org.apache.cassandra.utils.BloomFilter.close(BloomFilter.java:116) ~[apache-cassandra-2.1.2.jar:2.1.2-SNAPSHOT]
at org.apache.cassandra.io.sstable.SSTableWriter.abort(SSTableWriter.java:345) ~[apache-cassandra-2.1.2.jar:2.1.2-SNAPSHOT]
at org.apache.cassandra.io.sstable.SSTableRewriter.abort(SSTableRewriter.java:198) ~[apache-cassandra-2.1.2.jar:2.1.2-SNAPSHOT]
at org.apache.cassandra.db.compaction.CompactionTask.runWith(CompactionTask.java:204) ~[apache-cassandra-2.1.2.jar:2.1.2-SNAPSHOT]
at org.apache.cassandra.io.util.DiskAwareRunnable.runMayThrow(DiskAwareRunnable.java:48) ~[apache-cassandra-2.1.2.jar:2.1.2-SNAPSHOT]
at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) ~[apache-cassandra-2.1.2.jar:2.1.2-SNAPSHOT]
at org.apache.cassandra.db.compaction.CompactionTask.executeInternal(CompactionTask.java:75) ~[apache-cassandra-2.1.2.jar:2.1.2-SNAPSHOT]
at org.apache.cassandra.db.compaction.AbstractCompactionTask.execute(AbstractCompactionTask.java:59) ~[apache-cassandra-2.1.2.jar:2.1.2-SNAPSHOT]
at org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionTask.run(CompactionManager.java:232) ~[apache-cassandra-2.1.2.jar:2.1.2-SNAPSHOT]
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:1.7.0_71]
at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.7.0_71]
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) [na:1.7.0_71]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) [na:1.7.0_71]
at java.lang.Thread.run(Unknown Source) [na:1.7.0_71]
> Possible memory leak
> ---------------------
>
> Key: CASSANDRA-8248
> URL: https://issues.apache.org/jira/browse/CASSANDRA-8248
> Project: Cassandra
> Issue Type: Bug
> Reporter: Alexander Sterligov
> Assignee: Joshua McKenzie
> Attachments: 8248_v1.txt, thread_dump
>
>
> Sometimes during repair cassandra starts to consume more memory than expected.
> Total amount of data on node is about 20GB.
> Size of the data directory is 66GC because of snapshots.
> Top reports:
> {noformat}
> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
> 15724 loadbase 20 0 493g 55g 44g S 28 44.2 4043:24 java
> {noformat}
> At the /proc/15724/maps there are a lot of deleted file maps
> {quote}
> 7f63a6102000-7f63a6332000 r--s 00000000 08:21 9442763 /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a6332000-7f63a6562000 r--s 00000000 08:21 9442763 /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a6562000-7f63a6792000 r--s 00000000 08:21 9442763 /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a6792000-7f63a69c2000 r--s 00000000 08:21 9442763 /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a69c2000-7f63a6bf2000 r--s 00000000 08:21 9442763 /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a6bf2000-7f63a6e22000 r--s 00000000 08:21 9442763 /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a6e22000-7f63a7052000 r--s 00000000 08:21 9442763 /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a7052000-7f63a7282000 r--s 00000000 08:21 9442763 /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a7282000-7f63a74b2000 r--s 00000000 08:21 9442763 /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a74b2000-7f63a76e2000 r--s 00000000 08:21 9442763 /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a76e2000-7f63a7912000 r--s 00000000 08:21 9442763 /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a7912000-7f63a7b42000 r--s 00000000 08:21 9442763 /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a7b42000-7f63a7d72000 r--s 00000000 08:21 9442763 /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a7d72000-7f63a7fa2000 r--s 00000000 08:21 9442763 /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a7fa2000-7f63a81d2000 r--s 00000000 08:21 9442763 /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a81d2000-7f63a8402000 r--s 00000000 08:21 9442763 /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a8402000-7f63a8622000 r--s 00000000 08:21 9442763 /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a8622000-7f63a8842000 r--s 00000000 08:21 9442763 /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a8842000-7f63a8a62000 r--s 00000000 08:21 9442763 /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a8a62000-7f63a8c82000 r--s 00000000 08:21 9442763 /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a8c82000-7f63a8ea2000 r--s 00000000 08:21 9442763 /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a8ea2000-7f63a90c2000 r--s 00000000 08:21 9442763 /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> 7f63a90c2000-7f63a92e2000 r--s 00000000 08:21 9442763 /ssd/cassandra/data/iss/feedback_history-d32bc7e048c011e49b989bc3e8a5a440/iss-feedback_history-tmplink-ka-328671-Index.db (deleted)
> {quote}
> {quote}
> $ sudo grep deleted /proc/15724/maps | wc -l
> 640118
> {quote}
> {quote}
> $ sudo grep -v deleted /proc/15724/maps | wc -l
> 303340
> {quote}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)