You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Benedict (JIRA)" <ji...@apache.org> on 2015/09/06 20:09:45 UTC
[jira] [Commented] (CASSANDRA-10274) Assertion Errors when
interrupting Cleanup
[ https://issues.apache.org/jira/browse/CASSANDRA-10274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14732485#comment-14732485 ]
Benedict commented on CASSANDRA-10274:
--------------------------------------
{{CompactionManager:291}} is not safe. We must wait for all operations to complete whether or not there are any exceptions, as we must ensure that an sstable remains marked compacting while any operations are running against it.
It looks to me like both of these exceptions could be explained by this bug. Was there some other exception earlier on in the log?
> Assertion Errors when interrupting Cleanup
> ------------------------------------------
>
> Key: CASSANDRA-10274
> URL: https://issues.apache.org/jira/browse/CASSANDRA-10274
> Project: Cassandra
> Issue Type: Bug
> Reporter: Jeff Jirsa
> Fix For: 2.1.x
>
>
> Exceptions encountered after Interrupting cleanup on 2.1.7 - logging due to nature. Seen on 2 different nodes. May be related to CASSANDRA-10260 .
> {code}
> INFO [CompactionExecutor:5836] 2015-09-06 11:33:39,630 CompactionManager.java:1286 - Compaction interrupted: Cleanup@74bffc10-0fbe-11e5-a5ce-37a8b36fe285(keyspace, table, 44698243387/139158
> 624314)bytes
> INFO [CompactionExecutor:5838] 2015-09-06 11:33:39,638 CompactionManager.java:1286 - Compaction interrupted: Cleanup@74bffc10-0fbe-11e5-a5ce-37a8b36fe285(keyspace, table, 37886026781/133123
> 638379)bytes
> INFO [CompactionExecutor:5836] 2015-09-06 11:33:39,639 CompactionManager.java:749 - Cleaning up SSTableReader(path='/mnt/cassandra/data/keyspace/table-74bffc100fbe11e5a5ce37a8b36fe285/keyspace-table-26598-Data.db')
> ERROR [CompactionExecutor:5838] 2015-09-06 11:33:39,639 CassandraDaemon.java:223 - Exception in thread Thread[CompactionExecutor:5838,1,main]
> java.lang.AssertionError: Memory was freed
> at org.apache.cassandra.io.util.SafeMemory.checkBounds(SafeMemory.java:97) ~[apache-cassandra-2.1.7.jar:2.1.7]
> at org.apache.cassandra.io.util.Memory.getInt(Memory.java:281) ~[apache-cassandra-2.1.7.jar:2.1.7]
> at org.apache.cassandra.io.sstable.IndexSummary.getPositionInSummary(IndexSummary.java:139) ~[apache-cassandra-2.1.7.jar:2.1.7]
> at org.apache.cassandra.io.sstable.IndexSummary.getKey(IndexSummary.java:144) ~[apache-cassandra-2.1.7.jar:2.1.7]
> at org.apache.cassandra.io.sstable.IndexSummary.binarySearch(IndexSummary.java:113) ~[apache-cassandra-2.1.7.jar:2.1.7]
> at org.apache.cassandra.io.sstable.SSTableReader.getIndexScanPosition(SSTableReader.java:1183) ~[apache-cassandra-2.1.7.jar:2.1.7]
> at org.apache.cassandra.io.sstable.SSTableReader.firstKeyBeyond(SSTableReader.java:1667) ~[apache-cassandra-2.1.7.jar:2.1.7]
> at org.apache.cassandra.db.compaction.CompactionManager.needsCleanup(CompactionManager.java:693) ~[apache-cassandra-2.1.7.jar:2.1.7]
> at org.apache.cassandra.db.compaction.CompactionManager.doCleanupOne(CompactionManager.java:734) ~[apache-cassandra-2.1.7.jar:2.1.7]
> at org.apache.cassandra.db.compaction.CompactionManager.access$400(CompactionManager.java:94) ~[apache-cassandra-2.1.7.jar:2.1.7]
> at org.apache.cassandra.db.compaction.CompactionManager$5.execute(CompactionManager.java:389) ~[apache-cassandra-2.1.7.jar:2.1.7]
> at org.apache.cassandra.db.compaction.CompactionManager$2.call(CompactionManager.java:285) ~[apache-cassandra-2.1.7.jar:2.1.7]
> at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_51]
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) ~[na:1.8.0_51]
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_51]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_51]
> {code}
> And:
> {code}
> ERROR [IndexSummaryManager:1] 2015-09-06 09:32:23,346 CassandraDaemon.java:223 - Exception in thread Thread[IndexSummaryManager:1,1,main]
> java.lang.AssertionError: null
> at org.apache.cassandra.io.sstable.SSTableReader.setReplacedBy(SSTableReader.java:955) ~[apache-cassandra-2.1.7.jar:2.1.7]
> at org.apache.cassandra.io.sstable.SSTableReader.cloneAndReplace(SSTableReader.java:1002) ~[apache-cassandra-2.1.7.jar:2.1.7]
> at org.apache.cassandra.io.sstable.SSTableReader.cloneWithNewSummarySamplingLevel(SSTableReader.java:1105) ~[apache-cassandra-2.1.7.jar:2.1.7]
> at org.apache.cassandra.io.sstable.IndexSummaryManager.adjustSamplingLevels(IndexSummaryManager.java:421) ~[apache-cassandra-2.1.7.jar:2.1.7]
> at org.apache.cassandra.io.sstable.IndexSummaryManager.redistributeSummaries(IndexSummaryManager.java:299) ~[apache-cassandra-2.1.7.jar:2.1.7]
> at org.apache.cassandra.io.sstable.IndexSummaryManager.redistributeSummaries(IndexSummaryManager.java:238) ~[apache-cassandra-2.1.7.jar:2.1.7]
> at org.apache.cassandra.io.sstable.IndexSummaryManager$1.runMayThrow(IndexSummaryManager.java:139) ~[apache-cassandra-2.1.7.jar:2.1.7]
> at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) ~[apache-cassandra-2.1.7.jar:2.1.7]
> at org.apache.cassandra.concurrent.DebuggableScheduledThreadPoolExecutor$UncomplainingRunnable.run(DebuggableScheduledThreadPoolExecutor.java:118) ~[apache-cassandra-2.1.7.jar:2.1.7]
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_51]
> at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [na:1.8.0_51]
> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) [na:1.8.0_51]
> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) [na:1.8.0_51]
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_51]
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_51]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_51]
> ERROR [Reference-Reaper:1] 2015-09-06 09:32:24,891 Ref.java:179 - LEAK DETECTED: a reference (org.apache.cassandra.utils.concurrent.Ref$State@56b339db) to class org.apache.cassandra.io.sstable.SSTableReader$InstanceTidier@1484053885:/mnt/cassandra/data/keyspace/table-74bffc100fbe11e5a5ce37a8b36fe285/keyspace-table-ka-6021 was not released before the reference was garbage collected
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)