You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Ian Flatness (JIRA)" <ji...@apache.org> on 2013/10/29 16:52:31 UTC
[jira] [Commented] (CASSANDRA-6260) Cassandra 2.0.1
OutOfMemoryError: Requested array size exceeds VM limit
[ https://issues.apache.org/jira/browse/CASSANDRA-6260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13808113#comment-13808113 ]
Ian Flatness commented on CASSANDRA-6260:
-----------------------------------------
I have gotten the same error with the nodes on my cluster.
The cluster is running 2.0.1, and the error started on 29.10.2013 for me as well.
My machines are each running with heaps of 512mb, and that was consistent with how they were before the restart. On initialization system memory drops extremely low right before the error output (after which java stops and the memory is freed). There are 4 machines in my cluster and the partitioner is Murmur3.
On 2 of the nodes, a different error is thrown
{quote}
ERROR 08:46:08,205 Exception in thread Thread[MutationStage:16,5,main]
java.lang.IndexOutOfBoundsException: index (1) must be less than size (1)
at com.google.common.base.Preconditions.checkElementIndex(Preconditions.java:306)
at com.google.common.base.Preconditions.checkElementIndex(Preconditions.java:285)
at com.google.common.collect.SingletonImmutableList.get(SingletonImmutableList.java:45)
at org.apache.cassandra.db.marshal.CompositeType.getComparator(CompositeType.java:102)
at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:80)
at org.apache.cassandra.db.marshal.AbstractCompositeType.compare(AbstractCompositeType.java:35)
at edu.stanford.ppl.concurrent.SnapTreeMap$1.compareTo(SnapTreeMap.java:538)
at edu.stanford.ppl.concurrent.SnapTreeMap.attemptUpdate(SnapTreeMap.java:1108)
at edu.stanford.ppl.concurrent.SnapTreeMap.updateUnderRoot(SnapTreeMap.java:1059)
at edu.stanford.ppl.concurrent.SnapTreeMap.update(SnapTreeMap.java:1023)
at edu.stanford.ppl.concurrent.SnapTreeMap.putIfAbsent(SnapTreeMap.java:985)
at org.apache.cassandra.db.AtomicSortedColumns$Holder.addColumn(AtomicSortedColumns.java:323)
at org.apache.cassandra.db.AtomicSortedColumns.addAllWithSizeDelta(AtomicSortedColumns.java:195)
at org.apache.cassandra.db.Memtable.resolve(Memtable.java:196)
at org.apache.cassandra.db.Memtable.put(Memtable.java:160)
at org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:842)
at org.apache.cassandra.db.Keyspace.apply(Keyspace.java:373)
at org.apache.cassandra.db.Keyspace.apply(Keyspace.java:338)
at org.apache.cassandra.db.commitlog.CommitLogReplayer$1.runMayThrow(CommitLogReplayer.java:265)
at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
{quote}
> Cassandra 2.0.1 OutOfMemoryError: Requested array size exceeds VM limit
> ------------------------------------------------------------------------
>
> Key: CASSANDRA-6260
> URL: https://issues.apache.org/jira/browse/CASSANDRA-6260
> Project: Cassandra
> Issue Type: Bug
> Environment: Cassandra server 2.0.1
> Reporter: Prateek
> Priority: Critical
>
> I am running cassandra 2.0.1 server with cascading client https://github.com/ifesdjeen/cascading-cassandra/ (v 1.0.0-rc6). I am running a problem on restarting one of the nodes in the cassandra cluster. All other nodes in the cluster started properly without any issues. I had originally assigned 8G of RAM to heap space. I tried starting the node with 12G of RAM but it still fails with the following error. This is currently blocking a production release so appreciate your quick response.
> [(bloomreach-ami) ubuntu@ip-10-179-26-169 :/mnt/cassandra_latest]# ERROR 20:55:58,738 Exception encountered during startup
> java.lang.OutOfMemoryError: Requested array size exceeds VM limit
> at org.apache.cassandra.utils.ByteBufferUtil.read(ByteBufferUtil.java:394)
> at org.apache.cassandra.utils.ByteBufferUtil.readWithLength(ByteBufferUtil.java:355)
> at org.apache.cassandra.service.CacheService$KeyCacheSerializer.deserialize(CacheService.java:352)
> at org.apache.cassandra.cache.AutoSavingCache.loadSaved(AutoSavingCache.java:119)
> at org.apache.cassandra.db.ColumnFamilyStore.<init>(ColumnFamilyStore.java:267)
> at org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:411)
> at org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:383)
> at org.apache.cassandra.db.Keyspace.initCf(Keyspace.java:314)
> at org.apache.cassandra.db.Keyspace.<init>(Keyspace.java:268)
> at org.apache.cassandra.db.Keyspace.open(Keyspace.java:110)
> at org.apache.cassandra.db.Keyspace.open(Keyspace.java:88)
> at org.apache.cassandra.db.SystemKeyspace.checkHealth(SystemKeyspace.java:474)
> at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:226)
> at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:442)
> at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:485)
> INFO 20:55:58,739 Initializing system.schema_triggers
> java.lang.OutOfMemoryError: Requested array size exceeds VM limit
> at org.apache.cassandra.utils.ByteBufferUtil.read(ByteBufferUtil.java:394)
> at org.apache.cassandra.utils.ByteBufferUtil.readWithLength(ByteBufferUtil.java:355)
> at org.apache.cassandra.service.CacheService$KeyCacheSerializer.deserialize(CacheService.java:352)
> at org.apache.cassandra.cache.AutoSavingCache.loadSaved(AutoSavingCache.java:119)
--
This message was sent by Atlassian JIRA
(v6.1#6144)