You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by zangds <za...@ihep.ac.cn> on 2010/11/24 23:38:32 UTC
java.lang.OutOfMemoryError: Java heap space
Hi,
I'm using apache-cassandra-0.7.0-beta3 , when I did some insertions into cassandra,I got errors that stop cassandra from working, anyone have a look on this?
WARN [ScheduledTasks:1] 2010-11-24 22:38:33,067 MessagingService.java (line 515) Dropped 39 messages in the
last 1000ms
ERROR [ReadStage:3] 2010-11-24 22:38:33,075 AbstractCassandraDaemon.java (line 89) Fatal exception in thread
Thread[ReadStage:3,5,main]
java.lang.OutOfMemoryError: Java heap space
ERROR [ReadStage:7] 2010-11-24 22:38:49,581 AbstractCassandraDaemon.java (line 89) Fatal exception in thread
Thread[ReadStage:7,5,main]
java.lang.OutOfMemoryError: Java heap space
ERROR [ReadStage:4] 2010-11-24 22:38:49,581 AbstractCassandraDaemon.java (line 89) Fatal exception in thread
Thread[ReadStage:4,5,main]
java.lang.OutOfMemoryError: Java heap space
ERROR [ReadStage:6] 2010-11-24 22:38:49,580 AbstractCassandraDaemon.java (line 89) Fatal exception in thread
Thread[ReadStage:6,5,main]
java.lang.OutOfMemoryError: Java heap space
at org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.java:89)
at org.apache.cassandra.db.SuperColumnSerializer.deserialize(SuperColumn.java:342)
at org.apache.cassandra.db.SuperColumnSerializer.deserialize(SuperColumn.java:291)
at org.apache.cassandra.db.columniterator.SimpleSliceReader.computeNext(SimpleSliceReader.java:79)
at org.apache.cassandra.db.columniterator.SimpleSliceReader.computeNext(SimpleSliceReader.java:40)
at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:136)
at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:131)
at org.apache.cassandra.db.columniterator.SSTableSliceIterator.hasNext(SSTableSliceIterator.java:108
)
at org.apache.commons.collections.iterators.CollatingIterator.anyHasNext(CollatingIterator.java:364)
at org.apache.commons.collections.iterators.CollatingIterator.hasNext(CollatingIterator.java:217)
at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:63)
at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:136)
at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:131)
at org.apache.cassandra.db.filter.SliceQueryFilter.collectReducedColumns(SliceQueryFilter.java:122)
at org.apache.cassandra.db.filter.QueryFilter.collectCollatedColumns(QueryFilter.java:146)
at org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.java:1208)
at org.apache.cassandra.db.ColumnFamilyStore.cacheRow(ColumnFamilyStore.java:1068)
at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1092)
at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1055)
at org.apache.cassandra.db.Table.getRow(Table.java:359)
at org.apache.cassandra.db.SliceFromReadCommand.getRow(SliceFromReadCommand.java:63)
at org.apache.cassandra.service.StorageProxy$weakReadLocalCallable.call(StorageProxy.java:722)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
......
ERROR [ReadStage:2] 2010-11-24 22:38:49,580 AbstractCassandraDaemon.java (line 89) Fatal exception in thread
Thread[ReadStage:2,5,main]
java.lang.OutOfMemoryError: Java heap space
ERROR [pool-1-thread-2427] 2010-11-24 22:38:49,580 Cassandra.java (line 2792) Internal error processing mult
iget_slice
java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap s
pace
at org.apache.cassandra.service.StorageProxy.weakRead(StorageProxy.java:280)
at org.apache.cassandra.service.StorageProxy.readProtocol(StorageProxy.java:223)
at org.apache.cassandra.thrift.CassandraServer.readColumnFamily(CassandraServer.java:131)
at org.apache.cassandra.thrift.CassandraServer.getSlice(CassandraServer.java:227)
at org.apache.cassandra.thrift.CassandraServer.multigetSliceInternal(CassandraServer.java:305)
at org.apache.cassandra.thrift.CassandraServer.multiget_slice(CassandraServer.java:277)
at org.apache.cassandra.thrift.Cassandra$Processor$multiget_slice.process(Cassandra.java:2784)
at org.apache.cassandra.thrift.Cassandra$Processor.process(Cassandra.java:2555)
at org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThreadPoolServer.jav
a:167)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
Caused by: java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space
at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:252)
at java.util.concurrent.FutureTask.get(FutureTask.java:111)
at org.apache.cassandra.service.StorageProxy.weakRead(StorageProxy.java:276)
... 11 more
Caused by: java.lang.OutOfMemoryError: Java heap space
2010-11-24
zangds
Re: java.lang.OutOfMemoryError: Java heap space
Posted by Jonathan Ellis <jb...@gmail.com>.
http://www.riptano.com/docs/0.6/troubleshooting/index#nodes-are-dying-with-oom-errors
On Wed, Nov 24, 2010 at 4:38 PM, zangds <za...@ihep.ac.cn> wrote:
> Hi,
> I'm using apache-cassandra-0.7.0-beta3 , when I did some insertions into
> cassandra,I got errors that stop cassandra from working, anyone have a look
> on this?
>
> WARN [ScheduledTasks:1] 2010-11-24 22:38:33,067 MessagingService.java (line 515) Dropped 39 messages in the
> last 1000ms
> ERROR [ReadStage:3] 2010-11-24 22:38:33,075 AbstractCassandraDaemon.java (line 89) Fatal exception in thread
> Thread[ReadStage:3,5,main]
> java.lang.OutOfMemoryError: Java heap space
> ERROR [ReadStage:7] 2010-11-24 22:38:49,581 AbstractCassandraDaemon.java (line 89) Fatal exception in thread
> Thread[ReadStage:7,5,main]
> java.lang.OutOfMemoryError: Java heap space
> ERROR [ReadStage:4] 2010-11-24 22:38:49,581 AbstractCassandraDaemon.java (line 89) Fatal exception in thread
> Thread[ReadStage:4,5,main]
> java.lang.OutOfMemoryError: Java heap space
> ERROR [ReadStage:6] 2010-11-24 22:38:49,580 AbstractCassandraDaemon.java (line 89) Fatal exception in thread
> Thread[ReadStage:6,5,main]
> java.lang.OutOfMemoryError: Java heap space
> at org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.java:89)
> at org.apache.cassandra.db.SuperColumnSerializer.deserialize(SuperColumn.java:342)
> at org.apache.cassandra.db.SuperColumnSerializer.deserialize(SuperColumn.java:291)
> at org.apache.cassandra.db.columniterator.SimpleSliceReader.computeNext(SimpleSliceReader.java:79)
> at org.apache.cassandra.db.columniterator.SimpleSliceReader.computeNext(SimpleSliceReader.java:40)
> at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:136)
> at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:131)
> at org.apache.cassandra.db.columniterator.SSTableSliceIterator.hasNext(SSTableSliceIterator.java:108
> )
> at org.apache.commons.collections.iterators.CollatingIterator.anyHasNext(CollatingIterator.java:364)
> at org.apache.commons.collections.iterators.CollatingIterator.hasNext(CollatingIterator.java:217)
> at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:63)
> at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:136)
> at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:131)
> at org.apache.cassandra.db.filter.SliceQueryFilter.collectReducedColumns(SliceQueryFilter.java:122)
> at org.apache.cassandra.db.filter.QueryFilter.collectCollatedColumns(QueryFilter.java:146)
> at org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.java:1208)
> at org.apache.cassandra.db.ColumnFamilyStore.cacheRow(ColumnFamilyStore.java:1068)
> at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1092)
> at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1055)
> at org.apache.cassandra.db.Table.getRow(Table.java:359)
> at org.apache.cassandra.db.SliceFromReadCommand.getRow(SliceFromReadCommand.java:63)
> at org.apache.cassandra.service.StorageProxy$weakReadLocalCallable.call(StorageProxy.java:722)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> at java.lang.Thread.run(Thread.java:636)
> ......
> ERROR [ReadStage:2] 2010-11-24 22:38:49,580 AbstractCassandraDaemon.java (line 89) Fatal exception in thread
> Thread[ReadStage:2,5,main]
> java.lang.OutOfMemoryError: Java heap space
> ERROR [pool-1-thread-2427] 2010-11-24 22:38:49,580 Cassandra.java (line 2792) Internal error processing mult
> iget_slice
> java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap s
> pace
> at org.apache.cassandra.service.StorageProxy.weakRead(StorageProxy.java:280)
> at org.apache.cassandra.service.StorageProxy.readProtocol(StorageProxy.java:223)
> at org.apache.cassandra.thrift.CassandraServer.readColumnFamily(CassandraServer.java:131)
> at org.apache.cassandra.thrift.CassandraServer.getSlice(CassandraServer.java:227)
> at org.apache.cassandra.thrift.CassandraServer.multigetSliceInternal(CassandraServer.java:305)
> at org.apache.cassandra.thrift.CassandraServer.multiget_slice(CassandraServer.java:277)
> at org.apache.cassandra.thrift.Cassandra$Processor$multiget_slice.process(Cassandra.java:2784)
> at org.apache.cassandra.thrift.Cassandra$Processor.process(Cassandra.java:2555)
> at org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThreadPoolServer.jav
> a:167)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> at java.lang.Thread.run(Thread.java:636)
> Caused by: java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space
> at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:252)
> at java.util.concurrent.FutureTask.get(FutureTask.java:111)
> at org.apache.cassandra.service.StorageProxy.weakRead(StorageProxy.java:276)
> ... 11 more
> Caused by: java.lang.OutOfMemoryError: Java heap space
>
>
> 2010-11-24
> ________________________________
> zangds
--
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of Riptano, the source for professional Cassandra support
http://riptano.com