You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Everton Lima <pe...@gmail.com> on 2013/04/05 20:07:04 UTC

ERROR service.AbstractCassandraDaemon: Exception in thread Thread[Thrift:4,5,main]

Hello,

I am trying to insert a lot of data in cassandra 1.1.8, in 2 servers.
As a client I was using Astyanay to send Insert's CQL instructions.
It starts to insert the data, but after some time I recieve this error and
both, server and client, dead.
Someone knows how to fix it? It is the best way to insert the data?
In appendix is the cassandra.yalm that the servers use.

Ps. I am just reading the data of a postgres table, tuple by tuple, add one
collumn, as key for cassandra, and insert in cassandra's servers.


The absolute log is:

 ERROR service.AbstractCassandraDaemon: Exception in thread
Thread[Thrift:4,5,main]
java.lang.OutOfMemoryError: Java heap space
        at java.util.Arrays.copyOf(Arrays.java:2746)
        at java.util.ArrayList.ensureCapacity(ArrayList.java:187)
        at java.util.ArrayList.add(ArrayList.java:378)
        at
org.antlr.runtime.CommonTokenStream.fillBuffer(CommonTokenStream.java:116)
        at
org.antlr.runtime.CommonTokenStream.mark(CommonTokenStream.java:305)
        at org.antlr.runtime.DFA.predict(DFA.java:68)
        at org.apache.cassandra.cql.CqlParser.query(CqlParser.java:215)
        at
org.apache.cassandra.cql.QueryProcessor.getStatement(QueryProcessor.java:959)
        at
org.apache.cassandra.cql.QueryProcessor.process(QueryProcessor.java:879)
        at
org.apache.cassandra.thrift.CassandraServer.execute_cql_query(CassandraServer.java:1267)
        at
org.apache.cassandra.thrift.Cassandra$Processor$execute_cql_query.getResult(Cassandra.java:3637)
        at
org.apache.cassandra.thrift.Cassandra$Processor$execute_cql_query.getResult(Cassandra.java:3625)
        at
org.apache.thrift.ProcessFunction.process(ProcessFunction.java:32)
        at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:34)
        at
org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThreadPoolServer.java:186)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
        at java.lang.Thread.run(Thread.java:636)
[04/04/13 20:20:04,715 BRT] ERROR service.AbstractCassandraDaemon:
Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
java.lang.OutOfMemoryError: Java heap space
[04/04/13 20:20:04,712 BRT] ERROR service.AbstractCassandraDaemon:
Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
java.lang.OutOfMemoryError: Java heap space
[04/04/13 20:20:04,711 BRT] ERROR service.AbstractCassandraDaemon:
Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
java.lang.OutOfMemoryError: Java heap space
[04/04/13 20:20:04,710 BRT] ERROR service.AbstractCassandraDaemon:
Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
java.lang.OutOfMemoryError: Java heap space
[04/04/13 20:20:04,702 BRT] ERROR service.AbstractCassandraDaemon:
Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
java.lang.OutOfMemoryError: Java heap space
[04/04/13 20:20:04,700 BRT] ERROR service.AbstractCassandraDaemon:
Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
java.lang.OutOfMemoryError: Java heap space
[04/04/13 20:20:04,692 BRT] ERROR service.AbstractCassandraDaemon:
Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
java.lang.OutOfMemoryError: Java heap space
[04/04/13 20:20:04,591 BRT] ERROR service.AbstractCassandraDaemon:
Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
java.lang.OutOfMemoryError: Java heap space
[04/04/13 20:20:01,114 BRT] ERROR service.AbstractCassandraDaemon:
Exception in thread Thread[COMMIT-LOG-WRITER,5,main]
java.lang.OutOfMemoryError: Java heap space
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.addConditionWaiter(AbstractQueuedSynchronizer.java:1857)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2072)
        at
java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:423)
        at
org.apache.cassandra.db.commitlog.PeriodicCommitLogExecutorService$1.runMayThrow(PeriodicCommitLogExecutorService.java:47)
        at
org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
        at java.lang.Thread.run(Thread.java:636)
[04/04/13 20:20:01,114 BRT] ERROR service.AbstractCassandraDaemon:
Exception in thread Thread[GossipStage:1,5,main]
java.lang.OutOfMemoryError: Java heap space
[04/04/13 20:20:01,114 BRT] ERROR service.AbstractCassandraDaemon:
Exception in thread Thread[Thread-3,5,main]
java.lang.OutOfMemoryError: Java heap space
        at java.net.PlainSocketImpl.socketAccept(Native Method)
        at
java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:358)
        at java.net.ServerSocket.implAccept(ServerSocket.java:470)
        at java.net.ServerSocket.accept(ServerSocket.java:438)
        at
org.apache.cassandra.thrift.TCustomServerSocket.acceptImpl(TCustomServerSocket.java:97)
        at
org.apache.cassandra.thrift.TCustomServerSocket.acceptImpl(TCustomServerSocket.java:39)
        at
org.apache.thrift.transport.TServerTransport.accept(TServerTransport.java:31)
        at
org.apache.cassandra.thrift.CustomTThreadPoolServer.serve(CustomTThreadPoolServer.java:100)
        at
org.apache.cassandra.thrift.CassandraDaemon$ThriftServer.run(CassandraDaemon.java:214)
[04/04/13 20:20:01,114 BRT] ERROR service.AbstractCassandraDaemon:
Exception in thread Thread[Thread-11,5,main]
java.lang.OutOfMemoryError: Java heap space
        at java.util.Arrays.copyOfRange(Arrays.java:3221)
        at java.lang.String.<init>(String.java:233)
        at java.io.DataInputStream.readUTF(DataInputStream.java:661)
        at java.io.DataInputStream.readUTF(DataInputStream.java:564)
        at
org.apache.cassandra.net.IncomingTcpConnection.receiveMessage(IncomingTcpConnection.java:134)
        at
org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:113)
[04/04/13 20:20:01,114 BRT] ERROR service.AbstractCassandraDaemon:
Exception in thread Thread[CompactionExecutor:7,1,main]
java.lang.OutOfMemoryError: Java heap space


-- 
Everton Lima Aleixo
Mestrando em Ciência da Computação pela UFG
Programador no LUPA

Re: ERROR service.AbstractCassandraDaemon: Exception in thread Thread[Thrift:4,5,main]

Posted by aaron morton <aa...@thelastpickle.com>.
> Do not heve any manner to limit the usage of heap by setting some attribute in cassandra.yalm file?

No use cassandra-env.sh, normally in /etc/cassandra , there are comments in the file.

Cheers

-----------------
Aaron Morton
Freelance Cassandra Consultant
New Zealand

@aaronmorton
http://www.thelastpickle.com

On 9/04/2013, at 5:10 PM, Everton Lima <pe...@gmail.com> wrote:

> Do not heve any manner to limit the usage of heap by setting some attribute in cassandra.yalm file?
> 
> 
> 2013/4/9 aaron morton <aa...@thelastpickle.com>
> You need to increase the JVM heap, cassandra picks sensible defaults if you have enough server memory.
> 
> Reset all changed config files to default settings and make sure cassandra has at least 4GB of JVM heap. The heap size is calculated in cassandra-env.sh.
> 
> Cheers
> 
> -----------------
> Aaron Morton
> Freelance Cassandra Consultant
> New Zealand
> 
> @aaronmorton
> http://www.thelastpickle.com
> 
> On 6/04/2013, at 7:07 AM, Everton Lima <pe...@gmail.com> wrote:
> 
> > Hello,
> >
> > I am trying to insert a lot of data in cassandra 1.1.8, in 2 servers.
> > As a client I was using Astyanay to send Insert's CQL instructions.
> > It starts to insert the data, but after some time I recieve this error and both, server and client, dead.
> > Someone knows how to fix it? It is the best way to insert the data?
> > In appendix is the cassandra.yalm that the servers use.
> >
> > Ps. I am just reading the data of a postgres table, tuple by tuple, add one collumn, as key for cassandra, and insert in cassandra's servers.
> >
> >
> > The absolute log is:
> >
> >  ERROR service.AbstractCassandraDaemon: Exception in thread Thread[Thrift:4,5,main]
> > java.lang.OutOfMemoryError: Java heap space
> >         at java.util.Arrays.copyOf(Arrays.java:2746)
> >         at java.util.ArrayList.ensureCapacity(ArrayList.java:187)
> >         at java.util.ArrayList.add(ArrayList.java:378)
> >         at org.antlr.runtime.CommonTokenStream.fillBuffer(CommonTokenStream.java:116)
> >         at org.antlr.runtime.CommonTokenStream.mark(CommonTokenStream.java:305)
> >         at org.antlr.runtime.DFA.predict(DFA.java:68)
> >         at org.apache.cassandra.cql.CqlParser.query(CqlParser.java:215)
> >         at org.apache.cassandra.cql.QueryProcessor.getStatement(QueryProcessor.java:959)
> >         at org.apache.cassandra.cql.QueryProcessor.process(QueryProcessor.java:879)
> >         at org.apache.cassandra.thrift.CassandraServer.execute_cql_query(CassandraServer.java:1267)
> >         at org.apache.cassandra.thrift.Cassandra$Processor$execute_cql_query.getResult(Cassandra.java:3637)
> >         at org.apache.cassandra.thrift.Cassandra$Processor$execute_cql_query.getResult(Cassandra.java:3625)
> >         at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:32)
> >         at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:34)
> >         at org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThreadPoolServer.java:186)
> >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> >         at java.lang.Thread.run(Thread.java:636)
> > [04/04/13 20:20:04,715 BRT] ERROR service.AbstractCassandraDaemon: Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
> > java.lang.OutOfMemoryError: Java heap space
> > [04/04/13 20:20:04,712 BRT] ERROR service.AbstractCassandraDaemon: Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
> > java.lang.OutOfMemoryError: Java heap space
> > [04/04/13 20:20:04,711 BRT] ERROR service.AbstractCassandraDaemon: Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
> > java.lang.OutOfMemoryError: Java heap space
> > [04/04/13 20:20:04,710 BRT] ERROR service.AbstractCassandraDaemon: Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
> > java.lang.OutOfMemoryError: Java heap space
> > [04/04/13 20:20:04,702 BRT] ERROR service.AbstractCassandraDaemon: Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
> > java.lang.OutOfMemoryError: Java heap space
> > [04/04/13 20:20:04,700 BRT] ERROR service.AbstractCassandraDaemon: Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
> > java.lang.OutOfMemoryError: Java heap space
> > [04/04/13 20:20:04,692 BRT] ERROR service.AbstractCassandraDaemon: Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
> > java.lang.OutOfMemoryError: Java heap space
> > [04/04/13 20:20:04,591 BRT] ERROR service.AbstractCassandraDaemon: Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
> > java.lang.OutOfMemoryError: Java heap space
> > [04/04/13 20:20:01,114 BRT] ERROR service.AbstractCassandraDaemon: Exception in thread Thread[COMMIT-LOG-WRITER,5,main]
> > java.lang.OutOfMemoryError: Java heap space
> >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.addConditionWaiter(AbstractQueuedSynchronizer.java:1857)
> >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2072)
> >         at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:423)
> >         at org.apache.cassandra.db.commitlog.PeriodicCommitLogExecutorService$1.runMayThrow(PeriodicCommitLogExecutorService.java:47)
> >         at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
> >         at java.lang.Thread.run(Thread.java:636)
> > [04/04/13 20:20:01,114 BRT] ERROR service.AbstractCassandraDaemon: Exception in thread Thread[GossipStage:1,5,main]
> > java.lang.OutOfMemoryError: Java heap space
> > [04/04/13 20:20:01,114 BRT] ERROR service.AbstractCassandraDaemon: Exception in thread Thread[Thread-3,5,main]
> > java.lang.OutOfMemoryError: Java heap space
> >         at java.net.PlainSocketImpl.socketAccept(Native Method)
> >         at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:358)
> >         at java.net.ServerSocket.implAccept(ServerSocket.java:470)
> >         at java.net.ServerSocket.accept(ServerSocket.java:438)
> >         at org.apache.cassandra.thrift.TCustomServerSocket.acceptImpl(TCustomServerSocket.java:97)
> >         at org.apache.cassandra.thrift.TCustomServerSocket.acceptImpl(TCustomServerSocket.java:39)
> >         at org.apache.thrift.transport.TServerTransport.accept(TServerTransport.java:31)
> >         at org.apache.cassandra.thrift.CustomTThreadPoolServer.serve(CustomTThreadPoolServer.java:100)
> >         at org.apache.cassandra.thrift.CassandraDaemon$ThriftServer.run(CassandraDaemon.java:214)
> > [04/04/13 20:20:01,114 BRT] ERROR service.AbstractCassandraDaemon: Exception in thread Thread[Thread-11,5,main]
> > java.lang.OutOfMemoryError: Java heap space
> >         at java.util.Arrays.copyOfRange(Arrays.java:3221)
> >         at java.lang.String.<init>(String.java:233)
> >         at java.io.DataInputStream.readUTF(DataInputStream.java:661)
> >         at java.io.DataInputStream.readUTF(DataInputStream.java:564)
> >         at org.apache.cassandra.net.IncomingTcpConnection.receiveMessage(IncomingTcpConnection.java:134)
> >         at org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:113)
> > [04/04/13 20:20:01,114 BRT] ERROR service.AbstractCassandraDaemon: Exception in thread Thread[CompactionExecutor:7,1,main]
> > java.lang.OutOfMemoryError: Java heap space
> >
> >
> > --
> > Everton Lima Aleixo
> > Mestrando em Ciência da Computação pela UFG
> > Programador no LUPA
> >
> 
> 
> 
> 
> -- 
> Everton Lima Aleixo
> Bacharel em Ciência da Computação pela UFG
> Mestrando em Ciência da Computação pela UFG
> Programador no LUPA
>

Re: ERROR service.AbstractCassandraDaemon: Exception in thread Thread[Thrift:4,5,main]

Posted by Everton Lima <pe...@gmail.com>.
Do not heve any manner to limit the usage of heap by setting some attribute
in cassandra.yalm file?


2013/4/9 aaron morton <aa...@thelastpickle.com>

> You need to increase the JVM heap, cassandra picks sensible defaults if
> you have enough server memory.
>
> Reset all changed config files to default settings and make sure cassandra
> has at least 4GB of JVM heap. The heap size is calculated in
> cassandra-env.sh.
>
> Cheers
>
> -----------------
> Aaron Morton
> Freelance Cassandra Consultant
> New Zealand
>
> @aaronmorton
> http://www.thelastpickle.com
>
> On 6/04/2013, at 7:07 AM, Everton Lima <pe...@gmail.com> wrote:
>
> > Hello,
> >
> > I am trying to insert a lot of data in cassandra 1.1.8, in 2 servers.
> > As a client I was using Astyanay to send Insert's CQL instructions.
> > It starts to insert the data, but after some time I recieve this error
> and both, server and client, dead.
> > Someone knows how to fix it? It is the best way to insert the data?
> > In appendix is the cassandra.yalm that the servers use.
> >
> > Ps. I am just reading the data of a postgres table, tuple by tuple, add
> one collumn, as key for cassandra, and insert in cassandra's servers.
> >
> >
> > The absolute log is:
> >
> >  ERROR service.AbstractCassandraDaemon: Exception in thread
> Thread[Thrift:4,5,main]
> > java.lang.OutOfMemoryError: Java heap space
> >         at java.util.Arrays.copyOf(Arrays.java:2746)
> >         at java.util.ArrayList.ensureCapacity(ArrayList.java:187)
> >         at java.util.ArrayList.add(ArrayList.java:378)
> >         at
> org.antlr.runtime.CommonTokenStream.fillBuffer(CommonTokenStream.java:116)
> >         at
> org.antlr.runtime.CommonTokenStream.mark(CommonTokenStream.java:305)
> >         at org.antlr.runtime.DFA.predict(DFA.java:68)
> >         at org.apache.cassandra.cql.CqlParser.query(CqlParser.java:215)
> >         at
> org.apache.cassandra.cql.QueryProcessor.getStatement(QueryProcessor.java:959)
> >         at
> org.apache.cassandra.cql.QueryProcessor.process(QueryProcessor.java:879)
> >         at
> org.apache.cassandra.thrift.CassandraServer.execute_cql_query(CassandraServer.java:1267)
> >         at
> org.apache.cassandra.thrift.Cassandra$Processor$execute_cql_query.getResult(Cassandra.java:3637)
> >         at
> org.apache.cassandra.thrift.Cassandra$Processor$execute_cql_query.getResult(Cassandra.java:3625)
> >         at
> org.apache.thrift.ProcessFunction.process(ProcessFunction.java:32)
> >         at
> org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:34)
> >         at
> org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThreadPoolServer.java:186)
> >         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> >         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> >         at java.lang.Thread.run(Thread.java:636)
> > [04/04/13 20:20:04,715 BRT] ERROR service.AbstractCassandraDaemon:
> Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
> > java.lang.OutOfMemoryError: Java heap space
> > [04/04/13 20:20:04,712 BRT] ERROR service.AbstractCassandraDaemon:
> Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
> > java.lang.OutOfMemoryError: Java heap space
> > [04/04/13 20:20:04,711 BRT] ERROR service.AbstractCassandraDaemon:
> Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
> > java.lang.OutOfMemoryError: Java heap space
> > [04/04/13 20:20:04,710 BRT] ERROR service.AbstractCassandraDaemon:
> Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
> > java.lang.OutOfMemoryError: Java heap space
> > [04/04/13 20:20:04,702 BRT] ERROR service.AbstractCassandraDaemon:
> Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
> > java.lang.OutOfMemoryError: Java heap space
> > [04/04/13 20:20:04,700 BRT] ERROR service.AbstractCassandraDaemon:
> Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
> > java.lang.OutOfMemoryError: Java heap space
> > [04/04/13 20:20:04,692 BRT] ERROR service.AbstractCassandraDaemon:
> Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
> > java.lang.OutOfMemoryError: Java heap space
> > [04/04/13 20:20:04,591 BRT] ERROR service.AbstractCassandraDaemon:
> Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
> > java.lang.OutOfMemoryError: Java heap space
> > [04/04/13 20:20:01,114 BRT] ERROR service.AbstractCassandraDaemon:
> Exception in thread Thread[COMMIT-LOG-WRITER,5,main]
> > java.lang.OutOfMemoryError: Java heap space
> >         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.addConditionWaiter(AbstractQueuedSynchronizer.java:1857)
> >         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2072)
> >         at
> java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:423)
> >         at
> org.apache.cassandra.db.commitlog.PeriodicCommitLogExecutorService$1.runMayThrow(PeriodicCommitLogExecutorService.java:47)
> >         at
> org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
> >         at java.lang.Thread.run(Thread.java:636)
> > [04/04/13 20:20:01,114 BRT] ERROR service.AbstractCassandraDaemon:
> Exception in thread Thread[GossipStage:1,5,main]
> > java.lang.OutOfMemoryError: Java heap space
> > [04/04/13 20:20:01,114 BRT] ERROR service.AbstractCassandraDaemon:
> Exception in thread Thread[Thread-3,5,main]
> > java.lang.OutOfMemoryError: Java heap space
> >         at java.net.PlainSocketImpl.socketAccept(Native Method)
> >         at
> java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:358)
> >         at java.net.ServerSocket.implAccept(ServerSocket.java:470)
> >         at java.net.ServerSocket.accept(ServerSocket.java:438)
> >         at
> org.apache.cassandra.thrift.TCustomServerSocket.acceptImpl(TCustomServerSocket.java:97)
> >         at
> org.apache.cassandra.thrift.TCustomServerSocket.acceptImpl(TCustomServerSocket.java:39)
> >         at
> org.apache.thrift.transport.TServerTransport.accept(TServerTransport.java:31)
> >         at
> org.apache.cassandra.thrift.CustomTThreadPoolServer.serve(CustomTThreadPoolServer.java:100)
> >         at
> org.apache.cassandra.thrift.CassandraDaemon$ThriftServer.run(CassandraDaemon.java:214)
> > [04/04/13 20:20:01,114 BRT] ERROR service.AbstractCassandraDaemon:
> Exception in thread Thread[Thread-11,5,main]
> > java.lang.OutOfMemoryError: Java heap space
> >         at java.util.Arrays.copyOfRange(Arrays.java:3221)
> >         at java.lang.String.<init>(String.java:233)
> >         at java.io.DataInputStream.readUTF(DataInputStream.java:661)
> >         at java.io.DataInputStream.readUTF(DataInputStream.java:564)
> >         at
> org.apache.cassandra.net.IncomingTcpConnection.receiveMessage(IncomingTcpConnection.java:134)
> >         at
> org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:113)
> > [04/04/13 20:20:01,114 BRT] ERROR service.AbstractCassandraDaemon:
> Exception in thread Thread[CompactionExecutor:7,1,main]
> > java.lang.OutOfMemoryError: Java heap space
> >
> >
> > --
> > Everton Lima Aleixo
> > Mestrando em Ciência da Computação pela UFG
> > Programador no LUPA
> >
>
>


-- 
Everton Lima Aleixo
Bacharel em Ciência da Computação pela UFG
Mestrando em Ciência da Computação pela UFG
Programador no LUPA

Re: ERROR service.AbstractCassandraDaemon: Exception in thread Thread[Thrift:4,5,main]

Posted by aaron morton <aa...@thelastpickle.com>.
You need to increase the JVM heap, cassandra picks sensible defaults if you have enough server memory. 

Reset all changed config files to default settings and make sure cassandra has at least 4GB of JVM heap. The heap size is calculated in cassandra-env.sh. 

Cheers
 
-----------------
Aaron Morton
Freelance Cassandra Consultant
New Zealand

@aaronmorton
http://www.thelastpickle.com

On 6/04/2013, at 7:07 AM, Everton Lima <pe...@gmail.com> wrote:

> Hello,
> 
> I am trying to insert a lot of data in cassandra 1.1.8, in 2 servers.
> As a client I was using Astyanay to send Insert's CQL instructions.
> It starts to insert the data, but after some time I recieve this error and both, server and client, dead.
> Someone knows how to fix it? It is the best way to insert the data?
> In appendix is the cassandra.yalm that the servers use.
> 
> Ps. I am just reading the data of a postgres table, tuple by tuple, add one collumn, as key for cassandra, and insert in cassandra's servers.
> 
> 
> The absolute log is:
> 
>  ERROR service.AbstractCassandraDaemon: Exception in thread Thread[Thrift:4,5,main]
> java.lang.OutOfMemoryError: Java heap space
>         at java.util.Arrays.copyOf(Arrays.java:2746)
>         at java.util.ArrayList.ensureCapacity(ArrayList.java:187)
>         at java.util.ArrayList.add(ArrayList.java:378)
>         at org.antlr.runtime.CommonTokenStream.fillBuffer(CommonTokenStream.java:116)
>         at org.antlr.runtime.CommonTokenStream.mark(CommonTokenStream.java:305)
>         at org.antlr.runtime.DFA.predict(DFA.java:68)
>         at org.apache.cassandra.cql.CqlParser.query(CqlParser.java:215)
>         at org.apache.cassandra.cql.QueryProcessor.getStatement(QueryProcessor.java:959)
>         at org.apache.cassandra.cql.QueryProcessor.process(QueryProcessor.java:879)
>         at org.apache.cassandra.thrift.CassandraServer.execute_cql_query(CassandraServer.java:1267)
>         at org.apache.cassandra.thrift.Cassandra$Processor$execute_cql_query.getResult(Cassandra.java:3637)
>         at org.apache.cassandra.thrift.Cassandra$Processor$execute_cql_query.getResult(Cassandra.java:3625)
>         at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:32)
>         at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:34)
>         at org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThreadPoolServer.java:186)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>         at java.lang.Thread.run(Thread.java:636)
> [04/04/13 20:20:04,715 BRT] ERROR service.AbstractCassandraDaemon: Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
> java.lang.OutOfMemoryError: Java heap space
> [04/04/13 20:20:04,712 BRT] ERROR service.AbstractCassandraDaemon: Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
> java.lang.OutOfMemoryError: Java heap space
> [04/04/13 20:20:04,711 BRT] ERROR service.AbstractCassandraDaemon: Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
> java.lang.OutOfMemoryError: Java heap space
> [04/04/13 20:20:04,710 BRT] ERROR service.AbstractCassandraDaemon: Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
> java.lang.OutOfMemoryError: Java heap space
> [04/04/13 20:20:04,702 BRT] ERROR service.AbstractCassandraDaemon: Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
> java.lang.OutOfMemoryError: Java heap space
> [04/04/13 20:20:04,700 BRT] ERROR service.AbstractCassandraDaemon: Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
> java.lang.OutOfMemoryError: Java heap space
> [04/04/13 20:20:04,692 BRT] ERROR service.AbstractCassandraDaemon: Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
> java.lang.OutOfMemoryError: Java heap space
> [04/04/13 20:20:04,591 BRT] ERROR service.AbstractCassandraDaemon: Exception in thread Thread[RMI TCP Connection(idle),5,RMI Runtime]
> java.lang.OutOfMemoryError: Java heap space
> [04/04/13 20:20:01,114 BRT] ERROR service.AbstractCassandraDaemon: Exception in thread Thread[COMMIT-LOG-WRITER,5,main]
> java.lang.OutOfMemoryError: Java heap space
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.addConditionWaiter(AbstractQueuedSynchronizer.java:1857)
>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2072)
>         at java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:423)
>         at org.apache.cassandra.db.commitlog.PeriodicCommitLogExecutorService$1.runMayThrow(PeriodicCommitLogExecutorService.java:47)
>         at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:30)
>         at java.lang.Thread.run(Thread.java:636)
> [04/04/13 20:20:01,114 BRT] ERROR service.AbstractCassandraDaemon: Exception in thread Thread[GossipStage:1,5,main]
> java.lang.OutOfMemoryError: Java heap space
> [04/04/13 20:20:01,114 BRT] ERROR service.AbstractCassandraDaemon: Exception in thread Thread[Thread-3,5,main]
> java.lang.OutOfMemoryError: Java heap space
>         at java.net.PlainSocketImpl.socketAccept(Native Method)
>         at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:358)
>         at java.net.ServerSocket.implAccept(ServerSocket.java:470)
>         at java.net.ServerSocket.accept(ServerSocket.java:438)
>         at org.apache.cassandra.thrift.TCustomServerSocket.acceptImpl(TCustomServerSocket.java:97)
>         at org.apache.cassandra.thrift.TCustomServerSocket.acceptImpl(TCustomServerSocket.java:39)
>         at org.apache.thrift.transport.TServerTransport.accept(TServerTransport.java:31)
>         at org.apache.cassandra.thrift.CustomTThreadPoolServer.serve(CustomTThreadPoolServer.java:100)
>         at org.apache.cassandra.thrift.CassandraDaemon$ThriftServer.run(CassandraDaemon.java:214)
> [04/04/13 20:20:01,114 BRT] ERROR service.AbstractCassandraDaemon: Exception in thread Thread[Thread-11,5,main]
> java.lang.OutOfMemoryError: Java heap space
>         at java.util.Arrays.copyOfRange(Arrays.java:3221)
>         at java.lang.String.<init>(String.java:233)
>         at java.io.DataInputStream.readUTF(DataInputStream.java:661)
>         at java.io.DataInputStream.readUTF(DataInputStream.java:564)
>         at org.apache.cassandra.net.IncomingTcpConnection.receiveMessage(IncomingTcpConnection.java:134)
>         at org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:113)
> [04/04/13 20:20:01,114 BRT] ERROR service.AbstractCassandraDaemon: Exception in thread Thread[CompactionExecutor:7,1,main]
> java.lang.OutOfMemoryError: Java heap space
> 
> 
> -- 
> Everton Lima Aleixo
> Mestrando em Ciência da Computação pela UFG
> Programador no LUPA
>