[jira] [Comment Edited] (CASSANDRA-6424) Millions of Message.java (line 342) Got an IOException in internalRead messages on each node of cluster

["Dimetrio (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CASSANDRA-6424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13835630#comment-13835630 ] 

Dimetrio edited comment on CASSANDRA-6424 at 11/30/13 6:31 AM:
---------------------------------------------------------------

I have API servers with phpcassa and cassandra cluster in the one local network. And network connection works good.
The cluster becomes fully unusable when the problem appears. No one of API cannot connect to any node of cassandra. Other server side services work ok.
No threads in project.
Everything was fine before 2.0.2 ( upgraded from 1.2.11).

Api servers (local and global) cannot connect to cluster at the same time.


was (Author: dimetrio):
I have API servers with phpcassa and cassandra cluster in the one local network. And network connection works good.
The cluster becomes fully unusable when the problem appears. No one of API cannot connect to any node of cassandra. Other server side services work ok.
No threads in project.
Everything was fine before 2.0.2 ( upgraded from 1.2.11).


> Millions of Message.java (line 342) Got an IOException in internalRead messages on each node of cluster
> -------------------------------------------------------------------------------------------------------
>
>                 Key: CASSANDRA-6424
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-6424
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Core
>         Environment: Ubuntu server 12.04 , cassandra 2.0.2 & 2.0.3
>            Reporter: Dimetrio
>
> I have millions of this debug messages on all nodes of cassandra cluster. And after it's starts - no one node is working.
> Cassandra restart not solve the problem (but sometimes it can help).
> {{ WARN [Thrift-Selector_6] 2013-11-29 15:42:18,344 Message.java (line 342) Got an IOException in internalRead!
> java.io.IOException: Connection reset by peer
>         at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
>         at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
>         at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
>         at sun.nio.ch.IOUtil.read(IOUtil.java:192)
>         at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:379)
>         at org.apache.thrift.transport.TNonblockingSocket.read(TNonblockingSocket.java:141)
>         at com.thinkaurelius.thrift.util.mem.Buffer.readFrom(Buffer.java:96)
>         at com.thinkaurelius.thrift.Message.internalRead(Message.java:338)
>         at com.thinkaurelius.thrift.Message.read(Message.java:141)
>         at com.thinkaurelius.thrift.TDisruptorServer$SelectorThread.handleRead(TDisruptorServer.java:521)
>         at com.thinkaurelius.thrift.TDisruptorServer$SelectorThread.processKey(TDisruptorServer.java:500)
>         at com.thinkaurelius.thrift.TDisruptorServer$AbstractSelectorThread.select(TDisruptorServer.java:375)
>         at com.thinkaurelius.thrift.TDisruptorServer$AbstractSelectorThread.run(TDisrptorServer.java:339)
>  WARN [Thrift-Selector_2] 2013-11-29 15:42:18,344 Message.java (line 342) Got an IOException in internalRead!
> java.io.IOException:}}



--
This message was sent by Atlassian JIRA
(v6.1#6144)