You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Omar Shibli <om...@eyeviewdigital.com> on 2012/12/20 09:33:30 UTC

A new Cassandra node 1.2 rc1 is unable to join an existing Cassandra cluster 1.2 beta 2

I've a running cluster (3 nodes) with release version 1.2.0-beta2, and I've
successfully added/removed nodes to this cluster in the past.

I'm trying to add a new node to the cluster with release version 1.2 rc1,
but it seems like other peers are refusing to connect, these are the
exceptions:

INFO [Thread-5] 2012-12-19 17:49:50,189 ThriftServer.java (line 110)
Listening for thrift clients...
DEBUG [WRITE-/10.0.0.102] 2012-12-19 17:49:50,872
OutboundTcpConnection.java (line 255) attempting to connect to /10.0.0.102
DEBUG [WRITE-/10.0.0.102] 2012-12-19 17:49:50,880
OutboundTcpConnection.java (line 279) Target max version is 5; will
reconnect with that version
DEBUG [WRITE-/10.0.0.102] 2012-12-19 17:49:50,880 MessagingService.java
(line 805) Setting version 5 for /10.0.0.102
DEBUG [WRITE-/10.0.0.102] 2012-12-19 17:49:51,873
OutboundTcpConnection.java (line 255) attempting to connect to /10.0.0.102
DEBUG [ScheduledTasks:1] 2012-12-19 17:49:51,919 LoadBroadcaster.java (line
85) Disseminating load info ...
DEBUG [WRITE-/10.0.0.101] 2012-12-19 17:49:52,874
OutboundTcpConnection.java (line 255) attempting to connect to /10.0.0.101
DEBUG [WRITE-/10.0.0.101] 2012-12-19 17:49:52,876
OutboundTcpConnection.java (line 279) Target max version is 5; will
reconnect with that version
DEBUG [WRITE-/10.0.0.101] 2012-12-19 17:49:52,876 MessagingService.java
(line 805) Setting version 5 for /10.0.0.101
DEBUG [WRITE-/10.0.0.102] 2012-12-19 17:49:53,876
OutboundTcpConnection.java (line 194) error writing to /10.0.0.102
java.io.IOException: Connection reset by peer
        at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
        at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
        at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:89)
        at sun.nio.ch.IOUtil.write(IOUtil.java:60)
        at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:450)
        at java.nio.channels.Channels.writeFullyImpl(Channels.java:78)
        at java.nio.channels.Channels.writeFully(Channels.java:98)
        at java.nio.channels.Channels.access$000(Channels.java:61)
        at java.nio.channels.Channels$1.write(Channels.java:174)
        at
java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
        at
java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
        at java.io.DataOutputStream.flush(DataOutputStream.java:123)
        at
org.apache.cassandra.net.OutboundTcpConnection.writeConnected(OutboundTcpConnection.java:185)
        at
org.apache.cassandra.net.OutboundTcpConnection.run(OutboundTcpConnection.java:139)
DEBUG [WRITE-/10.0.0.102] 2012-12-19 17:49:54,875
OutboundTcpConnection.java (line 255) attempting to connect to /10.0.0.102
DEBUG [WRITE-/10.0.0.101] 2012-12-19 17:49:55,875
OutboundTcpConnection.java (line 255) attempting to connect to /10.0.0.101
DEBUG [WRITE-/10.0.0.102] 2012-12-19 17:49:56,876
OutboundTcpConnection.java (line 194) error writing to /10.0.0.102
java.io.IOException: Connection reset by peer
        at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
        at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
        at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:89)
        at sun.nio.ch.IOUtil.write(IOUtil.java:60)
        at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:450)
        at java.nio.channels.Channels.writeFullyImpl(Channels.java:78)
        at java.nio.channels.Channels.writeFully(Channels.java:98)
        at java.nio.channels.Channels.access$000(Channels.java:61)
        at java.nio.channels.Channels$1.write(Channels.java:174)
        at
java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
        at
java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
        at java.io.DataOutputStream.flush(DataOutputStream.java:123)
        at
org.apache.cassandra.net.OutboundTcpConnection.writeConnected(OutboundTcpConnection.java:185)
        at
org.apache.cassandra.net.OutboundTcpConnection.run(OutboundTcpConnection.java:139)
DEBUG [WRITE-/10.0.0.102] 2012-12-19 17:49:57,876
OutboundTcpConnection.java (line 255) attempting to connect to /10.0.0.102
DEBUG [WRITE-/10.0.0.101] 2012-12-19 17:49:58,877
OutboundTcpConnection.java (line 194) error writing to /10.0.0.101
java.io.IOException: Connection reset by peer
        at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
        at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
        at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:89)
        at sun.nio.ch.IOUtil.write(IOUtil.java:60)
        at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:450)
        at java.nio.channels.Channels.writeFullyImpl(Channels.java:78)
        at java.nio.channels.Channels.writeFully(Channels.java:98)
        at java.nio.channels.Channels.access$000(Channels.java:61)
        at java.nio.channels.Channels$1.write(Channels.java:174)
        at
java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)

Re: A new Cassandra node 1.2 rc1 is unable to join an existing Cassandra cluster 1.2 beta 2

Posted by Sylvain Lebresne <sy...@datastax.com>.
This is almost surely due to
https://issues.apache.org/jira/browse/CASSANDRA-4813 which slightly changed
the stream on-wire format. If you first upgrade the rest of your cluster to
rc1, you should be fine.


On Thu, Dec 20, 2012 at 9:33 AM, Omar Shibli <om...@eyeviewdigital.com>wrote:

> I've a running cluster (3 nodes) with release version 1.2.0-beta2, and
> I've successfully added/removed nodes to this cluster in the past.
>
> I'm trying to add a new node to the cluster with release version 1.2 rc1,
> but it seems like other peers are refusing to connect, these are the
> exceptions:
>
> INFO [Thread-5] 2012-12-19 17:49:50,189 ThriftServer.java (line 110)
> Listening for thrift clients...
> DEBUG [WRITE-/10.0.0.102] 2012-12-19 17:49:50,872
> OutboundTcpConnection.java (line 255) attempting to connect to /10.0.0.102
>
> DEBUG [WRITE-/10.0.0.102] 2012-12-19 17:49:50,880
> OutboundTcpConnection.java (line 279) Target max version is 5; will
> reconnect with that version
> DEBUG [WRITE-/10.0.0.102] 2012-12-19 17:49:50,880 MessagingService.java
> (line 805) Setting version 5 for /10.0.0.102
> DEBUG [WRITE-/10.0.0.102] 2012-12-19 17:49:51,873
> OutboundTcpConnection.java (line 255) attempting to connect to /10.0.0.102
>
> DEBUG [ScheduledTasks:1] 2012-12-19 17:49:51,919 LoadBroadcaster.java
> (line 85) Disseminating load info ...
> DEBUG [WRITE-/10.0.0.101] 2012-12-19 17:49:52,874
> OutboundTcpConnection.java (line 255) attempting to connect to /10.0.0.101
>
> DEBUG [WRITE-/10.0.0.101] 2012-12-19 17:49:52,876
> OutboundTcpConnection.java (line 279) Target max version is 5; will
> reconnect with that version
> DEBUG [WRITE-/10.0.0.101] 2012-12-19 17:49:52,876 MessagingService.java
> (line 805) Setting version 5 for /10.0.0.101
> DEBUG [WRITE-/10.0.0.102] 2012-12-19 17:49:53,876
> OutboundTcpConnection.java (line 194) error writing to /10.0.0.102
> java.io.IOException: Connection reset by peer
>         at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
>         at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
>         at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:89)
>         at sun.nio.ch.IOUtil.write(IOUtil.java:60)
>         at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:450)
>         at java.nio.channels.Channels.writeFullyImpl(Channels.java:78)
>         at java.nio.channels.Channels.writeFully(Channels.java:98)
>         at java.nio.channels.Channels.access$000(Channels.java:61)
>         at java.nio.channels.Channels$1.write(Channels.java:174)
>         at
> java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
>         at
> java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
>         at java.io.DataOutputStream.flush(DataOutputStream.java:123)
>         at
> org.apache.cassandra.net.OutboundTcpConnection.writeConnected(OutboundTcpConnection.java:185)
>         at
> org.apache.cassandra.net.OutboundTcpConnection.run(OutboundTcpConnection.java:139)
> DEBUG [WRITE-/10.0.0.102] 2012-12-19 17:49:54,875
> OutboundTcpConnection.java (line 255) attempting to connect to /10.0.0.102
>
> DEBUG [WRITE-/10.0.0.101] 2012-12-19 17:49:55,875
> OutboundTcpConnection.java (line 255) attempting to connect to /10.0.0.101
>
> DEBUG [WRITE-/10.0.0.102] 2012-12-19 17:49:56,876
> OutboundTcpConnection.java (line 194) error writing to /10.0.0.102
> java.io.IOException: Connection reset by peer
>         at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
>         at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
>         at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:89)
>         at sun.nio.ch.IOUtil.write(IOUtil.java:60)
>         at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:450)
>         at java.nio.channels.Channels.writeFullyImpl(Channels.java:78)
>         at java.nio.channels.Channels.writeFully(Channels.java:98)
>         at java.nio.channels.Channels.access$000(Channels.java:61)
>         at java.nio.channels.Channels$1.write(Channels.java:174)
>         at
> java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
>         at
> java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
>         at java.io.DataOutputStream.flush(DataOutputStream.java:123)
>         at
> org.apache.cassandra.net.OutboundTcpConnection.writeConnected(OutboundTcpConnection.java:185)
>         at
> org.apache.cassandra.net.OutboundTcpConnection.run(OutboundTcpConnection.java:139)
> DEBUG [WRITE-/10.0.0.102] 2012-12-19 17:49:57,876
> OutboundTcpConnection.java (line 255) attempting to connect to /10.0.0.102
>
> DEBUG [WRITE-/10.0.0.101] 2012-12-19 17:49:58,877
> OutboundTcpConnection.java (line 194) error writing to /10.0.0.101
> java.io.IOException: Connection reset by peer
>         at sun.nio.ch.FileDispatcherImpl.write0(Native Method)
>         at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47)
>         at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:89)
>         at sun.nio.ch.IOUtil.write(IOUtil.java:60)
>         at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:450)
>         at java.nio.channels.Channels.writeFullyImpl(Channels.java:78)
>         at java.nio.channels.Channels.writeFully(Channels.java:98)
>         at java.nio.channels.Channels.access$000(Channels.java:61)
>         at java.nio.channels.Channels$1.write(Channels.java:174)
>         at
> java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
>