You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by "Paulo Motta (JIRA)" <ji...@apache.org> on 2016/03/01 18:58:18 UTC

[jira] [Commented] (CASSANDRA-11287) Node Bootstrap fails due to Streaming error

    [ https://issues.apache.org/jira/browse/CASSANDRA-11287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15174105#comment-15174105 ] 

Paulo Motta commented on CASSANDRA-11287:
-----------------------------------------

Thanks for the report. This happens because you're trying to stream sstables from the previous format and this is not currently supported.

The error message is not clear enough and we could fix that, but we are already working on supporting streaming of sstables from previous versions on CASSANDRA-10990, which should be available on next release, if everything works out as planned.

The workaround for now is to run upgradesstables on all nodes before running any operation that uses streaming, such as bootstrap, repair or rebuild. For now I will close this as duplicate of CASSANDRA-10990, as this will be addressed there.

> Node Bootstrap fails due to Streaming error
> -------------------------------------------
>
>                 Key: CASSANDRA-11287
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-11287
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Streaming and Messaging
>         Environment: Cassandra 3.3
>            Reporter: Michał Matłoka
>
> I am trying to bootstrap a node, in its logs I get the following errors
> {code}
> ERROR [STREAM-IN-/10.10.10.3] 2016-03-01 08:16:33,006 StreamSession.java:520 - [Stream #866ffb60-df7d-11e5-a235-6562056da4d2] Streaming error occurred
> java.io.EOFException: null
>         at java.io.DataInputStream.readFully(DataInputStream.java:197) ~[na:1.8.0_72]
>         at java.io.DataInputStream.readLong(DataInputStream.java:416) ~[na:1.8.0_72]
>         at org.apache.cassandra.io.compress.CompressionMetadata$ChunkSerializer.deserialize(CompressionMetadata.java:513) ~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.io.compress.CompressionMetadata$ChunkSerializer.deserialize(CompressionMetadata.java:503) ~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.compress.CompressionInfo$CompressionInfoSerializer.deserialize(CompressionInfo.java:73) ~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.compress.CompressionInfo$CompressionInfoSerializer.deserialize(CompressionInfo.java:46) ~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.messages.FileMessageHeader$FileMessageHeaderSerializer.deserialize(FileMessageHeader.java:227) ~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.messages.IncomingFileMessage$1.deserialize(IncomingFileMessage.java:44) ~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.messages.IncomingFileMessage$1.deserialize(IncomingFileMessage.java:39) ~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.messages.StreamMessage.deserialize(StreamMessage.java:59) ~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.ConnectionHandler$IncomingMessageHandler.run(ConnectionHandler.java:261) ~[apache-cassandra-3.3.0.jar:3.3.0]
>         at java.lang.Thread.run(Thread.java:745) [na:1.8.0_72]
> ERROR [STREAM-OUT-/10.10.10.3] 2016-03-01 08:16:33,007 StreamSession.java:520 - [Stream #866ffb60-df7d-11e5-a235-6562056da4d2] Streaming error occurred
> java.io.IOException: Broken pipe
>         at sun.nio.ch.FileDispatcherImpl.write0(Native Method) ~[na:1.8.0_72]
>         at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47) ~[na:1.8.0_72]
>         at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93) ~[na:1.8.0_72]
>         at sun.nio.ch.IOUtil.write(IOUtil.java:51) ~[na:1.8.0_72]
>         at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471) ~[na:1.8.0_72]
>         at org.apache.cassandra.io.util.BufferedDataOutputStreamPlus.doFlush(BufferedDataOutputStreamPlus.java:323) ~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.io.util.BufferedDataOutputStreamPlus.flush(BufferedDataOutputStreamPlus.java:331) ~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.sendMessage(ConnectionHandler.java:364) [apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.run(ConnectionHandler.java:335) [apache-cassandra-3.3.0.jar:3.3.0]
>         at java.lang.Thread.run(Thread.java:745) [na:1.8.0_72]
> INFO  [STREAM-OUT-/10.10.10.3] 2016-03-01 08:16:33,019 StreamResultFuture.java:185 - [Stream #866ffb60-df7d-11e5-a235-6562056da4d2] Session with /10.10.10.3 is complete
> ERROR [STREAM-OUT-/10.10.10.3] 2016-03-01 08:16:33,020 StreamSession.java:520 - [Stream #866ffb60-df7d-11e5-a235-6562056da4d2] Streaming error occurred
> java.io.IOException: Broken pipe
>         at sun.nio.ch.FileDispatcherImpl.write0(Native Method) ~[na:1.8.0_72]
>         at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47) ~[na:1.8.0_72]
>         at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93) ~[na:1.8.0_72]
>         at sun.nio.ch.IOUtil.write(IOUtil.java:51) ~[na:1.8.0_72]
>         at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471) ~[na:1.8.0_72]
>         at org.apache.cassandra.io.util.BufferedDataOutputStreamPlus.doFlush(BufferedDataOutputStreamPlus.java:323) ~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.io.util.BufferedDataOutputStreamPlus.flush(BufferedDataOutputStreamPlus.java:331) ~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.sendMessage(ConnectionHandler.java:364) [apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.run(ConnectionHandler.java:343) [apache-cassandra-3.3.0.jar:3.3.0]
>         at java.lang.Thread.run(Thread.java:745) [na:1.8.0_72]
> {code}
> on source node
> {code}
> INFO  [STREAM-IN-/10.10.10.5] 2016-03-01 08:34:59,057 StreamResultFuture.java:171 - [Stream #19bddf70-df80-11e5-a235-6562056da4d2 ID#0] Prepare completed. Receiving 0 files(0 bytes), sending 102 files(276993164542 bytes)
> ERROR [STREAM-OUT-/10.10.10.5] 2016-03-01 08:34:59,185 StreamSession.java:520 - [Stream #19bddf70-df80-11e5-a235-6562056da4d2] Streaming error occurred
> java.lang.NullPointerException: null
>         at org.apache.cassandra.db.SerializationHeader$Component.access$500(SerializationHeader.java:283) ~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.db.SerializationHeader$Serializer.serialize(SerializationHeader.java:430) ~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.messages.FileMessageHeader$FileMessageHeaderSerializer.serialize(FileMessageHeader.java:208) ~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.messages.OutgoingFileMessage.serialize(OutgoingFileMessage.java:84) ~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.messages.OutgoingFileMessage$1.serialize(OutgoingFileMessage.java:48) ~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.messages.OutgoingFileMessage$1.serialize(OutgoingFileMessage.java:40) ~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.messages.StreamMessage.serialize(StreamMessage.java:48) ~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.sendMessage(ConnectionHandler.java:363) ~[apache-cassandra-3.3.0.jar:3.3.0]
>         at org.apache.cassandra.streaming.ConnectionHandler$OutgoingMessageHandler.run(ConnectionHandler.java:335) ~[apache-cassandra-3.3.0.jar:3.3.0]
>         at java.lang.Thread.run(Thread.java:745) [na:1.8.0_66]
> INFO  [STREAM-OUT-/10.10.10.5] 2016-03-01 08:34:59,186 StreamResultFuture.java:185 - [Stream #19bddf70-df80-11e5-a235-6562056da4d2] Session with /10.10.10.5 is complete
> WARN  [STREAM-OUT-/10.10.10.5] 2016-03-01 08:34:59,186 StreamResultFuture.java:212 - [Stream #19bddf70-df80-11e5-a235-6562056da4d2] Stream failed
> {code}
> All nodes have Cassandra 3.3.
> Note: source node is doing an sstable upgrade.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)