You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Peng Xiao <25...@qq.com> on 2017/12/17 00:11:32 UTC
rebuild in the new DC always failed
Hi there,
We need to rebuild a new DC,but the stream is always failed with the following errors.
we are using C* 2.1.18.Could anyone please advise?
error: null
-- StackTrace --
java.io.EOFException
at java.io.DataInputStream.readByte(DataInputStream.java:267)
at sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:222)
at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:161)
at com.sun.jmx.remote.internal.PRef.invoke(Unknown Source)
at javax.management.remote.rmi.RMIConnectionImpl_Stub.invoke(Unknown Source)
at javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.invoke(RMIConnector.java:1020)
at javax.management.MBeanServerInvocationHandler.invoke(MBeanServerInvocationHandler.java:298)
at com.sun.proxy.$Proxy8.rebuild(Unknown Source)
at org.apache.cassandra.tools.NodeProbe.rebuild(NodeProbe.java:1057)
at org.apache.cassandra.tools.NodeTool$Rebuild.execute(NodeTool.java:1825)
at org.apache.cassandra.tools.NodeTool$NodeToolCmd.run(NodeTool.java:292)
at org.apache.cassandra.tools.NodeTool.main(NodeTool.java:206)
in the source side,the error is:
ERROR [GossipStage:217] 2017-12-17 00:28:02,030 CassandraDaemon.java:231 - Exception in thread Thread[GossipStage:217,5,main]
java.lang.NullPointerException: null
Thanks
Re: 回复: rebuild in the new DC always failed
Posted by Jeff Jirsa <jj...@gmail.com>.
That NPE in gossip is probably a missing endpointstate, which is probably fixed by the gossip patch (#13700) in 2.1.19
I’m not sure it’s related to the rebuild failing - I’m not actually sure if that’s a server failure or jmx timing out. Do you see logs on the servers indicating that it was ever invoked? Did it calculate a streaming plan? Did it start sending files?
--
Jeff Jirsa
> On Dec 16, 2017, at 4:56 PM, Peng Xiao <25...@qq.com> wrote:
>
> Hi Jeff,
> This is the only informaiton we found from system.log
> <2E...@9F7CAF6B.D1C0355A.jpg>
>
> Thanks
> ------------------ 原始邮件 ------------------
> 发件人: "Jeff Jirsa";<jj...@gmail.com>;
> 发送时间: 2017年12月17日(星期天) 上午8:13
> 收件人: "user"<us...@cassandra.apache.org>;
> 主题: Re: rebuild in the new DC always failed
>
> What’s the rest of the stack beneath the null pointer exception?
>
> --
> Jeff Jirsa
>
>
> > On Dec 16, 2017, at 4:11 PM, Peng Xiao <25...@qq.com> wrote:
> >
> > Hi there,
> >
> > We need to rebuild a new DC,but the stream is always failed with the following errors.
> > we are using C* 2.1.18.Could anyone please advise?
> >
> > error: null
> > -- StackTrace --
> > java.io.EOFException
> > at java.io.DataInputStream.readByte(DataInputStream.java:267)
> > at sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:222)
> > at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:161)
> > at com.sun.jmx.remote.internal.PRef.invoke(Unknown Source)
> > at javax.management.remote.rmi.RMIConnectionImpl_Stub.invoke(Unknown Source)
> > at javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.invoke(RMIConnector.java:1020)
> > at javax.management.MBeanServerInvocationHandler.invoke(MBeanServerInvocationHandler.java:298)
> > at com.sun.proxy.$Proxy8.rebuild(Unknown Source)
> > at org.apache.cassandra.tools.NodeProbe.rebuild(NodeProbe.java:1057)
> > at org.apache.cassandra.tools.NodeTool$Rebuild.execute(NodeTool.java:1825)
> > at org.apache.cassandra.tools.NodeTool$NodeToolCmd.run(NodeTool.java:292)
> > at org.apache.cassandra.tools.NodeTool.main(NodeTool.java:206)
> >
> > in the source side,the error is:
> >
> > ERROR [GossipStage:217] 2017-12-17 00:28:02,030 CassandraDaemon.java:231 - Exception in thread Thread[GossipStage:217,5,main]
> > java.lang.NullPointerException: null
> >
> > Thanks
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@cassandra.apache.org
> For additional commands, e-mail: user-help@cassandra.apache.org
回复: rebuild in the new DC always failed
Posted by Peng Xiao <25...@qq.com>.
Hi Jeff,
This is the only informaiton we found from system.log
Thanks
------------------ 原始邮件 ------------------
发件人: "Jeff Jirsa";<jj...@gmail.com>;
发送时间: 2017年12月17日(星期天) 上午8:13
收件人: "user"<us...@cassandra.apache.org>;
主题: Re: rebuild in the new DC always failed
What’s the rest of the stack beneath the null pointer exception?
--
Jeff Jirsa
> On Dec 16, 2017, at 4:11 PM, Peng Xiao <25...@qq.com> wrote:
>
> Hi there,
>
> We need to rebuild a new DC,but the stream is always failed with the following errors.
> we are using C* 2.1.18.Could anyone please advise?
>
> error: null
> -- StackTrace --
> java.io.EOFException
> at java.io.DataInputStream.readByte(DataInputStream.java:267)
> at sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:222)
> at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:161)
> at com.sun.jmx.remote.internal.PRef.invoke(Unknown Source)
> at javax.management.remote.rmi.RMIConnectionImpl_Stub.invoke(Unknown Source)
> at javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.invoke(RMIConnector.java:1020)
> at javax.management.MBeanServerInvocationHandler.invoke(MBeanServerInvocationHandler.java:298)
> at com.sun.proxy.$Proxy8.rebuild(Unknown Source)
> at org.apache.cassandra.tools.NodeProbe.rebuild(NodeProbe.java:1057)
> at org.apache.cassandra.tools.NodeTool$Rebuild.execute(NodeTool.java:1825)
> at org.apache.cassandra.tools.NodeTool$NodeToolCmd.run(NodeTool.java:292)
> at org.apache.cassandra.tools.NodeTool.main(NodeTool.java:206)
>
> in the source side,the error is:
>
> ERROR [GossipStage:217] 2017-12-17 00:28:02,030 CassandraDaemon.java:231 - Exception in thread Thread[GossipStage:217,5,main]
> java.lang.NullPointerException: null
>
> Thanks
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@cassandra.apache.org
For additional commands, e-mail: user-help@cassandra.apache.org
Re: rebuild in the new DC always failed
Posted by Jeff Jirsa <jj...@gmail.com>.
What’s the rest of the stack beneath the null pointer exception?
--
Jeff Jirsa
> On Dec 16, 2017, at 4:11 PM, Peng Xiao <25...@qq.com> wrote:
>
> Hi there,
>
> We need to rebuild a new DC,but the stream is always failed with the following errors.
> we are using C* 2.1.18.Could anyone please advise?
>
> error: null
> -- StackTrace --
> java.io.EOFException
> at java.io.DataInputStream.readByte(DataInputStream.java:267)
> at sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:222)
> at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:161)
> at com.sun.jmx.remote.internal.PRef.invoke(Unknown Source)
> at javax.management.remote.rmi.RMIConnectionImpl_Stub.invoke(Unknown Source)
> at javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.invoke(RMIConnector.java:1020)
> at javax.management.MBeanServerInvocationHandler.invoke(MBeanServerInvocationHandler.java:298)
> at com.sun.proxy.$Proxy8.rebuild(Unknown Source)
> at org.apache.cassandra.tools.NodeProbe.rebuild(NodeProbe.java:1057)
> at org.apache.cassandra.tools.NodeTool$Rebuild.execute(NodeTool.java:1825)
> at org.apache.cassandra.tools.NodeTool$NodeToolCmd.run(NodeTool.java:292)
> at org.apache.cassandra.tools.NodeTool.main(NodeTool.java:206)
>
> in the source side,the error is:
>
> ERROR [GossipStage:217] 2017-12-17 00:28:02,030 CassandraDaemon.java:231 - Exception in thread Thread[GossipStage:217,5,main]
> java.lang.NullPointerException: null
>
> Thanks
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@cassandra.apache.org
For additional commands, e-mail: user-help@cassandra.apache.org