You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@iotdb.apache.org by "Jialin Qiao (Jira)" <ji...@apache.org> on 2022/06/02 03:46:00 UTC
[jira] [Created] (IOTDB-3376) Can't start ConfigNode consensus group
Jialin Qiao created IOTDB-3376:
----------------------------------
Summary: Can't start ConfigNode consensus group
Key: IOTDB-3376
URL: https://issues.apache.org/jira/browse/IOTDB-3376
Project: Apache IoTDB
Issue Type: Bug
Affects Versions: 0.14.0-SNAPSHOT
Reporter: Jialin Qiao
Attachments: iotdb-confignode1.properties, iotdb-confignode2.properties, iotdb-confignode3.properties, iotdb-engine1.properties, iotdb-engine2.properties, iotdb-engine3.properties
Start 3 confignode 3 datanode, in the second confignode(not the seednode), Meet:
{code:java}
2022-06-02 11:29:22,507 [main] ERROR o.a.i.c.c.s.SyncThriftClientWithErrorHandler:65 - level-0 Exception class org.apache.thrift.TException, message Error in calling method recv_applyConfigNode
2022-06-02 11:29:22,507 [main] ERROR o.a.i.c.c.s.SyncThriftClientWithErrorHandler:65 - level-1 Exception class org.apache.thrift.TException, message Error in calling method receiveBase
2022-06-02 11:29:22,507 [main] ERROR o.a.i.c.c.s.SyncThriftClientWithErrorHandler:65 - level-2 Exception class org.apache.thrift.transport.TTransportException, message java.net.SocketTimeoutException: Read timed out
2022-06-02 11:29:22,508 [main] ERROR o.a.i.c.c.s.SyncThriftClientWithErrorHandler:65 - level-3 Exception class java.net.SocketTimeoutException, message Read timed out
2022-06-02 11:29:22,508 [main] ERROR o.a.i.c.c.s.SyncThriftClientWithErrorHandler:80 - root cause message Read timed out, LocalizedMessage Read timed out,
java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:176)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:109)
at org.apache.iotdb.rpc.TElasticFramedTransport.readFrame(TElasticFramedTransport.java:112)
at org.apache.iotdb.rpc.TElasticFramedTransport.read(TElasticFramedTransport.java:107)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:109)
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:463)
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:361)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:244)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.CGLIB$receiveBase$83(<generated>)
at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85$$FastClassByCGLIB$$e3ef88be.invoke(<generated>)
at net.sf.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228)
at org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:55)
at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.receiveBase(<generated>)
at org.apache.iotdb.confignode.rpc.thrift.ConfigIService$Client.recv_applyConfigNode(ConfigIService.java:662)
at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.CGLIB$recv_applyConfigNode$74(<generated>)
at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85$$FastClassByCGLIB$$e3ef88be.invoke(<generated>)
at net.sf.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228)
at org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:55)
at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.recv_applyConfigNode(<generated>)
at org.apache.iotdb.confignode.rpc.thrift.ConfigIService$Client.applyConfigNode(ConfigIService.java:649)
at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.CGLIB$applyConfigNode$12(<generated>)
at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85$$FastClassByCGLIB$$e3ef88be.invoke(<generated>)
at net.sf.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228)
at org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:55)
at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.applyConfigNode(<generated>)
at org.apache.iotdb.confignode.client.SyncConfigNodeClientPool.applyConfigNode(SyncConfigNodeClientPool.java:75)
at org.apache.iotdb.confignode.manager.ConsensusManager.setConsensusLayer(ConsensusManager.java:116)
at org.apache.iotdb.confignode.manager.ConsensusManager.<init>(ConsensusManager.java:57)
at org.apache.iotdb.confignode.manager.ConfigManager.<init>(ConfigManager.java:133)
at org.apache.iotdb.confignode.service.ConfigNode.<init>(ConfigNode.java:58)
at org.apache.iotdb.confignode.service.ConfigNode.<init>(ConfigNode.java:40)
at org.apache.iotdb.confignode.service.ConfigNode$ConfigNodeHolder.<clinit>(ConfigNode.java:137)
at org.apache.iotdb.confignode.service.ConfigNode.getInstance(ConfigNode.java:145)
at org.apache.iotdb.confignode.service.ConfigNodeCommandLine.run(ConfigNodeCommandLine.java:74)
at org.apache.iotdb.commons.ServerCommandLine.doMain(ServerCommandLine.java:58)
at org.apache.iotdb.confignode.service.ConfigNode.main(ConfigNode.java:75)
2022-06-02 11:29:22,509 [main] WARN o.a.i.c.c.SyncConfigNodeClientPool:77 - Apply ConfigNode failed, retrying...
org.apache.thrift.TException: Error in calling method applyConfigNode
at org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:94)
at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.applyConfigNode(<generated>)
at org.apache.iotdb.confignode.client.SyncConfigNodeClientPool.applyConfigNode(SyncConfigNodeClientPool.java:75)
at org.apache.iotdb.confignode.manager.ConsensusManager.setConsensusLayer(ConsensusManager.java:116)
at org.apache.iotdb.confignode.manager.ConsensusManager.<init>(ConsensusManager.java:57)
at org.apache.iotdb.confignode.manager.ConfigManager.<init>(ConfigManager.java:133)
at org.apache.iotdb.confignode.service.ConfigNode.<init>(ConfigNode.java:58)
at org.apache.iotdb.confignode.service.ConfigNode.<init>(ConfigNode.java:40)
at org.apache.iotdb.confignode.service.ConfigNode$ConfigNodeHolder.<clinit>(ConfigNode.java:137)
at org.apache.iotdb.confignode.service.ConfigNode.getInstance(ConfigNode.java:145)
at org.apache.iotdb.confignode.service.ConfigNodeCommandLine.run(ConfigNodeCommandLine.java:74)
at org.apache.iotdb.commons.ServerCommandLine.doMain(ServerCommandLine.java:58)
at org.apache.iotdb.confignode.service.ConfigNode.main(ConfigNode.java:75)
Caused by: org.apache.thrift.TException: Error in calling method recv_applyConfigNode
at org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:94)
at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.recv_applyConfigNode(<generated>)
at org.apache.iotdb.confignode.rpc.thrift.ConfigIService$Client.applyConfigNode(ConfigIService.java:649)
at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.CGLIB$applyConfigNode$12(<generated>)
at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85$$FastClassByCGLIB$$e3ef88be.invoke(<generated>)
at net.sf.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228)
at org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:55)
... 12 common frames omitted
Caused by: org.apache.thrift.TException: Error in calling method receiveBase
at org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:94)
at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.receiveBase(<generated>)
at org.apache.iotdb.confignode.rpc.thrift.ConfigIService$Client.recv_applyConfigNode(ConfigIService.java:662)
at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.CGLIB$recv_applyConfigNode$74(<generated>)
at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85$$FastClassByCGLIB$$e3ef88be.invoke(<generated>)
at net.sf.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228)
at org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:55)
... 18 common frames omitted
Caused by: org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:178)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:109)
at org.apache.iotdb.rpc.TElasticFramedTransport.readFrame(TElasticFramedTransport.java:112)
at org.apache.iotdb.rpc.TElasticFramedTransport.read(TElasticFramedTransport.java:107)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:109)
at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:463)
at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:361)
at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:244)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.CGLIB$receiveBase$83(<generated>)
at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85$$FastClassByCGLIB$$e3ef88be.invoke(<generated>)
at net.sf.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228)
at org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:55)
... 24 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:176)
... 36 common frames omitted
2022-06-02 11:29:22,611 [main] ERROR o.a.i.c.c.SyncConfigNodeClientPool:81 - Apply ConfigNode failed
2022-06-02 11:29:22,611 [main] ERROR o.a.i.c.m.ConsensusManager:122 - All retry failed.
2022-06-02 11:29:22,611 [main] ERROR o.a.i.c.s.ConfigNode:60 - Can't start ConfigNode consensus group!
java.io.IOException: Apply ConfigNode failed:
at org.apache.iotdb.confignode.manager.ConsensusManager.setConsensusLayer(ConsensusManager.java:123)
at org.apache.iotdb.confignode.manager.ConsensusManager.<init>(ConsensusManager.java:57)
at org.apache.iotdb.confignode.manager.ConfigManager.<init>(ConfigManager.java:133)
at org.apache.iotdb.confignode.service.ConfigNode.<init>(ConfigNode.java:58)
at org.apache.iotdb.confignode.service.ConfigNode.<init>(ConfigNode.java:40)
at org.apache.iotdb.confignode.service.ConfigNode$ConfigNodeHolder.<clinit>(ConfigNode.java:137)
at org.apache.iotdb.confignode.service.ConfigNode.getInstance(ConfigNode.java:145)
at org.apache.iotdb.confignode.service.ConfigNodeCommandLine.run(ConfigNodeCommandLine.java:74)
at org.apache.iotdb.commons.ServerCommandLine.doMain(ServerCommandLine.java:58)
at org.apache.iotdb.confignode.service.ConfigNode.main(ConfigNode.java:75)
2022-06-02 11:29:22,612 [main] INFO o.a.i.c.s.ConfigNode:124 - Deactivating IoTDB-ConfigNode...
2022-06-02 11:29:22,612 [main] INFO o.a.i.c.s.RegisterManager:67 - deregister all service.
Exception in thread "main" java.lang.ExceptionInInitializerError
at org.apache.iotdb.confignode.service.ConfigNode.getInstance(ConfigNode.java:145)
at org.apache.iotdb.confignode.service.ConfigNodeCommandLine.run(ConfigNodeCommandLine.java:74)
at org.apache.iotdb.commons.ServerCommandLine.doMain(ServerCommandLine.java:58)
at org.apache.iotdb.confignode.service.ConfigNode.main(ConfigNode.java:75)
Caused by: java.lang.NullPointerException
at org.apache.iotdb.confignode.service.ConfigNode.deactivate(ConfigNode.java:127)
at org.apache.iotdb.confignode.service.ConfigNode.stop(ConfigNode.java:132)
at org.apache.iotdb.confignode.service.ConfigNode.<init>(ConfigNode.java:62)
at org.apache.iotdb.confignode.service.ConfigNode.<init>(ConfigNode.java:40)
at org.apache.iotdb.confignode.service.ConfigNode$ConfigNodeHolder.<clinit>(ConfigNode.java:137)
... 4 more {code}
--
This message was sent by Atlassian Jira
(v8.20.7#820007)