You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@iotdb.apache.org by "Jialin Qiao (Jira)" <ji...@apache.org> on 2022/06/02 03:46:00 UTC
[jira] [Assigned] (IOTDB-3376) Can't start ConfigNode consensus group
[ https://issues.apache.org/jira/browse/IOTDB-3376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jialin Qiao reassigned IOTDB-3376:
----------------------------------
Assignee: Xinyu Tan
> Can't start ConfigNode consensus group
> --------------------------------------
>
> Key: IOTDB-3376
> URL: https://issues.apache.org/jira/browse/IOTDB-3376
> Project: Apache IoTDB
> Issue Type: Bug
> Affects Versions: 0.14.0-SNAPSHOT
> Reporter: Jialin Qiao
> Assignee: Xinyu Tan
> Priority: Major
> Attachments: iotdb-confignode1.properties, iotdb-confignode2.properties, iotdb-confignode3.properties, iotdb-engine1.properties, iotdb-engine2.properties, iotdb-engine3.properties
>
>
> Start 3 confignode 3 datanode, in the second confignode(not the seednode), Meet:
>
> {code:java}
> 2022-06-02 11:29:22,507 [main] ERROR o.a.i.c.c.s.SyncThriftClientWithErrorHandler:65 - level-0 Exception class org.apache.thrift.TException, message Error in calling method recv_applyConfigNode
> 2022-06-02 11:29:22,507 [main] ERROR o.a.i.c.c.s.SyncThriftClientWithErrorHandler:65 - level-1 Exception class org.apache.thrift.TException, message Error in calling method receiveBase
> 2022-06-02 11:29:22,507 [main] ERROR o.a.i.c.c.s.SyncThriftClientWithErrorHandler:65 - level-2 Exception class org.apache.thrift.transport.TTransportException, message java.net.SocketTimeoutException: Read timed out
> 2022-06-02 11:29:22,508 [main] ERROR o.a.i.c.c.s.SyncThriftClientWithErrorHandler:65 - level-3 Exception class java.net.SocketTimeoutException, message Read timed out
> 2022-06-02 11:29:22,508 [main] ERROR o.a.i.c.c.s.SyncThriftClientWithErrorHandler:80 - root cause message Read timed out, LocalizedMessage Read timed out,
> java.net.SocketTimeoutException: Read timed out
> at java.net.SocketInputStream.socketRead0(Native Method)
> at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
> at java.net.SocketInputStream.read(SocketInputStream.java:171)
> at java.net.SocketInputStream.read(SocketInputStream.java:141)
> at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
> at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
> at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
> at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:176)
> at org.apache.thrift.transport.TTransport.readAll(TTransport.java:109)
> at org.apache.iotdb.rpc.TElasticFramedTransport.readFrame(TElasticFramedTransport.java:112)
> at org.apache.iotdb.rpc.TElasticFramedTransport.read(TElasticFramedTransport.java:107)
> at org.apache.thrift.transport.TTransport.readAll(TTransport.java:109)
> at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:463)
> at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:361)
> at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:244)
> at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
> at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.CGLIB$receiveBase$83(<generated>)
> at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85$$FastClassByCGLIB$$e3ef88be.invoke(<generated>)
> at net.sf.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228)
> at org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:55)
> at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.receiveBase(<generated>)
> at org.apache.iotdb.confignode.rpc.thrift.ConfigIService$Client.recv_applyConfigNode(ConfigIService.java:662)
> at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.CGLIB$recv_applyConfigNode$74(<generated>)
> at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85$$FastClassByCGLIB$$e3ef88be.invoke(<generated>)
> at net.sf.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228)
> at org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:55)
> at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.recv_applyConfigNode(<generated>)
> at org.apache.iotdb.confignode.rpc.thrift.ConfigIService$Client.applyConfigNode(ConfigIService.java:649)
> at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.CGLIB$applyConfigNode$12(<generated>)
> at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85$$FastClassByCGLIB$$e3ef88be.invoke(<generated>)
> at net.sf.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228)
> at org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:55)
> at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.applyConfigNode(<generated>)
> at org.apache.iotdb.confignode.client.SyncConfigNodeClientPool.applyConfigNode(SyncConfigNodeClientPool.java:75)
> at org.apache.iotdb.confignode.manager.ConsensusManager.setConsensusLayer(ConsensusManager.java:116)
> at org.apache.iotdb.confignode.manager.ConsensusManager.<init>(ConsensusManager.java:57)
> at org.apache.iotdb.confignode.manager.ConfigManager.<init>(ConfigManager.java:133)
> at org.apache.iotdb.confignode.service.ConfigNode.<init>(ConfigNode.java:58)
> at org.apache.iotdb.confignode.service.ConfigNode.<init>(ConfigNode.java:40)
> at org.apache.iotdb.confignode.service.ConfigNode$ConfigNodeHolder.<clinit>(ConfigNode.java:137)
> at org.apache.iotdb.confignode.service.ConfigNode.getInstance(ConfigNode.java:145)
> at org.apache.iotdb.confignode.service.ConfigNodeCommandLine.run(ConfigNodeCommandLine.java:74)
> at org.apache.iotdb.commons.ServerCommandLine.doMain(ServerCommandLine.java:58)
> at org.apache.iotdb.confignode.service.ConfigNode.main(ConfigNode.java:75)
> 2022-06-02 11:29:22,509 [main] WARN o.a.i.c.c.SyncConfigNodeClientPool:77 - Apply ConfigNode failed, retrying...
> org.apache.thrift.TException: Error in calling method applyConfigNode
> at org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:94)
> at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.applyConfigNode(<generated>)
> at org.apache.iotdb.confignode.client.SyncConfigNodeClientPool.applyConfigNode(SyncConfigNodeClientPool.java:75)
> at org.apache.iotdb.confignode.manager.ConsensusManager.setConsensusLayer(ConsensusManager.java:116)
> at org.apache.iotdb.confignode.manager.ConsensusManager.<init>(ConsensusManager.java:57)
> at org.apache.iotdb.confignode.manager.ConfigManager.<init>(ConfigManager.java:133)
> at org.apache.iotdb.confignode.service.ConfigNode.<init>(ConfigNode.java:58)
> at org.apache.iotdb.confignode.service.ConfigNode.<init>(ConfigNode.java:40)
> at org.apache.iotdb.confignode.service.ConfigNode$ConfigNodeHolder.<clinit>(ConfigNode.java:137)
> at org.apache.iotdb.confignode.service.ConfigNode.getInstance(ConfigNode.java:145)
> at org.apache.iotdb.confignode.service.ConfigNodeCommandLine.run(ConfigNodeCommandLine.java:74)
> at org.apache.iotdb.commons.ServerCommandLine.doMain(ServerCommandLine.java:58)
> at org.apache.iotdb.confignode.service.ConfigNode.main(ConfigNode.java:75)
> Caused by: org.apache.thrift.TException: Error in calling method recv_applyConfigNode
> at org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:94)
> at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.recv_applyConfigNode(<generated>)
> at org.apache.iotdb.confignode.rpc.thrift.ConfigIService$Client.applyConfigNode(ConfigIService.java:649)
> at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.CGLIB$applyConfigNode$12(<generated>)
> at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85$$FastClassByCGLIB$$e3ef88be.invoke(<generated>)
> at net.sf.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228)
> at org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:55)
> ... 12 common frames omitted
> Caused by: org.apache.thrift.TException: Error in calling method receiveBase
> at org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:94)
> at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.receiveBase(<generated>)
> at org.apache.iotdb.confignode.rpc.thrift.ConfigIService$Client.recv_applyConfigNode(ConfigIService.java:662)
> at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.CGLIB$recv_applyConfigNode$74(<generated>)
> at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85$$FastClassByCGLIB$$e3ef88be.invoke(<generated>)
> at net.sf.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228)
> at org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:55)
> ... 18 common frames omitted
> Caused by: org.apache.thrift.transport.TTransportException: java.net.SocketTimeoutException: Read timed out
> at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:178)
> at org.apache.thrift.transport.TTransport.readAll(TTransport.java:109)
> at org.apache.iotdb.rpc.TElasticFramedTransport.readFrame(TElasticFramedTransport.java:112)
> at org.apache.iotdb.rpc.TElasticFramedTransport.read(TElasticFramedTransport.java:107)
> at org.apache.thrift.transport.TTransport.readAll(TTransport.java:109)
> at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:463)
> at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:361)
> at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:244)
> at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77)
> at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85.CGLIB$receiveBase$83(<generated>)
> at org.apache.iotdb.commons.client.sync.SyncConfigNodeIServiceClient$$EnhancerByCGLIB$$55e13f85$$FastClassByCGLIB$$e3ef88be.invoke(<generated>)
> at net.sf.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228)
> at org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:55)
> ... 24 common frames omitted
> Caused by: java.net.SocketTimeoutException: Read timed out
> at java.net.SocketInputStream.socketRead0(Native Method)
> at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
> at java.net.SocketInputStream.read(SocketInputStream.java:171)
> at java.net.SocketInputStream.read(SocketInputStream.java:141)
> at java.io.BufferedInputStream.fill(BufferedInputStream.java:246)
> at java.io.BufferedInputStream.read1(BufferedInputStream.java:286)
> at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
> at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:176)
> ... 36 common frames omitted
> 2022-06-02 11:29:22,611 [main] ERROR o.a.i.c.c.SyncConfigNodeClientPool:81 - Apply ConfigNode failed
> 2022-06-02 11:29:22,611 [main] ERROR o.a.i.c.m.ConsensusManager:122 - All retry failed.
> 2022-06-02 11:29:22,611 [main] ERROR o.a.i.c.s.ConfigNode:60 - Can't start ConfigNode consensus group!
> java.io.IOException: Apply ConfigNode failed:
> at org.apache.iotdb.confignode.manager.ConsensusManager.setConsensusLayer(ConsensusManager.java:123)
> at org.apache.iotdb.confignode.manager.ConsensusManager.<init>(ConsensusManager.java:57)
> at org.apache.iotdb.confignode.manager.ConfigManager.<init>(ConfigManager.java:133)
> at org.apache.iotdb.confignode.service.ConfigNode.<init>(ConfigNode.java:58)
> at org.apache.iotdb.confignode.service.ConfigNode.<init>(ConfigNode.java:40)
> at org.apache.iotdb.confignode.service.ConfigNode$ConfigNodeHolder.<clinit>(ConfigNode.java:137)
> at org.apache.iotdb.confignode.service.ConfigNode.getInstance(ConfigNode.java:145)
> at org.apache.iotdb.confignode.service.ConfigNodeCommandLine.run(ConfigNodeCommandLine.java:74)
> at org.apache.iotdb.commons.ServerCommandLine.doMain(ServerCommandLine.java:58)
> at org.apache.iotdb.confignode.service.ConfigNode.main(ConfigNode.java:75)
> 2022-06-02 11:29:22,612 [main] INFO o.a.i.c.s.ConfigNode:124 - Deactivating IoTDB-ConfigNode...
> 2022-06-02 11:29:22,612 [main] INFO o.a.i.c.s.RegisterManager:67 - deregister all service.
> Exception in thread "main" java.lang.ExceptionInInitializerError
> at org.apache.iotdb.confignode.service.ConfigNode.getInstance(ConfigNode.java:145)
> at org.apache.iotdb.confignode.service.ConfigNodeCommandLine.run(ConfigNodeCommandLine.java:74)
> at org.apache.iotdb.commons.ServerCommandLine.doMain(ServerCommandLine.java:58)
> at org.apache.iotdb.confignode.service.ConfigNode.main(ConfigNode.java:75)
> Caused by: java.lang.NullPointerException
> at org.apache.iotdb.confignode.service.ConfigNode.deactivate(ConfigNode.java:127)
> at org.apache.iotdb.confignode.service.ConfigNode.stop(ConfigNode.java:132)
> at org.apache.iotdb.confignode.service.ConfigNode.<init>(ConfigNode.java:62)
> at org.apache.iotdb.confignode.service.ConfigNode.<init>(ConfigNode.java:40)
> at org.apache.iotdb.confignode.service.ConfigNode$ConfigNodeHolder.<clinit>(ConfigNode.java:137)
> ... 4 more {code}
--
This message was sent by Atlassian Jira
(v8.20.7#820007)