You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@iotdb.apache.org by "Yongzao Dan (Jira)" <ji...@apache.org> on 2022/08/10 08:27:00 UTC
[jira] [Commented] (IOTDB-3874) [flush] DataNode:ERROR o.a.i.c.c.s.SyncThriftClientWithErrorHandler:80 - root cause message Fail to connect to any config node.
[ https://issues.apache.org/jira/browse/IOTDB-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17577861#comment-17577861 ]
Yongzao Dan commented on IOTDB-3874:
------------------------------------
This is a client redirection error. I suppose that it only occur randomly.
> [flush] DataNode:ERROR o.a.i.c.c.s.SyncThriftClientWithErrorHandler:80 - root cause message Fail to connect to any config node.
> --------------------------------------------------------------------------------------------------------------------------------
>
> Key: IOTDB-3874
> URL: https://issues.apache.org/jira/browse/IOTDB-3874
> Project: Apache IoTDB
> Issue Type: Bug
> Components: mpp-cluster
> Affects Versions: 0.14.0-SNAPSHOT
> Reporter: 刘珍
> Assignee: Yongzao Dan
> Priority: Major
> Attachments: 1_luanxu.sh, image-2022-07-18-17-25-48-195.png, insert_is_overflow.config.properties, ip62_config_data_logs.tar.gz, ip66_config_data_logs.tar.gz, ip68_config_data_logs.tar.gz
>
>
> master_0718_967cde6
> 3副本3C3D
> benchmark写入数据之后，串行连接每个datanode 执行flush
> !image-2022-07-18-17-25-48-195.png!
> ConfigNode没报错，DataNode日志：
> 2022-07-18 17:14:12,450 [20220718_091312_00199_3-1773] ERROR o.a.i.c.c.s.SyncThriftClientWithErrorHandler:80 - root cause message Fail to connect to any config node. Please check server it, LocalizedMessage Fail to connect to any config node. Please check server it,
> org.apache.thrift.TException: Fail to connect to any config node. Please check server it
> at org.apache.iotdb.db.client.ConfigNodeClient.flush(ConfigNodeClient.java:757)
> at org.apache.iotdb.db.client.ConfigNodeClient$$EnhancerByCGLIB$$6e95fc21.CGLIB$flush$49(<generated>)
> at org.apache.iotdb.db.client.ConfigNodeClient$$EnhancerByCGLIB$$6e95fc21$$FastClassByCGLIB$$beeb6c93.invoke(<generated>)
> at net.sf.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228)
> at org.apache.iotdb.commons.client.sync.SyncThriftClientWithErrorHandler.intercept(SyncThriftClientWithErrorHandler.java:55)
> at org.apache.iotdb.db.client.ConfigNodeClient$$EnhancerByCGLIB$$6e95fc21.flush(<generated>)
> at org.apache.iotdb.db.mpp.plan.execution.config.executor.ClusterConfigTaskExecutor.flush(ClusterConfigTaskExecutor.java:275)
> at org.apache.iotdb.db.mpp.plan.execution.config.FlushTask.execute(FlushTask.java:64)
> at org.apache.iotdb.db.mpp.plan.execution.config.ConfigExecution.start(ConfigExecution.java:96)
> at org.apache.iotdb.db.mpp.plan.Coordinator.execute(Coordinator.java:131)
> at org.apache.iotdb.db.service.thrift.impl.ClientRPCServiceImpl.executeStatement(ClientRPCServiceImpl.java:562)
> at org.apache.iotdb.service.rpc.thrift.IClientRPCService$Processor$executeStatement.getResult(IClientRPCService.java:2853)
> at org.apache.iotdb.service.rpc.thrift.IClientRPCService$Processor$executeStatement.getResult(IClientRPCService.java:2833)
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:38)
> at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:38)
> at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:248)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> 复现流程：
> 1. 192.168.10.62/66/68
> schema_region_consensus_protocol_class=org.apache.iotdb.consensus.ratis.RatisConsensus
> data_region_consensus_protocol_class=org.apache.iotdb.consensus.multileader.MultiLeaderConsensus
> schema_replication_factor=3
> data_replication_factor=3
> max_waiting_time_when_insert_blocked=3600000
> enable_seq_space_compaction=false
> enable_unseq_space_compaction=false
> enable_cross_space_compaction=false
> query_timeout_threshold=3600000
> 2. benchmark 启动写入有乱序
> 写入完成，ip68连各datanode执行flush：
> datanode/sbin/start-cli.sh -h ${node1} -e "flush"
> datanode/sbin/start-cli.sh -h ${node2} -e "flush"
> datanode/sbin/start-cli.sh -h ${node3} -e "flush"
> datanode报错。
--
This message was sent by Atlassian Jira
(v8.20.10#820010)