You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@iotdb.apache.org by "FengQingxin (Jira)" <ji...@apache.org> on 2022/11/23 15:10:00 UTC

[jira] [Commented] (IOTDB-3944) [Cluster][ratis]cannot dispatch FI for write operation

    [ https://issues.apache.org/jira/browse/IOTDB-3944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637827#comment-17637827 ] 

FengQingxin commented on IOTDB-3944:
------------------------------------

2022/11/23发现以下报错信息:
2022-11-23 16:48:26,683 [pool-24-IoTDB-DataNodeInternalRPC-Processor-41] ERROR o.a.i.d.m.e.e.RegionWriteExecutor$WritePlanNodeExecutionVisitor:137 - Something wrong happened while calling consensus layer's write API.
org.apache.iotdb.consensus.exception.RatisRequestFailedException: Ratis request failed
        at org.apache.iotdb.consensus.ratis.RatisConsensus.write(RatisConsensus.java:277)
        at org.apache.iotdb.db.mpp.execution.executor.RegionWriteExecutor$WritePlanNodeExecutionVisitor.executePlanNodeInConsensusLayer(RegionWriteExecutor.java:152)
        at org.apache.iotdb.db.mpp.execution.executor.RegionWriteExecutor$WritePlanNodeExecutionVisitor.visitPlan(RegionWriteExecutor.java:129)
        at org.apache.iotdb.db.mpp.execution.executor.RegionWriteExecutor$WritePlanNodeExecutionVisitor.visitPlan(RegionWriteExecutor.java:119)
        at org.apache.iotdb.db.mpp.plan.planner.plan.node.PlanVisitor.visitCreateMultiTimeSeries(PlanVisitor.java:219)
        at org.apache.iotdb.db.mpp.execution.executor.RegionWriteExecutor$WritePlanNodeExecutionVisitor.visitCreateMultiTimeSeries(RegionWriteExecutor.java:373)
        at org.apache.iotdb.db.mpp.execution.executor.RegionWriteExecutor$WritePlanNodeExecutionVisitor.visitCreateMultiTimeSeries(RegionWriteExecutor.java:119)
        at org.apache.iotdb.db.mpp.plan.planner.plan.node.metedata.write.CreateMultiTimeSeriesNode.accept(CreateMultiTimeSeriesNode.java:156)
        at org.apache.iotdb.db.mpp.execution.executor.RegionWriteExecutor.execute(RegionWriteExecutor.java:85)
        at org.apache.iotdb.db.service.thrift.impl.DataNodeInternalRPCServiceImpl.sendPlanNode(DataNodeInternalRPCServiceImpl.java:283)
        at org.apache.iotdb.mpp.rpc.thrift.IDataNodeRPCService$Processor$sendPlanNode.getResult(IDataNodeRPCService.java:3607)
        at org.apache.iotdb.mpp.rpc.thrift.IDataNodeRPCService$Processor$sendPlanNode.getResult(IDataNodeRPCService.java:3587)
        at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:38)
        at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:38)
        at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:248)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.ratis.protocol.exceptions.LeaderSteppingDownException: 3@group-000200000007 is stepping down
        at org.apache.ratis.server.impl.RaftServerImpl.checkLeaderState(RaftServerImpl.java:708)
        at org.apache.ratis.server.impl.RaftServerImpl.submitClientRequestAsync(RaftServerImpl.java:832)
        at org.apache.ratis.server.impl.RaftServerImpl.lambda$null$12(RaftServerImpl.java:815)
        at org.apache.ratis.util.JavaUtils.callAsUnchecked(JavaUtils.java:117)
        at org.apache.ratis.server.impl.RaftServerImpl.lambda$executeSubmitClientRequestAsync$13(RaftServerImpl.java:815)
        at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1590)
        ... 3 common frames omitted

> [Cluster][ratis]cannot dispatch FI for write operation
> ------------------------------------------------------
>
>                 Key: IOTDB-3944
>                 URL: https://issues.apache.org/jira/browse/IOTDB-3944
>             Project: Apache IoTDB
>          Issue Type: Bug
>          Components: Core/Cluster
>    Affects Versions: 0.14.0-SNAPSHOT
>            Reporter: FengQingxin
>            Assignee: Jinrui Zhang
>            Priority: Major
>         Attachments: 0816更新报错日志.zip, 20221012-logs.zip, conf_ConfigNode.zip, conf_Datanode.zip, image-2022-07-25-11-24-07-874.png, image-2022-10-12-12-21-25-898.png, logs_ConfigNode.zip, logs_Datanode.zip
>
>
> commit bd1894fb72e85b152dd412afca8a7e6b97ad769e
> Author: Zhang.Jinrui <xi...@gmail.com>
> Date:   Mon Jul 25 10:12:17 2022 +0800
>     fix the potential issue for StateTracker that it cannot be terminated sometimes (#6755)
>  
> Reproduce steps:
>  # Setup a cluster with 3C3D(Ratis)
>  # Using 3BMs to insert data
> BM    -----  》  IoTDB Node
> 172.20.70.7    -----  》 172.20.70.22
> 172.20.70.8    -----  》 172.20.70.23
> 172.20.70.9    -----  》 172.20.70.24
>  3. got an error in bm and iotdb
> 2022-07-25 11:21:53,022 [20220725_032152_65483_3-92] ERROR o.a.i.d.m.p.s.FragmentInstanceDispatcherImpl:125 - cannot dispatch FI for write operation
> java.lang.NullPointerException: null
> 2022-07-25 11:21:53,062 [20220725_032152_65523_3-311] ERROR o.a.i.d.m.p.s.FragmentInstanceDispatcherImpl:125 - cannot dispatch FI for write operation
> java.lang.NullPointerException: null
> 2022-07-25 11:21:53,064 [20220725_032152_65514_3-100] ERROR o.a.i.d.m.p.s.FragmentInstanceDispatcherImpl:125 - cannot dispatch FI for write operation
> java.lang.NullPointerException: null
> 2022-07-25 11:21:53,096 [20220725_032152_65509_3-84] ERROR o.a.i.d.m.p.s.FragmentInstanceDispatcherImpl:125 - cannot dispatch FI for write operation
> java.lang.NullPointerException: null
> 2022-07-25 11:21:53,129 [20220725_032152_65517_3-303] ERROR o.a.i.d.m.p.s.FragmentInstanceDispatcherImpl:125 - cannot dispatch FI for write operation
> java.lang.NullPointerException: null
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)