You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@iotdb.apache.org by "刘珍 (Jira)" <ji...@apache.org> on 2022/11/10 03:58:00 UTC
[jira] [Commented] (IOTDB-4860) [ ClusterSchemaFetcher ] NPE
[ https://issues.apache.org/jira/browse/IOTDB-4860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17631436#comment-17631436 ]
刘珍 commented on IOTDB-4860:
---------------------------
1109_87a416e 复测 ，补充下面的异常信息：
2022-11-10 00:20:38,491 [pool-22-IoTDB-DataNodeInternalRPC-Processor-158] ERROR o.a.t.ProcessFunction:47 - Internal error processing sendPlanNode
java.lang.IndexOutOfBoundsException: Index 300 out of bounds for length 300
at java.base/jdk.internal.util.Preconditions.outOfBounds(Preconditions.java:64)
at java.base/jdk.internal.util.Preconditions.outOfBoundsCheckIndex(Preconditions.java:70)
at java.base/jdk.internal.util.Preconditions.checkIndex(Preconditions.java:248)
at java.base/java.util.Objects.checkIndex(Objects.java:372)
at java.base/java.util.ArrayList.remove(ArrayList.java:536)
at org.apache.iotdb.db.mpp.plan.planner.plan.node.metedata.write.MeasurementGroup.removeMeasurement(MeasurementGroup.java:122)
at org.apache.iotdb.db.mpp.execution.executor.RegionWriteExecutor$WritePlanNodeExecutionVisitor.visitInternalCreateTimeSeries(RegionWriteExecutor.java:438)
at org.apache.iotdb.db.mpp.execution.executor.RegionWriteExecutor$WritePlanNodeExecutionVisitor.visitInternalCreateTimeSeries(RegionWriteExecutor.java:118)
at org.apache.iotdb.db.mpp.plan.planner.plan.node.metedata.write.InternalCreateTimeSeriesNode.accept(InternalCreateTimeSeriesNode.java:105)
at org.apache.iotdb.db.mpp.execution.executor.RegionWriteExecutor.execute(RegionWriteExecutor.java:84)
at org.apache.iotdb.db.service.thrift.impl.DataNodeInternalRPCServiceImpl.sendPlanNode(DataNodeInternalRPCServiceImpl.java:282)
at org.apache.iotdb.mpp.rpc.thrift.IDataNodeRPCService$Processor$sendPlanNode.getResult(IDataNodeRPCService.java:3607)
at org.apache.iotdb.mpp.rpc.thrift.IDataNodeRPCService$Processor$sendPlanNode.getResult(IDataNodeRPCService.java:3587)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:38)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:38)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:248)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:834)
> [ ClusterSchemaFetcher ] NPE
> ----------------------------
>
> Key: IOTDB-4860
> URL: https://issues.apache.org/jira/browse/IOTDB-4860
> Project: Apache IoTDB
> Issue Type: Bug
> Components: mpp-cluster
> Affects Versions: 0.14.0-SNAPSHOT
> Reporter: 刘珍
> Assignee: Yukun Zhou
> Priority: Major
> Attachments: ip26.conf, ip27.conf, ip28.conf, ip29.conf, ip30.conf, ip31.conf, ip32.conf
>
>
> m_1103_f857667
> schema_region_consensus_protocol_class=org.apache.iotdb.consensus.ratis.RatisConsensus
> data_region_consensus_protocol_class=org.apache.iotdb.consensus.multileader.MultiLeaderConsensus
> 1. 启动3C21D 集群
> 2. 启动7个benchmark 连集群 写入数据（配置见附件）
> ClusterSchemaFetcher 报NPE ：
> 2022-11-06 22:05:36,816 [pool-22-IoTDB-DataNodeInternalRPC-Processor-661] ERROR o.a.t.ProcessFunction:47 - Internal error processing sendPlanNode
> java.lang.NullPointerException: null
> at org.apache.iotdb.db.mpp.plan.analyze.ClusterSchemaFetcher.executeInternalCreateTimeseriesStatement(ClusterSchemaFetcher.java:490)
> at org.apache.iotdb.db.mpp.plan.analyze.ClusterSchemaFetcher.internalCreateTimeseries(ClusterSchemaFetcher.java:447)
> at org.apache.iotdb.db.mpp.plan.analyze.ClusterSchemaFetcher.checkAndAutoCreateMissingMeasurements(ClusterSchemaFetcher.java:409)
> at org.apache.iotdb.db.mpp.plan.analyze.ClusterSchemaFetcher.fetchSchemaWithAutoCreate(ClusterSchemaFetcher.java:212)
> at org.apache.iotdb.db.mpp.plan.analyze.SchemaValidator.validate(SchemaValidator.java:56)
> at org.apache.iotdb.db.mpp.execution.executor.RegionWriteExecutor$WritePlanNodeExecutionVisitor.executeDataInsert(RegionWriteExecutor.java:192)
> at org.apache.iotdb.db.mpp.execution.executor.RegionWriteExecutor$WritePlanNodeExecutionVisitor.visitInsertTablet(RegionWriteExecutor.java:164)
> at org.apache.iotdb.db.mpp.execution.executor.RegionWriteExecutor$WritePlanNodeExecutionVisitor.visitInsertTablet(RegionWriteExecutor.java:118)
> at org.apache.iotdb.db.mpp.plan.planner.plan.node.write.InsertTabletNode.accept(InsertTabletNode.java:1086)
> at org.apache.iotdb.db.mpp.execution.executor.RegionWriteExecutor.execute(RegionWriteExecutor.java:84)
> at org.apache.iotdb.db.service.thrift.impl.DataNodeInternalRPCServiceImpl.sendPlanNode(DataNodeInternalRPCServiceImpl.java:282)
> at org.apache.iotdb.mpp.rpc.thrift.IDataNodeRPCService$Processor$sendPlanNode.getResult(IDataNodeRPCService.java:3607)
> at org.apache.iotdb.mpp.rpc.thrift.IDataNodeRPCService$Processor$sendPlanNode.getResult(IDataNodeRPCService.java:3587)
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:38)
> at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:38)
> at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:248)
> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at java.base/java.lang.Thread.run(Thread.java:834)
> 测试环境 私有云1期 8CPU 32GB
> 1. 172.16.2.2 ~ 25
> DataNode 在2~22
> ConfigNode 在23~25
> benchmark在26~32
> ConfigNode
> MAX_HEAP_SIZE="20G"
> MAX_DIRECT_MEMORY_SIZE="6G"
> Common
> schema_region_consensus_protocol_class=org.apache.iotdb.consensus.ratis.RatisConsensus
> data_region_consensus_protocol_class=org.apache.iotdb.consensus.multileader.MultiLeaderConsensus
> schema_replication_factor=3
> data_replication_factor=3
> enable_seq_space_compaction=false
> enable_unseq_space_compaction=false
> enable_cross_space_compaction=false
> data_region_per_processor=1
> series_partition_slot_num=20000
> DataNode
> MAX_HEAP_SIZE="20G"
> MAX_DIRECT_MEMORY_SIZE="6G"
> 2. benchmark 配置见附件
> 主要配置（下面是1个bm的配置，一共7个）：
> GROUP_NUMBER=1
> DEVICE_NUMBER=3000
> SENSOR_NUMBER=600
> OPERATION_PROPORTION=1:0:0:0:0:0:0:0:0:0:0
> CLIENT_NUMBER=90
> LOOP=10000
> BATCH_SIZE_PER_WRITE=10
> 启动benchmark 脚本顺序：
> start_bm ${bm1}
> sleep 2
> start_bm ${bm2}
> sleep 2
> start_bm ${bm3}
> sleep 2
> start_bm ${bm4}
> sleep 2
> start_bm ${bm5}
> sleep 2
> start_bm ${bm6}
> sleep 2
> start_bm ${bm7}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)