You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@iotdb.apache.org by "刘珍 (Jira)" <ji...@apache.org> on 2022/11/07 06:20:00 UTC

[jira] [Created] (IOTDB-4860) [ ClusterSchemaFetcher ] NPE

刘珍 created IOTDB-4860:
-------------------------

             Summary: [ ClusterSchemaFetcher ] NPE
                 Key: IOTDB-4860
                 URL: https://issues.apache.org/jira/browse/IOTDB-4860
             Project: Apache IoTDB
          Issue Type: Bug
          Components: mpp-cluster
    Affects Versions: 0.14.0-SNAPSHOT
            Reporter: 刘珍
            Assignee: Yukun Zhou


m_1103_f857667
schema_region_consensus_protocol_class=org.apache.iotdb.consensus.ratis.RatisConsensus
data_region_consensus_protocol_class=org.apache.iotdb.consensus.multileader.MultiLeaderConsensus

1. 启动3C21D 集群
2. 启动7个benchmark 连集群 写入数据(配置见附件)
ClusterSchemaFetcher 报NPE :
2022-11-06 22:05:36,816 [pool-22-IoTDB-DataNodeInternalRPC-Processor-661] ERROR o.a.t.ProcessFunction:47 - Internal error processing sendPlanNode 
java.lang.NullPointerException: null
	at org.apache.iotdb.db.mpp.plan.analyze.ClusterSchemaFetcher.executeInternalCreateTimeseriesStatement(ClusterSchemaFetcher.java:490)
	at org.apache.iotdb.db.mpp.plan.analyze.ClusterSchemaFetcher.internalCreateTimeseries(ClusterSchemaFetcher.java:447)
	at org.apache.iotdb.db.mpp.plan.analyze.ClusterSchemaFetcher.checkAndAutoCreateMissingMeasurements(ClusterSchemaFetcher.java:409)
	at org.apache.iotdb.db.mpp.plan.analyze.ClusterSchemaFetcher.fetchSchemaWithAutoCreate(ClusterSchemaFetcher.java:212)
	at org.apache.iotdb.db.mpp.plan.analyze.SchemaValidator.validate(SchemaValidator.java:56)
	at org.apache.iotdb.db.mpp.execution.executor.RegionWriteExecutor$WritePlanNodeExecutionVisitor.executeDataInsert(RegionWriteExecutor.java:192)
	at org.apache.iotdb.db.mpp.execution.executor.RegionWriteExecutor$WritePlanNodeExecutionVisitor.visitInsertTablet(RegionWriteExecutor.java:164)
	at org.apache.iotdb.db.mpp.execution.executor.RegionWriteExecutor$WritePlanNodeExecutionVisitor.visitInsertTablet(RegionWriteExecutor.java:118)
	at org.apache.iotdb.db.mpp.plan.planner.plan.node.write.InsertTabletNode.accept(InsertTabletNode.java:1086)
	at org.apache.iotdb.db.mpp.execution.executor.RegionWriteExecutor.execute(RegionWriteExecutor.java:84)
	at org.apache.iotdb.db.service.thrift.impl.DataNodeInternalRPCServiceImpl.sendPlanNode(DataNodeInternalRPCServiceImpl.java:282)
	at org.apache.iotdb.mpp.rpc.thrift.IDataNodeRPCService$Processor$sendPlanNode.getResult(IDataNodeRPCService.java:3607)
	at org.apache.iotdb.mpp.rpc.thrift.IDataNodeRPCService$Processor$sendPlanNode.getResult(IDataNodeRPCService.java:3587)
	at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:38)
	at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:38)
	at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:248)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	at java.base/java.lang.Thread.run(Thread.java:834)

测试环境 私有云1期 8CPU 32GB
1. 172.16.2.2 ~ 25
DataNode 在2~22
ConfigNode 在23~25
benchmark在26~32

ConfigNode
MAX_HEAP_SIZE="20G"
MAX_DIRECT_MEMORY_SIZE="6G"

Common 
schema_region_consensus_protocol_class=org.apache.iotdb.consensus.ratis.RatisConsensus
data_region_consensus_protocol_class=org.apache.iotdb.consensus.multileader.MultiLeaderConsensus
schema_replication_factor=3
data_replication_factor=3
enable_seq_space_compaction=false
enable_unseq_space_compaction=false
enable_cross_space_compaction=false
data_region_per_processor=1
series_partition_slot_num=20000

DataNode
MAX_HEAP_SIZE="20G"
MAX_DIRECT_MEMORY_SIZE="6G"

2. benchmark 配置见附件
主要配置(下面是1个bm的配置,一共7个):
GROUP_NUMBER=1
DEVICE_NUMBER=3000
SENSOR_NUMBER=600

OPERATION_PROPORTION=1:0:0:0:0:0:0:0:0:0:0
CLIENT_NUMBER=90
LOOP=10000
BATCH_SIZE_PER_WRITE=10





--
This message was sent by Atlassian Jira
(v8.20.10#820010)