You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@iotdb.apache.org by "Yukun Zhou (Jira)" <ji...@apache.org> on 2022/11/02 01:26:00 UTC
[jira] [Commented] (IOTDB-4632) [ MetaData ] org.apache.iotdb.db.exception.metadata.MeasurementAlreadyExistException: Path [xx] already exist
[ https://issues.apache.org/jira/browse/IOTDB-4632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17627408#comment-17627408 ]
Yukun Zhou commented on IOTDB-4632:
-----------------------------------
复测结果中发生了10次的ratis转发的重试，导致产生了100w条序列已存在的报错日志。
> [ MetaData ] org.apache.iotdb.db.exception.metadata.MeasurementAlreadyExistException: Path [xx] already exist
> -------------------------------------------------------------------------------------------------------------
>
> Key: IOTDB-4632
> URL: https://issues.apache.org/jira/browse/IOTDB-4632
> Project: Apache IoTDB
> Issue Type: Bug
> Components: mpp-cluster
> Affects Versions: 0.14.0-SNAPSHOT
> Reporter: 刘珍
> Assignee: Yukun Zhou
> Priority: Major
> Attachments: more_ts.conf, screenshot-1.png
>
>
> master_1010_9917053
> schema region ： ratis
> 3副本
> 500dev，10万sensor/dev , enable_auto_create_schema=false
> 注册元数据，大量ERROR，部分dev没注册成功（ratis 超时？超时时间需可配置）
> ERROR 信息：
> 2022-10-13 11:37:36,676 [192.168.10.62_50010@group-000200000001-StateMachineUpdater] ERROR o.a.i.d.m.v.SchemaExecutionVisitor:109 - IoTDB: MetaData error:
> org.apache.iotdb.db.exception.metadata.MeasurementAlreadyExistException: Path [root.test.g_1.d_221.s_48893] already exist
> at org.apache.iotdb.db.metadata.mtree.MTreeBelowSGMemoryImpl.createTimeseries(MTreeBelowSGMemoryImpl.java:218)
> at org.apache.iotdb.db.metadata.schemaregion.SchemaRegionMemoryImpl.createTimeseries(SchemaRegionMemoryImpl.java:622)
> at org.apache.iotdb.db.metadata.visitor.SchemaExecutionVisitor.visitCreateMultiTimeSeries(SchemaExecutionVisitor.java:106)
> at org.apache.iotdb.db.metadata.visitor.SchemaExecutionVisitor.visitCreateMultiTimeSeries(SchemaExecutionVisitor.java:63)
> at org.apache.iotdb.db.mpp.plan.planner.plan.node.metedata.write.CreateMultiTimeSeriesNode.accept(CreateMultiTimeSeriesNode.java:141)
> at org.apache.iotdb.db.consensus.statemachine.SchemaRegionStateMachine.write(SchemaRegionStateMachine.java:74)
> at org.apache.iotdb.consensus.ratis.ApplicationStateMachineProxy.applyTransaction(ApplicationStateMachineProxy.java:135)
> at org.apache.ratis.server.impl.RaftServerImpl.applyLogToStateMachine(RaftServerImpl.java:1588)
> at org.apache.ratis.server.impl.StateMachineUpdater.applyLog(StateMachineUpdater.java:239)
> at org.apache.ratis.server.impl.StateMachineUpdater.run(StateMachineUpdater.java:182)
> at java.lang.Thread.run(Thread.java:748)
> 测试环境
> 1. 192.168.10.62/66/68 物理机 72CPU 256GB
> bm在64
> ConfigNode
> MAX_HEAP_SIZE="8G"
> MAX_DIRECT_MEMORY_SIZE="8G"
> schema_region_consensus_protocol_class=org.apache.iotdb.consensus.ratis.RatisConsensus
> data_region_consensus_protocol_class=org.apache.iotdb.consensus.multileader.MultiLeaderConsensus
> schema_replication_factor=3
> data_replication_factor=3
> connection_timeout_ms=1200000
> DataNode
> MAX_HEAP_SIZE="192G"
> MAX_DIRECT_MEMORY_SIZE="32G"
> connection_timeout_ms=1200000
> max_connection_for_internal_service=1100
> enable_timed_flush_seq_memtable=true
> seq_memtable_flush_interval_in_ms=3600000
> seq_memtable_flush_check_interval_in_ms=600000
> enable_timed_flush_unseq_memtable=true
> unseq_memtable_flush_interval_in_ms=3600000
> unseq_memtable_flush_check_interval_in_ms=600000
> max_waiting_time_when_insert_blocked=3600000
> query_timeout_threshold=36000000
> enable_auto_create_schema=false
> 2. bm配置见附件
--
This message was sent by Atlassian Jira
(v8.20.10#820010)