You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@iotdb.apache.org by "changxue (Jira)" <ji...@apache.org> on 2023/01/31 02:53:00 UTC

[jira] [Commented] (IOTDB-5441) [session]insert data failed to timeseries using aligned template when the data schema is more than template define, MetadataException: nullnull

    [ https://issues.apache.org/jira/browse/IOTDB-5441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17682355#comment-17682355 ] 

changxue commented on IOTDB-5441:
---------------------------------

1. 我定义了一个aligned template: aligned_template, 绑定到 root.blendAddTS.alignedUsingTemp
2. insert tablet 成功, schema 与定义的一致
3. 再次insert data,数据结构比定义的多一个 float ,报错。

下列方法我都使用过,代码中有,表现一致:
1. 使用 insertAlignedStringRecordsOfOneDevice
2. 使用 insertAlignedRecord
3. 使用tablet

> [session]insert data failed to timeseries using aligned template when the data schema is more than template define, MetadataException: nullnull
> -----------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: IOTDB-5441
>                 URL: https://issues.apache.org/jira/browse/IOTDB-5441
>             Project: Apache IoTDB
>          Issue Type: Bug
>          Components: Client/Java
>    Affects Versions: 1.1.0
>            Reporter: changxue
>            Assignee: Yukun Zhou
>            Priority: Major
>         Attachments: IOTDB5441.tar.gz
>
>
> build:
> master branch
> commit 315d6526fae06b634e99a4dbe0e3a3127163c8f1
> Date:   Sun Jan 29 23:58:36 2023 +0800
>     Use gitbox to accelerate the picture loading (#8918)
> reproduction:
> 1. start a standalone service with default config
> 2. execute the java test ng codes . notice this method of testUpdateAfterAddTS_alignedTemp 
> notice:
> the inserting data schema is more than template defied: appendFloat 
> datanode error log:
> {code}
> 2023-01-30 17:56:39,584 [1@group-0002000000C6-LeaderElection13] INFO  o.a.r.s.r.s.SegmentedRaftLogWorker:452 - 1@group-0002000000C6-SegmentedRaftLogWorker: Starting segment from index:0 
> 2023-01-30 17:56:39,587 [1@group-0002000000C6-LeaderElection13] INFO  o.a.r.s.impl.ServerState:430 - 1@group-0002000000C6: set configuration 0: peers:[1|rpc:127.0.0.1:10750|admin:|client:|dataStream:|priority:0|startupRole:FOLLOWER]|listeners:[], old=null 
> 2023-01-30 17:56:39,588 [1@group-0002000000C6-SegmentedRaftLogWorker] INFO  o.a.r.s.r.s.SegmentedRaftLogWorker$StartLogSegment:656 - 1@group-0002000000C6-SegmentedRaftLogWorker: created new log segment /Users/changxue/work/soft/apache-iotdb-1.1.0-SNAPSHOT-all-bin/sbin/./../data/datanode/consensus/schema_region/47474747-4747-4747-4747-0002000000c6/current/log_inprogress_0 
> 2023-01-30 17:56:39,722 [pool-25-IoTDB-ClientRPC-Processor-8$20230130_080023_01035_1.1.0] INFO  o.a.i.d.e.s.TsFileProcessor:193 - create a new tsfile processor /Users/changxue/work/soft/apache-iotdb-1.1.0-SNAPSHOT-all-bin/sbin/./../data/datanode/data/sequence/root.blendAddTS/197/2759/1675072599720-1-0-0.tsfile 
> 2023-01-30 17:56:39,821 [Query-Worker-Thread-1$20230130_080023_01041_1.1.0.0] ERROR o.a.i.d.m.e.o.s.SchemaFetchScanOperator:92 - Error occurred during execute SchemaFetchOperator 3 
> org.apache.iotdb.commons.exception.MetadataException: nullnull
> 	at org.apache.iotdb.db.metadata.mtree.traverser.Traverser.traverse(Traverser.java:95)
> 	at org.apache.iotdb.db.metadata.mtree.MTreeBelowSGMemoryImpl.fetchSchema(MTreeBelowSGMemoryImpl.java:648)
> 	at org.apache.iotdb.db.metadata.schemaregion.SchemaRegionMemoryImpl.fetchSchema(SchemaRegionMemoryImpl.java:841)
> 	at org.apache.iotdb.db.mpp.execution.operator.schema.SchemaFetchScanOperator.fetchSchema(SchemaFetchScanOperator.java:116)
> 	at org.apache.iotdb.db.mpp.execution.operator.schema.SchemaFetchScanOperator.next(SchemaFetchScanOperator.java:90)
> 	at org.apache.iotdb.db.mpp.execution.operator.Operator.nextWithTimer(Operator.java:46)
> 	at org.apache.iotdb.db.mpp.execution.operator.schema.SchemaFetchMergeOperator.next(SchemaFetchMergeOperator.java:76)
> 	at org.apache.iotdb.db.mpp.execution.operator.Operator.nextWithTimer(Operator.java:46)
> 	at org.apache.iotdb.db.mpp.execution.driver.Driver.processInternal(Driver.java:204)
> 	at org.apache.iotdb.db.mpp.execution.driver.Driver.lambda$processFor$1(Driver.java:136)
> 	at org.apache.iotdb.db.mpp.execution.driver.Driver.tryWithLock(Driver.java:291)
> 	at org.apache.iotdb.db.mpp.execution.driver.Driver.processFor(Driver.java:117)
> 	at org.apache.iotdb.db.mpp.execution.schedule.DriverTaskThread.execute(DriverTaskThread.java:69)
> 	at org.apache.iotdb.db.mpp.execution.schedule.AbstractDriverThread.run(AbstractDriverThread.java:73)
> 2023-01-30 17:56:39,826 [Query-Worker-Thread-1$20230130_080023_01041_1.1.0.0] WARN  o.a.i.d.m.e.s.AbstractDriverThread:79 - [ExecuteFailed] 
> java.lang.RuntimeException: org.apache.iotdb.commons.exception.MetadataException: nullnull
> 	at org.apache.iotdb.db.mpp.execution.operator.schema.SchemaFetchScanOperator.next(SchemaFetchScanOperator.java:93)
> 	at org.apache.iotdb.db.mpp.execution.operator.Operator.nextWithTimer(Operator.java:46)
> 	at org.apache.iotdb.db.mpp.execution.operator.schema.SchemaFetchMergeOperator.next(SchemaFetchMergeOperator.java:76)
> 	at org.apache.iotdb.db.mpp.execution.operator.Operator.nextWithTimer(Operator.java:46)
> 	at org.apache.iotdb.db.mpp.execution.driver.Driver.processInternal(Driver.java:204)
> 	at org.apache.iotdb.db.mpp.execution.driver.Driver.lambda$processFor$1(Driver.java:136)
> 	at org.apache.iotdb.db.mpp.execution.driver.Driver.tryWithLock(Driver.java:291)
> 	at org.apache.iotdb.db.mpp.execution.driver.Driver.processFor(Driver.java:117)
> 	at org.apache.iotdb.db.mpp.execution.schedule.DriverTaskThread.execute(DriverTaskThread.java:69)
> 	at org.apache.iotdb.db.mpp.execution.schedule.AbstractDriverThread.run(AbstractDriverThread.java:73)
> Caused by: org.apache.iotdb.commons.exception.MetadataException: nullnull
> 	at org.apache.iotdb.db.metadata.mtree.traverser.Traverser.traverse(Traverser.java:95)
> 	at org.apache.iotdb.db.metadata.mtree.MTreeBelowSGMemoryImpl.fetchSchema(MTreeBelowSGMemoryImpl.java:648)
> 	at org.apache.iotdb.db.metadata.schemaregion.SchemaRegionMemoryImpl.fetchSchema(SchemaRegionMemoryImpl.java:841)
> 	at org.apache.iotdb.db.mpp.execution.operator.schema.SchemaFetchScanOperator.fetchSchema(SchemaFetchScanOperator.java:116)
> 	at org.apache.iotdb.db.mpp.execution.operator.schema.SchemaFetchScanOperator.next(SchemaFetchScanOperator.java:90)
> 	... 9 common frames omitted
> 2023-01-30 17:56:39,830 [pool-25-IoTDB-ClientRPC-Processor-8] WARN  o.a.i.d.u.ErrorHandlingUtils:89 - Status code: 507, Query Statement: "select appendFloat from root.blendAddTS.alignedUsingTemp where time=1669109508000;". executeStatement failed 
> java.lang.RuntimeException: Fetch Schema failed. 
> 	at org.apache.iotdb.db.mpp.plan.analyze.schema.ClusterSchemaFetchExecutor.executeSchemaFetchQuery(ClusterSchemaFetchExecutor.java:173)
> 	at org.apache.iotdb.db.mpp.plan.analyze.schema.ClusterSchemaFetchExecutor.fetchSchemaOfPreciseMatch(ClusterSchemaFetchExecutor.java:98)
> 	at org.apache.iotdb.db.mpp.plan.analyze.schema.ClusterSchemaFetcher.fetchSchema(ClusterSchemaFetcher.java:142)
> 	at org.apache.iotdb.db.mpp.plan.analyze.schema.ClusterSchemaFetcher.fetchSchema(ClusterSchemaFetcher.java:51)
> 	at org.apache.iotdb.db.mpp.plan.analyze.AnalyzeVisitor.visitQuery(AnalyzeVisitor.java:225)
> 	at org.apache.iotdb.db.mpp.plan.analyze.AnalyzeVisitor.visitQuery(AnalyzeVisitor.java:177)
> 	at org.apache.iotdb.db.mpp.plan.statement.crud.QueryStatement.accept(QueryStatement.java:523)
> 	at org.apache.iotdb.db.mpp.plan.statement.StatementVisitor.process(StatementVisitor.java:113)
> 	at org.apache.iotdb.db.mpp.plan.analyze.Analyzer.analyze(Analyzer.java:48)
> 	at org.apache.iotdb.db.mpp.plan.execution.QueryExecution.analyze(QueryExecution.java:263)
> 	at org.apache.iotdb.db.mpp.plan.execution.QueryExecution.<init>(QueryExecution.java:147)
> 	at org.apache.iotdb.db.mpp.plan.Coordinator.createQueryExecution(Coordinator.java:107)
> 	at org.apache.iotdb.db.mpp.plan.Coordinator.execute(Coordinator.java:140)
> 	at org.apache.iotdb.db.service.thrift.impl.ClientRPCServiceImpl.executeStatementInternal(ClientRPCServiceImpl.java:217)
> 	at org.apache.iotdb.db.service.thrift.impl.ClientRPCServiceImpl.executeStatementV2(ClientRPCServiceImpl.java:411)
> 	at org.apache.iotdb.db.service.thrift.impl.ClientRPCServiceImpl.executeQueryStatementV2(ClientRPCServiceImpl.java:401)
> 	at org.apache.iotdb.service.rpc.thrift.IClientRPCService$Processor$executeQueryStatementV2.getResult(IClientRPCService.java:3459)
> 	at org.apache.iotdb.service.rpc.thrift.IClientRPCService$Processor$executeQueryStatementV2.getResult(IClientRPCService.java:3439)
> 	at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:38)
> 	at org.apache.iotdb.db.service.thrift.ProcessorWithMetrics.process(ProcessorWithMetrics.java:64)
> 	at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:248)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> 	at java.lang.Thread.run(Thread.java:750)
> Caused by: org.apache.iotdb.commons.exception.IoTDBException: java.lang.RuntimeException: org.apache.iotdb.commons.exception.MetadataException: nullnull
> 	at org.apache.iotdb.db.mpp.plan.execution.QueryExecution.dealWithException(QueryExecution.java:445)
> 	at org.apache.iotdb.db.mpp.plan.execution.QueryExecution.getResult(QueryExecution.java:428)
> 	at org.apache.iotdb.db.mpp.plan.execution.QueryExecution.getBatchResult(QueryExecution.java:454)
> 	at org.apache.iotdb.db.mpp.plan.analyze.schema.ClusterSchemaFetchExecutor.executeSchemaFetchQuery(ClusterSchemaFetchExecutor.java:171)
> 	... 23 common frames omitted
> Caused by: java.lang.RuntimeException: org.apache.iotdb.commons.exception.MetadataException: nullnull
> 	at org.apache.iotdb.db.mpp.execution.operator.schema.SchemaFetchScanOperator.next(SchemaFetchScanOperator.java:93)
> 	at org.apache.iotdb.db.mpp.execution.operator.Operator.nextWithTimer(Operator.java:46)
> 	at org.apache.iotdb.db.mpp.execution.operator.schema.SchemaFetchMergeOperator.next(SchemaFetchMergeOperator.java:76)
> 	at org.apache.iotdb.db.mpp.execution.operator.Operator.nextWithTimer(Operator.java:46)
> 	at org.apache.iotdb.db.mpp.execution.driver.Driver.processInternal(Driver.java:204)
> 	at org.apache.iotdb.db.mpp.execution.driver.Driver.lambda$processFor$1(Driver.java:136)
> 	at org.apache.iotdb.db.mpp.execution.driver.Driver.tryWithLock(Driver.java:291)
> 	at org.apache.iotdb.db.mpp.execution.driver.Driver.processFor(Driver.java:117)
> 	at org.apache.iotdb.db.mpp.execution.schedule.DriverTaskThread.execute(DriverTaskThread.java:69)
> 	at org.apache.iotdb.db.mpp.execution.schedule.AbstractDriverThread.run(AbstractDriverThread.java:73)
> Caused by: org.apache.iotdb.commons.exception.MetadataException: nullnull
> 	at org.apache.iotdb.db.metadata.mtree.traverser.Traverser.traverse(Traverser.java:95)
> 	at org.apache.iotdb.db.metadata.mtree.MTreeBelowSGMemoryImpl.fetchSchema(MTreeBelowSGMemoryImpl.java:648)
> 	at org.apache.iotdb.db.metadata.schemaregion.SchemaRegionMemoryImpl.fetchSchema(SchemaRegionMemoryImpl.java:841)
> 	at org.apache.iotdb.db.mpp.execution.operator.schema.SchemaFetchScanOperator.fetchSchema(SchemaFetchScanOperator.java:116)
> 	at org.apache.iotdb.db.mpp.execution.operator.schema.SchemaFetchScanOperator.next(SchemaFetchScanOperator.java:90)
> 	... 9 common frames omitted
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)