You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@iotdb.apache.org by "刘珍 (Jira)" <ji...@apache.org> on 2023/01/11 01:46:00 UTC
[jira] [Assigned] (IOTDB-5394) Error happened while reading tsfile from position xxxxx
[ https://issues.apache.org/jira/browse/IOTDB-5394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
刘珍 reassigned IOTDB-5394:
-------------------------
Assignee: 刘珍 (was: Haonan Hou)
> Error happened while reading tsfile from position xxxxx
> -------------------------------------------------------
>
> Key: IOTDB-5394
> URL: https://issues.apache.org/jira/browse/IOTDB-5394
> Project: Apache IoTDB
> Issue Type: Bug
> Components: mpp-cluster
> Affects Versions: 1.0.1
> Reporter: 刘珍
> Assignee: 刘珍
> Priority: Major
> Attachments: 1673348664765-22224-0-0.tsfile, lt_fast.conf
>
>
> rc/1.0.1 2023-01-07_09dd173
> IoT协议，读tsfile 报错 (见附件）
> 2023-01-11 00:03:34,583 [Query-Worker-Thread-44$20230110_160324_67079_3.1.0] ERROR o.a.i.t.r.r.LocalTsFileInput:101 - {color:#DE350B}*Error happened while reading /data/mpp_test/r_0107_09dd173/sbin/../data/datanode/data/unsequence/root.test.g_0/51/2538/1673348664765-22224-0-0.tsfile from position 490728*{color}
> 2023-01-11 00:03:34,584 [Query-Worker-Thread-44$20230110_160324_67079_3.1.0] ERROR o.a.i.d.e.c.ChunkCache:80 - Something wrong happened in reading measurementId: s_501, datatype: FLOAT, version: 22224, Statistics: startTime: 1535559503187 endTime: 1535564087240 count: 10 [minValue:49.9543,maxValue:50.01069,firstValue:49.970222,lastValue:49.96979,sumValue:499.8036880493164], deleteIntervalList: null, filePath: /data/mpp_test/r_0107_09dd173/sbin/../data/datanode/data/unsequence/root.test.g_0/51/2538/1673348664765-22224-0-0.tsfile
> java.nio.channels.ClosedChannelException: null
> at java.base/sun.nio.ch.FileChannelImpl.ensureOpen(FileChannelImpl.java:150)
> at java.base/sun.nio.ch.FileChannelImpl.read(FileChannelImpl.java:790)
> at org.apache.iotdb.tsfile.read.reader.LocalTsFileInput.read(LocalTsFileInput.java:95)
> at org.apache.iotdb.tsfile.utils.ReadWriteIOUtils.readAsPossible(ReadWriteIOUtils.java:806)
> at org.apache.iotdb.tsfile.read.TsFileSequenceReader.readData(TsFileSequenceReader.java:1448)
> at org.apache.iotdb.tsfile.read.TsFileSequenceReader.readChunk(TsFileSequenceReader.java:1268)
> at org.apache.iotdb.tsfile.read.TsFileSequenceReader.readMemChunk(TsFileSequenceReader.java:1286)
> at org.apache.iotdb.db.engine.cache.ChunkCache.lambda$new$1(ChunkCache.java:78)
> at com.github.benmanes.caffeine.cache.LocalLoadingCache.lambda$newMappingFunction$2(LocalLoadingCache.java:145)
> at com.github.benmanes.caffeine.cache.LocalCache.lambda$statsAware$0(LocalCache.java:139)
> at com.github.benmanes.caffeine.cache.BoundedLocalCache.lambda$doComputeIfAbsent$14(BoundedLocalCache.java:2406)
> at java.base/java.util.concurrent.ConcurrentHashMap.compute(ConcurrentHashMap.java:1947)
> at com.github.benmanes.caffeine.cache.BoundedLocalCache.doComputeIfAbsent(BoundedLocalCache.java:2404)
> at com.github.benmanes.caffeine.cache.BoundedLocalCache.computeIfAbsent(BoundedLocalCache.java:2387)
> at com.github.benmanes.caffeine.cache.LocalCache.computeIfAbsent(LocalCache.java:108)
> at com.github.benmanes.caffeine.cache.LocalLoadingCache.get(LocalLoadingCache.java:56)
> at org.apache.iotdb.db.engine.cache.ChunkCache.get(ChunkCache.java:114)
> at org.apache.iotdb.db.query.reader.chunk.DiskChunkLoader.getChunkReader(DiskChunkLoader.java:55)
> at org.apache.iotdb.db.utils.FileLoaderUtils.loadPageReaderList(FileLoaderUtils.java:289)
> at org.apache.iotdb.db.mpp.execution.operator.source.SeriesScanUtil.unpackOneChunkMetaData(SeriesScanUtil.java:518)
> at org.apache.iotdb.db.mpp.execution.operator.source.SeriesScanUtil.unpackAllOverlappedChunkMetadataToPageReaders(SeriesScanUtil.java:507)
> at org.apache.iotdb.db.mpp.execution.operator.source.SeriesScanUtil.hasNextPage(SeriesScanUtil.java:427)
> at org.apache.iotdb.db.mpp.execution.operator.source.SeriesScanOperator.readPageData(SeriesScanOperator.java:162)
> at org.apache.iotdb.db.mpp.execution.operator.source.SeriesScanOperator.readChunkData(SeriesScanOperator.java:154)
> at org.apache.iotdb.db.mpp.execution.operator.source.SeriesScanOperator.readFileData(SeriesScanOperator.java:145)
> at org.apache.iotdb.db.mpp.execution.operator.source.SeriesScanOperator.hasNext(SeriesScanOperator.java:108)
> at org.apache.iotdb.db.mpp.execution.driver.Driver.processInternal(Driver.java:192)
> at org.apache.iotdb.db.mpp.execution.driver.Driver.lambda$processFor$1(Driver.java:131)
> at org.apache.iotdb.db.mpp.execution.driver.Driver.tryWithLock(Driver.java:277)
> at org.apache.iotdb.db.mpp.execution.driver.Driver.processFor(Driver.java:112)
> at org.apache.iotdb.db.mpp.execution.schedule.DriverTaskThread.execute(DriverTaskThread.java:64)
> at org.apache.iotdb.db.mpp.execution.schedule.AbstractDriverThread.run(AbstractDriverThread.java:74)
> 测试环境
> 1. 192.168.10.72/73/74 48CPU 384GB
> 3副本3C3D
> config/schema/data 协议分别是ratis/ratis/IoT
> ConfigNode 显式配置
> MAX_HEAP_SIZE="8G"
> cn_target_config_node_list=192.168.10.72:10710
> DataNode 显式配置
> MAX_HEAP_SIZE="8G"
> MAX_DIRECT_MEMORY_SIZE="8G"
> dn_target_config_node_list=192.168.10.72:10710,192.168.10.73:10710,192.168.10.74:10710
> COMMON 显式配置
> schema_replication_factor=3
> data_replication_factor=3
> avg_series_point_number_threshold=10000
> cross_performer=fast
> inner_seq_performer=fast
> inner_unseq_performer=fast
> 2.运行BM 配置见附件
> 24小时后，报错。
--
This message was sent by Atlassian Jira
(v8.20.10#820010)