You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@iotdb.apache.org by "刘珍 (Jira)" <ji...@apache.org> on 2023/01/11 01:38:00 UTC
[jira] [Created] (IOTDB-5394) Error happened while reading tsfile from position xxxxx
刘珍 created IOTDB-5394:
-------------------------
Summary: Error happened while reading tsfile from position xxxxx
Key: IOTDB-5394
URL: https://issues.apache.org/jira/browse/IOTDB-5394
Project: Apache IoTDB
Issue Type: Bug
Components: mpp-cluster
Affects Versions: 1.0.1
Reporter: 刘珍
Assignee: Haonan Hou
Attachments: 1673348664765-22224-0-0.tsfile, lt_fast.conf
rc/1.0.1 2023-01-07_09dd173
IoT协议，读tsfile 报错 (见附件）
2023-01-11 00:03:34,583 [Query-Worker-Thread-44$20230110_160324_67079_3.1.0] ERROR o.a.i.t.r.r.LocalTsFileInput:101 - Error happened while reading /data/mpp_test/r_0107_09dd173/sbin/../data/datanode/data/unsequence/root.test.g_0/51/2538/1673348664765-22224-0-0.tsfile from position 490728
2023-01-11 00:03:34,584 [Query-Worker-Thread-44$20230110_160324_67079_3.1.0] ERROR o.a.i.d.e.c.ChunkCache:80 - Something wrong happened in reading measurementId: s_501, datatype: FLOAT, version: 22224, Statistics: startTime: 1535559503187 endTime: 1535564087240 count: 10 [minValue:49.9543,maxValue:50.01069,firstValue:49.970222,lastValue:49.96979,sumValue:499.8036880493164], deleteIntervalList: null, filePath: /data/mpp_test/r_0107_09dd173/sbin/../data/datanode/data/unsequence/root.test.g_0/51/2538/1673348664765-22224-0-0.tsfile
java.nio.channels.ClosedChannelException: null
at java.base/sun.nio.ch.FileChannelImpl.ensureOpen(FileChannelImpl.java:150)
at java.base/sun.nio.ch.FileChannelImpl.read(FileChannelImpl.java:790)
at org.apache.iotdb.tsfile.read.reader.LocalTsFileInput.read(LocalTsFileInput.java:95)
at org.apache.iotdb.tsfile.utils.ReadWriteIOUtils.readAsPossible(ReadWriteIOUtils.java:806)
at org.apache.iotdb.tsfile.read.TsFileSequenceReader.readData(TsFileSequenceReader.java:1448)
at org.apache.iotdb.tsfile.read.TsFileSequenceReader.readChunk(TsFileSequenceReader.java:1268)
at org.apache.iotdb.tsfile.read.TsFileSequenceReader.readMemChunk(TsFileSequenceReader.java:1286)
at org.apache.iotdb.db.engine.cache.ChunkCache.lambda$new$1(ChunkCache.java:78)
at com.github.benmanes.caffeine.cache.LocalLoadingCache.lambda$newMappingFunction$2(LocalLoadingCache.java:145)
at com.github.benmanes.caffeine.cache.LocalCache.lambda$statsAware$0(LocalCache.java:139)
at com.github.benmanes.caffeine.cache.BoundedLocalCache.lambda$doComputeIfAbsent$14(BoundedLocalCache.java:2406)
at java.base/java.util.concurrent.ConcurrentHashMap.compute(ConcurrentHashMap.java:1947)
at com.github.benmanes.caffeine.cache.BoundedLocalCache.doComputeIfAbsent(BoundedLocalCache.java:2404)
at com.github.benmanes.caffeine.cache.BoundedLocalCache.computeIfAbsent(BoundedLocalCache.java:2387)
at com.github.benmanes.caffeine.cache.LocalCache.computeIfAbsent(LocalCache.java:108)
at com.github.benmanes.caffeine.cache.LocalLoadingCache.get(LocalLoadingCache.java:56)
at org.apache.iotdb.db.engine.cache.ChunkCache.get(ChunkCache.java:114)
at org.apache.iotdb.db.query.reader.chunk.DiskChunkLoader.getChunkReader(DiskChunkLoader.java:55)
at org.apache.iotdb.db.utils.FileLoaderUtils.loadPageReaderList(FileLoaderUtils.java:289)
at org.apache.iotdb.db.mpp.execution.operator.source.SeriesScanUtil.unpackOneChunkMetaData(SeriesScanUtil.java:518)
at org.apache.iotdb.db.mpp.execution.operator.source.SeriesScanUtil.unpackAllOverlappedChunkMetadataToPageReaders(SeriesScanUtil.java:507)
at org.apache.iotdb.db.mpp.execution.operator.source.SeriesScanUtil.hasNextPage(SeriesScanUtil.java:427)
at org.apache.iotdb.db.mpp.execution.operator.source.SeriesScanOperator.readPageData(SeriesScanOperator.java:162)
at org.apache.iotdb.db.mpp.execution.operator.source.SeriesScanOperator.readChunkData(SeriesScanOperator.java:154)
at org.apache.iotdb.db.mpp.execution.operator.source.SeriesScanOperator.readFileData(SeriesScanOperator.java:145)
at org.apache.iotdb.db.mpp.execution.operator.source.SeriesScanOperator.hasNext(SeriesScanOperator.java:108)
at org.apache.iotdb.db.mpp.execution.driver.Driver.processInternal(Driver.java:192)
at org.apache.iotdb.db.mpp.execution.driver.Driver.lambda$processFor$1(Driver.java:131)
at org.apache.iotdb.db.mpp.execution.driver.Driver.tryWithLock(Driver.java:277)
at org.apache.iotdb.db.mpp.execution.driver.Driver.processFor(Driver.java:112)
at org.apache.iotdb.db.mpp.execution.schedule.DriverTaskThread.execute(DriverTaskThread.java:64)
at org.apache.iotdb.db.mpp.execution.schedule.AbstractDriverThread.run(AbstractDriverThread.java:74)
测试环境
1. 192.168.10.72/73/74 48CPU 384GB
3副本3C3D
config/schema/data 协议分别是ratis/ratis/IoT
ConfigNode 显式配置
MAX_HEAP_SIZE="8G"
cn_target_config_node_list=192.168.10.72:10710
DataNode 显式配置
MAX_HEAP_SIZE="8G"
MAX_DIRECT_MEMORY_SIZE="8G"
dn_target_config_node_list=192.168.10.72:10710,192.168.10.73:10710,192.168.10.74:10710
COMMON 显式配置
schema_replication_factor=3
data_replication_factor=3
avg_series_point_number_threshold=10000
cross_performer=fast
inner_seq_performer=fast
inner_unseq_performer=fast
2.运行BM 配置见附件
24小时后，报错。
--
This message was sent by Atlassian Jira
(v8.20.10#820010)