You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@iotdb.apache.org by "刘珍 (Jira)" <ji...@apache.org> on 2023/03/21 07:08:00 UTC
[jira] [Assigned] (IOTDB-5664) [compaction] java.lang.OutOfMemoryError: Java heap space
[ https://issues.apache.org/jira/browse/IOTDB-5664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
刘珍 reassigned IOTDB-5664:
-------------------------
Assignee: 周沛辰 (was: Jinrui Zhang)
> [compaction] java.lang.OutOfMemoryError: Java heap space
> --------------------------------------------------------
>
> Key: IOTDB-5664
> URL: https://issues.apache.org/jira/browse/IOTDB-5664
> Project: Apache IoTDB
> Issue Type: Bug
> Components: Core/Compaction, mpp-cluster
> Affects Versions: 1.1.0-SNAPSHOT
> Reporter: 刘珍
> Assignee: 周沛辰
> Priority: Major
> Attachments: comp1_normal.conf, comp3_aligned.conf, run_comp.sh, test.sh
>
>
> rc/1.1.0 0306_32f9db0
> 启动1C1D，写入1个顺序tsfile，其他tsfile为乱序，每个序列(普通/对齐)写入1个点，flush一次。
> 46小时，OOM
> 2023-03-12 14:53:49,951 [pool-24-IoTDB-DataNodeInternalRPC-Processor-24] ERROR o.a.i.c.c.t.WrappedThreadPoolExecutor:108 - Exception in thread pool org.apache.iotdb.threadpool:type=DataNodeInternalRPC-Processor
> java.lang.OutOfMemoryError: Java heap space: failed reallocation of scalar replaced objects
> 2023-03-12 14:57:58,102 [pool-7-IoTDB-StorageEngine-1415] ERROR o.a.i.c.c.t.WrappedThreadPoolExecutor:108 - Exception in thread pool org.apache.iotdb.threadpool:type=StorageEngine
> java.lang.OutOfMemoryError: Java heap space
> 2023-03-12 14:58:03,694 [pool-24-IoTDB-DataNodeInternalRPC-Processor-24] ERROR o.a.i.c.c.IoTDBDefaultThreadExceptionHandler:31 - Exception in thread pool-24-IoTDB-DataNodeInternalRPC-Processor-24-20462
> java.lang.OutOfMemoryError: Java heap space: failed reallocation of scalar replaced objects
> 2023-03-12 14:53:49,951 [pool-24-IoTDB-DataNodeInternalRPC-Processor-17] ERROR o.a.i.c.c.t.WrappedThreadPoolExecutor:108 - Exception in thread pool org.apache.iotdb.threadpool:type=DataNodeInternalRPC-Processor
> java.lang.OutOfMemoryError: Java heap space
> 2023-03-12 14:53:49,951 [pool-21-IoTDB-MPPCoordinator-1] ERROR o.a.i.c.c.t.WrappedThreadPoolExecutor:108 - Exception in thread pool org.apache.iotdb.threadpool:type=MPPCoordinator
> java.lang.OutOfMemoryError: Java heap space
> 2023-03-12 14:58:03,694 [pool-21-IoTDB-MPPCoordinator-2] ERROR o.a.i.c.c.t.WrappedThreadPoolExecutor:108 - Exception in thread pool org.apache.iotdb.threadpool:type=MPPCoordinator
> java.lang.OutOfMemoryError: Java heap space
> 2023-03-12 14:54:01,138 [pool-21-IoTDB-MPPCoordinator-4] ERROR o.a.i.c.c.IoTDBDefaultThreadExceptionHandler:31 - Exception in thread pool-21-IoTDB-MPPCoordinator-4-62
> java.lang.OutOfMemoryError: Java heap space
> 2023-03-12 14:57:52,533 [pool-24-IoTDB-DataNodeInternalRPC-Processor-77] ERROR o.a.i.c.c.t.WrappedThreadPoolExecutor:108 - Exception in thread pool org.apache.iotdb.threadpool:type=DataNodeInternalRPC-Processor
> java.lang.OutOfMemoryError: Java heap space
> 2023-03-12 14:54:12,287 [pool-25-IoTDB-ClientRPC-Processor-22385$20230312_064221_26096_1.1.0] ERROR o.a.i.d.m.e.e.RegionWriteExecutor:92 - Java heap space
> java.lang.OutOfMemoryError: Java heap space
> at java.base/java.lang.StringLatin1.toLowerCase(StringLatin1.java:397)
> at java.base/java.lang.String.toLowerCase(String.java:2503)
> at java.base/java.lang.String.toLowerCase(String.java:2527)
> at org.apache.iotdb.commons.service.metric.enums.Metric.toString(Metric.java:96)
> at org.apache.iotdb.db.mpp.metric.PerformanceOverviewMetricsManager.recordScheduleSchemaValidateCost(PerformanceOverviewMetricsManager.java:88)
> at org.apache.iotdb.db.mpp.execution.executor.RegionWriteExecutor$WritePlanNodeExecutionVisitor.executeDataInsert(RegionWriteExecutor.java:228)
> at org.apache.iotdb.db.mpp.execution.executor.RegionWriteExecutor$WritePlanNodeExecutionVisitor.visitInsertTablet(RegionWriteExecutor.java:185)
> at org.apache.iotdb.db.mpp.execution.executor.RegionWriteExecutor$WritePlanNodeExecutionVisitor.visitInsertTablet(RegionWriteExecutor.java:139)
> at org.apache.iotdb.db.mpp.plan.planner.plan.node.write.InsertTabletNode.accept(InsertTabletNode.java:1062)
> at org.apache.iotdb.db.mpp.execution.executor.RegionWriteExecutor.execute(RegionWriteExecutor.java:90)
> at org.apache.iotdb.db.mpp.plan.scheduler.FragmentInstanceDispatcherImpl.dispatchLocally(FragmentInstanceDispatcherImpl.java:321)
> at org.apache.iotdb.db.mpp.plan.scheduler.FragmentInstanceDispatcherImpl.dispatchOneInstance(FragmentInstanceDispatcherImpl.java:211)
> at org.apache.iotdb.db.mpp.plan.scheduler.FragmentInstanceDispatcherImpl.dispatchWriteAsync(FragmentInstanceDispatcherImpl.java:182)
> at org.apache.iotdb.db.mpp.plan.scheduler.FragmentInstanceDispatcherImpl.dispatch(FragmentInstanceDispatcherImpl.java:101)
> at org.apache.iotdb.db.mpp.plan.scheduler.ClusterScheduler.start(ClusterScheduler.java:116)
> at org.apache.iotdb.db.mpp.plan.execution.QueryExecution.schedule(QueryExecution.java:312)
> at org.apache.iotdb.db.mpp.plan.execution.QueryExecution.start(QueryExecution.java:215)
> at org.apache.iotdb.db.mpp.plan.Coordinator.execute(Coordinator.java:161)
> at org.apache.iotdb.db.mpp.plan.Coordinator.execute(Coordinator.java:175)
> at org.apache.iotdb.db.service.thrift.impl.ClientRPCServiceImpl.insertTablet(ClientRPCServiceImpl.java:1378)
> at org.apache.iotdb.service.rpc.thrift.IClientRPCService$Processor$insertTablet.getResult(IClientRPCService.java:4279)
> at org.apache.iotdb.service.rpc.thrift.IClientRPCService$Processor$insertTablet.getResult(IClientRPCService.java:4259)
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:38)
> at org.apache.iotdb.db.service.thrift.ProcessorWithMetrics.process(ProcessorWithMetrics.java:64)
> at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:248)
> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at java.base/java.lang.Thread.run(Thread.java:834)
> 1.测试环境
> 私有云1期 172.16.2.15
> CN ENV：
> MAX_HEAP_SIZE="2G"
> cn_target_config_node_list=172.16.2.15:10710
> DN ENV：
> MAX_HEAP_SIZE="20G"
> MAX_DIRECT_MEMORY_SIZE="6G"
> 2. 启动运行脚本
> bm配置文件有2个，见附件
> 在benchmark dir下运行run_comp.sh
--
This message was sent by Atlassian Jira
(v8.20.10#820010)