[jira] [Created] (IOTDB-5597) [ query ]error when create FragmentInstanceExecution ,The system can't allow more query tasks.

["刘珍 (Jira)" <ji...@apache.org>]

刘珍 created IOTDB-5597:
-------------------------

             Summary: [ query ]error when create FragmentInstanceExecution ,The system can't allow more query tasks.
                 Key: IOTDB-5597
                 URL: https://issues.apache.org/jira/browse/IOTDB-5597
             Project: Apache IoTDB
          Issue Type: Improvement
          Components: Core/Query, mpp-cluster
            Reporter: 刘珍
            Assignee: Yuan Tian
         Attachments: image-2023-02-28-17-50-41-215.png

master_0228_fc8d05b
30,000 devices, 10 dataregion, 1 timepartition (seq/unseq data)
1 query :
select min_time(s_0),max_time(s_0),count(s_0) from root.** align by device;

2023-02-28 17:40:47,808 [pool-47-IoTDB-ClientRPC-Processor-2$20230228_094037_00001_1.6.0] WARN  o.a.i.d.m.e.f.FragmentInstanceManager:154 - error when create FragmentInstanceExecution. 
java.lang.IllegalStateException: The system can't allow more query tasks.
	at com.google.common.base.Preconditions.checkState(Preconditions.java:502)
	at org.apache.iotdb.db.mpp.execution.schedule.queue.IndexedBlockingReserveQueue.push(IndexedBlockingReserveQueue.java:57)
	at org.apache.iotdb.db.mpp.execution.schedule.DriverScheduler.submitTaskToReadyQueue(DriverScheduler.java:246)
	at org.apache.iotdb.db.mpp.execution.schedule.DriverScheduler.submitDrivers(DriverScheduler.java:220)
	at org.apache.iotdb.db.mpp.execution.fragment.FragmentInstanceExecution.createFragmentInstanceExecution(FragmentInstanceExecution.java:65)
	at org.apache.iotdb.db.mpp.execution.fragment.FragmentInstanceManager.lambda$execDataQueryFragmentInstance$2(FragmentInstanceManager.java:144)
	at java.base/java.util.concurrent.ConcurrentHashMap.computeIfAbsent(ConcurrentHashMap.java:1705)
	at org.apache.iotdb.db.mpp.execution.fragment.FragmentInstanceManager.execDataQueryFragmentInstance(FragmentInstanceManager.java:115)
	at org.apache.iotdb.db.consensus.statemachine.DataRegionStateMachine.read(DataRegionStateMachine.java:269)
	at org.apache.iotdb.consensus.iot.IoTConsensusServerImpl.read(IoTConsensusServerImpl.java:288)
	at org.apache.iotdb.consensus.iot.IoTConsensus.read(IoTConsensus.java:184)
	at org.apache.iotdb.db.mpp.execution.executor.RegionReadExecutor.execute(RegionReadExecutor.java:46)
	at org.apache.iotdb.db.mpp.plan.scheduler.FragmentInstanceDispatcherImpl.dispatchLocally(FragmentInstanceDispatcherImpl.java:311)
	at org.apache.iotdb.db.mpp.plan.scheduler.FragmentInstanceDispatcherImpl.dispatchOneInstance(FragmentInstanceDispatcherImpl.java:211)
	at org.apache.iotdb.db.mpp.plan.scheduler.FragmentInstanceDispatcherImpl.dispatchRead(FragmentInstanceDispatcherImpl.java:112)
	at org.apache.iotdb.db.mpp.plan.scheduler.FragmentInstanceDispatcherImpl.dispatch(FragmentInstanceDispatcherImpl.java:99)
	at org.apache.iotdb.db.mpp.plan.scheduler.ClusterScheduler.start(ClusterScheduler.java:116)
	at org.apache.iotdb.db.mpp.plan.execution.QueryExecution.schedule(QueryExecution.java:306)
	at org.apache.iotdb.db.mpp.plan.execution.QueryExecution.start(QueryExecution.java:221)
	at org.apache.iotdb.db.mpp.plan.Coordinator.execute(Coordinator.java:161)
	at org.apache.iotdb.db.service.thrift.impl.ClientRPCServiceImpl.executeStatementInternal(ClientRPCServiceImpl.java:218)
	at org.apache.iotdb.db.service.thrift.impl.ClientRPCServiceImpl.executeStatementV2(ClientRPCServiceImpl.java:480)
	at org.apache.iotdb.service.rpc.thrift.IClientRPCService$Processor$executeStatementV2.getResult(IClientRPCService.java:3629)
	at org.apache.iotdb.service.rpc.thrift.IClientRPCService$Processor$executeStatementV2.getResult(IClientRPCService.java:3609)
	at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:38)
	at org.apache.iotdb.db.service.thrift.ProcessorWithMetrics.process(ProcessorWithMetrics.java:64)
	at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:248)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	at java.base/java.lang.Thread.run(Thread.java:834)
2023-02-28 17:40:47,816 [pool-47-IoTDB-ClientRPC-Processor-2$20230228_094037_00001_1.6.0] WARN  o.a.i.d.m.p.s.FragmentInstanceDispatcherImpl:313 - The system can't allow more query tasks. 

TEST ENV
1. 192.168.10.73  * 48CPU *
/data/mpp_test/m_0228_94ad9f3

ConfigNode env
MAX_HEAP_SIZE="8G"
DataNode env
MAX_HEAP_SIZE="32G"
MAX_DIRECT_MEMORY_SIZE="16G"
COMMON prop：
data_region_group_extension_policy=CUSTOM
default_data_region_group_num_per_database=10
time_partition_interval=86400000

1C1D (start-standalone.sh)

2. benchmark  write data ( part1.conf ,part2.conf)
benchmark runs the configuration of part1.conf.
cli flush;
benchmark runs the configuration of part2.conf.
cli flush;

3. cli -e "select min_time(s_0),max_time(s_0),count(s_0) from root.** align by device;"
 !image-2023-02-28-17-50-41-215.png! 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)