You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@iotdb.apache.org by "刘珍 (Jira)" <ji...@apache.org> on 2022/09/28 03:27:00 UTC
[jira] [Commented] (IOTDB-4544) [ count timeseries ] java.lang.IllegalArgumentException: bytes should be greater than zero while less than or equal to max bytes per query
[ https://issues.apache.org/jira/browse/IOTDB-4544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17610338#comment-17610338 ]
刘珍 commented on IOTDB-4544:
---------------------------
田原加日志:
2022-09-28 11:25:12,583 [Query-Worker-Thread-71$20220928_032235_00003_5.1.0] ERROR o.a.i.d.m.e.s.AbstractDriverThread:76 - [ExecuteFailed]
java.lang.IllegalArgumentException: bytes should be greater than zero while less than or equal to max bytes per query: 163443084
at org.apache.commons.lang3.Validate.isTrue(Validate.java:109)
at org.apache.iotdb.db.mpp.execution.memory.MemoryPool.reserve(MemoryPool.java:99)
at org.apache.iotdb.db.mpp.execution.exchange.SinkHandle.send(SinkHandle.java:156)
at org.apache.iotdb.db.mpp.execution.driver.Driver.processInternal(Driver.java:188)
at org.apache.iotdb.db.mpp.execution.driver.Driver.lambda$processFor$1(Driver.java:125)
at org.apache.iotdb.db.mpp.execution.driver.Driver.tryWithLock(Driver.java:270)
at org.apache.iotdb.db.mpp.execution.driver.Driver.processFor(Driver.java:118)
at org.apache.iotdb.db.mpp.execution.schedule.DriverTaskThread.execute(DriverTaskThread.java:63)
at org.apache.iotdb.db.mpp.execution.schedule.AbstractDriverThread.run(AbstractDriverThread.java:70)
> [ count timeseries ] java.lang.IllegalArgumentException: bytes should be greater than zero while less than or equal to max bytes per query
> ------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: IOTDB-4544
> URL: https://issues.apache.org/jira/browse/IOTDB-4544
> Project: Apache IoTDB
> Issue Type: Bug
> Components: mpp-cluster
> Affects Versions: 0.14.0-SNAPSHOT
> Reporter: 刘珍
> Assignee: Yukun Zhou
> Priority: Major
> Attachments: image-2022-09-28-10-25-24-221.png, iotdb_4544.conf, screenshot-1.png
>
>
> master_0924_04d9a4a
> schemaregion : StandAloneConsensus
> dataregion : StandAloneConsensus
> 3C3D
> count timeseries group by level=4 客户端:
> {color:#DE350B}Msg: 500: [INTERNAL_SERVER_ERROR(500)] Exception occurred: "count timeseries group by level=4". executeStatement failed.{color} {color:#DE350B}Task was cancelled.{color}
> (ip62)datanode 报错
> 2022-09-28 10:18:00,963 [Query-Worker-Thread-4$20220928_021535_00010_5.1.0] ERROR o.a.i.d.m.e.driver.Driver:193 - Failed to execute fragment instance 20220928_021535_00010_5.1.0
> {color:#DE350B}*java.lang.IllegalArgumentException: bytes should be greater than zero while less than or equal to max bytes per query.*{color}
> at org.apache.commons.lang3.Validate.isTrue(Validate.java:158)
> at org.apache.iotdb.db.mpp.execution.memory.MemoryPool.reserve(MemoryPool.java:97)
> at org.apache.iotdb.db.mpp.execution.exchange.SinkHandle.send(SinkHandle.java:156)
> at org.apache.iotdb.db.mpp.execution.driver.Driver.processInternal(Driver.java:188)
> at org.apache.iotdb.db.mpp.execution.driver.Driver.lambda$processFor$1(Driver.java:125)
> at org.apache.iotdb.db.mpp.execution.driver.Driver.tryWithLock(Driver.java:271)
> at org.apache.iotdb.db.mpp.execution.driver.Driver.processFor(Driver.java:118)
> at org.apache.iotdb.db.mpp.execution.schedule.DriverTaskThread.execute(DriverTaskThread.java:63)
> at org.apache.iotdb.db.mpp.execution.schedule.AbstractDriverThread.run(AbstractDriverThread.java:64)
> 2022-09-28 10:18:00,963 [Query-Worker-Thread-4] ERROR o.a.i.d.m.e.s.AbstractDriverThread:66 - [ExecuteFailed]
> java.lang.IllegalArgumentException: bytes should be greater than zero while less than or equal to max bytes per query.
> at org.apache.commons.lang3.Validate.isTrue(Validate.java:158)
> at org.apache.iotdb.db.mpp.execution.memory.MemoryPool.reserve(MemoryPool.java:97)
> at org.apache.iotdb.db.mpp.execution.exchange.SinkHandle.send(SinkHandle.java:156)
> at org.apache.iotdb.db.mpp.execution.driver.Driver.processInternal(Driver.java:188)
> at org.apache.iotdb.db.mpp.execution.driver.Driver.lambda$processFor$1(Driver.java:125)
> at org.apache.iotdb.db.mpp.execution.driver.Driver.tryWithLock(Driver.java:271)
> at org.apache.iotdb.db.mpp.execution.driver.Driver.processFor(Driver.java:118)
> at org.apache.iotdb.db.mpp.execution.schedule.DriverTaskThread.execute(DriverTaskThread.java:63)
> at org.apache.iotdb.db.mpp.execution.schedule.AbstractDriverThread.run(AbstractDriverThread.java:64)
> (ip68 cli连接节点)
> 2022-09-28 10:17:20,879 [pool-24-IoTDB-ClientRPC-Processor-38] WARN o.a.i.d.u.ErrorHandlingUtils:62 - Status code: INTERNAL_SERVER_ERROR(500), operation: "count timeseries group by level=4". executeStatement failed
> java.util.concurrent.CancellationException: Task was cancelled.
> at com.google.common.util.concurrent.AbstractFuture.cancellationExceptionWithCause(AbstractFuture.java:1543)
> at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:586)
> at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:567)
> at com.google.common.util.concurrent.AbstractFuture$TrustedFuture.get(AbstractFuture.java:113)
> at org.apache.iotdb.db.mpp.plan.execution.QueryExecution.getBatchResult(QueryExecution.java:359)
> at org.apache.iotdb.db.utils.QueryDataSetUtils.convertTsBlockByFetchSize(QueryDataSetUtils.java:201)
> at org.apache.iotdb.db.service.thrift.impl.ClientRPCServiceImpl.executeStatement(ClientRPCServiceImpl.java:586)
> at org.apache.iotdb.service.rpc.thrift.IClientRPCService$Processor$executeStatement.getResult(IClientRPCService.java:3037)
> at org.apache.iotdb.service.rpc.thrift.IClientRPCService$Processor$executeStatement.getResult(IClientRPCService.java:3017)
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:38)
> at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:38)
> at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:248)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> 2022-09-28 10:17:20,879 [pool-24-IoTDB-ClientRPC-Processor-38] INFO o.a.i.d.s.t.i.ClientRPCServiceImpl:601 - Cost: 105508 ms, sql is count timeseries group by level=4
> 测试环境
> 1. 192.168.10.68/62/66 72cpu 256GB
> ConfigNode
> MAX_HEAP_SIZE="16G"
> MAX_DIRECT_MEMORY_SIZE="8G"
> time_partition_interval_for_routing=86400000
> DataNode
> MAX_HEAP_SIZE="128G"
> MAX_DIRECT_MEMORY_SIZE="32G"
> query_timeout_threshold=36000000
> 2. benchmark配置见附件
> 运行16.9小时,完成
> 3. cli查询连68 count timeseries group by level=4
> 查看返回结果
> !screenshot-1.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)