You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@iotdb.apache.org by "shuchenbuxiao (via GitHub)" <gi...@apache.org> on 2025/06/26 02:22:30 UTC
[D] 基于sessionpool的last查询 [iotdb]
GitHub user shuchenbuxiao created a discussion: 基于sessionpool的last查询
基于sessionpool的last查询，java语言开发,iotb版本2.02版本，docker-standalone运行
目前实现方式是：
1.sessionpool创建连接池，maxsize设置的16
2.查询时从连接池拿session，执行拼接后的sql返回SessionDataSetWrapper，取SessionDataSet即业务数据
3.finally中closeResultSet（wrapper）
出现的问题：
1.测试使用的sql在dbeaver中执行约0.053s，所以应该能排除sql导致的性能问题
2.反复执行查询，会出现第一次查询需约2.7s，然后连续10次左右请求时长都是在100ms内，然后再有一次2.72s的查询，依次循环
3.间隔查询，查询一次耗费时长2.7s的查询后，如间隔10s左右再进行下一次查询，查询好事也在2.7s左右
查询sql示例：
SELECT LAST LINE.`01`.SYS.`H-a311`.FBHumidity, LINE.`01`.SYS.`H-a311`.FBTemperature, LINE.`01`.SYS.`H-a310`.FBHumidity,
LINE.`01`.SYS.`H-a310`.FBTemperature, LINE.`01`.SYS.`H-a309`.FBHumidity, LINE.`01`.SYS.`H-a309`.FBTemperature,
LINE.`01`.SYS.`H-a308`.FBHumidity, LINE.`01`.SYS.`H-a308`.FBTemperature, LINE.`01`.SYS.`H-a307`.FBHumidity,
LINE.`01`.SYS.`H-a307`.FBTemperature, LINE.`01`.SYS.`H-a306`.FBHumidity, LINE.`01`.SYS.`H-a306`.FBTemperature,
LINE.`01`.SYS.`H-a305`.FBHumidity, LINE.`01`.SYS.`H-a305`.FBTemperature, LINE.`01`.SYS.`H-a303`.FBHumidity,
LINE.`01`.SYS.`H-a303`.FBTemperature, LINE.`01`.SYS.`H-a212`.FBHumidity, LINE.`01`.SYS.`H-a212`.FBTemperature,
LINE.`01`.SYS.`H-a211`.FBHumidity, LINE.`01`.SYS.`H-a211`.FBTemperature, LINE.`01`.SYS.`H-a210`.FBHumidity,
LINE.`01`.SYS.`H-a210`.FBTemperature, LINE.`01`.SYS.`H-a209`.FBHumidity, LINE.`01`.SYS.`H-a209`.FBTemperature, LINE.`01`.SYS.`H-a208`.FBHumidity,
LINE.`01`.SYS.`H-a208`.FBTemperature, LINE.`01`.SYS.`H-a207`.FBHumidity, LINE.`01`.SYS.`H-a207`.FBTemperature, LINE.`01`.SYS.`H-a206`.FBHumidity,
LINE.`01`.SYS.`H-a206`.FBTemperature, LINE.`01`.SYS.`H-a205`.FBHumidity, LINE.`01`.SYS.`H-a205`.FBTemperature, LINE.`01`.SYS.`H-a204`.FBHumidity,
LINE.`01`.SYS.`H-a204`.FBTemperature, LINE.`01`.SYS.`H-a203`.FBHumidity, LINE.`01`.SYS.`H-a203`.FBTemperature, LINE.`01`.SYS.`H-a107`.FBHumidity,
LINE.`01`.SYS.`H-a107`.FBTemperature, LINE.`01`.SYS.`H-a106`.FBHumidity, LINE.`01`.SYS.`H-a106`.FBTemperature, LINE.`01`.SYS.`H-a105`.FBHumidity,
LINE.`01`.SYS.`H-a105`.FBTemperature, LINE.`01`.SYS.`H-a104`.FBHumidity, LINE.`01`.SYS.`H-a104`.FBTemperature, LINE.`01`.SYS.`H-a103`.FBHumidity,
LINE.`01`.SYS.`H-a103`.FBTemperature, LINE.`01`.SYS.`909-H-A09`.FBHumidity, LINE.`01`.SYS.`909-H-A09`.FBTemperature, LINE.`01`.SYS.`909-H-A08`.FBHumidity,
LINE.`01`.SYS.`909-H-A08`.FBTemperature, LINE.`01`.SYS.`909-H-A06`.FBHumidity, LINE.`01`.SYS.`909-H-A06`.FBTemperature, LINE.`01`.SYS.`909-H-A05`.FBHumidity,
LINE.`01`.SYS.`909-H-A05`.FBTemperature, LINE.`01`.SYS.`909-H-A01`.FBHumidity, LINE.`01`.SYS.`909-H-A01`.FBTemperature, LINE.`01`.SYS.`H-a304`.FBHumidity,
LINE.`01`.SYS.`H-a304`.FBTemperature, LINE.`01`.SYS.`H-a302`.FBHumidity, LINE.`01`.SYS.`H-a302`.FBTemperature, LINE.`01`.SYS.`H-a301`.FBHumidity,
LINE.`01`.SYS.`H-a301`.FBTemperature, LINE.`01`.SYS.`H-a202`.FBHumidity, LINE.`01`.SYS.`H-a202`.FBTemperature, LINE.`01`.SYS.`H-a201`.FBHumidity,
LINE.`01`.SYS.`H-a201`.FBTemperature, LINE.`01`.SYS.`H-a102`.FBHumidity, LINE.`01`.SYS.`H-a102`.FBTemperature, LINE.`01`.SYS.`H-a101`.FBHumidity,
LINE.`01`.SYS.`H-a101`.FBTemperature, LINE.`01`.SYS.`909-H-A04`.FBHumidity, LINE.`01`.SYS.`909-H-A04`.FBTemperature, LINE.`01`.SYS.`909-H-A03`.FBHumidity,
LINE.`01`.SYS.`909-H-A03`.FBTemperature, LINE.`01`.SYS.`909-H-A02`.FBHumidity, LINE.`01`.SYS.`909-H-A02`.FBTemperature, LINE.`01`.SYS.`909-C-A02`.
FBPpmConcentration, LINE.`01`.SYS.`909-C-A01`.FBPpmConcentration FROM root
GitHub link: https://github.com/apache/iotdb/discussions/15823
----
This is an automatically sent email for dev@iotdb.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@iotdb.apache.org
Re: [D] 基于sessionpool的last查询 [iotdb]
Posted by "shuchenbuxiao (via GitHub)" <gi...@apache.org>.
GitHub user shuchenbuxiao edited a discussion: 基于sessionpool的last查询
基于sessionpool的last查询，java语言开发,iotb版本2.02版本，docker-standalone运行
目前实现方式是：
1.sessionpool创建连接池，maxsize设置的16
2.查询时从连接池拿session，执行拼接后的sql返回SessionDataSetWrapper，取SessionDataSet即业务数据
3.finally中closeResultSet（wrapper）
出现的问题：
1.测试使用的sql在dbeaver中执行约0.053s，所以应该能排除sql导致的性能问题
2.反复执行查询，会出现第一次查询需约2.7s，然后连续10次左右请求时长都是在100ms内，然后再有一次2.72s的查询，依次循环
3.间隔查询，查询一次耗费时长2.7s的查询后，如间隔10s左右再进行下一次查询，查询耗时也在2.7s左右
以上问题导致在实际使用中查询最新数据效率达不到预期要求（1s以内）
查询sql示例：
SELECT LAST LINE.`01`.SYS.`H-a311`.FBHumidity, LINE.`01`.SYS.`H-a311`.FBTemperature, LINE.`01`.SYS.`H-a310`.FBHumidity,
LINE.`01`.SYS.`H-a310`.FBTemperature, LINE.`01`.SYS.`H-a309`.FBHumidity, LINE.`01`.SYS.`H-a309`.FBTemperature,
LINE.`01`.SYS.`H-a308`.FBHumidity, LINE.`01`.SYS.`H-a308`.FBTemperature, LINE.`01`.SYS.`H-a307`.FBHumidity,
LINE.`01`.SYS.`H-a307`.FBTemperature, LINE.`01`.SYS.`H-a306`.FBHumidity, LINE.`01`.SYS.`H-a306`.FBTemperature,
LINE.`01`.SYS.`H-a305`.FBHumidity, LINE.`01`.SYS.`H-a305`.FBTemperature, LINE.`01`.SYS.`H-a303`.FBHumidity,
LINE.`01`.SYS.`H-a303`.FBTemperature, LINE.`01`.SYS.`H-a212`.FBHumidity, LINE.`01`.SYS.`H-a212`.FBTemperature,
LINE.`01`.SYS.`H-a211`.FBHumidity, LINE.`01`.SYS.`H-a211`.FBTemperature, LINE.`01`.SYS.`H-a210`.FBHumidity,
LINE.`01`.SYS.`H-a210`.FBTemperature, LINE.`01`.SYS.`H-a209`.FBHumidity, LINE.`01`.SYS.`H-a209`.FBTemperature, LINE.`01`.SYS.`H-a208`.FBHumidity,
LINE.`01`.SYS.`H-a208`.FBTemperature, LINE.`01`.SYS.`H-a207`.FBHumidity, LINE.`01`.SYS.`H-a207`.FBTemperature, LINE.`01`.SYS.`H-a206`.FBHumidity,
LINE.`01`.SYS.`H-a206`.FBTemperature, LINE.`01`.SYS.`H-a205`.FBHumidity, LINE.`01`.SYS.`H-a205`.FBTemperature, LINE.`01`.SYS.`H-a204`.FBHumidity,
LINE.`01`.SYS.`H-a204`.FBTemperature, LINE.`01`.SYS.`H-a203`.FBHumidity, LINE.`01`.SYS.`H-a203`.FBTemperature, LINE.`01`.SYS.`H-a107`.FBHumidity,
LINE.`01`.SYS.`H-a107`.FBTemperature, LINE.`01`.SYS.`H-a106`.FBHumidity, LINE.`01`.SYS.`H-a106`.FBTemperature, LINE.`01`.SYS.`H-a105`.FBHumidity,
LINE.`01`.SYS.`H-a105`.FBTemperature, LINE.`01`.SYS.`H-a104`.FBHumidity, LINE.`01`.SYS.`H-a104`.FBTemperature, LINE.`01`.SYS.`H-a103`.FBHumidity,
LINE.`01`.SYS.`H-a103`.FBTemperature, LINE.`01`.SYS.`909-H-A09`.FBHumidity, LINE.`01`.SYS.`909-H-A09`.FBTemperature, LINE.`01`.SYS.`909-H-A08`.FBHumidity,
LINE.`01`.SYS.`909-H-A08`.FBTemperature, LINE.`01`.SYS.`909-H-A06`.FBHumidity, LINE.`01`.SYS.`909-H-A06`.FBTemperature, LINE.`01`.SYS.`909-H-A05`.FBHumidity,
LINE.`01`.SYS.`909-H-A05`.FBTemperature, LINE.`01`.SYS.`909-H-A01`.FBHumidity, LINE.`01`.SYS.`909-H-A01`.FBTemperature, LINE.`01`.SYS.`H-a304`.FBHumidity,
LINE.`01`.SYS.`H-a304`.FBTemperature, LINE.`01`.SYS.`H-a302`.FBHumidity, LINE.`01`.SYS.`H-a302`.FBTemperature, LINE.`01`.SYS.`H-a301`.FBHumidity,
LINE.`01`.SYS.`H-a301`.FBTemperature, LINE.`01`.SYS.`H-a202`.FBHumidity, LINE.`01`.SYS.`H-a202`.FBTemperature, LINE.`01`.SYS.`H-a201`.FBHumidity,
LINE.`01`.SYS.`H-a201`.FBTemperature, LINE.`01`.SYS.`H-a102`.FBHumidity, LINE.`01`.SYS.`H-a102`.FBTemperature, LINE.`01`.SYS.`H-a101`.FBHumidity,
LINE.`01`.SYS.`H-a101`.FBTemperature, LINE.`01`.SYS.`909-H-A04`.FBHumidity, LINE.`01`.SYS.`909-H-A04`.FBTemperature, LINE.`01`.SYS.`909-H-A03`.FBHumidity,
LINE.`01`.SYS.`909-H-A03`.FBTemperature, LINE.`01`.SYS.`909-H-A02`.FBHumidity, LINE.`01`.SYS.`909-H-A02`.FBTemperature, LINE.`01`.SYS.`909-C-A02`.
FBPpmConcentration, LINE.`01`.SYS.`909-C-A01`.FBPpmConcentration FROM root
GitHub link: https://github.com/apache/iotdb/discussions/15823
----
This is an automatically sent email for dev@iotdb.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@iotdb.apache.org
Re: [D] 基于sessionpool的last查询 [iotdb]
Posted by "CritasWang (via GitHub)" <gi...@apache.org>.
GitHub user CritasWang added a comment to the discussion: 基于sessionpool的last查询
请参考 readme 加入官方交流群以便更方便沟通。
另外请提供下 测试数据、测试程序。以及机器配置
GitHub link: https://github.com/apache/iotdb/discussions/15823#discussioncomment-13580774
----
This is an automatically sent email for dev@iotdb.apache.org.
To unsubscribe, please send an email to: dev-unsubscribe@iotdb.apache.org