You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@skywalking.apache.org by GitBox <gi...@apache.org> on 2020/12/22 11:37:35 UTC
[GitHub] [skywalking] bestpayAmes opened a new issue #6059: storage influxdb has slow query
bestpayAmes opened a new issue #6059:
URL: https://github.com/apache/skywalking/issues/6059
Please answer these questions before submitting your issue.
- Why do you submit this issue?
Question or discussion
___
### Question
- What do you want to know?
```
when use storage influxdb ,I find slow query sql,like this:
SELECT *::field FROM endpoint_avg WHERE id =~ /202012221019_bG9hbi1zdC1jcnMtc2VydmljZQ==.1_eHhsLWpvYi9NZXRob2RKb2IvaW8ua3lvdG8uY2hhbm5lbC5jcnMubW9kdWxlcy5qb2JzLkNyZWRpdFF1ZXJ5SW5nQmF0Y2hGb3JQYXJhbXNCZWFuLnRhc2tKb2JIYW5kbGVy|202012221019_bG9hbi1kZXYtZGVzLXNlcnZpY2U=.1_U3ByaW5nU2NoZWR1bGVkL2lvLmt5b3RvLnJpc2suZGVzLm1vZHVsZXMuZXhlYy5zZXJ2aWNlLmltcGwuS2llQ29udGFpbmVyUmVwb3NpdG9yeUltcGwuc3luY0NvbnRhaW5lclN0YXR1cw==|202012221019_bG9hbi1zdC1hcHYtc2VydmljZQ==.1_eHhsLWpvYi9NZXRob2RKb2IvaW8ua3lvdG8ub3BlcmF0aW9uLmFwdi5qb2JzLndvcmtmbG93LlRhc2tSZWRvQmVhbi50YXNrSm9iSGFuZGxlcg==|202012221019_bG9hbi1kZXYtbGNzLXNlcnZpY2U=.1_eHhsLWpvYi9NZXRob2RKb2IvaW8ua3lvdG8ucGlsbGFyLmxjcy5qb2JzLnB1dG91dC5QdXRPdXRUaGlyZE9mZmVyQ2hlY2tUYXNrLnRhc2tKb2JIYW5kbGVy|202012221019_bG9hbi1zdC1hcHYtc2VydmljZQ==.1_eHhsLWpvYi9NZXRob2RKb2IvaW8ua3lvdG8uc29sZS5kYXRhLmxpZmVjeWNsZS5qb2IuTGlmZWN5Y2xlRXZlbnRUYXNrLnRhc2tKb2JIYW5kbGVy|202012221019_bG9hbi1kZXYtbGNzLXNlcnZpY2U=.1_eHhsLWpvYi9NZXRob2RKb2IvaW8ua3lvdG8ucGlsbGFyLmxjcy5qb2JzLnB
1dG91dC5QdXRPdXRTdGF0dXNUaGlyZENoZWNrVGFzay50YXNrSm9iSGFuZGxlcg==|202012221019_bG9hbi1zdC1sY3Mtc2VydmljZQ==.1_eHhsLWpvYi9NZXRob2RKb2IvaW8ua3lvdG8ucGlsbGFyLmxjcy5qb2JzLmNvbW1vbi5EYWlseUNoYW5nZUJlYW4udGFza0pvYkhhbmRsZXI=|202012221019_bG9hbi1zdC1sY3Mtc2VydmljZQ==.1_eHhsLWpvYi9NZXRob2RKb2IvaW8ua3lvdG8ucGlsbGFyLmxjcy5qb2JzLnJlcGF5LlJlcGF5UmVzdWx0UHJvY2Vzc0JlYW4udGFza0pvYkhhbmRsZXI=|202012221019_bG9hbi1zdC1sY3Mtc2VydmljZQ==.1_eHhsLWpvYi9NZXRob2RKb2IvaW8ua3lvdG8ucGlsbGFyLmxjcy5qb2JzLnB1dG91dC5QdXRPdXRUaGlyZE9mZmVyQ2hlY2tUYXNrLnRhc2tKb2JIYW5kbGVy|202012221019_bG9hbi1zdC1sY3Mtc2VydmljZQ==.1_U3ByaW5nU2NoZWR1bGVkL2lvLmt5b3RvLnBpbGxhci5jb25maWcuQ2FjaGVDb25maWcuc3lzdGVtQXJndW1lbnRDYWNoZVVwZGF0ZQ==|202012221019_bG9hbi1kZXYtbGNzLXNlcnZpY2U=.1_eHhsLWpvYi9NZXRob2RKb2IvaW8ua3lvdG8ucGlsbGFyLmxjcy5qb2JzLmNvbW1vbi5EYWlseUNoYW5nZUJlYW4udGFza0pvYkhhbmRsZXI=|202012221019_bG9hbi1kZXYtZGVzLXNlcnZpY2U=.1_U3ByaW5nU2NoZWR1bGVkL2lvLmt5b3RvLnNvbGUudGhyZWFkcG9vbC5jb25maWcuRGVmYXVsdFRocmVhZFBvb2xDb25maWd1cmF0aW9uLn
RocmVhZFN0YXRlSm9iUnVu|202012221019_bG9hbi1kZXYtZ29zLXNlcnZpY2U=.1_U3ByaW5nU2NoZWR1bGVkL2lvLmt5b3RvLnNvbGUudGhyZWFkcG9vbC5jb25maWcuRGVmYXVsdFRocmVhZFBvb2xDb25maWd1cmF0aW9uLnRocmVhZFBvb2xTdGF0ZUpvYlJ1bg==|202012221019_bG9hbi1zdC1hbXMtc2VydmljZQ==.1_U3ByaW5nU2NoZWR1bGVkL2lvLmt5b3RvLnNvbGUudGhyZWFkcG9vbC5jb25maWcuRGVmYXVsdFRocmVhZFBvb2xDb25maWd1cmF0aW9uLnRocmVhZFBvb2xTdGF0ZUpvYlJ1bg==|202012221019_bG9hbi1zdC1jcnMtc2VydmljZQ==.1_U3ByaW5nU2NoZWR1bGVkL2lvLmt5b3RvLmNoYW5uZWwuY3JzLm1vZHVsZXMubGlzdG1hdGNoLnNlcnZpY2UuaW1wbC5MaXN0TWF0Y2hTZXJ2aWNlSW1wbCQkRW5oYW5jZXJCeVNwcmluZ0NHTElCJCQ5N2E2MjVjMi5zeW5jTGlzdE1hdGNoZXJz|202012221019_bG9hbi1zdC1jaXMtc2VydmljZQ==.1_U3ByaW5nU2NoZWR1bGVkL2lvLmt5b3RvLnNvbGUudGhyZWFkcG9vbC5jb25maWcuRGVmYXVsdFRocmVhZFBvb2xDb25maWd1cmF0aW9uLnRocmVhZFN0YXRlSm9iUnVu|202012221019_bG9hbi1zdC1jaXMtc2VydmljZQ==.1_U3ByaW5nU2NoZWR1bGVkL2lvLmt5b3RvLnNvbGUudGhyZWFkcG9vbC5jb25maWcuRGVmYXVsdFRocmVhZFBvb2xDb25maWd1cmF0aW9uLnRocmVhZFBvb2xTdGF0ZUpvYlJ1bg==|202012221019_bG9hbi1kZXYtbGNz
LXNlcnZpY2U=.1_eHhsLWpvYi9NZXRob2RKb2IvaW8ua3lvdG8ucGlsbGFyLmxjcy5qb2JzLmRhbmJhby5HdWFyYW50ZWVSZWNvblRhc2sudGhpcmRDb21wZW5zYXRlQmF0Y2hGaWxlUmVjb25UYXNr|202012221019_bG9hbi1kZXYtbWVzLXNlcnZpY2U=.1_U3ByaW5nU2NoZWR1bGVkL2lvLmt5b3RvLnNvbGUudGhyZWFkcG9vbC5jb25maWcuRGVmYXVsdFRocmVhZFBvb2xDb25maWd1cmF0aW9uLnRocmVhZFN0YXRlSm9iUnVu|202012221019_ZGV2LXBhcy1zZXJ2aWNl.1_U3ByaW5nU2NoZWR1bGVkL2lvLmt5b3RvLnNvbGUudGhyZWFkcG9vbC5jb25maWcuRGVmYXVsdFRocmVhZFBvb2xDb25maWd1cmF0aW9uLnRocmVhZFN0YXRlSm9iUnVu|202012221019_bG9hbi1kZXYtbHBzLXdlYg==.1_L2xwcy13ZWIv|202012221019_bG9hbi1zdC1hcHYtc2VydmljZQ==.1_eHhsLWpvYi9NZXRob2RKb2IvaW8ua3lvdG8ub3BlcmF0aW9uLmFwdi5qb2JzLmFkanVzdC5DYXNBZGp1c3RJbmZvQmF0Y2hCZWFuLnRhc2tKb2JIYW5kbGVy|202012221019_bG9hbi1kZXYtY3JzLXNlcnZpY2U=.1_U3ByaW5nU2NoZWR1bGVkL2lvLmt5b3RvLmNoYW5uZWwuY3JzLm1vZHVsZXMubGlzdG1hdGNoLnNlcnZpY2UuaW1wbC5MaXN0TWF0Y2hTZXJ2aWNlSW1wbCQkRW5oYW5jZXJCeVNwcmluZ0NHTElCJCQ2MTQ0NDQ0YS5zeW5jTGlzdE1hdGNoZXJz|202012221019_bG9hbi1zdC1hbXMtc2VydmljZQ==.1_U3ByaW5nU2NoZWR1
bGVkL2lvLmt5b3RvLnNvbGUudGhyZWFkcG9vbC5jb25maWcuRGVmYXVsdFRocmVhZFBvb2xDb25maWd1cmF0aW9uLnRocmVhZFN0YXRlSm9iUnVu|202012221019_bG9hbi1zdC1hcHYtc2VydmljZQ==.1_eHhsLWpvYi9NZXRob2RKb2IvaW8ua3lvdG8ub3BlcmF0aW9uLmFwdi5qb2JzLndvcmtmbG93LlRhc2tSZWRvQnlQaGFzZU5vQmVhbi50YXNrSm9iSGFuZGxlcg==|202012221019_bG9hbi1kZXYtZ29zLXNlcnZpY2U=.1_U3ByaW5nU2NoZWR1bGVkL2lvLmt5b3RvLnNvbGUudGhyZWFkcG9vbC5jb25maWcuRGVmYXVsdFRocmVhZFBvb2xDb25maWd1cmF0aW9uLnRocmVhZFN0YXRlSm9iUnVu|202012221019_bG9hbi1zdC1sY3Mtc2VydmljZQ==.1_UmFiYml0TVEvVG9waWMva2V5Lmxjcy1zZXJ2aWNlLnJlcGF5UmVzdWx0UXVldWUvQ29uc3VtZXJ7Im1zZ0lkIjoiNWEzMjkyMGQ5MTdmNDQzMDhjZDVmMWY5N2Q3NWZkNjciLCJjb250ZW50Ijp7Im9mZmVyUmVxTm8iOiIwMDY5NjkyMzE1NDM1NzIwNzA0IiwidHJh|202012221019_bG9hbi1kZXYtY3JzLXNlcnZpY2U=.1_U3ByaW5nU2NoZWR1bGVkL2lvLmt5b3RvLnNvbGUuZWhjYWNoZS5sb2FkZXIuTG9jYWxDYWNoZUxvYWRlci51cGRhdGU=|202012221019_bG9hbi1kZXYtY3JzLXNlcnZpY2U=.1_eHhsLWpvYi9NZXRob2RKb2IvaW8ua3lvdG8uY2hhbm5lbC5jcnMubW9kdWxlcy5qb2JzLkNyZWRpdFF1ZXJ5SW5nQmF0Y2hGb3JQYXJhbXNCZWFuLnRh
c2tKb2JIYW5kbGVy|202012221019_bG9hbi1zdC1jcnMtc2VydmljZQ==.1_U3ByaW5nU2NoZWR1bGVkL2lvLmt5b3RvLnNvbGUuZWhjYWNoZS5sb2FkZXIuTG9jYWxDYWNoZUxvYWRlci51cGRhdGU=|202012221019_bG9hbi1kZXYtY3JzLXNlcnZpY2U=.1_U3ByaW5nU2NoZWR1bGVkL2lvLmt5b3RvLnNvbGUudGhyZWFkcG9vbC5jb25maWcuRGVmYXVsdFRocmVhZFBvb2xDb25maWd1cmF0aW9uLnRocmVhZFBvb2xTdGF0ZUpvYlJ1bg==|202012221019_bG9hbi1kZXYtbWVzLXNlcnZpY2U=.1_U3ByaW5nU2NoZWR1bGVkL2lvLmt5b3RvLnNvbGUudGhyZWFkcG9vbC5jb25maWcuRGVmYXVsdFRocmVhZFBvb2xDb25maWd1cmF0aW9uLnRocmVhZFBvb2xTdGF0ZUpvYlJ1bg==|202012221019_bG9hbi1zdC1jcnMtc2VydmljZQ==.1_U3ByaW5nU2NoZWR1bGVkL2lvLmt5b3RvLnNvbGUudGhyZWFkcG9vbC5jb25maWcuRGVmYXVsdFRocmVhZFBvb2xDb25maWd1cmF0aW9uLnRocmVhZFBvb2xTdGF0ZUpvYlJ1bg==|202012221019_bG9hbi1zdC1jcnMtc2VydmljZQ==.1_U3ByaW5nU2NoZWR1bGVkL2lvLmt5b3RvLnNvbGUudGhyZWFkcG9vbC5jb25maWcuRGVmYXVsdFRocmVhZFBvb2xDb25maWd1cmF0aW9uLnRocmVhZFN0YXRlSm9iUnVu|202012221019_c3QtcGFzLXNlcnZpY2U=.1_aW8ua3lvdG8ucGlsbGFyLnBhcy53aXRoaG9sZC5XaXRoaG9sZEZhY2FkZS5xdWVyeVJlc3VsdChRdWVyeVJlc3VsdFJ
lcXVlc3Qp|202012221019_bG9hbi1kZXYtbGNzLXNlcnZpY2U=.1_U3ByaW5nU2NoZWR1bGVkL2lvLmt5b3RvLnBpbGxhci5jb25maWcuQ2FjaGVDb25maWcuc3lzdGVtQXJndW1lbnRDYWNoZVVwZGF0ZQ==|202012221019_ZGV2LXBhcy1zZXJ2aWNl.1_U3ByaW5nU2NoZWR1bGVkL2lvLmt5b3RvLnNvbGUudGhyZWFkcG9vbC5jb25maWcuRGVmYXVsdFRocmVhZFBvb2xDb25maWd1cmF0aW9uLnRocmVhZFBvb2xTdGF0ZUpvYlJ1bg==|202012221019_bG9hbi1zdC1sY3Mtc2VydmljZQ==.1_eHhsLWpvYi9NZXRob2RKb2IvaW8ua3lvdG8ucGlsbGFyLmxjcy5qb2JzLnB1dG91dC5QdXRPdXRPZmZlckNoZWNrVGFzay50YXNrSm9iSGFuZGxlcg==|202012221019_bG9hbi1zdC1jaXMtc2VydmljZQ==.1_U3ByaW5nU2NoZWR1bGVkL2lvLmt5b3RvLnBpbGxhci5jaXMuY29tbW9uLmNvbmZpZy5DYWNoZUNvbmZpZy5kYkNvbmZpZ01pbnV0ZWx5Q2FjaGVVcGRhdGU=|202012221019_bG9hbi1kZXYtY3JzLXNlcnZpY2U=.1_U3ByaW5nU2NoZWR1bGVkL2lvLmt5b3RvLnNvbGUudGhyZWFkcG9vbC5jb25maWcuRGVmYXVsdFRocmVhZFBvb2xDb25maWd1cmF0aW9uLnRocmVhZFN0YXRlSm9iUnVu|202012221019_bG9hbi1zdC1hcHYtc2VydmljZQ==.1_eHhsLWpvYi9NZXRob2RKb2IvaW8ua3lvdG8ub3BlcmF0aW9uLmFwdi5qb2JzLmNyZWRpdC5DcmVkaXRRdWVyeUdhcFRpbWVPdXRCYXRjaEJlYW4udGFza0pvYk
hhbmRsZXI=|202012221019_bG9hbi1kZXYtZGVzLXNlcnZpY2U=.1_U3ByaW5nU2NoZWR1bGVkL2lvLmt5b3RvLnNvbGUudGhyZWFkcG9vbC5jb25maWcuRGVmYXVsdFRocmVhZFBvb2xDb25maWd1cmF0aW9uLnRocmVhZFBvb2xTdGF0ZUpvYlJ1bg==/
```
because of this,The system load will be very high,influxdb will failure to provide services ;
___
### version
8.2.0
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] wu-sheng commented on issue #6059: storage influxdb has slow query
Posted by GitBox <gi...@apache.org>.
wu-sheng commented on issue #6059:
URL: https://github.com/apache/skywalking/issues/6059#issuecomment-749498857
Could you format the query better than this? It is hard to read.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] dmsolr commented on issue #6059: storage influxdb has slow query
Posted by GitBox <gi...@apache.org>.
dmsolr commented on issue #6059:
URL: https://github.com/apache/skywalking/issues/6059#issuecomment-750301969
Hi @bestpayAmes
Could you take your time to test #6066 ?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] bestpayAmes commented on issue #6059: storage influxdb has slow query
Posted by GitBox <gi...@apache.org>.
bestpayAmes commented on issue #6059:
URL: https://github.com/apache/skywalking/issues/6059#issuecomment-749501067
because id is field key,so this query will be very slow;
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] bestpayAmes commented on issue #6059: storage influxdb has slow query
Posted by GitBox <gi...@apache.org>.
bestpayAmes commented on issue #6059:
URL: https://github.com/apache/skywalking/issues/6059#issuecomment-749541342
MetricsDAO.multiGet
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] wu-sheng commented on issue #6059: storage influxdb has slow query
Posted by GitBox <gi...@apache.org>.
wu-sheng commented on issue #6059:
URL: https://github.com/apache/skywalking/issues/6059#issuecomment-749525388
@bestpayAmes @dmsolr Do you know which query could trigger this?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] wu-sheng commented on issue #6059: storage influxdb has slow query
Posted by GitBox <gi...@apache.org>.
wu-sheng commented on issue #6059:
URL: https://github.com/apache/skywalking/issues/6059#issuecomment-749573209
@dmsolr it seems that is the thing we discussed. Do you have any suggestions? Make entity id as tag? `MetricsDAO#multiGet` looks like only having ID, rather than time range.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] wu-sheng closed issue #6059: storage influxdb has slow query
Posted by GitBox <gi...@apache.org>.
wu-sheng closed issue #6059:
URL: https://github.com/apache/skywalking/issues/6059
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] bestpayAmes edited a comment on issue #6059: storage influxdb has slow query
Posted by GitBox <gi...@apache.org>.
bestpayAmes edited a comment on issue #6059:
URL: https://github.com/apache/skywalking/issues/6059#issuecomment-749505740
```
SELECT
* ::FIELD
FROM
endpoint_avg
WHERE id = ~ / id1| id2 | id3 | id4 /
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] bestpayAmes commented on issue #6059: storage influxdb has slow query
Posted by GitBox <gi...@apache.org>.
bestpayAmes commented on issue #6059:
URL: https://github.com/apache/skywalking/issues/6059#issuecomment-749505740
SELECT
* ::FIELD
FROM
endpoint_avg
WHERE id = ~ / id1| id2 | id3 | id4 /
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] bestpayAmes commented on issue #6059: storage influxdb has slow query
Posted by GitBox <gi...@apache.org>.
bestpayAmes commented on issue #6059:
URL: https://github.com/apache/skywalking/issues/6059#issuecomment-749501356
@wu-sheng
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] bestpayAmes commented on issue #6059: storage influxdb has slow query
Posted by GitBox <gi...@apache.org>.
bestpayAmes commented on issue #6059:
URL: https://github.com/apache/skywalking/issues/6059#issuecomment-749500719
sorry,you mean the query condition?these id values are what it looks like;
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org