You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@skywalking.apache.org by GitBox <gi...@apache.org> on 2022/12/06 14:23:44 UTC

[GitHub] [skywalking] hanahmily opened a new issue, #10119: [BanyanDB][Bug] Querying topology takes a long time

hanahmily opened a new issue, #10119:
URL: https://github.com/apache/skywalking/issues/10119

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/skywalking/issues?q=is%3Aissue) and found no similar issues.
   
   
   ### Apache SkyWalking Component
   
   OAP server (apache/skywalking)
   
   ### What happened
   
    Querying topology takes a long time in BanyanDB. It uses around 10 seconds to get the results. We should investigate the root reason.
   
   ### What you expected to happen
   
   Get response in millisecond.
   
   ### How to reproduce
   
   Use showcase to deploy a cluster. Query the global topology.
   
   ### Anything else
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [skywalking] hanahmily commented on issue #10119: [BanyanDB][Bug] Querying topology takes a long time

Posted by GitBox <gi...@apache.org>.
hanahmily commented on issue #10119:
URL: https://github.com/apache/skywalking/issues/10119#issuecomment-1343795598

   Although the latency is reduced to ms when data is written in buffer(Main memory). The querying takes seconds when scanning tables on the disk. 
   ![profile005](https://user-images.githubusercontent.com/1960537/206616779-83d2ceef-588f-4048-9470-71e70ea5effb.png)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [skywalking] hanahmily commented on issue #10119: [BanyanDB][Bug] Querying topology takes a long time

Posted by GitBox <gi...@apache.org>.
hanahmily commented on issue #10119:
URL: https://github.com/apache/skywalking/issues/10119#issuecomment-1343802971

   There are a couple of enhancements needed to be applied. The order represents their priorities. 
   
   - [ ] [OAP] Using `or` in place of several independent short `querying by service_id/instance_id/endpoint_id`. `or` could merge `source` and `dest` searchings.
   - [ ] Reclaim the write buffer of the inverted index. 
   - [ ] Remove the primary index to get rid of scanning tables. 
   - [ ] Transform the index filter's logical expressions to the inverted index's boolean operations. 
     


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [skywalking] hanahmily commented on issue #10119: [BanyanDB][Bug] Querying topology takes a long time

Posted by GitBox <gi...@apache.org>.
hanahmily commented on issue #10119:
URL: https://github.com/apache/skywalking/issues/10119#issuecomment-1366670761

   Fixed by https://github.com/apache/skywalking/pull/10181
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [skywalking] hanahmily closed issue #10119: [BanyanDB][Bug] Querying topology takes a long time

Posted by GitBox <gi...@apache.org>.
hanahmily closed issue #10119: [BanyanDB][Bug] Querying topology takes a long time 
URL: https://github.com/apache/skywalking/issues/10119


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [skywalking] hanahmily commented on issue #10119: [BanyanDB][Bug] Querying topology takes a long time

Posted by GitBox <gi...@apache.org>.
hanahmily commented on issue #10119:
URL: https://github.com/apache/skywalking/issues/10119#issuecomment-1340447152

   ![topology_profile](https://user-images.githubusercontent.com/1960537/206103835-5f5f614d-771c-4780-887c-0d9fd58f335f.svg)
   
   According to the above CPU profile. The query procedure fetches the Etcd service by mistake. It should access the cache instead. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [skywalking] hanahmily closed issue #10119: [BanyanDB][Bug] Querying topology takes a long time

Posted by GitBox <gi...@apache.org>.
hanahmily closed issue #10119: [BanyanDB][Bug] Querying topology takes a long time 
URL: https://github.com/apache/skywalking/issues/10119


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org