You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@devlake.apache.org by "ibrahimejaz (via GitHub)" <gi...@apache.org> on 2023/02/01 19:15:16 UTC

[GitHub] [incubator-devlake] ibrahimejaz opened a new issue, #4291: Getting stream timeout error in most dashboards and huge time in querying.

ibrahimejaz opened a new issue, #4291:
URL: https://github.com/apache/incubator-devlake/issues/4291

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/incubator-devlake/issues?q=is%3Aissue) and found no similar issues.
   
   
   ### What happened
   
   Hi,
   We've tried using this and happen to see a huge latency in querying the results especially under DORA dashboard and as result ended up in stream timeout error, we've increased the limits in the grafana.ini file.
   Also able to see huge spike in the mysql process which kills the intances, so de-coupled the Database source to Cloud SQL and connected while querying from there as well there is huge spike in latency and also mysql instances received 100 CPU usage and stop responding we've even increased our mysql size to 12 core CPU but still there is 100% CPU usage, is there any known issue for the same? it would be really great if we could get any help for the same. Thanks much.
   
   
   ### What do you expect to happen
   
   Well it's a query from sql and it supposed be getting it response but its taking delay and going into stream timeout in almost all cases.
   
   ### How to reproduce
   
   While running DORA metrics dashboard mostly. 
   
   ### Anything else
   
   _No response_
   
   ### Version
   
   v0.15.0
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-devlake] klesh commented on issue #4291: Getting stream timeout error in most dashboards and huge time in querying.

Posted by "klesh (via GitHub)" <gi...@apache.org>.
klesh commented on issue #4291:
URL: https://github.com/apache/incubator-devlake/issues/4291#issuecomment-1415527846

   > @klesh Can see happening in "Overall DORA Metrics" and "Deployment Frequency" Charts, if thats specific you're asking about. Also using 16 Core machine with 64GB Memory and mostly seeing the same.
   
   I see, please try replacing the dashboard with the one from @abeizn 's pr #4311 and see if the problem solved, thanks in advanced. 😊


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-devlake] ibrahimejaz commented on issue #4291: Getting stream timeout error in most dashboards and huge time in querying.

Posted by "ibrahimejaz (via GitHub)" <gi...@apache.org>.
ibrahimejaz commented on issue #4291:
URL: https://github.com/apache/incubator-devlake/issues/4291#issuecomment-1413943909

   Also getting more error with 504 Gateway Time-out.https://share.anysnap.app/fXbw9qrSGh3B
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-devlake] abeizn commented on issue #4291: Getting stream timeout error in most dashboards and huge time in querying.

Posted by "abeizn (via GitHub)" <gi...@apache.org>.
abeizn commented on issue #4291:
URL: https://github.com/apache/incubator-devlake/issues/4291#issuecomment-1414588021

   > Also getting more error with 504 Gateway Time-out.https://share.anysnap.app/fXbw9qrSGh3B
   @ibrahimejaz 
   The v0.15.0-rc5 version will alleviate, you can try. In next version, we will consider how to further optimize.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-devlake] klesh commented on issue #4291: Getting stream timeout error in most dashboards and huge time in querying.

Posted by "klesh (via GitHub)" <gi...@apache.org>.
klesh commented on issue #4291:
URL: https://github.com/apache/incubator-devlake/issues/4291#issuecomment-1413252329

   @ibrahimejaz thank you very much for reporting the issue, this is indeed a problem.
   Do you have any clue which Charts/SQLs might cause the problem?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-devlake] ibrahimejaz commented on issue #4291: Getting stream timeout error in most dashboards and huge time in querying.

Posted by "ibrahimejaz (via GitHub)" <gi...@apache.org>.
ibrahimejaz commented on issue #4291:
URL: https://github.com/apache/incubator-devlake/issues/4291#issuecomment-1413558408

   @klesh Can see happening in "Overall DORA Metrics" and "Deployment Frequency" Charts, if thats specific you're asking about. Also using 16 Core machine with 64GB Memory and mostly seeing the same. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-devlake] ibrahimejaz commented on issue #4291: Getting stream timeout error in most dashboards and huge time in querying.

Posted by "ibrahimejaz (via GitHub)" <gi...@apache.org>.
ibrahimejaz commented on issue #4291:
URL: https://github.com/apache/incubator-devlake/issues/4291#issuecomment-1415653770

   It's now working like a charm. Thanks.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-devlake] ibrahimejaz closed issue #4291: Getting stream timeout error in most dashboards and huge time in querying.

Posted by "ibrahimejaz (via GitHub)" <gi...@apache.org>.
ibrahimejaz closed issue #4291: Getting stream timeout error in most dashboards and huge time in querying.
URL: https://github.com/apache/incubator-devlake/issues/4291


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org