You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@devlake.apache.org by GitBox <gi...@apache.org> on 2022/11/18 07:26:50 UTC
[GitHub] [incubator-devlake] klesh opened a new issue, #3756: [Feature][framework] RESTful helper to support slow jira server api response by adjusting ratelimit dynamically
klesh opened a new issue, #3756:
URL: https://github.com/apache/incubator-devlake/issues/3756
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/incubator-devlake/issues?q=is%3Aissue) and found no similar feature requirement.
### Use case
For users who have to collect data from a slow JIRA Server Instance, the chance of pipelines failing is too high to cope:
1. API timeout too many times causing the RETRY mechanism to give up.
2. High concurrency causing jira API to be even slower or crash
In this situation, it is nearly impossible for the user to collect jira data, it would fail over and over again for any reasonable jira board.
Apache Devlake should be able to cope with the situation:
1. Be able to collect data even if the API was insanely slow
2. Be able to collect data ASAP even if the API response time fluctuates from time to time
### Description
1. set RETRY to a relative high value
2. keep track of the RETRY history and adjust the RATE LIMIT dynamically
### Related issues
_No response_
### Are you willing to submit a PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] klesh commented on issue #3756: [Feature][framework] RESTful helper to support slow jira server api response by adjusting ratelimit dynamically
Posted by GitBox <gi...@apache.org>.
klesh commented on issue #3756:
URL: https://github.com/apache/incubator-devlake/issues/3756#issuecomment-1322116000
Come to think about the problem, it is more like a Cache Eviction Policy problem rather than Binary Exponential Backoff:
In order to find out the Optimal Concurrency Value at any point in time for a slow API server in a Production Environment, we need to approach the highest possible concurrency without Breaking the Server if possible. BEB is too aggressive and it is more likely to take down the Server completely.
Now, let's assume that at time A, the Best Value for the Server is 10000 RPH (Request Per Hour), 800 RPH for time B, 6000 RPH for time C, ideally, we want our Actual Value to match them perfectly. However, it is impossible since nobody including the server itself can predict what would the Best Value be. The only thing we can bet on is the Response Lag from the Server, it reflects the Server Load, more or less.
So, here is my Plan of Attach:
1. Write a proxy server that could Record/Replay API response
2. Record a full issues collection from a Jira Server and save the responses to some sort of cache
3. The proxy server should be able to replay the responses in a controllable way, like, adding a random Delay to the response which correlated to the Best Value, and writing the Delay/BestRPH to the database as the BestValues
4. Write a RateLimitRegulator that would take samples of the response time, adjust the RPH accordingly and write them to the database as the ActualValues as well
5. Pull the BestValues and ActualValues from the database to a Grafana Trend Chart, they should look alike and close to each other.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] github-actions[bot] commented on issue #3756: [Feature][framework] RESTful helper to support slow jira server api response by adjusting ratelimit dynamically
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #3756:
URL: https://github.com/apache/incubator-devlake/issues/3756#issuecomment-1362243315
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] github-actions[bot] commented on issue #3756: [Feature][framework] RESTful helper to support slow jira server api response by adjusting ratelimit dynamically
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #3756:
URL: https://github.com/apache/incubator-devlake/issues/3756#issuecomment-1366994138
This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-devlake] github-actions[bot] closed issue #3756: [Feature][framework] RESTful helper to support slow jira server api response by adjusting ratelimit dynamically
Posted by GitBox <gi...@apache.org>.
github-actions[bot] closed issue #3756: [Feature][framework] RESTful helper to support slow jira server api response by adjusting ratelimit dynamically
URL: https://github.com/apache/incubator-devlake/issues/3756
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@devlake.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org