You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@openwhisk.apache.org by "husterdjx (via GitHub)" <gi...@apache.org> on 2023/05/17 10:38:14 UTC

[GitHub] [openwhisk] husterdjx opened a new issue, #5414: Load Balancer's Buffering and Scheduling Strategies

husterdjx opened a new issue, #5414:
URL: https://github.com/apache/openwhisk/issues/5414

# Describe the question
I am studying the internal operations of OpenWhisk, particularly the load balancer. I would like to understand more about the buffering and scheduling strategies for incoming requests.

# Details to consider

1. How does the buffering of incoming requests work within the load balancer? Is there a dedicated request buffer?
What are the factors taken into consideration in the load balancer's scheduling strategy when distributing these buffered requests to the invokers?
2. In situations where invoker load is high, how does the system respond? Are more requests buffered during these times?
3. In situations where invoker load is high, how does the system respond? Does the load balancer consider waiting for a period of time before issuing a request immediately when the invoker is always available?
# Additional context
Understanding these details will be beneficial for optimizing my use of OpenWhisk and contributing to the project. Any information or resources you could provide would be greatly appreciated.

Thank you!

--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@openwhisk.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [openwhisk] style95 commented on issue #5414: Load Balancer's Buffering and Scheduling Strategies

Posted by "style95 (via GitHub)" <gi...@apache.org>.

style95 commented on issue #5414:
URL: https://github.com/apache/openwhisk/issues/5414#issuecomment-1551203834

   OpenWhisk is now moving forward with the new scheduler though OW is still using the old scheduler by default.
   If you are asking them in terms of the new scheduler, I believe you can find this document useful.
   https://cwiki.apache.org/confluence/display/OPENWHISK/System+Architecture


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@openwhisk.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [openwhisk] husterdjx commented on issue #5414: Load Balancer's Buffering and Scheduling Strategies

Posted by "husterdjx (via GitHub)" <gi...@apache.org>.

husterdjx commented on issue #5414:
URL: https://github.com/apache/openwhisk/issues/5414#issuecomment-1554167879

   > OpenWhisk is now moving forward with the new scheduler though OW is still using the old scheduler by default. If you are asking them in terms of the new scheduler, I believe you can find this document useful. https://cwiki.apache.org/confluence/display/OPENWHISK/System+Architecture
   
   Thank you for your timely response!
   
   Unfortunately, I didn't find what I was looking for in the document. I would like to explore openwhisk's handling of batch processing requests. For example, the system sets the batch size to 8. Under low load, if the batch buffer doesn't fill up with requests for a long time, will this result in a situation where a batch request cannot be triggered?
   
   I'm very interested in understanding the design or implementation of this part and would appreciate if someone could help me with this query!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@openwhisk.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [openwhisk] style95 commented on issue #5414: Load Balancer's Buffering and Scheduling Strategies

Posted by "style95 (via GitHub)" <gi...@apache.org>.

style95 commented on issue #5414:
URL: https://github.com/apache/openwhisk/issues/5414#issuecomment-1554197029

   I don't get what kinds of batches you are mentioning.
   As described in the document, OW has a queue for each action. Incoming requests will be buffered in the queue and the queue itself calculates the required number of containers to process them.
   Once containers are provisioned, each container will process requests in a best-effort manner.
   When there are not enough containers, requests will stay longer in the queue and the queue will try to provision extra containers according to it.
   And the number of containers is limited by the namespace limit.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@openwhisk.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org