You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@cloudstack.apache.org by Vishesh Jindal <Vi...@shapeblue.com> on 2023/09/27 18:16:02 UTC

[DISCUSS] Timeout for Command execution on System VM & Agents

Hi all,

I came across an interesting bug today which can result in high wait times on System VMs & agents.

While processing a Command on system VM or an agent, even if the management server is no longer waiting for an answer the Command still keeps on getting processed. This can lead to high wait times if a lot of Commands get queued up on the system VM or the agent. I have added more details in the github issue here: https://github.com/apache/cloudstack/issues/8011
[https://opengraph.githubassets.com/fe2392c1a388867e98583043755129fedbe3ef20bf8d4f103711ab87e9426532/apache/cloudstack/issues/8011]<https://github.com/apache/cloudstack/issues/8011>
Add timeout for handling of Command on agent's implementation · Issue #8011 · apache/cloudstack<https://github.com/apache/cloudstack/issues/8011>
ISSUE TYPE Improvement Request COMPONENT NAME Agent, ServerResource CLOUDSTACK VERSION All versions CONFIGURATION N/A OS / ENVIRONMENT N/A SUMMARY The value for wait set in Command is not honored b...
github.com

One of the possible solutions would be to add a timeout on agents for all Commands. Cancelling the Command's execution on timeout will leave things in an intermediate state which can cause issues.

Anyone has any ideas or suggestions on a better approach to resolve this?

Regards,
Vishesh