You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cloudstack.apache.org by "btzq (via GitHub)" <gi...@apache.org> on 2024/12/02 09:04:19 UTC
[I] Feature Idea: 'Host/Cluster Waiting For Maintenance' Mode [cloudstack]
btzq opened a new issue, #10019:
URL: https://github.com/apache/cloudstack/issues/10019
<!--
Verify first that your issue/request is not already reported on GitHub.
Also test if the latest release and main branch are affected too.
Always add information AFTER of these HTML comments, but no need to delete the comments.
-->
##### ISSUE TYPE
<!-- Pick one below and delete the rest -->
* Feature Idea
##### COMPONENT NAME
<!--
Categorize the issue, e.g. API, VR, VPN, UI, etc.
-->
~~~
Host? Cluster? Im not sure
~~~
##### CLOUDSTACK VERSION
<!--
New line separated list of affected versions, commit ID for issues on main branch.
-->
~~~
NA
~~~
##### CONFIGURATION
<!--
Information about the configuration if relevant, e.g. basic network, advanced networking, etc. N/A otherwise
-->
##### OS / ENVIRONMENT
<!--
Information about the environment if relevant, N/A otherwise
-->
##### SUMMARY
<!-- Explain the problem/feature briefly -->
### **Current Capability**
CloudStack currently offers a 'Maintenance' Mode, which facilitates the live migration of all VMs from a host and removes the host from the cluster for maintenance.
### **Proposed Feature: "Waiting for Maintenance" Mode**
The proposed "Waiting for Maintenance" Mode introduces a preparatory state that addresses scenarios where live migration is impractical or impossible. This feature would enable gradual decommissioning or maintenance while avoiding service disruption.
### **General Idea of How It Might Work:**
**1. **Operator Responsibilities:****
- Customer communication and notification will be managed entirely by the cloud company, outside of CloudStack. This is to inform customers that they are given a time window to voluntarily restart their VMs before the cut off date.
**2. CloudStack Responsibilities:**
- Block the creation of new VMs to the host/cluster marked as 'Waiting For Maintenance'
- Ensure restarted VMs are relocated to clusters with matching host tags.
_This is actually a similar process as how AWS Cloud does it: https://aws.amazon.com/maintenance-help/_
### **Use Cases**
**Scenario 1: Decommissioning an Old Compute Cluster**
Problem:
- Legacy clusters with outdated CPU architectures cannot perform live migration due to compatibility issues
(e.g., VM freezing during migration causing downtime).
- Existing VMs must restart to migrate to a new cluster with compatible architectures.
- The old cluster remains active, risking the placement of new VMs and hindering decommissioning.
**Scenario 2: Maintenance of GPU Clusters with GPU Passthrough**
Problem:
- GPU passthrough prevents live migration, unlike vGPU setups that allow seamless migration.
- Downtime-free maintenance is not feasible, requiring customer cooperation to restart affected VMs.
##### STEPS TO REPRODUCE
<!--
For bugs, show exactly how to reproduce the problem, using a minimal test-case. Use Screenshots if accurate.
For new features, show how the feature would be used.
-->
<!-- Paste example playbooks or commands between quotes below -->
~~~
NA
~~~
<!-- You can also paste gist.github.com links for larger files -->
##### EXPECTED RESULTS
<!-- What did you expect to happen when running the steps above? -->
~~~
Refer to Above
~~~
##### ACTUAL RESULTS
<!-- What actually happened? -->
<!-- Paste verbatim command output between quotes below -->
~~~
Not able to facilitate smooth decomissioning of servers for compute where live migration is not possible.
~~~
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Feature Idea: 'Host/Cluster Waiting For Maintenance' Mode [cloudstack]
Posted by "btzq (via GitHub)" <gi...@apache.org>.
btzq commented on issue #10019:
URL: https://github.com/apache/cloudstack/issues/10019#issuecomment-2536146510
@nvazquez just to confirm, Cloudstack does not need to handle the notification to users. The Cloud Operator should handle that themselves, via their chosen mode of communication with the users.
Question, when a Host is disabled, does the VMs that were originally running in that Host stay there? Or does Cloudstack force it to restart in another host that is available?
Your understanding on the proposed idea is correct.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Feature Idea: 'Host/Cluster Waiting For Maintenance' Mode [cloudstack]
Posted by "DaanHoogland (via GitHub)" <gi...@apache.org>.
DaanHoogland commented on issue #10019:
URL: https://github.com/apache/cloudstack/issues/10019#issuecomment-4222079159
@btzq @nvazquez , it seems to me this feature idea is not going to happen. Shall we close? (maybe after some extra documenting?)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Feature Idea: 'Host/Cluster Waiting For Maintenance' Mode [cloudstack]
Posted by "DaanHoogland (via GitHub)" <gi...@apache.org>.
DaanHoogland commented on issue #10019:
URL: https://github.com/apache/cloudstack/issues/10019#issuecomment-2514501396
cc @nvazquez any opinion?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Feature Idea: 'Host/Cluster Waiting For Maintenance' Mode [cloudstack]
Posted by "nvazquez (via GitHub)" <gi...@apache.org>.
nvazquez commented on issue #10019:
URL: https://github.com/apache/cloudstack/issues/10019#issuecomment-2533531055
Hi @DaanHoogland @btzq I think its a good idea for automating or notifying users about planned maintenance automatically. If I'm understanding the use case correctly, the same tasks can be manually done currently by:
- disabling the host to prevent new VM deployments
- stop the running VMs and migrate them to different hosts, then start them back on the new hosts.
- enable maintenance mode on the host.
I assume the proposed idea is to set the host into this new state and provide a date to let know CloudStack when to stop the VMs and migrate them away, and enable maintenance mode? If a VM running on the host is restarted before the planned date then it should be migrated and started on a different host? Is my understanding correct?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Feature Idea: 'Host/Cluster Waiting For Maintenance' Mode [cloudstack]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #10019:
URL: https://github.com/apache/cloudstack/issues/10019#issuecomment-4215231164
### 🏷️ Issue Triaged
Hi `@nvazquez`! I've categorized this issue as **feature** based on the following analysis:
**Reasoning**: This is a feature request for a new "Waiting for Maintenance" mode that would allow hosts/clusters to gracefully transition before entering maintenance mode.
<details>
<summary><b>View Triage Details</b></summary>
#### Analysis
- **Keywords detected**: "Feature Idea", "Waiting For Maintenance Mode", new functionality
- **Issue type indicators**: Requests new capability for host/cluster maintenance workflow
- **Confidence**: High
#### Recommended Next Steps
- Review feasibility of implementing this intermediate maintenance state
- Consider impact on existing maintenance workflows
- Evaluate user stories and use cases
</details>
**References**: [Triage run §24196541923](https://github.com/apache/cloudstack/actions/runs/24196541923)
> Generated by [Issue Triage Agent](https://github.com/apache/cloudstack/actions/runs/24196541923)
>
> To install this workflow, run `gh aw add github/gh-aw/.github/workflows/issue-triage-agent.md@94662b1dee8ce96c876ba9f33b3ab8be32de82a4`. View source at [https://github.com/github/gh-aw/tree/94662b1dee8ce96c876ba9f33b3ab8be32de82a4/.github/workflows/issue-triage-agent.md](https://github.com/github/gh-aw/tree/94662b1dee8ce96c876ba9f33b3ab8be32de82a4/.github/workflows/issue-triage-agent.md).
<!-- gh-aw-agentic-workflow: Issue Triage Agent, run: https://github.com/apache/cloudstack/actions/runs/24196541923 -->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Feature Idea: 'Host/Cluster Waiting For Maintenance' Mode [cloudstack]
Posted by "nvazquez (via GitHub)" <gi...@apache.org>.
nvazquez commented on issue #10019:
URL: https://github.com/apache/cloudstack/issues/10019#issuecomment-2536843762
Thanks @btzq, in the current behavior: once the host is disabled CloudStack just prevents new deployments on that host but all the running VMs remain running on the host. The migration of these VMs need to be manually executed, otherwise while entering maintenance mode CloudStack will attempt live migrations to another host.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Feature Idea: 'Host/Cluster Waiting For Maintenance' Mode [cloudstack]
Posted by "DaanHoogland (via GitHub)" <gi...@apache.org>.
DaanHoogland commented on issue #10019:
URL: https://github.com/apache/cloudstack/issues/10019#issuecomment-2514500558
good idea @btzq , I wonder if we need a new state as there is already "prepare for maintenance". this might be overloaded, i.e. set manually instead of automatically. let's investigate.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org