You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cloudstack.apache.org by "sureshanaparti (via GitHub)" <gi...@apache.org> on 2024/09/23 11:15:26 UTC
[I] Management server state not Down after management service stop [in main] [cloudstack]
sureshanaparti opened a new issue, #9722:
URL: https://github.com/apache/cloudstack/issues/9722
<!--
Verify first that your issue/request is not already reported on GitHub.
Also test if the latest release and main branch are affected too.
Always add information AFTER of these HTML comments, but no need to delete the comments.
-->
Management server state not Down after management service stop [in main], also noticed some components are not stopped during service stop.
##### ISSUE TYPE
<!-- Pick one below and delete the rest -->
* Bug Report
##### COMPONENT NAME
<!--
Categorize the issue, e.g. API, VR, VPN, UI, etc.
-->
~~~
Manager Components: ClusterManagerImpl, ClusterServiceServletAdapter, etc
~~~
##### CLOUDSTACK VERSION
<!--
New line separated list of affected versions, commit ID for issues on main branch.
-->
~~~
4.20.0.0-SNAPSHOT
~~~
##### CONFIGURATION
<!--
Information about the configuration if relevant, e.g. basic network, advanced networking, etc. N/A otherwise
-->
##### OS / ENVIRONMENT
<!--
Information about the environment if relevant, N/A otherwise
-->
MS OL8 + KVM OL8, Advanced Networking.
##### SUMMARY
<!-- Explain the problem/feature briefly -->
Management server state not Down after management service stop [in main], also noticed some components are not stopped during service stop.
Manager Components: ClusterManagerImpl, ClusterServiceServletAdapter, etc are not stopped. Didn't notice the below logs after stop.
```
stopping bean ClusterManagerImpl
stopping bean ClusterServiceServletAdapter
```
From 4.20.0.0-SNAPSHOT =>
<img width="1262" alt="MgmtServers_4 20 0 0-SNAPSHOT" src="https://github.com/user-attachments/assets/9b2a3de5-a4e7-404a-bbc3-a6127d97052d">
```
sureshanaparti$ cat 4.20.0.0-SNAPSHOT_StoppingBeansCheck.txt | wc -l
1139
```
[4.20.0.0-SNAPSHOT_StoppingBeansCheck.txt](https://github.com/user-attachments/files/17096546/4.20.0.0-SNAPSHOT_StoppingBeansCheck.txt)
From 4.19.1.1 env =>
<img width="1266" alt="MgmtServers_4 19 1 1" src="https://github.com/user-attachments/assets/b6e4a19f-fa93-43ca-9881-244590a41120">
```
sureshanaparti$ cat 4.19.1.1_StoppingBeansCheck.txt | wc -l
1272
```
[4.19.1.1_StoppingBeansCheck.txt](https://github.com/user-attachments/files/17096548/4.19.1.1_StoppingBeansCheck.txt)
##### STEPS TO REPRODUCE
<!--
For bugs, show exactly how to reproduce the problem, using a minimal test-case. Use Screenshots if accurate.
For new features, show how the feature would be used.
-->
- Created env with latest main / 4.20.0.0-SNAPSHOT
- Stop the management service from MS (`service cloudstack-management stop`) - Notice that management server state is still Up after service is stopped.
<!-- You can also paste gist.github.com links for larger files -->
##### EXPECTED RESULTS
<!-- What did you expect to happen when running the steps above? -->
~~~
MS state should be in Down state after management service stopped (and all manager components should be stopped for graceful service stop).
~~~
##### ACTUAL RESULTS
<!-- What actually happened? -->
<!-- Paste verbatim command output between quotes below -->
~~~
MS state is in Up state after management service stopped (and few manager components are not stopped).
~~~
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Management server state not Down after management service stop [in main] [cloudstack]
Posted by "sureshanaparti (via GitHub)" <gi...@apache.org>.
sureshanaparti commented on issue #9722:
URL: https://github.com/apache/cloudstack/issues/9722#issuecomment-2367949760
@weizhouapache this is not related to OOM killer, some components in the spring modules are not invoking stop during service stop. I could root cause the issue, working on the fix.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Management server state not Down after management service stop [in main] [cloudstack]
Posted by "weizhouapache (via GitHub)" <gi...@apache.org>.
weizhouapache commented on issue #9722:
URL: https://github.com/apache/cloudstack/issues/9722#issuecomment-2367978910
> @weizhouapache this is not related to OOM killer, some components in the spring modules are not invoking stop during service stop. I could root cause the issue, working on the fix.
thanks @sureshanaparti
I never faced the OOM killer issue in envs with only 1 mgmt server.
Maybe it is also related to the multiple mgmt serverss
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Management server state not Down after management service stop [in main] [cloudstack]
Posted by "sureshanaparti (via GitHub)" <gi...@apache.org>.
sureshanaparti commented on issue #9722:
URL: https://github.com/apache/cloudstack/issues/9722#issuecomment-2367919023
@JoaoJandre @DaanHoogland I've noticed this issue in my testing, seems to be a critical one, maybe blocker if the management server state is considered during communication in multi-MS/clustered env.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Management server state not Down after management service stop [in main] [cloudstack]
Posted by "weizhouapache (via GitHub)" <gi...@apache.org>.
weizhouapache commented on issue #9722:
URL: https://github.com/apache/cloudstack/issues/9722#issuecomment-2367933814
I remember we have noticed some other issues regarding the management server
- stopping management server takes 1 minute which is mucher longer than before (found by @DaanHoogland ?)
- OOM killer on cloudstack-management service (might it be related to this issue ? @sureshanaparti )
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org