You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cloudstack.apache.org by GitBox <gi...@apache.org> on 2020/03/09 16:36:41 UTC

[GitHub] [cloudstack] rvalle opened a new issue #3954: Cloudstack Management Improper shutdown

rvalle opened a new issue #3954: Cloudstack Management Improper shutdown
URL: https://github.com/apache/cloudstack/issues/3954
 
 
   <!--
   Verify first that your issue/request is not already reported on GitHub.
   Also test if the latest release and master branch are affected too.
   Always add information AFTER of these HTML comments, but no need to delete the comments.
   -->
   
   ##### ISSUE TYPE
   <!-- Pick one below and delete the rest -->
    * Bug Report
   
   ##### COMPONENT NAME
   <!--
   Categorize the issue, e.g. API, VR, VPN, UI, etc.
   -->
   ~~~
   Cloudstack Manager
   ~~~
   
   ##### CLOUDSTACK VERSION
   <!--
   New line separated list of affected versions, commit ID for issues on master branch.
   -->
   
   ~~~
   4.13.0.0
   ~~~
   
   ##### CONFIGURATION
   <!--
   Information about the configuration if relevant, e.g. basic network, advanced networking, etc.  N/A otherwise
   -->
   
   
   ##### OS / ENVIRONMENT
   <!--
   Information about the environment if relevant, N/A otherwise
   -->
   
   Centos 7, following quick installation guide.
   
   
   ##### SUMMARY
   <!-- Explain the problem/feature briefly -->
   
   I believe a Cloudstack Management Server shutdown will shutdown mysql and the Cloudstack Manager in no particular order, which results in instability.
   
   ##### STEPS TO REPRODUCE
   <!--
   For bugs, show exactly how to reproduce the problem, using a minimal test-case. Use Screenshots if accurate.
   
   For new features, show how the feature would be used.
   -->
   
   <!-- Paste example playbooks or commands between quotes below -->
   ~~~
   Install the Cloudstack Management server followign the quick install guide,
   when finished, reboot the system.
   A lot of exceptions appear in the log files during the Manager shutdown pointing at the database not being available.
   
   The system may become "broken" after restart.
   
   ~~~
   
   <!-- You can also paste gist.github.com links for larger files -->
   
   ##### EXPECTED RESULTS
   <!-- What did you expect to happen when running the steps above? -->
   
   ~~~
   The server should be rebooted cleanly, all components (manager, mysql, etc) in the right order, no exceptions thrown.
   ~~~
   
   ##### ACTUAL RESULTS
   <!-- What actually happened? -->
   
   <!-- Paste verbatim command output between quotes below -->
   ~~~
   Lots of exceptions during shutdown.
   Non working system after reboot.
   
   
   
   ~~~
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] andrijapanicsb edited a comment on issue #3954: Cloudstack Management Improper shutdown - causes mgmt to not start after reboot of server

Posted by GitBox <gi...@apache.org>.
andrijapanicsb edited a comment on issue #3954: Cloudstack Management Improper shutdown - causes mgmt to not start after reboot of server
URL: https://github.com/apache/cloudstack/issues/3954#issuecomment-597625815
 
 
   I guess I answered this question myself by testing - the mgmt will not boot after the MySQL and thus is down, needs a restart of mgmt server to be up again.
   
   Marking this one as a blocker against 4.14, but the fix will be implemented un 4.13.1 so we can forward merge to 4.14/master.
   
   Thanks, @rvalle for reporting this, nice blocker :) 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] DaanHoogland commented on issue #3954: Cloudstack Management Improper shutdown

Posted by GitBox <gi...@apache.org>.
DaanHoogland commented on issue #3954: Cloudstack Management Improper shutdown
URL: https://github.com/apache/cloudstack/issues/3954#issuecomment-597019583
 
 
   @rvalle can you confirm this with 4.14 as well?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] DaanHoogland commented on issue #3954: Cloudstack Management Improper shutdown

Posted by GitBox <gi...@apache.org>.
DaanHoogland commented on issue #3954: Cloudstack Management Improper shutdown
URL: https://github.com/apache/cloudstack/issues/3954#issuecomment-597581466
 
 
   btw, I could read above that you think it should be solved in documentation and not in packaging. Is that correct?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] rvalle commented on issue #3954: Cloudstack Management Improper shutdown - causes mgmt to not start after reboot of server

Posted by GitBox <gi...@apache.org>.
rvalle commented on issue #3954: Cloudstack Management Improper shutdown - causes mgmt to not start after reboot of server
URL: https://github.com/apache/cloudstack/issues/3954#issuecomment-597629554
 
 
   @andrijapanicsb  I found out about this in issue #3909 a reboot after the initial setup is actually fatal.
   you are welcome, happy to contribute when I can.
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] DaanHoogland commented on issue #3954: Cloudstack Management Improper shutdown

Posted by GitBox <gi...@apache.org>.
DaanHoogland commented on issue #3954: Cloudstack Management Improper shutdown
URL: https://github.com/apache/cloudstack/issues/3954#issuecomment-597580793
 
 
   @rvalle sound good, one doubt is editting the unit dep file with ldap and/or nginx. How will that behave on upgrades? for now ldap is only used readonly so that would not be a big problem.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] rvalle commented on issue #3954: Cloudstack Management Improper shutdown

Posted by GitBox <gi...@apache.org>.
rvalle commented on issue #3954: Cloudstack Management Improper shutdown
URL: https://github.com/apache/cloudstack/issues/3954#issuecomment-597565642
 
 
   For option 2, in case you need to supplement your existing system with an additional dependency just:
   - create the directory: **/etc/systemd/system/cloudstack-management.service.d**
   - create a configuration file, such as **mysq-dep.conf** for that particular dependency in that directory, with the following content:
   ```
   [Unit]
   Requires=mysql.service
   After=mysql.service
   ```
   - then you need to reload systemd configuration with **systemctl daemon-reload**
   - test that the dependency is working: for stopping mysql will stop your cloudstack management service first.
   - Similar files can be created to add other dependencies: ldap, nginx, etc. depending on your setup.
   
   
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] rvalle edited a comment on issue #3954: Cloudstack Management Improper shutdown

Posted by GitBox <gi...@apache.org>.
rvalle edited a comment on issue #3954: Cloudstack Management Improper shutdown
URL: https://github.com/apache/cloudstack/issues/3954#issuecomment-597486925
 
 
   Systemd seems to support 2 approaches,
   - The obvious one, to fix the provided Systemd files for CS Manager.
   - The second one, is to [supplement existing configuration files](https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/7/html/system_administrators_guide/sect-Managing_Services_with_systemd-Unit_Files#sect-Managing_Services_with_systemd-Unit_File_Modify) with additional files that fine tune its behaviour.
   The second one is useful in the (unlikely) case we needed to modify mysql unit file or in case we want to patch installation based on versions of CS Manager with this bug.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] DaanHoogland commented on issue #3954: Cloudstack Management Improper shutdown - causes mgmt to not start after reboot of server

Posted by GitBox <gi...@apache.org>.
DaanHoogland commented on issue #3954: Cloudstack Management Improper shutdown - causes mgmt to not start after reboot of server
URL: https://github.com/apache/cloudstack/issues/3954#issuecomment-599593507
 
 
   @rvalle @rhtyd @andrijapanicsb I've read up on systemd a bit;
   
   1. `If unit1 has the directive After=unit2, then if both units are run, unit2 will be executed fully before unit1 starts.`
   
   1. `If unit1 has Wants=unit2 as a dependency, when unit1 is run, unit2 will be run as well. But whether unit2 starts successfully does not affect unit1 running successfully.`
   
   I think we can leverage the two to make sure that if mysql is installed on the same server it will be properly schedule to start before and shutdown after cloudstack.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] rvalle commented on issue #3954: Cloudstack Management Improper shutdown

Posted by GitBox <gi...@apache.org>.
rvalle commented on issue #3954: Cloudstack Management Improper shutdown
URL: https://github.com/apache/cloudstack/issues/3954#issuecomment-597606152
 
 
   @DaanHoogland 
   when supplementing a service profile it is possible to create a directory under /etc/systemd... (as shown avobe) and under the directory an independent file can be created to map each dependency.
   
   systemd foresees this particular use case where dependencies need to be tuned by the system administrator, independently of the software distribution.
   
   Package distributions will install their service units under /lib/systemd and will not interfere.
   
   In other words, I can add an ldap-dep.conf file and an nginx-dep.conf in /etc/systemd/system/cloudstack-management.service.d/ and they will complement the file provided by the distribution, even if there are updates (directory trees are independent).
   
   Having said this, we face 2 problems.
   - Admins may or may not run mysql alongside the management server
   - Admins may or may not run other services (ldap, nginx, etc).
   
   What I think we could implement is:
   - leave **/lib/systemd/system/cloudstack-management.service** unchanged, because we don't know where mysql will run, and we cannot ask the admins to patch that file according to their env.
   - modify **cloudstack-setup-databases** to create a service profile supplement by default, creating the dependency as: **/etc/systemd/system/cloudstack-management.service.d/mysql-dep.conf** with an option to disable its creation for the cases in which both servers won't run alongside.
   - include a reference in the documentation. perhaps a link to the redhat configuration above, also in form of comments on the distributed service file and the file created by **cloudstack-setup-databases**

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] rvalle commented on issue #3954: Cloudstack Management Improper shutdown

Posted by GitBox <gi...@apache.org>.
rvalle commented on issue #3954: Cloudstack Management Improper shutdown
URL: https://github.com/apache/cloudstack/issues/3954#issuecomment-597486925
 
 
   Systemd seems to support 2 approaches,
   - The obvious one, to fix the provided Systemd files for CS Manager.
   - The second one, is to supplement existing configuration files with additional files that fine tune its behaviour.
   The second one is useful in the (unlikely) case we needed to modify mysql unit file or in case we want to patch installation based on versions of CS Manager with this bug.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] rvalle commented on issue #3954: Cloudstack Management Improper shutdown - causes mgmt to not start after reboot of server

Posted by GitBox <gi...@apache.org>.
rvalle commented on issue #3954: Cloudstack Management Improper shutdown - causes mgmt to not start after reboot of server
URL: https://github.com/apache/cloudstack/issues/3954#issuecomment-599039775
 
 
   @rhtyd yes, that is the case. However, CSM has a long starting time while mysql is quick. In a race condition I think mysql wins. I think corruption takes place on shutdown depending on what the DB was up to. 
   
   In my use case I deploy CSM with ansible and then restart. I guess the DB was pretty busy at shutdown time to the point that every single test would fail.
   
   I have been testing the dependencies introduced in /etc/systemd listed above, and they work like a charm.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] DaanHoogland commented on issue #3954: Cloudstack Management Improper shutdown

Posted by GitBox <gi...@apache.org>.
DaanHoogland commented on issue #3954: Cloudstack Management Improper shutdown
URL: https://github.com/apache/cloudstack/issues/3954#issuecomment-597048475
 
 
   @rvalle 4.14 is not released and would be a snapshot of master. if you can't build yourself there are nightly builds around.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] DaanHoogland commented on issue #3954: Cloudstack Management Improper shutdown - causes mgmt to not start after reboot of server

Posted by GitBox <gi...@apache.org>.
DaanHoogland commented on issue #3954: Cloudstack Management Improper shutdown - causes mgmt to not start after reboot of server
URL: https://github.com/apache/cloudstack/issues/3954#issuecomment-604027611
 
 
   fixed by #3973

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] DaanHoogland commented on issue #3954: Cloudstack Management Improper shutdown

Posted by GitBox <gi...@apache.org>.
DaanHoogland commented on issue #3954: Cloudstack Management Improper shutdown
URL: https://github.com/apache/cloudstack/issues/3954#issuecomment-597503668
 
 
   I think the best solution will be somewhere in the middle. @rvalle, are you taking the time to propose a change?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] rvalle commented on issue #3954: Cloudstack Management Improper shutdown

Posted by GitBox <gi...@apache.org>.
rvalle commented on issue #3954: Cloudstack Management Improper shutdown
URL: https://github.com/apache/cloudstack/issues/3954#issuecomment-597037998
 
 
   @DaanHoogland should be feasible. are there packages in any centos repo? 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] DaanHoogland closed issue #3954: Cloudstack Management Improper shutdown - causes mgmt to not start after reboot of server

Posted by GitBox <gi...@apache.org>.
DaanHoogland closed issue #3954: Cloudstack Management Improper shutdown - causes mgmt to not start after reboot of server
URL: https://github.com/apache/cloudstack/issues/3954
 
 
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] rhtyd commented on issue #3954: Cloudstack Management Improper shutdown - causes mgmt to not start after reboot of server

Posted by GitBox <gi...@apache.org>.
rhtyd commented on issue #3954: Cloudstack Management Improper shutdown - causes mgmt to not start after reboot of server
URL: https://github.com/apache/cloudstack/issues/3954#issuecomment-599033915
 
 
   @rvalle on reboot could it be that mysql is shutdown before Cloudstack management server? You can check using systemd, or just add a dependency on mysql service to shutdown after cloudstack mgmt server.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] rvalle commented on issue #3954: Cloudstack Management Improper shutdown

Posted by GitBox <gi...@apache.org>.
rvalle commented on issue #3954: Cloudstack Management Improper shutdown
URL: https://github.com/apache/cloudstack/issues/3954#issuecomment-596642236
 
 
   Exceptions during shutdown: (to be provided)
   Exceptions after restart: https://pastebin.com/RWRPCSd1

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] DaanHoogland commented on issue #3954: Cloudstack Management Improper shutdown - causes mgmt to not start after reboot of server

Posted by GitBox <gi...@apache.org>.
DaanHoogland commented on issue #3954: Cloudstack Management Improper shutdown - causes mgmt to not start after reboot of server
URL: https://github.com/apache/cloudstack/issues/3954#issuecomment-599602320
 
 
   issue with that last solution is that the target to depend on may be different:
   it may be mariadb or mysql or mysqld depnding on distribution used.
   maybe solve is docs after all :(

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] rvalle edited a comment on issue #3954: Cloudstack Management Improper shutdown

Posted by GitBox <gi...@apache.org>.
rvalle edited a comment on issue #3954: Cloudstack Management Improper shutdown
URL: https://github.com/apache/cloudstack/issues/3954#issuecomment-597037998
 
 
   @DaanHoogland should be feasible. are there packages in any centos repo? 
   
   I can see I have frozen my playbooks at 4.13. 
   
   Let me check with 4.14

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] rvalle commented on issue #3954: Cloudstack Management Improper shutdown

Posted by GitBox <gi...@apache.org>.
rvalle commented on issue #3954: Cloudstack Management Improper shutdown
URL: https://github.com/apache/cloudstack/issues/3954#issuecomment-597561089
 
 
   @DaanHoogland I can certainly put together a PR for option 1, to add the dependency to Mysql the mysql service.
   
   As you tagged the issue I believe it is critical. In particular with a reboot right after installation. By the log files, I believe you are using a Java Persistence framework, and probably it is likely that will have a cache layer. 
   
   I still think that it is useful do document the second approach somewhere, becuse it is likely that any deployment will have additional dependencies.  

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] DaanHoogland commented on issue #3954: Cloudstack Management Improper shutdown - causes mgmt to not start after reboot of server

Posted by GitBox <gi...@apache.org>.
DaanHoogland commented on issue #3954: Cloudstack Management Improper shutdown - causes mgmt to not start after reboot of server
URL: https://github.com/apache/cloudstack/issues/3954#issuecomment-599581774
 
 
   @rvalle How do you want to proceed this?
   I can imagine a wait in the automation scripts could help as well as a dependency in the systemd configuration. That last one however could lead to a system fault as the dependency does not have to exist locally on the host. Have you given this any thought over the weekend?
   I am open to any solution if it works with your automation (and doesn't destroy the rest of the world).

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] andrijapanicsb commented on issue #3954: Cloudstack Management Improper shutdown

Posted by GitBox <gi...@apache.org>.
andrijapanicsb commented on issue #3954: Cloudstack Management Improper shutdown
URL: https://github.com/apache/cloudstack/issues/3954#issuecomment-597623652
 
 
   @rvalle I'm trying to reproduce this on the current mater.
   In the meantime, what do you mean that the system is broken after the restart? Can you describe that? thx

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] Spaceman1984 removed a comment on issue #3954: Cloudstack Management Improper shutdown - causes mgmt to not start after reboot of server

Posted by GitBox <gi...@apache.org>.
Spaceman1984 removed a comment on issue #3954: Cloudstack Management Improper shutdown - causes mgmt to not start after reboot of server
URL: https://github.com/apache/cloudstack/issues/3954#issuecomment-603675524
 
 
   @blueorangutan package

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] Spaceman1984 commented on issue #3954: Cloudstack Management Improper shutdown - causes mgmt to not start after reboot of server

Posted by GitBox <gi...@apache.org>.
Spaceman1984 commented on issue #3954: Cloudstack Management Improper shutdown - causes mgmt to not start after reboot of server
URL: https://github.com/apache/cloudstack/issues/3954#issuecomment-603675524
 
 
   @blueorangutan package

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] rvalle commented on issue #3954: Cloudstack Management Improper shutdown

Posted by GitBox <gi...@apache.org>.
rvalle commented on issue #3954: Cloudstack Management Improper shutdown
URL: https://github.com/apache/cloudstack/issues/3954#issuecomment-597569304
 
 
   @DaanHoogland the problem with option 1 is that we don't really know if the mysql server is running at the management service host or not. 
   
   According to documentation the database server can also run on a separate server.
   
   Perhaps we should use option 2 from cloudstack-setup-databases

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] rvalle commented on issue #3954: Cloudstack Management Improper shutdown

Posted by GitBox <gi...@apache.org>.
rvalle commented on issue #3954: Cloudstack Management Improper shutdown
URL: https://github.com/apache/cloudstack/issues/3954#issuecomment-597045964
 
 
   I cannot find 4.14 in the release repo. Is there a nightly build repo? If there is a repo I can run my tests easily. And could also check 4.11 LTS 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] rvalle edited a comment on issue #3954: Cloudstack Management Improper shutdown

Posted by GitBox <gi...@apache.org>.
rvalle edited a comment on issue #3954: Cloudstack Management Improper shutdown
URL: https://github.com/apache/cloudstack/issues/3954#issuecomment-596642236
 
 
   Exceptions during shutdown: https://pastebin.com/YWCJqEir
   Exceptions after restart: https://pastebin.com/RWRPCSd1

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] rvalle commented on issue #3954: Cloudstack Management Improper shutdown

Posted by GitBox <gi...@apache.org>.
rvalle commented on issue #3954: Cloudstack Management Improper shutdown
URL: https://github.com/apache/cloudstack/issues/3954#issuecomment-596640803
 
 
   I am pretty sure the installed Systemd scripts don't observe the order in which components should be shutdown, can anybody confirm?
   
   I will get 2 pastebins with the exceptions during the shutdown and after restart.
   
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] rvalle commented on issue #3954: Cloudstack Management Improper shutdown

Posted by GitBox <gi...@apache.org>.
rvalle commented on issue #3954: Cloudstack Management Improper shutdown
URL: https://github.com/apache/cloudstack/issues/3954#issuecomment-597159192
 
 
   @DaanHoogland I am currently migrating/extending an ansible collection of roles to manage my cloud form opennebula to cloudstack. The interesting thing is that I did setup a cloud Continuous Integration infrastructure. On every push a 3 node cloudstack cluster is created and tested .
    
   Let me advance a little bit more on this front and I would be happy to integrate this CI with a Nightly Builds or Travis that generates packages that I can take. We can discuss.
   
   ![Screenshot_2020-03-10 Pipeline ยท privazio ansible-collection-vdc](https://user-images.githubusercontent.com/412837/76330715-7c937b00-62ee-11ea-97cd-6b52146ac9c7.png)
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

[GitHub] [cloudstack] andrijapanicsb commented on issue #3954: Cloudstack Management Improper shutdown

Posted by GitBox <gi...@apache.org>.
andrijapanicsb commented on issue #3954: Cloudstack Management Improper shutdown
URL: https://github.com/apache/cloudstack/issues/3954#issuecomment-597625815
 
 
   I guess I answered this question myslef by testing - the mgmt will not boot after the MySQL and thus is down, needs restart of mgmt server to be up again.
   
   Marking this one as blocker against 4.14, but the fix will be implemented un 4.13.1 so we can forwar merge to 4.14/master.
   
   Thanks @rvalle for reporting this, nice blocker :) 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services