You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by Kapil Bhuskute <kb...@qualys.com.INVALID> on 2024/02/10 16:36:52 UTC
Unable to start cloudstack.management server after initial installation successfully completed.
Hello,
I have successfully followed all the management server installation steps for the first time. I see the cloudstack.management service is also showing started and active, but with some errors causing the UI to give below 503 error. Can someone please help?
● cloudstack-management.service - CloudStack Management Server
Loaded: loaded (/usr/lib/systemd/system/cloudstack-management.service; enabled; vendor preset: disabled)
Active: active (running) since Sat 2024-02-10 15:55:09 UTC; 11min ago
Main PID: 13630 (java)
Tasks: 102 (limit: 3355442)
Memory: 870.5M
CGroup: /system.slice/cloudstack-management.service
└─13630 /usr/bin/java -Djava.security.properties=/etc/cloudstack/management/java.security.ciphers -Djava.awt.headless=true -Dcom.sun.management.jmxremote=fa>
Feb 10 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module context [nested-cloudstack>
Feb 10 15:55:23 <SERVER_FQDN> java[13630]: WARN [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Failed to start module [nested-cloudstack>
Feb 10 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module context [redfish] from URL>
Feb 10 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module context [redfish] from URL>
Feb 10 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module context [redfish] from URL>
Feb 10 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module context [redfish] from URL>
Feb 10 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module context [redfish] from URL>
Feb 10 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module context [redfish] from URL>
Feb 10 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module context [redfish] from URL>
Feb 10 15:55:23 <SERVER_FQDN> java[13630]: WARN [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Failed to start module [redfish] due to: >
~
The management logs are showing below messages:
[root@qcs01 ~]# grep -i -E 'error|exception' /var/log/cloudstack/management/management-server.log
2024-02-10 15:55:15,811 INFO [c.c.u.d.T.Transaction] (main:null) (logid:) Using the following URI to connect to cloud database [jdbc:mysql://localhost:3306/cloud?autoReconnect=true&prepStmtCacheSize=517&cachePrepStmts=true&sessionVariables=sql_mode='STRICT_TRANS_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_ENGINE_SUBSTITUTION'&serverTimezone=UTC].
2024-02-10 15:55:19,952 ERROR [c.c.u.d.Merovingian2] (main:null) (logid:) Unable to get a new db connection
java.sql.SQLNonTransientConnectionException: Could not create connection to database server. Attempted reconnect 3 times. Giving up.
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:110)
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97)
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:89)
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:63)
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:73)
at com.cloud.utils.db.TransactionLegacy.getStandaloneConnectionWithException(TransactionLegacy.java:212)
Caused by: com.mysql.cj.exceptions.SSLParamsException: Cannot open file:NONE [NONE (No such file or directory)]
Caused by: java.io.FileNotFoundException: NONE (No such file or directory)
2024-02-10 15:55:19,958 WARN [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Failed to start module [system] due to: [Error creating bean with name 'lockControllerListener' defined in URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.19.0.0.jar!/META-INF/cloudstack/system/spring-server-system-context.xml]: Bean instantiation via constructor failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [com.cloud.server.LockControllerListener]: Constructor threw exception; nested exception is com.cloud.utils.exception.CloudRuntimeException: Unable to initialize a connection to the database for locking purposes].
org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'lockControllerListener' defined in URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.19.0.0.jar!/META-INF/cloudstack/system/spring-server-system-context.xml]: Bean instantiation via constructor failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [com.cloud.server.LockControllerListener]: Constructor threw exception; nested exception is com.cloud.utils.exception.CloudRuntimeException: Unable to initialize a connection to the database for locking purposes
Caused by: org.springframework.beans.BeanInstantiationException: Failed to instantiate [com.cloud.server.LockControllerListener]: Constructor threw exception; nested exception is com.cloud.utils.exception.CloudRuntimeException: Unable to initialize a connection to the database for locking purposes
Caused by: com.cloud.utils.exception.CloudRuntimeException: Unable to initialize a connection to the database for locking purposes
Caused by: java.sql.SQLNonTransientConnectionException: Could not create connection to database server. Attempted reconnect 3 times. Giving up.
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:110)
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97)
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:89)
Caused by: com.mysql.cj.exceptions.SSLParamsException: Cannot open file:NONE [NONE (No such file or directory)]
Caused by: java.io.FileNotFoundException: NONE (No such file or directory)
2024-02-10 15:55:20,736 WARN [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Failed to start module [core] due to: [Error creating bean with name 'org.springframework.beans.factory.config.PropertyPlaceholderConfigurer#0' defined in URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.19.0.0.jar!/META-INF/cloudstack/bootstrap/spring-bootstrap-context-inheritable.xml]: Cannot resolve reference to bean 'DefaultConfigResources' while setting bean property 'locations'; nested exception is org.springframework.beans.factory.NoSuchBeanDefinitionException: No bean named 'DefaultConfigResources' available].
org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'org.springframework.beans.factory.config.PropertyPlaceholderConfigurer#0' defined in URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.19.0.0.jar!/META-INF/cloudstack/bootstrap/spring-bootstrap-context-inheritable.xml]: Cannot resolve reference to bean 'DefaultConfigResources' while setting bean property 'locations'; nested exception is org.springframework.beans.factory.NoSuchBeanDefinitionException: No bean named 'DefaultConfigResources' available
* Kapil Bhuskute
Re: Unable to start cloudstack.management server after initial installation successfully completed.
Posted by Wei ZHOU <us...@gmail.com>.
Hi,
Since you have enabled FIPS, can you try with stronger db password, and
management key, database key?
-Wei
在 2024年2月10日星期六，Kapil Bhuskute <kb...@qualys.com.invalid> 写道：
> Yes, I have followed all steps accordingly to the management server
> installation document says.
> And the database server is up and running fine.
>
> [root@qcs01 ~]# systemctl status mysqld.service
> ● mysqld.service - MySQL 8.0 database server
> Loaded: loaded (/usr/lib/systemd/system/mysqld.service; enabled;
> vendor preset: disabled)
> Active: active (running) since Sat 2024-02-10 14:36:47 UTC; 2h 32min ago
> Main PID: 11969 (mysqld)
> Status: "Server is operational"
> Tasks: 46 (limit: 3355442)
> Memory: 859.1M
> CGroup: /system.slice/mysqld.service
> └─11969 /usr/libexec/mysqld --basedir=/usr
>
> Feb 10 14:36:43 <SERVER_FQDN> systemd[1]: Starting MySQL 8.0 database
> server...
> Feb 10 14:36:43 <SERVER_FQDN> mysql-prepare-db-dir[11883]: Initializing
> MySQL database
> Feb 10 14:36:47 <SERVER_FQDN> systemd[1]: Started MySQL 8.0 database
> server.
> [root@qcs01 ~]#
>
>
>
> And one more thing I forgot to mention is that we have FIPS enabled on the
> OEL8 server here. Does that need any additional configurations before the
> management server is started?
> Kindly confirm and share if any additional config is required...
>
>
> Kapil Bhuskute
>
>
> -----Original Message-----
> From: Pearl d'Silva <pe...@shapeblue.com>
> Sent: Saturday, February 10, 2024 10:29 PM
> To: users@cloudstack.apache.org
> Subject: Re: Unable to start cloudstack.management server after initial
> installation successfully completed.
>
> CAUTION: This Email is from an EXTERNAL source. Ensure you trust
> this sender before clicking on any links or attachments.
>
> Hi Kapil,
>
> Can you please check if your database server is running - i.e., you've
> done all the steps mentioned here:https://urldefense.com/
> v3/__https://docs.cloudstack.apache.org/en/latest/installguide/management-
> server/index.html*install-the-database-on-the-management-
> server-node__;Iw!!Pw1rFClp!tqkNYBskb445HaLvcbQ3ACNCj44tYH
> qz8tRRA9ZHpdOobhELSD7slGjSqcRdp_QRIx8aDAG9eXOAoanofuXWGgxsQi4$
>
> Thanks,
> Pearl
>
>
>
> ________________________________
> From: Kapil Bhuskute <kb...@qualys.com.INVALID>
> Sent: February 10, 2024 11:36 AM
> To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
> Subject: Unable to start cloudstack.management server after initial
> installation successfully completed.
>
> Hello,
> I have successfully followed all the management server installation steps
> for the first time. I see the cloudstack.management service is also showing
> started and active, but with some errors causing the UI to give below 503
> error. Can someone please help?
>
> ● cloudstack-management.service - CloudStack Management Server
> Loaded: loaded (/usr/lib/systemd/system/cloudstack-management.service;
> enabled; vendor preset: disabled)
> Active: active (running) since Sat 2024-02-10 15:55:09 UTC; 11min ago
> Main PID: 13630 (java)
> Tasks: 102 (limit: 3355442)
> Memory: 870.5M
> CGroup: /system.slice/cloudstack-management.service
> └─13630 /usr/bin/java -Djava.security.properties=/
> etc/cloudstack/management/java.security.ciphers -Djava.awt.headless=true
> -Dcom.sun.management.jmxremote=fa>
>
> Feb 10 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet]
> (main:null) (logid:) Loading module context [nested-cloudstack> Feb 10
> 15:55:23 <SERVER_FQDN> java[13630]: WARN [o.a.c.s.m.m.i.DefaultModuleDefinitionSet]
> (main:null) (logid:) Failed to start module [nested-cloudstack> Feb 10
> 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet]
> (main:null) (logid:) Loading module context [redfish] from URL> Feb 10
> 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet]
> (main:null) (logid:) Loading module context [redfish] from URL> Feb 10
> 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet]
> (main:null) (logid:) Loading module context [redfish] from URL> Feb 10
> 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet]
> (main:null) (logid:) Loading module context [redfish] from URL> Feb 10
> 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet]
> (main:null) (logid:) Loading module context [redfish] from URL> Feb 10
> 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet]
> (main:null) (logid:) Loading module context [redfish] from URL> Feb 10
> 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet]
> (main:null) (logid:) Loading module context [redfish] from URL> Feb 10
> 15:55:23 <SERVER_FQDN> java[13630]: WARN [o.a.c.s.m.m.i.DefaultModuleDefinitionSet]
> (main:null) (logid:) Failed to start module [redfish] due to: > ~
>
> The management logs are showing below messages:
> [root@qcs01 ~]# grep -i -E 'error|exception' /var/log/cloudstack/
> management/management-server.log
> 2024-02-10 15:55:15,811 INFO [c.c.u.d.T.Transaction] (main:null) (logid:)
> Using the following URI to connect to cloud database
> [jdbc:mysql://localhost:3306/cloud?autoReconnect=true&
> prepStmtCacheSize=517&cachePrepStmts=true&sessionVariables=sql_mode='
> STRICT_TRANS_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_
> FOR_DIVISION_BY_ZERO,NO_ENGINE_SUBSTITUTION'&serverTimezone=UTC].
> 2024-02-10 15:55:19,952 ERROR [c.c.u.d.Merovingian2] (main:null) (logid:)
> Unable to get a new db connection
> java.sql.SQLNonTransientConnectionException: Could not create connection
> to database server. Attempted reconnect 3 times. Giving up.
> at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(
> SQLError.java:110)
> at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(
> SQLError.java:97)
> at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(
> SQLError.java:89)
> at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(
> SQLError.java:63)
> at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(
> SQLError.java:73)
> at com.cloud.utils.db.TransactionLegacy.
> getStandaloneConnectionWithException(TransactionLegacy.java:212)
> Caused by: com.mysql.cj.exceptions.SSLParamsException: Cannot open
> file:NONE [NONE (No such file or directory)] Caused by:
> java.io.FileNotFoundException: NONE (No such file or directory)
> 2024-02-10 15:55:19,958 WARN [o.a.c.s.m.m.i.DefaultModuleDefinitionSet]
> (main:null) (logid:) Failed to start module [system] due to: [Error
> creating bean with name 'lockControllerListener' defined in URL
> [jar:file:/usr/share/cloudstack-management/lib/
> cloudstack-4.19.0.0.jar!/META-INF/cloudstack/system/spring-server-system-context.xml]:
> Bean instantiation via constructor failed; nested exception is
> org.springframework.beans.BeanInstantiationException: Failed to
> instantiate [com.cloud.server.LockControllerListener]: Constructor threw
> exception; nested exception is com.cloud.utils.exception.CloudRuntimeException:
> Unable to initialize a connection to the database for locking purposes].
> org.springframework.beans.factory.BeanCreationException: Error creating
> bean with name 'lockControllerListener' defined in URL [jar:file:/usr/share/
> cloudstack-management/lib/cloudstack-4.19.0.0.jar!/META-
> INF/cloudstack/system/spring-server-system-context.xml]: Bean
> instantiation via constructor failed; nested exception is
> org.springframework.beans.BeanInstantiationException: Failed to
> instantiate [com.cloud.server.LockControllerListener]: Constructor threw
> exception; nested exception is com.cloud.utils.exception.CloudRuntimeException:
> Unable to initialize a connection to the database for locking purposes
> Caused by: org.springframework.beans.BeanInstantiationException: Failed
> to instantiate [com.cloud.server.LockControllerListener]: Constructor
> threw exception; nested exception is com.cloud.utils.exception.CloudRuntimeException:
> Unable to initialize a connection to the database for locking purposes
> Caused by: com.cloud.utils.exception.CloudRuntimeException: Unable to
> initialize a connection to the database for locking purposes Caused by:
> java.sql.SQLNonTransientConnectionException: Could not create connection
> to database server. Attempted reconnect 3 times. Giving up.
> at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(
> SQLError.java:110)
> at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(
> SQLError.java:97)
> at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(
> SQLError.java:89)
> Caused by: com.mysql.cj.exceptions.SSLParamsException: Cannot open
> file:NONE [NONE (No such file or directory)] Caused by:
> java.io.FileNotFoundException: NONE (No such file or directory)
> 2024-02-10 15:55:20,736 WARN [o.a.c.s.m.m.i.DefaultModuleDefinitionSet]
> (main:null) (logid:) Failed to start module [core] due to: [Error creating
> bean with name 'org.springframework.beans.factory.config.
> PropertyPlaceholderConfigurer#0' defined in URL [jar:file:/usr/share/
> cloudstack-management/lib/cloudstack-4.19.0.0.jar!/META-
> INF/cloudstack/bootstrap/spring-bootstrap-context-inheritable.xml]:
> Cannot resolve reference to bean 'DefaultConfigResources' while setting
> bean property 'locations'; nested exception is org.springframework.beans.
> factory.NoSuchBeanDefinitionException: No bean named
> 'DefaultConfigResources' available].
> org.springframework.beans.factory.BeanCreationException: Error creating
> bean with name 'org.springframework.beans.factory.config.
> PropertyPlaceholderConfigurer#0' defined in URL [jar:file:/usr/share/
> cloudstack-management/lib/cloudstack-4.19.0.0.jar!/META-
> INF/cloudstack/bootstrap/spring-bootstrap-context-inheritable.xml]:
> Cannot resolve reference to bean 'DefaultConfigResources' while setting
> bean property 'locations'; nested exception is org.springframework.beans.
> factory.NoSuchBeanDefinitionException: No bean named
> 'DefaultConfigResources' available
>
>
>
> * Kapil Bhuskute
>
RE: Unable to start cloudstack.management server after initial installation successfully completed.
Posted by Kapil Bhuskute <kb...@qualys.com.INVALID>.
Yes, I have followed all steps accordingly to the management server installation document says.
And the database server is up and running fine.
[root@qcs01 ~]# systemctl status mysqld.service
● mysqld.service - MySQL 8.0 database server
Loaded: loaded (/usr/lib/systemd/system/mysqld.service; enabled; vendor preset: disabled)
Active: active (running) since Sat 2024-02-10 14:36:47 UTC; 2h 32min ago
Main PID: 11969 (mysqld)
Status: "Server is operational"
Tasks: 46 (limit: 3355442)
Memory: 859.1M
CGroup: /system.slice/mysqld.service
└─11969 /usr/libexec/mysqld --basedir=/usr
Feb 10 14:36:43 <SERVER_FQDN> systemd[1]: Starting MySQL 8.0 database server...
Feb 10 14:36:43 <SERVER_FQDN> mysql-prepare-db-dir[11883]: Initializing MySQL database
Feb 10 14:36:47 <SERVER_FQDN> systemd[1]: Started MySQL 8.0 database server.
[root@qcs01 ~]#
And one more thing I forgot to mention is that we have FIPS enabled on the OEL8 server here. Does that need any additional configurations before the management server is started?
Kindly confirm and share if any additional config is required...
Kapil Bhuskute
-----Original Message-----
From: Pearl d'Silva <pe...@shapeblue.com>
Sent: Saturday, February 10, 2024 10:29 PM
To: users@cloudstack.apache.org
Subject: Re: Unable to start cloudstack.management server after initial installation successfully completed.
CAUTION: This Email is from an EXTERNAL source. Ensure you trust this sender before clicking on any links or attachments.
Hi Kapil,
Can you please check if your database server is running - i.e., you've done all the steps mentioned here:https://urldefense.com/v3/__https://docs.cloudstack.apache.org/en/latest/installguide/management-server/index.html*install-the-database-on-the-management-server-node__;Iw!!Pw1rFClp!tqkNYBskb445HaLvcbQ3ACNCj44tYHqz8tRRA9ZHpdOobhELSD7slGjSqcRdp_QRIx8aDAG9eXOAoanofuXWGgxsQi4$
Thanks,
Pearl
________________________________
From: Kapil Bhuskute <kb...@qualys.com.INVALID>
Sent: February 10, 2024 11:36 AM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Subject: Unable to start cloudstack.management server after initial installation successfully completed.
Hello,
I have successfully followed all the management server installation steps for the first time. I see the cloudstack.management service is also showing started and active, but with some errors causing the UI to give below 503 error. Can someone please help?
● cloudstack-management.service - CloudStack Management Server
Loaded: loaded (/usr/lib/systemd/system/cloudstack-management.service; enabled; vendor preset: disabled)
Active: active (running) since Sat 2024-02-10 15:55:09 UTC; 11min ago Main PID: 13630 (java)
Tasks: 102 (limit: 3355442)
Memory: 870.5M
CGroup: /system.slice/cloudstack-management.service
└─13630 /usr/bin/java -Djava.security.properties=/etc/cloudstack/management/java.security.ciphers -Djava.awt.headless=true -Dcom.sun.management.jmxremote=fa>
Feb 10 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module context [nested-cloudstack> Feb 10 15:55:23 <SERVER_FQDN> java[13630]: WARN [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Failed to start module [nested-cloudstack> Feb 10 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module context [redfish] from URL> Feb 10 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module context [redfish] from URL> Feb 10 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module context [redfish] from URL> Feb 10 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module context [redfish] from URL> Feb 10 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module context [redfish] from URL> Feb 10 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module context [redfish] from URL> Feb 10 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module context [redfish] from URL> Feb 10 15:55:23 <SERVER_FQDN> java[13630]: WARN [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Failed to start module [redfish] due to: > ~
The management logs are showing below messages:
[root@qcs01 ~]# grep -i -E 'error|exception' /var/log/cloudstack/management/management-server.log
2024-02-10 15:55:15,811 INFO [c.c.u.d.T.Transaction] (main:null) (logid:) Using the following URI to connect to cloud database [jdbc:mysql://localhost:3306/cloud?autoReconnect=true&prepStmtCacheSize=517&cachePrepStmts=true&sessionVariables=sql_mode='STRICT_TRANS_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_ENGINE_SUBSTITUTION'&serverTimezone=UTC].
2024-02-10 15:55:19,952 ERROR [c.c.u.d.Merovingian2] (main:null) (logid:) Unable to get a new db connection
java.sql.SQLNonTransientConnectionException: Could not create connection to database server. Attempted reconnect 3 times. Giving up.
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:110)
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97)
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:89)
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:63)
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:73)
at com.cloud.utils.db.TransactionLegacy.getStandaloneConnectionWithException(TransactionLegacy.java:212)
Caused by: com.mysql.cj.exceptions.SSLParamsException: Cannot open file:NONE [NONE (No such file or directory)] Caused by: java.io.FileNotFoundException: NONE (No such file or directory)
2024-02-10 15:55:19,958 WARN [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Failed to start module [system] due to: [Error creating bean with name 'lockControllerListener' defined in URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.19.0.0.jar!/META-INF/cloudstack/system/spring-server-system-context.xml]: Bean instantiation via constructor failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [com.cloud.server.LockControllerListener]: Constructor threw exception; nested exception is com.cloud.utils.exception.CloudRuntimeException: Unable to initialize a connection to the database for locking purposes].
org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'lockControllerListener' defined in URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.19.0.0.jar!/META-INF/cloudstack/system/spring-server-system-context.xml]: Bean instantiation via constructor failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [com.cloud.server.LockControllerListener]: Constructor threw exception; nested exception is com.cloud.utils.exception.CloudRuntimeException: Unable to initialize a connection to the database for locking purposes Caused by: org.springframework.beans.BeanInstantiationException: Failed to instantiate [com.cloud.server.LockControllerListener]: Constructor threw exception; nested exception is com.cloud.utils.exception.CloudRuntimeException: Unable to initialize a connection to the database for locking purposes Caused by: com.cloud.utils.exception.CloudRuntimeException: Unable to initialize a connection to the database for locking purposes Caused by: java.sql.SQLNonTransientConnectionException: Could not create connection to database server. Attempted reconnect 3 times. Giving up.
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:110)
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97)
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:89)
Caused by: com.mysql.cj.exceptions.SSLParamsException: Cannot open file:NONE [NONE (No such file or directory)] Caused by: java.io.FileNotFoundException: NONE (No such file or directory)
2024-02-10 15:55:20,736 WARN [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Failed to start module [core] due to: [Error creating bean with name 'org.springframework.beans.factory.config.PropertyPlaceholderConfigurer#0' defined in URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.19.0.0.jar!/META-INF/cloudstack/bootstrap/spring-bootstrap-context-inheritable.xml]: Cannot resolve reference to bean 'DefaultConfigResources' while setting bean property 'locations'; nested exception is org.springframework.beans.factory.NoSuchBeanDefinitionException: No bean named 'DefaultConfigResources' available].
org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'org.springframework.beans.factory.config.PropertyPlaceholderConfigurer#0' defined in URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.19.0.0.jar!/META-INF/cloudstack/bootstrap/spring-bootstrap-context-inheritable.xml]: Cannot resolve reference to bean 'DefaultConfigResources' while setting bean property 'locations'; nested exception is org.springframework.beans.factory.NoSuchBeanDefinitionException: No bean named 'DefaultConfigResources' available
* Kapil Bhuskute
Re: Unable to start cloudstack.management server after initial installation successfully completed.
Posted by Pearl d'Silva <pe...@shapeblue.com>.
Hi Kapil,
Can you please check if your database server is running - i.e., you've done all the steps mentioned here:https://docs.cloudstack.apache.org/en/latest/installguide/management-server/index.html#install-the-database-on-the-management-server-node
Thanks,
Pearl
________________________________
From: Kapil Bhuskute <kb...@qualys.com.INVALID>
Sent: February 10, 2024 11:36 AM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Subject: Unable to start cloudstack.management server after initial installation successfully completed.
Hello,
I have successfully followed all the management server installation steps for the first time. I see the cloudstack.management service is also showing started and active, but with some errors causing the UI to give below 503 error. Can someone please help?
● cloudstack-management.service - CloudStack Management Server
Loaded: loaded (/usr/lib/systemd/system/cloudstack-management.service; enabled; vendor preset: disabled)
Active: active (running) since Sat 2024-02-10 15:55:09 UTC; 11min ago
Main PID: 13630 (java)
Tasks: 102 (limit: 3355442)
Memory: 870.5M
CGroup: /system.slice/cloudstack-management.service
└─13630 /usr/bin/java -Djava.security.properties=/etc/cloudstack/management/java.security.ciphers -Djava.awt.headless=true -Dcom.sun.management.jmxremote=fa>
Feb 10 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module context [nested-cloudstack>
Feb 10 15:55:23 <SERVER_FQDN> java[13630]: WARN [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Failed to start module [nested-cloudstack>
Feb 10 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module context [redfish] from URL>
Feb 10 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module context [redfish] from URL>
Feb 10 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module context [redfish] from URL>
Feb 10 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module context [redfish] from URL>
Feb 10 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module context [redfish] from URL>
Feb 10 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module context [redfish] from URL>
Feb 10 15:55:23 <SERVER_FQDN> java[13630]: INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module context [redfish] from URL>
Feb 10 15:55:23 <SERVER_FQDN> java[13630]: WARN [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Failed to start module [redfish] due to: >
~
The management logs are showing below messages:
[root@qcs01 ~]# grep -i -E 'error|exception' /var/log/cloudstack/management/management-server.log
2024-02-10 15:55:15,811 INFO [c.c.u.d.T.Transaction] (main:null) (logid:) Using the following URI to connect to cloud database [jdbc:mysql://localhost:3306/cloud?autoReconnect=true&prepStmtCacheSize=517&cachePrepStmts=true&sessionVariables=sql_mode='STRICT_TRANS_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_ENGINE_SUBSTITUTION'&serverTimezone=UTC].
2024-02-10 15:55:19,952 ERROR [c.c.u.d.Merovingian2] (main:null) (logid:) Unable to get a new db connection
java.sql.SQLNonTransientConnectionException: Could not create connection to database server. Attempted reconnect 3 times. Giving up.
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:110)
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97)
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:89)
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:63)
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:73)
at com.cloud.utils.db.TransactionLegacy.getStandaloneConnectionWithException(TransactionLegacy.java:212)
Caused by: com.mysql.cj.exceptions.SSLParamsException: Cannot open file:NONE [NONE (No such file or directory)]
Caused by: java.io.FileNotFoundException: NONE (No such file or directory)
2024-02-10 15:55:19,958 WARN [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Failed to start module [system] due to: [Error creating bean with name 'lockControllerListener' defined in URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.19.0.0.jar!/META-INF/cloudstack/system/spring-server-system-context.xml]: Bean instantiation via constructor failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [com.cloud.server.LockControllerListener]: Constructor threw exception; nested exception is com.cloud.utils.exception.CloudRuntimeException: Unable to initialize a connection to the database for locking purposes].
org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'lockControllerListener' defined in URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.19.0.0.jar!/META-INF/cloudstack/system/spring-server-system-context.xml]: Bean instantiation via constructor failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [com.cloud.server.LockControllerListener]: Constructor threw exception; nested exception is com.cloud.utils.exception.CloudRuntimeException: Unable to initialize a connection to the database for locking purposes
Caused by: org.springframework.beans.BeanInstantiationException: Failed to instantiate [com.cloud.server.LockControllerListener]: Constructor threw exception; nested exception is com.cloud.utils.exception.CloudRuntimeException: Unable to initialize a connection to the database for locking purposes
Caused by: com.cloud.utils.exception.CloudRuntimeException: Unable to initialize a connection to the database for locking purposes
Caused by: java.sql.SQLNonTransientConnectionException: Could not create connection to database server. Attempted reconnect 3 times. Giving up.
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:110)
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97)
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:89)
Caused by: com.mysql.cj.exceptions.SSLParamsException: Cannot open file:NONE [NONE (No such file or directory)]
Caused by: java.io.FileNotFoundException: NONE (No such file or directory)
2024-02-10 15:55:20,736 WARN [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Failed to start module [core] due to: [Error creating bean with name 'org.springframework.beans.factory.config.PropertyPlaceholderConfigurer#0' defined in URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.19.0.0.jar!/META-INF/cloudstack/bootstrap/spring-bootstrap-context-inheritable.xml]: Cannot resolve reference to bean 'DefaultConfigResources' while setting bean property 'locations'; nested exception is org.springframework.beans.factory.NoSuchBeanDefinitionException: No bean named 'DefaultConfigResources' available].
org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'org.springframework.beans.factory.config.PropertyPlaceholderConfigurer#0' defined in URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.19.0.0.jar!/META-INF/cloudstack/bootstrap/spring-bootstrap-context-inheritable.xml]: Cannot resolve reference to bean 'DefaultConfigResources' while setting bean property 'locations'; nested exception is org.springframework.beans.factory.NoSuchBeanDefinitionException: No bean named 'DefaultConfigResources' available
* Kapil Bhuskute