You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by "Hossein4185 (via GitHub)" <gi...@apache.org> on 2025/09/21 11:01:27 UTC
[D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
GitHub user Hossein4185 created a discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
### problem
ssvm can connect to management port 8250. This has been tested with Telnet but it gives an SSL error.
2025-09-21T20:58:53,248 WARN [utils.nio.Link] (main:[]) SSL Handshake has taken more than 30000 ms to connect to: /172.24.48.134:8250 while status: NEED_UNWRAP. Please investigate this connection.
2025-09-21T20:58:53,249 ERROR [utils.nio.NioClient] (main:[]) IOException while connecting to 172.24.48.134:8250 java.io.IOException: SSL Handshake failed while connecting to host: 172.24.48.134:8250
at com.cloud.utils.nio.NioClient.init(NioClient.java:75)
at com.cloud.utils.nio.NioConnection.start(NioConnection.java:109)
at com.cloud.agent.Agent.start(Agent.java:338)
at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:477)
at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:454)
at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:438)
at com.cloud.agent.AgentShell.start(AgentShell.java:539)
at com.cloud.agent.AgentShell.main(AgentShell.java:569)
2025-09-21T20:58:53,250 ERROR [utils.nio.NioClient] (main:[]) Unable to initialize the threads. java.io.IOException: SSL Handshake failed while connecting to host: 172.24.48.134:8250
2025-09-21T20:47:12,447 ERROR [utils.nio.NioClient] (main:[]) IOException while connecting to 172.24.48.134:8250 java.io.IOException: SSL Handshake failed while connecting to host: 172.24.48.134:8250
at com.cloud.utils.nio.NioClient.init(NioClient.java:75)
at com.cloud.utils.nio.NioConnection.start(NioConnection.java:109)
at com.cloud.agent.Agent.start(Agent.java:338)
at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:477)
at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:454)
at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:438)
at com.cloud.agent.AgentShell.start(AgentShell.java:539)
at com.cloud.agent.AgentShell.main(AgentShell.java:569)
2025-09-21T20:47:12,448 ERROR [utils.nio.NioClient] (main:[]) Unable to initialize the threads. java.io.IOException: SSL Handshake failed while connecting to host: 172.24.48.134:8250
at com.cloud.utils.nio.NioClient.init(NioClient.java:75)
at com.cloud.utils.nio.NioConnection.start(NioConnection.java:109)
at com.cloud.agent.Agent.start(Agent.java:338)
at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:477)
at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:454)
at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:438)
at com.cloud.agent.AgentShell.start(AgentShell.java:539)
at com.cloud.agent.AgentShell.main(AgentShell.java:569)
2025-09-21T20:47:12,449 INFO [utils.nio.NioClient] (main:[]) NioClient connection closed
2025-09-21T20:47:12,449 INFO [cloud.agent.Agent] (main:[]) Attempted to connect to the server, but received an unexpected exception, trying again... com.cloud.utils.exception.NioConnectionException: SSL Handshake failed while connecting to host: 172.24.48.134:8250
at com.cloud.utils.nio.NioConnection.start(NioConnection.java:115)
at com.cloud.agent.Agent.start(Agent.java:338)
at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:477)
at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:454)
at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:438)
at com.cloud.agent.AgentShell.start(AgentShell.java:539)
at com.cloud.agent.AgentShell.main(AgentShell.java:569)
Caused by: java.io.IOException: SSL Handshake failed while connecting to host: 172.24.48.134:8250
at com.cloud.utils.nio.NioClient.init(NioClient.java:75)
at com.cloud.utils.nio.NioConnection.start(NioConnection.java:109)
... 6 more
2025-09-21T20:47:17,450 INFO [cloud.agent.Agent] (main:[]) Connecting to host: 172.24.48.133
2025-09-21T20:47:17,453 INFO [utils.nio.NioClient] (main:[]) Connecting to 172.24.48.133:8250
2025-09-21T20:47:17,454 INFO [utils.nio.NioClient] (main:[]) Connected to 172.24.48.133:8250
2025-09-21T20:47:17,455 INFO [utils.nio.Link] (main:[]) Conf file found: /usr/local/cloud/systemvm/conf/agent.properties
### versions
4.21
OS: Ubuntu 24.04
GitHub link: https://github.com/apache/cloudstack/discussions/11694
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "weizhouapache (via GitHub)" <gi...@apache.org>.
GitHub user weizhouapache added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
> @weizhouapache I changed the management IP in global setting and the error changed. Please check.
>
the new issue seems same to #11081
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14495701
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "weizhouapache (via GitHub)" <gi...@apache.org>.
GitHub user weizhouapache added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
> @weizhouapache The problem was solved with this command But when I try to upload a template as a url, I get an error on management
>
> 514a63 with error: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
>
> and also get an error on ssvm
>
> 2025-09-24T09:41:57,759 INFO [storage.template.DownloadManagerImpl] (pool-2-thread-4:[]) local: /mnt/SecStorage/054aca04-065d-3b12-84e6-504ff84130cb/template/tmpl/9/258/dnld2045255748598754523tmp_, bytes=(0 bytes) 0, error=PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target, pct=0
you can try with global setting use.https.to.upload=false
or setup https/tls, refer to https://www.shapeblue.com/securing-cloudstack-4-11-with-https-tls/
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14496835
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "weizhouapache (via GitHub)" <gi...@apache.org>.
GitHub user weizhouapache added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
@Hossein4185
I cannot find any clue in the logs
can you run the following commands in SSVM and share new logs ?
```
sed -i "s/INFO/DEBUG/g" /usr/local/cloud/systemvm/conf/log4j-cloud.xml
systemctl restart cloud
```
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14484359
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
I tested this solution but it didn't solve the problem.
https://github.com/apache/cloudstack/issues/11081
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14468408
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 edited a comment on the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
@weizhouapache
2025-09-23T23:21:32,605 INFO [cloud.agent.AgentShell] (main:[]) Agent started
2025-09-23T23:21:32,612 INFO [cloud.agent.AgentShell] (main:[]) Implementation Version is 4.21.0.0
2025-09-23T23:21:32,613 INFO [cloud.agent.AgentShell] (main:[]) agent.properties found at /usr/local/cloud/systemvm/conf/agent.properties
2025-09-23T23:21:32,634 DEBUG [agent.properties.AgentPropertiesFileHandler] (main:[]) Property [guid] was altered. Now using the value [s-5333-VM].
2025-09-23T23:21:32,690 DEBUG [agent.properties.AgentPropertiesFileHandler] (main:[]) Property [consoleproxy.httpListenPort] has empty or null value. Using default value [443].
2025-09-23T23:21:32,691 DEBUG [agent.properties.AgentPropertiesFileHandler] (main:[]) Property [ping.retries] has empty or null value. Using default value [5].
2025-09-23T23:21:32,692 DEBUG [agent.properties.AgentPropertiesFileHandler] (main:[]) Property [host.lb.check.interval] has empty or null value. Using default value [null].
2025-09-23T23:21:32,693 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: private.network.device
2025-09-23T23:21:32,696 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: storagegateway
2025-09-23T23:21:32,696 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: eth2mask
2025-09-23T23:21:32,698 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: sslcopy
2025-09-23T23:21:32,698 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: eth0ip
2025-09-23T23:21:32,701 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: host
2025-09-23T23:21:32,704 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: nfsVersion
2025-09-23T23:21:32,705 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: template
2025-09-23T23:21:32,707 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: useHttpsToUpload
2025-09-23T23:21:32,708 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: workers
2025-09-23T23:21:32,708 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: storagenetmask
2025-09-23T23:21:32,709 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: dns2
2025-09-23T23:21:32,710 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: zone
2025-09-23T23:21:32,717 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: dns1
2025-09-23T23:21:32,717 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: keystore_password
2025-09-23T23:21:32,718 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: name
2025-09-23T23:21:32,720 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: mtu
2025-09-23T23:21:32,720 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: gateway
2025-09-23T23:21:32,721 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: eth1mask
2025-09-23T23:21:32,722 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: secondaryStorageServerAddress
2025-09-23T23:21:32,723 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: keystore.passphrase
2025-09-23T23:21:32,724 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: guid
2025-09-23T23:21:32,725 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: eth0mask
2025-09-23T23:21:32,726 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: resource
2025-09-23T23:21:32,726 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: role
2025-09-23T23:21:32,727 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: internaldns2
2025-09-23T23:21:32,728 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: internaldns1
2025-09-23T23:21:32,728 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: port
2025-09-23T23:21:32,729 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: eth3ip
2025-09-23T23:21:32,730 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: pod
2025-09-23T23:21:32,730 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: storageip
2025-09-23T23:21:32,732 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: eth3mask
2025-09-23T23:21:32,732 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: instance
2025-09-23T23:21:32,733 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: eth2ip
2025-09-23T23:21:32,734 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: localgw
2025-09-23T23:21:32,738 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: mgmtcidr
2025-09-23T23:21:32,739 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: eth1ip
2025-09-23T23:21:32,739 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: authorized_key
2025-09-23T23:21:32,740 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: public.network.device
2025-09-23T23:21:32,740 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: type
2025-09-23T23:21:32,740 INFO [cloud.agent.AgentShell] (main:[]) Defaulting to using properties file for storage
2025-09-23T23:21:32,742 INFO [cloud.agent.AgentShell] (main:[]) Defaulting to the constant time backoff algorithm
2025-09-23T23:21:32,787 INFO [cloud.utils.LogUtils] (main:[]) log4j configuration found at /usr/local/cloud/systemvm/conf/log4j-cloud.xml
2025-09-23T23:21:32,792 INFO [cloud.agent.AgentShell] (main:[]) Using default Java settings for IPv6 preference for agent connection
2025-09-23T23:21:32,793 DEBUG [cloud.agent.AgentShell] (main:[]) Checking to see if agent.SecStorage.pid exists.
2025-09-23T23:21:32,796 DEBUG [cloud.utils.ProcessUtil] (main:[]) environment.properties could not be opened
2025-09-23T23:21:32,806 DEBUG [cloud.utils.ProcessUtil] (main:[]) Executing command [bash -c echo $PPID ].
2025-09-23T23:21:32,836 DEBUG [cloud.utils.ProcessUtil] (main:[]) Successfully executed process [7697] for command [bash -c echo $PPID ].
2025-09-23T23:21:32,848 DEBUG [agent.properties.AgentPropertiesFileHandler] (main:[]) Property [resource] was altered. Now using the value [com.cloud.storage.resource.PremiumSecondaryStorageResource].
2025-09-23T23:21:32,900 INFO [cloud.agent.Agent] (main:[]) Initialising agent [id: , uuid: null, name: null]
2025-09-23T23:21:32,901 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) conf secondary.storage.vm is true, act as if executing in SSVM
2025-09-23T23:21:32,909 DEBUG [utils.net.NetUtils] (main:[]) Retrieving network interface [eth1].
2025-09-23T23:21:32,909 DEBUG [utils.net.NetUtils] (main:[]) Retrieving network interface [eth2].
2025-09-23T23:21:32,910 DEBUG [utils.net.NetUtils] (main:[]) Retrieving network interface [null].
2025-09-23T23:21:32,911 DEBUG [utils.net.NetUtils] (main:[]) Retrieving network interface [null].
2025-09-23T23:21:32,912 DEBUG [utils.net.NetUtils] (main:[]) Retrieving network params of NIC [name:eth1 (eth1)].
2025-09-23T23:21:32,917 DEBUG [utils.net.NetUtils] (main:[]) Retrieving params of address [/172.17.26.82/24 [/172.17.26.255]] of NIC [name:eth1 (eth1)].
2025-09-23T23:21:32,924 DEBUG [utils.script.Script] (main:[]) Looking for config_ssl.sh in the classpath
2025-09-23T23:21:32,925 DEBUG [utils.script.Script] (main:[]) System resource: file:/usr/local/cloud/systemvm/config_ssl.sh
2025-09-23T23:21:32,926 DEBUG [utils.script.Script] (main:[]) Absolute path = /usr/local/cloud/systemvm/config_ssl.sh
2025-09-23T23:21:32,928 INFO [storage.resource.NfsSecondaryStorageResource] (main:[]) config_ssl.sh found in /usr/local/cloud/systemvm/config_ssl.sh
2025-09-23T23:21:32,928 DEBUG [utils.script.Script] (main:[]) Looking for config_auth.sh in the classpath
2025-09-23T23:21:32,929 DEBUG [utils.script.Script] (main:[]) System resource: file:/usr/local/cloud/systemvm/config_auth.sh
2025-09-23T23:21:32,929 DEBUG [utils.script.Script] (main:[]) Absolute path = /usr/local/cloud/systemvm/config_auth.sh
2025-09-23T23:21:32,929 INFO [storage.resource.NfsSecondaryStorageResource] (main:[]) config_auth.sh found in /usr/local/cloud/systemvm/config_auth.sh
2025-09-23T23:21:32,930 DEBUG [utils.script.Script] (main:[]) Looking for ipfirewall.sh in the classpath
2025-09-23T23:21:32,932 DEBUG [utils.script.Script] (main:[]) System resource: file:/usr/local/cloud/systemvm/ipfirewall.sh
2025-09-23T23:21:32,932 DEBUG [utils.script.Script] (main:[]) Absolute path = /usr/local/cloud/systemvm/ipfirewall.sh
2025-09-23T23:21:32,933 INFO [storage.resource.NfsSecondaryStorageResource] (main:[]) _configIpFirewallScr found in /usr/local/cloud/systemvm/ipfirewall.sh
2025-09-23T23:21:32,936 DEBUG [utils.script.Script] (main:[]) Looking for create_privatetemplate_from_snapshot_xen.sh in the classpath
2025-09-23T23:21:32,936 DEBUG [utils.script.Script] (main:[]) System resource: null
2025-09-23T23:21:32,937 DEBUG [utils.script.Script] (main:[]) Classpath resource: file:/usr/local/cloud/systemvm/scripts/storage/secondary/create_privatetemplate_from_snapshot_xen.sh
2025-09-23T23:21:32,938 DEBUG [utils.script.Script] (main:[]) Absolute path = /usr/local/cloud/systemvm/scripts/storage/secondary/create_privatetemplate_from_snapshot_xen.sh
2025-09-23T23:21:32,939 INFO [storage.resource.NfsSecondaryStorageResource] (main:[]) Secondary storage runs in role templateProcessor
2025-09-23T23:21:32,951 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) addRouteToInternalIp: localgw=172.17.26.1, eth1ip=172.17.26.82, eth1mask=255.255.255.0,destIp=172.24.48.133
2025-09-23T23:21:32,957 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Executing command [/bin/bash -c ip route delete 172.24.48.133 ].
2025-09-23T23:21:32,982 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Successfully executed process [7700] for command [/bin/bash -c ip route delete 172.24.48.133 ].
2025-09-23T23:21:32,983 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Executing command [/bin/bash -c ip route add 172.24.48.133 via 172.17.26.1 ].
2025-09-23T23:21:32,988 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Successfully executed process [7702] for command [/bin/bash -c ip route add 172.24.48.133 via 172.17.26.1 ].
2025-09-23T23:21:32,989 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) addRouteToInternalIp: added route to internal ip=172.24.48.133 via 172.17.26.1
2025-09-23T23:21:32,989 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) addRouteToInternalIp: localgw=172.17.26.1, eth1ip=172.17.26.82, eth1mask=255.255.255.0,destIp=172.24.48.134
2025-09-23T23:21:32,990 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Executing command [/bin/bash -c ip route delete 172.24.48.134 ].
2025-09-23T23:21:32,993 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Successfully executed process [7704] for command [/bin/bash -c ip route delete 172.24.48.134 ].
2025-09-23T23:21:32,994 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Executing command [/bin/bash -c ip route add 172.24.48.134 via 172.17.26.1 ].
2025-09-23T23:21:32,998 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Successfully executed process [7706] for command [/bin/bash -c ip route add 172.24.48.134 via 172.17.26.1 ].
2025-09-23T23:21:33,000 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) addRouteToInternalIp: added route to internal ip=172.24.48.134 via 172.17.26.1
2025-09-23T23:21:33,000 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) addRouteToInternalIp: localgw=172.17.26.1, eth1ip=172.17.26.82, eth1mask=255.255.255.0,destIp=172.24.48.195
2025-09-23T23:21:33,001 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Executing command [/bin/bash -c ip route delete 172.24.48.195 ].
2025-09-23T23:21:33,009 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Successfully executed process [7708] for command [/bin/bash -c ip route delete 172.24.48.195 ].
2025-09-23T23:21:33,010 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Executing command [/bin/bash -c ip route add 172.24.48.195 via 172.17.26.1 ].
2025-09-23T23:21:33,015 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Successfully executed process [7710] for command [/bin/bash -c ip route add 172.24.48.195 via 172.17.26.1 ].
2025-09-23T23:21:33,016 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) addRouteToInternalIp: added route to internal ip=172.24.48.195 via 172.17.26.1
2025-09-23T23:21:33,017 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) addRouteToInternalIp: localgw=172.17.26.1, eth1ip=172.17.26.82, eth1mask=255.255.255.0,destIp=172.24.48.196
2025-09-23T23:21:33,018 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Executing command [/bin/bash -c ip route delete 172.24.48.196 ].
2025-09-23T23:21:33,025 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Successfully executed process [7712] for command [/bin/bash -c ip route delete 172.24.48.196 ].
2025-09-23T23:21:33,026 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Executing command [/bin/bash -c ip route add 172.24.48.196 via 172.17.26.1 ].
2025-09-23T23:21:33,031 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Successfully executed process [7714] for command [/bin/bash -c ip route add 172.24.48.196 via 172.17.26.1 ].
2025-09-23T23:21:33,032 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) addRouteToInternalIp: added route to internal ip=172.24.48.196 via 172.17.26.1
2025-09-23T23:21:33,033 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Executing command [/bin/systemctl restart ssh ].
2025-09-23T23:21:33,134 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Successfully executed process [7716] for command [/bin/systemctl restart ssh ].
2025-09-23T23:21:33,135 INFO [storage.resource.IpTablesHelper] (main:[]) Adding rule [-i eth1 -p tcp -m state --state NEW -m tcp --dport 3922 -j ACCEPT] to [INPUT] if required.
2025-09-23T23:21:33,139 DEBUG [storage.resource.IpTablesHelper] (main:[]) Executing command [/bin/bash -c iptables -C INPUT -i eth1 -p tcp -m state --state NEW -m tcp --dport 3922 -j ACCEPT ].
2025-09-23T23:21:33,155 DEBUG [storage.resource.IpTablesHelper] (main:[]) Successfully executed process [7720] for command [/bin/bash -c iptables -C INPUT -i eth1 -p tcp -m state --state NEW -m tcp --dport 3922 -j ACCEPT ].
2025-09-23T23:21:33,155 DEBUG [storage.resource.IpTablesHelper] (main:[]) Rule [-i eth1 -p tcp -m state --state NEW -m tcp --dport 3922 -j ACCEPT], doesn't need adding to [INPUT] : null
2025-09-23T23:21:33,156 WARN [storage.resource.IpTablesHelper] (main:[]) Rule already defined in SVM: -i eth1 -p tcp -m state --state NEW -m tcp --dport 3922 -j ACCEPT
2025-09-23T23:21:33,160 INFO [storage.template.DownloadManagerImpl] (main:[]) DownloadManager: starting additional services since we are inside system vm
2025-09-23T23:21:33,160 DEBUG [storage.template.DownloadManagerImpl] (main:[]) Executing command [/bin/systemctl stop apache2 ].
2025-09-23T23:21:33,288 DEBUG [storage.template.DownloadManagerImpl] (main:[]) Successfully executed process [7721] for command [/bin/systemctl stop apache2 ].
2025-09-23T23:21:33,290 INFO [storage.resource.IpTablesHelper] (main:[]) Adding rule [-i eth2 -p tcp -m state --state NEW -m tcp --dport 80 -j ACCEPT] to [INPUT] if required.
2025-09-23T23:21:33,290 DEBUG [storage.resource.IpTablesHelper] (main:[]) Executing command [/bin/bash -c iptables -C INPUT -i eth2 -p tcp -m state --state NEW -m tcp --dport 80 -j ACCEPT ].
2025-09-23T23:21:33,296 DEBUG [storage.resource.IpTablesHelper] (main:[]) Successfully executed process [7727] for command [/bin/bash -c iptables -C INPUT -i eth2 -p tcp -m state --state NEW -m tcp --dport 80 -j ACCEPT ].
2025-09-23T23:21:33,296 DEBUG [storage.resource.IpTablesHelper] (main:[]) Rule [-i eth2 -p tcp -m state --state NEW -m tcp --dport 80 -j ACCEPT], doesn't need adding to [INPUT] : null
2025-09-23T23:21:33,297 WARN [storage.resource.IpTablesHelper] (main:[]) Rule already defined in SVM: -i eth2 -p tcp -m state --state NEW -m tcp --dport 80 -j ACCEPT
2025-09-23T23:21:33,297 INFO [storage.resource.IpTablesHelper] (main:[]) Adding rule [-i eth2 -p tcp -m state --state NEW -m tcp --dport 443 -j ACCEPT;] to [INPUT] if required.
2025-09-23T23:21:33,300 DEBUG [storage.resource.IpTablesHelper] (main:[]) Executing command [/bin/bash -c iptables -C INPUT -i eth2 -p tcp -m state --state NEW -m tcp --dport 443 -j ACCEPT; ].
2025-09-23T23:21:33,309 DEBUG [storage.resource.IpTablesHelper] (main:[]) Successfully executed process [7728] for command [/bin/bash -c iptables -C INPUT -i eth2 -p tcp -m state --state NEW -m tcp --dport 443 -j ACCEPT; ].
2025-09-23T23:21:33,309 DEBUG [storage.resource.IpTablesHelper] (main:[]) Rule [-i eth2 -p tcp -m state --state NEW -m tcp --dport 443 -j ACCEPT;], doesn't need adding to [INPUT] : null
2025-09-23T23:21:33,310 WARN [storage.resource.IpTablesHelper] (main:[]) Rule already defined in SVM: -i eth2 -p tcp -m state --state NEW -m tcp --dport 443 -j ACCEPT;
2025-09-23T23:21:33,311 DEBUG [storage.template.DownloadManagerImpl] (main:[]) Executing command [/bin/systemctl start apache2 ].
2025-09-23T23:21:33,352 DEBUG [storage.template.DownloadManagerImpl] (main:[]) Successfully executed process [7729] for command [/bin/systemctl start apache2 ].
2025-09-23T23:21:33,352 DEBUG [storage.template.DownloadManagerImpl] (main:[]) Executing command [/bin/su -s /bin/bash -c mkdir -p /var/www/html/copy/template www-data ].
2025-09-23T23:21:33,565 DEBUG [storage.template.DownloadManagerImpl] (main:[]) Successfully executed process [7735] for command [/bin/su -s /bin/bash -c mkdir -p /var/www/html/copy/template www-data ].
2025-09-23T23:21:33,566 INFO [storage.resource.IpTablesHelper] (main:[]) Adding rule [-o eth1 -p tcp -m state --state NEW -m tcp --dport 80 -j REJECT;] to [OUTPUT] if required.
2025-09-23T23:21:33,566 DEBUG [storage.resource.IpTablesHelper] (main:[]) Executing command [/bin/bash -c iptables -C OUTPUT -o eth1 -p tcp -m state --state NEW -m tcp --dport 80 -j REJECT; ].
2025-09-23T23:21:33,573 DEBUG [storage.resource.IpTablesHelper] (main:[]) Successfully executed process [7810] for command [/bin/bash -c iptables -C OUTPUT -o eth1 -p tcp -m state --state NEW -m tcp --dport 80 -j REJECT; ].
2025-09-23T23:21:33,574 DEBUG [storage.resource.IpTablesHelper] (main:[]) Rule [-o eth1 -p tcp -m state --state NEW -m tcp --dport 80 -j REJECT;], doesn't need adding to [OUTPUT] : null
2025-09-23T23:21:33,575 WARN [storage.resource.IpTablesHelper] (main:[]) Rule already defined in SVM: -o eth1 -p tcp -m state --state NEW -m tcp --dport 80 -j REJECT;
2025-09-23T23:21:33,575 INFO [storage.resource.IpTablesHelper] (main:[]) Adding rule [-o eth1 -p tcp -m state --state NEW -m tcp --dport 443 -j REJECT;] to [OUTPUT] if required.
2025-09-23T23:21:33,575 DEBUG [storage.resource.IpTablesHelper] (main:[]) Executing command [/bin/bash -c iptables -C OUTPUT -o eth1 -p tcp -m state --state NEW -m tcp --dport 443 -j REJECT; ].
2025-09-23T23:21:33,579 DEBUG [storage.resource.IpTablesHelper] (main:[]) Successfully executed process [7811] for command [/bin/bash -c iptables -C OUTPUT -o eth1 -p tcp -m state --state NEW -m tcp --dport 443 -j REJECT; ].
2025-09-23T23:21:33,579 DEBUG [storage.resource.IpTablesHelper] (main:[]) Rule [-o eth1 -p tcp -m state --state NEW -m tcp --dport 443 -j REJECT;], doesn't need adding to [OUTPUT] : null
2025-09-23T23:21:33,581 WARN [storage.resource.IpTablesHelper] (main:[]) Rule already defined in SVM: -o eth1 -p tcp -m state --state NEW -m tcp --dport 443 -j REJECT;
2025-09-23T23:21:33,581 DEBUG [utils.script.Script] (main:[]) Looking for listvmtmplt.sh in the classpath
2025-09-23T23:21:33,582 DEBUG [utils.script.Script] (main:[]) System resource: null
2025-09-23T23:21:33,582 DEBUG [utils.script.Script] (main:[]) Classpath resource: file:/usr/local/cloud/systemvm/scripts/storage/secondary/listvmtmplt.sh
2025-09-23T23:21:33,583 DEBUG [utils.script.Script] (main:[]) Absolute path = /usr/local/cloud/systemvm/scripts/storage/secondary/listvmtmplt.sh
2025-09-23T23:21:33,584 INFO [storage.template.DownloadManagerImpl] (main:[]) listvmtmplt.sh found in /usr/local/cloud/systemvm/scripts/storage/secondary/listvmtmplt.sh
2025-09-23T23:21:33,585 DEBUG [utils.script.Script] (main:[]) Looking for createtmplt.sh in the classpath
2025-09-23T23:21:33,588 DEBUG [utils.script.Script] (main:[]) System resource: null
2025-09-23T23:21:33,589 DEBUG [utils.script.Script] (main:[]) Classpath resource: file:/usr/local/cloud/systemvm/scripts/storage/secondary/createtmplt.sh
2025-09-23T23:21:33,589 DEBUG [utils.script.Script] (main:[]) Absolute path = /usr/local/cloud/systemvm/scripts/storage/secondary/createtmplt.sh
2025-09-23T23:21:33,590 INFO [storage.template.DownloadManagerImpl] (main:[]) createtmplt.sh found in /usr/local/cloud/systemvm/scripts/storage/secondary/createtmplt.sh
2025-09-23T23:21:33,592 DEBUG [utils.script.Script] (main:[]) Looking for listvolume.sh in the classpath
2025-09-23T23:21:33,593 DEBUG [utils.script.Script] (main:[]) System resource: null
2025-09-23T23:21:33,595 DEBUG [utils.script.Script] (main:[]) Classpath resource: file:/usr/local/cloud/systemvm/scripts/storage/secondary/listvolume.sh
2025-09-23T23:21:33,596 DEBUG [utils.script.Script] (main:[]) Absolute path = /usr/local/cloud/systemvm/scripts/storage/secondary/listvolume.sh
2025-09-23T23:21:33,596 INFO [storage.template.DownloadManagerImpl] (main:[]) listvolume.sh found in /usr/local/cloud/systemvm/scripts/storage/secondary/listvolume.sh
2025-09-23T23:21:33,599 DEBUG [utils.script.Script] (main:[]) Looking for createvolume.sh in the classpath
2025-09-23T23:21:33,600 DEBUG [utils.script.Script] (main:[]) System resource: null
2025-09-23T23:21:33,601 DEBUG [utils.script.Script] (main:[]) Classpath resource: file:/usr/local/cloud/systemvm/scripts/storage/secondary/createvolume.sh
2025-09-23T23:21:33,601 DEBUG [utils.script.Script] (main:[]) Absolute path = /usr/local/cloud/systemvm/scripts/storage/secondary/createvolume.sh
2025-09-23T23:21:33,601 INFO [storage.template.DownloadManagerImpl] (main:[]) createvolume.sh found in /usr/local/cloud/systemvm/scripts/storage/secondary/createvolume.sh
2025-09-23T23:21:33,615 INFO [storage.template.UploadManagerImpl] (main:[]) UploadManager: starting additional services since we are inside system vm
2025-09-23T23:21:33,622 DEBUG [storage.template.UploadManagerImpl] (main:[]) Executing command [rm -rf /mnt/SecStorage/extractmnt ].
2025-09-23T23:21:33,628 DEBUG [storage.template.UploadManagerImpl] (main:[]) Successfully executed process [7812] for command [rm -rf /mnt/SecStorage/extractmnt ].
2025-09-23T23:21:33,628 DEBUG [storage.template.UploadManagerImpl] (main:[]) Executing command [touch /mnt/SecStorage/extractmnt ].
2025-09-23T23:21:33,636 DEBUG [storage.template.UploadManagerImpl] (main:[]) Successfully executed process [7813] for command [touch /mnt/SecStorage/extractmnt ].
2025-09-23T23:21:33,637 DEBUG [storage.template.UploadManagerImpl] (main:[]) Executing command [/bin/bash -c ln -sf null /mnt/SecStorage/extractmnt ].
2025-09-23T23:21:33,642 DEBUG [storage.template.UploadManagerImpl] (main:[]) Successfully executed process [7814] for command [/bin/bash -c ln -sf null /mnt/SecStorage/extractmnt ].
2025-09-23T23:21:33,670 INFO [cloud.serializer.GsonHelper] (main:[]) Default Builder inited.
**2025-09-23T23:21:33,701 DEBUG [agent.properties.AgentPropertiesFileHandler] (main:[]) Property [ssl.handshake.timeout] has empty or null value. Using default value [30].**
2025-09-23T23:21:33,703 INFO [cloud.agent.Agent] (main:[]) Agent [id = new, uuid = null, name = null, type = PremiumSecondaryStorageResource, zone = 3, pod = 3, workers = 5, port = 8250] with host = 172.24.48.133, local id = 1
2025-09-23T23:21:33,704 DEBUG [utils.script.Script] (main:[]) Looking for keystore-setup in the classpath
2025-09-23T23:21:33,705 DEBUG [utils.script.Script] (main:[]) System resource: null
2025-09-23T23:21:33,707 DEBUG [utils.script.Script] (main:[]) Classpath resource: file:/usr/local/cloud/systemvm/scripts/util/keystore-setup
2025-09-23T23:21:33,708 DEBUG [utils.script.Script] (main:[]) Absolute path = /usr/local/cloud/systemvm/scripts/util/keystore-setup
2025-09-23T23:21:33,709 DEBUG [utils.script.Script] (main:[]) Looking for keystore-cert-import in the classpath
2025-09-23T23:21:33,711 DEBUG [utils.script.Script] (main:[]) System resource: null
2025-09-23T23:21:33,711 DEBUG [utils.script.Script] (main:[]) Classpath resource: file:/usr/local/cloud/systemvm/scripts/util/keystore-cert-import
2025-09-23T23:21:33,712 DEBUG [utils.script.Script] (main:[]) Absolute path = /usr/local/cloud/systemvm/scripts/util/keystore-cert-import
2025-09-23T23:21:33,713 INFO [utils.nio.NioClient] (main:[]) Connecting to 172.24.48.133:8250
2025-09-23T23:21:33,730 INFO [utils.nio.NioClient] (main:[]) Connected to 172.24.48.133:8250
2025-09-23T23:21:33,734 INFO [utils.nio.Link] (main:[]) Conf file found: /usr/local/cloud/systemvm/conf/agent.properties
2025-09-23T23:22:04,338 WARN [utils.nio.Link] (main:[]) SSL Handshake has taken more than 30000 ms to connect to: /172.24.48.133:8250 while status: NEED_UNWRAP. Please investigate this connection.
2025-09-23T23:22:04,341 ERROR [utils.nio.NioClient] (main:[]) IOException while connecting to 172.24.48.133:8250 java.io.IOException: SSL Handshake failed while connecting to host: 172.24.48.133:8250
at com.cloud.utils.nio.NioClient.init(NioClient.java:75)
at com.cloud.utils.nio.NioConnection.start(NioConnection.java:109)
at com.cloud.agent.Agent.start(Agent.java:327)
at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:477)
at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:454)
at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:438)
at com.cloud.agent.AgentShell.start(AgentShell.java:539)
at com.cloud.agent.AgentShell.main(AgentShell.java:569)
2025-09-23T23:22:04,342 ERROR [utils.nio.NioClient] (main:[]) Unable to initialize the threads. java.io.IOException: SSL Handshake failed while connecting to host: 172.24.48.133:8250
at com.cloud.utils.nio.NioClient.init(NioClient.java:75)
at com.cloud.utils.nio.NioConnection.start(NioConnection.java:109)
at com.cloud.agent.Agent.start(Agent.java:327)
at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:477)
at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:454)
at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:438)
at com.cloud.agent.AgentShell.start(AgentShell.java:539)
at com.cloud.agent.AgentShell.main(AgentShell.java:569)
2025-09-23T23:22:04,344 WARN [cloud.agent.Agent] (main:[]) Attempt to connect to server generated NIO Connection Exception SSL Handshake failed while connecting to host: 172.24.48.133:8250, trying again
2025-09-23T23:22:09,346 DEBUG [agent.properties.AgentPropertiesFileHandler] (main:[]) Property [ssl.handshake.timeout] has empty or null value. Using default value [30].
2025-09-23T23:22:09,348 INFO [cloud.agent.Agent] (main:[]) Connecting to host: 172.24.48.134
2025-09-23T23:22:09,351 INFO [utils.nio.NioClient] (main:[]) Connecting to 172.24.48.134:8250
2025-09-23T23:22:09,353 INFO [utils.nio.NioClient] (main:[]) Connected to 172.24.48.134:8250
2025-09-23T23:22:09,355 INFO [utils.nio.Link] (main:[]) Conf file found: /usr/local/cloud/systemvm/conf/agent.properties
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14485163
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "weizhouapache (via GitHub)" <gi...@apache.org>.
GitHub user weizhouapache added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
> Yes, of course.
can you run the following command in SSVM ?
@Hossein4185
```
keytool -list -keystore /usr/local/cloud/systemvm/conf/cloud.jks -storepass $(grep keystore.passphrase /usr/local/cloud/systemvm/conf/agent.properties |cut -d "=" -f2)
```
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14475200
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "weizhouapache (via GitHub)" <gi...@apache.org>.
GitHub user weizhouapache added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
> @weizhouapache I have already registered with this template.
can you confirm the new SSVM is created from this new template ?
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14474944
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 closed a discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
### problem
ssvm can connect to management port 8250. This has been tested with Telnet but it gives an SSL error.
2025-09-21T20:58:53,248 WARN [utils.nio.Link] (main:[]) SSL Handshake has taken more than 30000 ms to connect to: /172.24.48.134:8250 while status: NEED_UNWRAP. Please investigate this connection.
2025-09-21T20:58:53,249 ERROR [utils.nio.NioClient] (main:[]) IOException while connecting to 172.24.48.134:8250 java.io.IOException: SSL Handshake failed while connecting to host: 172.24.48.134:8250
at com.cloud.utils.nio.NioClient.init(NioClient.java:75)
at com.cloud.utils.nio.NioConnection.start(NioConnection.java:109)
at com.cloud.agent.Agent.start(Agent.java:338)
at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:477)
at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:454)
at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:438)
at com.cloud.agent.AgentShell.start(AgentShell.java:539)
at com.cloud.agent.AgentShell.main(AgentShell.java:569)
2025-09-21T20:58:53,250 ERROR [utils.nio.NioClient] (main:[]) Unable to initialize the threads. java.io.IOException: SSL Handshake failed while connecting to host: 172.24.48.134:8250
2025-09-21T20:47:12,447 ERROR [utils.nio.NioClient] (main:[]) IOException while connecting to 172.24.48.134:8250 java.io.IOException: SSL Handshake failed while connecting to host: 172.24.48.134:8250
at com.cloud.utils.nio.NioClient.init(NioClient.java:75)
at com.cloud.utils.nio.NioConnection.start(NioConnection.java:109)
at com.cloud.agent.Agent.start(Agent.java:338)
at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:477)
at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:454)
at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:438)
at com.cloud.agent.AgentShell.start(AgentShell.java:539)
at com.cloud.agent.AgentShell.main(AgentShell.java:569)
2025-09-21T20:47:12,448 ERROR [utils.nio.NioClient] (main:[]) Unable to initialize the threads. java.io.IOException: SSL Handshake failed while connecting to host: 172.24.48.134:8250
at com.cloud.utils.nio.NioClient.init(NioClient.java:75)
at com.cloud.utils.nio.NioConnection.start(NioConnection.java:109)
at com.cloud.agent.Agent.start(Agent.java:338)
at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:477)
at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:454)
at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:438)
at com.cloud.agent.AgentShell.start(AgentShell.java:539)
at com.cloud.agent.AgentShell.main(AgentShell.java:569)
2025-09-21T20:47:12,449 INFO [utils.nio.NioClient] (main:[]) NioClient connection closed
2025-09-21T20:47:12,449 INFO [cloud.agent.Agent] (main:[]) Attempted to connect to the server, but received an unexpected exception, trying again... com.cloud.utils.exception.NioConnectionException: SSL Handshake failed while connecting to host: 172.24.48.134:8250
at com.cloud.utils.nio.NioConnection.start(NioConnection.java:115)
at com.cloud.agent.Agent.start(Agent.java:338)
at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:477)
at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:454)
at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:438)
at com.cloud.agent.AgentShell.start(AgentShell.java:539)
at com.cloud.agent.AgentShell.main(AgentShell.java:569)
Caused by: java.io.IOException: SSL Handshake failed while connecting to host: 172.24.48.134:8250
at com.cloud.utils.nio.NioClient.init(NioClient.java:75)
at com.cloud.utils.nio.NioConnection.start(NioConnection.java:109)
... 6 more
2025-09-21T20:47:17,450 INFO [cloud.agent.Agent] (main:[]) Connecting to host: 172.24.48.133
2025-09-21T20:47:17,453 INFO [utils.nio.NioClient] (main:[]) Connecting to 172.24.48.133:8250
2025-09-21T20:47:17,454 INFO [utils.nio.NioClient] (main:[]) Connected to 172.24.48.133:8250
2025-09-21T20:47:17,455 INFO [utils.nio.Link] (main:[]) Conf file found: /usr/local/cloud/systemvm/conf/agent.properties
### versions
4.21
OS: Ubuntu 24.04
Vmware version is 8.0.3
GitHub link: https://github.com/apache/cloudstack/discussions/11694
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 edited a comment on the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
We don't have any logs on the management, the Vmware version is 8.0.3, so rebuilding the SSVM doesn't solve the problem, and then the third health check log is sent.
root@s-5333-VM:~# bash /usr/local/cloud/systemvm/ssvm-check.sh
================================================
First DNS server is 172.24.48.195
PING 172.24.48.195 (172.24.48.195): 56 data bytes
64 bytes from 172.24.48.195: icmp_seq=0 ttl=61 time=0.621 ms
64 bytes from 172.24.48.195: icmp_seq=1 ttl=61 time=0.552 ms
--- 172.24.48.195 ping statistics ---
2 packets transmitted, 2 packets received, 0% packet loss
round-trip min/avg/max/stddev = 0.552/0.587/0.621/0.035 ms
Good: Can ping DNS server
================================================
Good: DNS resolves cloudstack.apache.org
================================================
ERROR: Storage nfs is not currently mounted
Verifying if we can at least ping the storage
Storage address(s): scst.pvcl.afracloud.local, trying to ping
Pinging storage address: scst.pvcl.afracloud.local
PING scst.pvcl.afracloud.local (172.24.48.100): 56 data bytes
64 bytes from 172.24.48.100: icmp_seq=0 ttl=61 time=0.629 ms
64 bytes from 172.24.48.100: icmp_seq=1 ttl=61 time=0.522 ms
--- scst.pvcl.afracloud.local ping statistics ---
2 packets transmitted, 2 packets received, 0% packet loss
round-trip min/avg/max/stddev = 0.522/0.576/0.629/0.054 ms
Good: Can ping nfs storage address
================================================
Management server is 172.24.48.133,172.24.48.134. Checking connectivity.
Good: Can connect to management server 172.24.48.133 port 8250
Good: Can connect to management server 172.24.48.134 port 8250
================================================
Good: Java process is running
================================================
Tests Complete. Look for ERROR or WARNING above.
root@s-5333-VM:~# ^C
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14474023
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
@weizhouapache
2025-09-23T22:39:32,101 ERROR [utils.nio.NioClient] (main:[]) IOException while connecting to 172.24.48.133:8250 java.io.IOException: SSL Handshake failed while connecting to host: 172.24.48.133:8250
at com.cloud.utils.nio.NioClient.init(NioClient.java:75)
at com.cloud.utils.nio.NioConnection.start(NioConnection.java:109)
at com.cloud.agent.Agent.start(Agent.java:338)
at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:477)
at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:454)
at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:438)
at com.cloud.agent.AgentShell.start(AgentShell.java:539)
at com.cloud.agent.AgentShell.main(AgentShell.java:569)
2025-09-23T22:39:32,102 ERROR [utils.nio.NioClient] (main:[]) Unable to initialize the threads. java.io.IOException: SSL Handshake failed while connecting to host: 172.24.48.133:8250
at com.cloud.utils.nio.NioClient.init(NioClient.java:75)
at com.cloud.utils.nio.NioConnection.start(NioConnection.java:109)
at com.cloud.agent.Agent.start(Agent.java:338)
at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:477)
at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:454)
at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:438)
at com.cloud.agent.AgentShell.start(AgentShell.java:539)
at com.cloud.agent.AgentShell.main(AgentShell.java:569)
2025-09-23T22:39:32,103 INFO [utils.nio.NioClient] (main:[]) NioClient connection closed
2025-09-23T22:39:32,103 INFO [cloud.agent.Agent] (main:[]) Attempted to connect to the server, but received an unexpected exception, trying again... com.cloud.utils.exception.NioConnectionException: SSL Handshake failed while connecting to host: 172.24.48.133:8250
at com.cloud.utils.nio.NioConnection.start(NioConnection.java:115)
at com.cloud.agent.Agent.start(Agent.java:338)
at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:477)
at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:454)
at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:438)
at com.cloud.agent.AgentShell.start(AgentShell.java:539)
at com.cloud.agent.AgentShell.main(AgentShell.java:569)
Caused by: java.io.IOException: SSL Handshake failed while connecting to host: 172.24.48.133:8250
at com.cloud.utils.nio.NioClient.init(NioClient.java:75)
at com.cloud.utils.nio.NioConnection.start(NioConnection.java:109)
... 6 more
2025-09-23T22:39:37,105 DEBUG [agent.properties.AgentPropertiesFileHandler] (main:[]) Property [ssl.handshake.timeout] has empty or null value. Using default value [30].
2025-09-23T22:39:37,108 INFO [cloud.agent.Agent] (main:[]) Connecting to host: 172.24.48.134
2025-09-23T22:39:37,109 INFO [utils.nio.NioClient] (main:[]) Connecting to 172.24.48.134:8250
2025-09-23T22:39:37,110 INFO [utils.nio.NioClient] (main:[]) Connected to 172.24.48.134:8250
2025-09-23T22:39:37,113 INFO [utils.nio.Link] (main:[]) Conf file found: /usr/local/cloud/systemvm/conf/agent.properties
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14484773
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
@weizhouapache
What script can I use to download directly?
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14497092
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "weizhouapache (via GitHub)" <gi...@apache.org>.
GitHub user weizhouapache added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
> 2025-09-23T22:39:32,101 ERROR [utils.nio.NioClient] (main:[]) IOException while connecting to 172.24.48.133:8250 java.io.IOException: SSL Handshake failed while connecting to host: 172.24.48.133:8250 at com.cloud.utils.nio.NioClient.init(NioClient.java:75) at com.cloud.utils.nio.NioConnection.start(NioConnection.java:109) at com.cloud.agent.Agent.start(Agent.java:338) at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:477) at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:454) at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:438) at com.cloud.agent.AgentShell.start(AgentShell.java:539) at com.cloud.agent.AgentShell.main(AgentShell.java:569)
@Hossein4185
all logs since the restart ?
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14484889
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 edited a comment on the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
@weizhouapache
Yes, of course.
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14475341
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
@weizhouapache
[daemon.log](https://github.com/user-attachments/files/22491913/daemon.log)
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14485422
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 edited a comment on the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
@weizhouapache
The problem was solved with this command
But when I try to upload a template as a URL, I get an error on management
514a63 with error: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
and also get an error on ssvm
2025-09-24T09:41:57,759 INFO [storage.template.DownloadManagerImpl] (pool-2-thread-4:[]) local: /mnt/SecStorage/054aca04-065d-3b12-84e6-504ff84130cb/template/tmpl/9/258/dnld2045255748598754523tmp_, bytes=(0 bytes) 0, error=PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target, pct=0
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14496748
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
@weizhouapache
set use.https.to.upload=false and restart ssvm and management but get an error on ssvm
2025-09-24T10:04:36,429 INFO [cloud.agent.Agent] (AgentRequest-Handler-4:[]) Ready command is processed for agent [id: 26, uuid: 76f82e32-1552-4db7-b502-c69e3a1ea27c, name: s-5346-VM]
2025-09-24T10:04:36,522 INFO [cloud.agent.Agent] (AgentRequest-Handler-2:[]) Processing agent ready command, agent id = 26, uuid = 76f82e32-1552-4db7-b502-c69e3a1ea27c, name = s-5346-VM
2025-09-24T10:04:36,534 INFO [cloud.agent.Agent] (AgentRequest-Handler-2:[]) Ready command is processed for agent [id: 26, uuid: 76f82e32-1552-4db7-b502-c69e3a1ea27c, name: s-5346-VM]
2025-09-24T10:04:38,046 INFO [cloud.agent.Agent] (Agent-Handler-3:[]) Connected to the host: 172.24.48.197
2025-09-24T10:04:40,978 INFO [storage.resource.NfsSecondaryStorageResource] (AgentRequest-Handler-3:[]) Determined host scst.pvcl.afracloud.local corresponds to IP 172.24.48.100
2025-09-24T10:04:41,082 INFO [storage.resource.NfsSecondaryStorageResource] (AgentRequest-Handler-5:[]) Determined host scst.pvcl.afracloud.local corresponds to IP 172.24.48.100
2025-09-24T10:04:41,194 INFO [storage.resource.NfsSecondaryStorageResource] (AgentRequest-Handler-1:[]) Determined host scst.pvcl.afracloud.local corresponds to IP 172.24.48.100
2025-09-24T10:05:23,115 INFO [storage.resource.NfsSecondaryStorageResource] (AgentRequest-Handler-4:[]) Determined host scst.pvcl.afracloud.local corresponds to IP 172.24.48.100
2025-09-24T10:05:23,210 INFO [storage.resource.NfsSecondaryStorageResource] (AgentRequest-Handler-2:[]) Determined host scst.pvcl.afracloud.local corresponds to IP 172.24.48.100
2025-09-24T10:05:23,293 INFO [storage.template.HttpTemplateDownloader] (AgentRequest-Handler-4:[]) No credentials configured for host=stackbill-infra.s3.us-west-1.amazonaws.com:443
2025-09-24T10:05:23,295 INFO [storage.template.HttpTemplateDownloader] (AgentRequest-Handler-2:[]) No credentials configured for host=stackbill-infra.s3.us-west-1.amazonaws.com:443
2025-09-24T10:05:23,308 INFO [storage.resource.NfsSecondaryStorageResource] (AgentRequest-Handler-3:[]) Determined host scst.pvcl.afracloud.local corresponds to IP 172.24.48.100
2025-09-24T10:05:23,358 INFO [storage.template.HttpTemplateDownloader] (AgentRequest-Handler-3:[]) No credentials configured for host=stackbill-infra.s3.us-west-1.amazonaws.com:443
2025-09-24T10:05:24,250 INFO [storage.template.DownloadManagerImpl] (pool-2-thread-10:[]) Download Completion for jobId: 52a024fe-5a4f-4374-ae64-7011b02e8227, status=UNRECOVERABLE_ERROR
2025-09-24T10:05:24,251 INFO [storage.template.DownloadManagerImpl] (pool-2-thread-10:[]) local: /mnt/SecStorage/054aca04-065d-3b12-84e6-504ff84130cb/template/tmpl/9/260/dnld9207861704134784506tmp_, bytes=(0 bytes) 0, error=PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target, pct=0
2025-09-24T10:05:24,252 INFO [storage.template.DownloadManagerImpl] (pool-2-thread-11:[]) Download Completion for jobId: 1390703d-767b-4730-b201-317bbbc34e93, status=UNRECOVERABLE_ERROR
2025-09-24T10:05:24,253 INFO [storage.template.DownloadManagerImpl] (pool-2-thread-11:[]) local: /mnt/SecStorage/054aca04-065d-3b12-84e6-504ff84130cb/template/tmpl/9/260/dnld16757691477733494967tmp_, bytes=(0 bytes) 0, error=PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target, pct=0
2025-09-24T10:05:25,155 INFO [storage.template.DownloadManagerImpl] (pool-2-thread-12:[]) Download Completion for jobId: 9a75b50f-486a-46e6-86f5-5bb75bbebd91, status=UNRECOVERABLE_ERROR
2025-09-24T10:05:25,156 INFO [storage.template.DownloadManagerImpl] (pool-2-thread-12:[]) local: /mnt/SecStorage/054aca04-065d-3b12-84e6-504ff84130cb/template/tmpl/9/260/dnld2972593311434184403tmp_, bytes=(0 bytes) 0, error=PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target, pct=0
2025-09-24T10:05:41,322 INFO [storage.resource.NfsSecondaryStorageResource] (AgentRequest-Handler-5:[]) Determined host scst.pvcl.afracloud.local corresponds to IP 172.24.48.100
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14497009
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
@weizhouapache
The current state of the systems is as follows:
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14487349
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 edited a comment on the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
@weizhouapache
I changed the management IP in global setting and the error changed. Please check.
Wed Sep 24 08:10:52 PM UTC 2025 Starting guest services for vmware
Wed Sep 24 08:10:59 PM UTC 2025 Applying iptables rules
Wed Sep 24 08:10:59 PM UTC 2025 Setting up interface: eth0
Wed Sep 24 08:10:59 PM UTC 2025 Setting up interface: eth1
Wed Sep 24 08:10:59 PM UTC 2025 Setting up interface: eth2
Wed Sep 24 08:10:59 PM UTC 2025 Received mgmt cidr : 172.24.48.128/26
Wed Sep 24 08:10:59 PM UTC 2025 Configuring sshd
Wed Sep 24 08:11:00 PM UTC 2025 Executing cloud-early-config
Wed Sep 24 08:11:00 PM UTC 2025 Scripts checksum detected: oldmd5=b0bf21ef8e4aa6df495c71f7d96b6aeb newmd5=b0bf21ef8e4aa6df495c71f7d96b6aeb
Wed Sep 24 08:11:02 PM UTC 2025 Could not find patch file, retrying
Wed Sep 24 08:11:04 PM UTC 2025 Could not find patch file, retrying
Wed Sep 24 08:11:06 PM UTC 2025 Could not find patch file, retrying
Wed Sep 24 08:11:08 PM UTC 2025 Could not find patch file, retrying
Wed Sep 24 08:11:10 PM UTC 2025 Could not find patch file, retrying
Wed Sep 24 08:11:10 PM UTC 2025 Scripts checksum detected: oldmd5=b0bf21ef8e4aa6df495c71f7d96b6aeb newmd5=125120ec9fbf442a2cdb23c17d2f56b5
Wed Sep 24 08:11:10 PM UTC 2025 Patched scripts using /var/cache/cloud/cloud-scripts.tgz
Wed Sep 24 08:11:10 PM UTC 2025 Bootstrapping systemvm appliance
Wed Sep 24 08:11:10 PM UTC 2025 Unziping /var/cache/cloud//agent.zip
Wed Sep 24 08:11:11 PM UTC 2025 As system VM type is secstorage, we will remove the default properties 'instance' and 'resource' from usr/local/cloud/systemvm/conf/agent.properties
Wed Sep 24 08:11:11 PM UTC 2025 Copying content of /var/cache/cloud/cmdline to usr/local/cloud/systemvm/conf/agent.properties
Wed Sep 24 08:11:12 PM UTC 2025 Configuring systemvm type=secstorage
Wed Sep 24 08:11:13 PM UTC 2025 Setting up secondary storage system vm
Wed Sep 24 08:11:13 PM UTC 2025 Setting up interface: eth3
Wed Sep 24 08:11:13 PM UTC 2025 Successfully setup storage network with STORAGE_IP:172.24.14.62, STORAGE_NETMASK:255.255.255.240, STORAGE_CIDR:
Wed Sep 24 08:11:13 PM UTC 2025 Setting up route of RFC1918 space to 172.17.26.1
Wed Sep 24 08:11:13 PM UTC 2025 Setting up entry in hosts
Wed Sep 24 08:11:13 PM UTC 2025 Applying iptables rules
Wed Sep 24 08:11:13 PM UTC 2025 Configuring apache2
Wed Sep 24 08:11:13 PM UTC 2025 Setting up apache web server
Wed Sep 24 08:11:13 PM UTC 2025 Setting up apache2 for post upload of volume/template
Wed Sep 24 08:11:13 PM UTC 2025 cloud: disable rp_filter
Wed Sep 24 08:11:13 PM UTC 2025 disable rpfilter
Wed Sep 24 08:11:13 PM UTC 2025 cloud: enable_fwding = 0
Wed Sep 24 08:11:13 PM UTC 2025 enable_fwding = 0
Wed Sep 24 08:11:13 PM UTC 2025 Processors = 1 Enable service = 0
Wed Sep 24 08:11:13 PM UTC 2025 Setting up NTP
Wed Sep 24 08:11:13 PM UTC 2025 Adding PubkeyAcceptedAlgorithms=+ssh-rsa to sshd_config
Wed Sep 24 08:11:13 PM UTC 2025 Skipped the installation of package python-is-python3 on Debian 12 as it can only be installed on Debian 11.
Wed Sep 24 08:11:13 PM UTC 2025 Skipped the installation of package python3-netaddr on Debian 12 as it can only be installed on Debian 11.
Wed Sep 24 08:11:13 PM UTC 2025 Finished setting up systemvm
Wed Sep 24 08:11:13 PM UTC 2025 Finished setting up systemvm
2025-09-24T20:11:20,664 INFO [cloud.agent.AgentShell] (main:[]) Agent started
2025-09-24T20:11:20,675 INFO [cloud.agent.AgentShell] (main:[]) Implementation Version is 4.21.0.0
2025-09-24T20:11:20,676 INFO [cloud.agent.AgentShell] (main:[]) agent.properties found at /usr/local/cloud/systemvm/conf/agent.properties
2025-09-24T20:11:20,741 INFO [cloud.agent.AgentShell] (main:[]) Defaulting to using properties file for storage
2025-09-24T20:11:20,742 INFO [cloud.agent.AgentShell] (main:[]) Defaulting to the constant time backoff algorithm
2025-09-24T20:11:20,785 INFO [cloud.utils.LogUtils] (main:[]) log4j configuration found at /usr/local/cloud/systemvm/conf/log4j-cloud.xml
2025-09-24T20:11:20,786 INFO [cloud.agent.AgentShell] (main:[]) Using default Java settings for IPv6 preference for agent connection
2025-09-24T20:11:20,893 INFO [cloud.agent.Agent] (main:[]) Initialising agent [id: , uuid: null, name: null]
2025-09-24T20:11:20,908 INFO [storage.resource.NfsSecondaryStorageResource] (main:[]) config_ssl.sh found in /usr/local/cloud/systemvm/config_ssl.sh
2025-09-24T20:11:20,908 INFO [storage.resource.NfsSecondaryStorageResource] (main:[]) config_auth.sh found in /usr/local/cloud/systemvm/config_auth.sh
2025-09-24T20:11:20,909 INFO [storage.resource.NfsSecondaryStorageResource] (main:[]) _configIpFirewallScr found in /usr/local/cloud/systemvm/ipfirewall.sh
2025-09-24T20:11:20,915 INFO [storage.resource.NfsSecondaryStorageResource] (main:[]) Secondary storage runs in role templateProcessor
2025-09-24T20:11:20,938 WARN [storage.resource.NfsSecondaryStorageResource] (main:[]) Execution of process [3817] for command [/bin/bash -c ip route delete 172.24.48.197 ] failed.
2025-09-24T20:11:20,938 WARN [storage.resource.NfsSecondaryStorageResource] (main:[]) Process [3817] for command [/bin/bash -c ip route delete 172.24.48.197 ] encountered the error: [RTNETLINK answers: No such process].
2025-09-24T20:11:20,954 WARN [storage.resource.NfsSecondaryStorageResource] (main:[]) Execution of process [3821] for command [/bin/bash -c ip route delete 172.24.48.198 ] failed.
2025-09-24T20:11:20,955 WARN [storage.resource.NfsSecondaryStorageResource] (main:[]) Process [3821] for command [/bin/bash -c ip route delete 172.24.48.198 ] encountered the error: [RTNETLINK answers: No such process].
2025-09-24T20:11:20,969 WARN [storage.resource.NfsSecondaryStorageResource] (main:[]) Execution of process [3825] for command [/bin/bash -c ip route delete 172.24.48.195 ] failed.
2025-09-24T20:11:20,969 WARN [storage.resource.NfsSecondaryStorageResource] (main:[]) Process [3825] for command [/bin/bash -c ip route delete 172.24.48.195 ] encountered the error: [RTNETLINK answers: No such process].
2025-09-24T20:11:20,984 WARN [storage.resource.NfsSecondaryStorageResource] (main:[]) Execution of process [3829] for command [/bin/bash -c ip route delete 172.24.48.196 ] failed.
2025-09-24T20:11:20,984 WARN [storage.resource.NfsSecondaryStorageResource] (main:[]) Process [3829] for command [/bin/bash -c ip route delete 172.24.48.196 ] encountered the error: [RTNETLINK answers: No such process].
2025-09-24T20:11:21,045 INFO [storage.resource.IpTablesHelper] (main:[]) Adding rule [-i eth1 -p tcp -m state --state NEW -m tcp --dport 3922 -j ACCEPT] to [INPUT] if required.
2025-09-24T20:11:21,053 WARN [storage.resource.IpTablesHelper] (main:[]) Execution of process [3837] for command [/bin/bash -c iptables -C INPUT -i eth1 -p tcp -m state --state NEW -m tcp --dport 3922 -j ACCEPT ] failed.
2025-09-24T20:11:21,314 WARN [storage.resource.IpTablesHelper] (main:[]) Process [3934] for command [/bin/bash -c iptables -C OUTPUT -o eth1 -p tcp -m state --state NEW -m tcp --dport 443 -j REJECT; ] encountered the error: [iptables: Bad rule (does a matching rule exist in that chain?).].
2025-09-24T20:11:21,318 INFO [storage.template.DownloadManagerImpl] (main:[]) listvmtmplt.sh found in /usr/local/cloud/systemvm/scripts/storage/secondary/listvmtmplt.sh
2025-09-24T20:11:21,323 INFO [storage.template.DownloadManagerImpl] (main:[]) createtmplt.sh found in /usr/local/cloud/systemvm/scripts/storage/secondary/createtmplt.sh
2025-09-24T20:11:21,324 INFO [storage.template.DownloadManagerImpl] (main:[]) listvolume.sh found in /usr/local/cloud/systemvm/scripts/storage/secondary/listvolume.sh
2025-09-24T20:11:21,327 INFO [storage.template.DownloadManagerImpl] (main:[]) createvolume.sh found in /usr/local/cloud/systemvm/scripts/storage/secondary/createvolume.sh
2025-09-24T20:11:21,338 INFO [storage.template.UploadManagerImpl] (main:[]) UploadManager: starting additional services since we are inside system vm
2025-09-24T20:11:21,378 INFO [cloud.serializer.GsonHelper] (main:[]) Default Builder inited.
2025-09-24T20:11:21,397 INFO [cloud.agent.Agent] (main:[]) Agent [id = new, uuid = null, name = null, type = PremiumSecondaryStorageResource, zone = 3, pod = 3, workers = 5, port = 8250] with host = 172.24.48.197, local id = 1
2025-09-24T20:11:21,401 INFO [utils.nio.NioClient] (main:[]) Connecting to 172.24.48.197:8250
2025-09-24T20:11:21,418 INFO [utils.nio.NioClient] (main:[]) Connected to 172.24.48.197:8250
2025-09-24T20:11:21,421 INFO [utils.nio.Link] (main:[]) Conf file found: /usr/local/cloud/systemvm/conf/agent.properties
2025-09-24T20:11:22,062 ERROR [utils.nio.Link] (main:[]) SSL error caught during wrap data: No trusted certificate found, for local address=/172.17.26.85:34672, remote address=/172.24.48.197:8250.
2025-09-24T20:11:22,063 INFO [utils.nio.NioClient] (main:[]) SSL: Handshake done
2025-09-24T20:11:22,144 WARN [cloud.agent.Agent] (Agent-Handler-1:[]) Unable to send request to /172.24.48.197:8250 due to 'null', request: null
2025-09-24T20:11:27,094 INFO [cloud.agent.Agent] (Agent-Handler-2:[]) Lost connection to host: 172.24.48.197. Attempting reconnection while we still have 0 commands in progress.
2025-09-24T20:11:27,098 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) NioClient connection closed
2025-09-24T20:11:32,100 INFO [cloud.agent.Agent] (Agent-Handler-2:[]) Reconnecting to host: 172.24.48.198
2025-09-24T20:11:32,109 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) Connecting to 172.24.48.198:8250
2025-09-24T20:11:32,111 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) Connected to 172.24.48.198:8250
2025-09-24T20:11:32,113 INFO [utils.nio.Link] (Agent-Handler-2:[]) Conf file found: /usr/local/cloud/systemvm/conf/agent.properties
2025-09-24T20:11:32,227 ERROR [utils.nio.Link] (Agent-Handler-2:[]) SSL error caught during wrap data: No trusted certificate found, for local address=/172.17.26.85:60296, remote address=/172.24.48.198:8250.
2025-09-24T20:11:32,228 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) SSL: Handshake done
2025-09-24T20:11:32,241 WARN [cloud.agent.Agent] (Agent-Handler-1:[]) Unable to send request to /172.24.48.198:8250 due to 'null', request: null
2025-09-24T20:11:37,231 INFO [cloud.agent.Agent] (Agent-Handler-2:[]) Connected to the host: 172.24.48.198
2025-09-24T20:11:37,238 INFO [cloud.agent.Agent] (Agent-Handler-2:[]) Lost connection to host: 172.24.48.198. Attempting reconnection while we still have 0 commands in progress.
2025-09-24T20:11:37,240 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) NioClient connection closed
2025-09-24T20:11:42,242 INFO [cloud.agent.Agent] (Agent-Handler-2:[]) Reconnecting to host: 172.24.48.198
2025-09-24T20:11:42,247 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) Connecting to 172.24.48.198:8250
2025-09-24T20:11:42,254 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) Connected to 172.24.48.198:8250
2025-09-24T20:11:42,255 INFO [utils.nio.Link] (Agent-Handler-2:[]) Conf file found: /usr/local/cloud/systemvm/conf/agent.properties
2025-09-24T20:11:42,354 ERROR [utils.nio.Link] (Agent-Handler-2:[]) SSL error caught during wrap data: No trusted certificate found, for local address=/172.17.26.85:57034, remote address=/172.24.48.198:8250.
2025-09-24T20:11:42,358 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) SSL: Handshake done
2025-09-24T20:11:42,376 WARN [cloud.agent.Agent] (Agent-Handler-1:[]) Unable to send request to /172.24.48.198:8250 due to 'null', request: null
2025-09-24T20:11:47,368 INFO [cloud.agent.Agent] (Agent-Handler-2:[]) Lost connection to host: 172.24.48.198. Attempting reconnection while we still have 0 commands in progress.
2025-09-24T20:11:47,376 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) NioClient connection closed
2025-09-24T20:11:47,364 INFO [cloud.agent.Agent] (Agent-Handler-2:[]) Connected to the host: 172.24.48.198
2025-09-24T20:11:52,378 INFO [cloud.agent.Agent] (Agent-Handler-2:[]) Reconnecting to host: 172.24.48.198
2025-09-24T20:11:52,383 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) Connecting to 172.24.48.198:8250
2025-09-24T20:11:52,387 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) Connected to 172.24.48.198:8250
2025-09-24T20:11:52,389 INFO [utils.nio.Link] (Agent-Handler-2:[]) Conf file found: /usr/local/cloud/systemvm/conf/agent.properties
2025-09-24T20:11:52,538 ERROR [utils.nio.Link] (Agent-Handler-2:[]) SSL error caught during wrap data: No trusted certificate found, for local address=/172.17.26.85:37370, remote address=/172.24.48.198:8250.
2025-09-24T20:11:52,543 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) SSL: Handshake done
2025-09-24T20:11:52,561 WARN [cloud.agent.Agent] (Agent-Handler-1:[]) Unable to send request to /172.24.48.198:8250 due to 'null', request: null
2025-09-24T20:11:57,547 INFO [cloud.agent.Agent] (Agent-Handler-2:[]) Connected to the host: 172.24.48.198
2025-09-24T20:11:57,549 INFO [cloud.agent.Agent] (Agent-Handler-2:[]) Lost connection to host: 172.24.48.198. Attempting reconnection while we still have 0 commands in progress.
*******************************************************
and also management log is sent
Local":false,"usageLocal":true,"systemBootTime":"Sep 17, 2025, 10:16:05 AM","kernelVersion":"6.8.0-79-generic"}
2025-09-24 11:24:30,486 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-a0853d3f]) (logid:4ba692f3) No inactive management server node found
2025-09-24 11:24:30,487 DEBUG [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-a0853d3f]) (logid:4ba692f3) Peer scan is finished. profiler: Done. Duration: 5ms , profilerQueryActiveList: Done. Duration: 2ms, , profilerSyncClusterInfo: Done. Duration: 1ms, profilerInvalidatedNodeList: Done. Duration: 0ms, profilerRemovedList: Done. Duration: 0ms,, profilerNewList: Done. Duration: 0ms, profilerInactiveList: Done. Duration: 1ms
2025-09-24 11:24:31,139 ERROR [c.c.u.n.Link] (AgentManager-SSLHandshakeHandler-2:[]) (logid:) SSL error caught during unwrap data: Received fatal alert: certificate_unknown, for local address=/172.24.48.198:8250, remote address=/172.17.26.85:51674. The client may have invalid ca-certificates.
2025-09-24 11:24:31,283 ERROR [c.c.u.n.Link] (AgentManager-SSLHandshakeHandler-2:[]) (logid:) SSL error caught during unwrap data: Received fatal alert: certificate_unknown, for local address=/172.24.48.198:8250, remote address=/172.17.26.41:55808. The client may have invalid ca-certificates.
2025-09-24 11:24:31,989 INFO [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-b276e80b]) (logid:b10eb84f) No inactive management server node found
2025-09-24 11:24:31,989 DEBUG [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:[ctx-b276e80b]) (logid:b10eb84f) Peer scan is finished. profiler: Done. Duration: 6ms , profilerQueryActiveList: Done. Duration: 2ms, , profilerSyncClusterInfo: Done. Duration: 1ms, profilerInvalidatedNodeList: Done. Duration: 0ms, profilerRemovedList: Done. Duration: 0ms,, profilerNewList: Done. Duration: 0ms, profilerInactiveList: Done. Duration: 1ms
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14495363
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 edited a comment on the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
We don't have any logs on the management, the Vmware version is 8.0.3, so rebuilding the SSVM doesn't solve the problem, and then the ssvm health check log is sent.
root@s-5333-VM:~# bash /usr/local/cloud/systemvm/ssvm-check.sh
================================================
First DNS server is 172.24.48.195
PING 172.24.48.195 (172.24.48.195): 56 data bytes
64 bytes from 172.24.48.195: icmp_seq=0 ttl=61 time=0.621 ms
64 bytes from 172.24.48.195: icmp_seq=1 ttl=61 time=0.552 ms
--- 172.24.48.195 ping statistics ---
2 packets transmitted, 2 packets received, 0% packet loss
round-trip min/avg/max/stddev = 0.552/0.587/0.621/0.035 ms
Good: Can ping DNS server
================================================
Good: DNS resolves cloudstack.apache.org
================================================
ERROR: Storage nfs is not currently mounted
Verifying if we can at least ping the storage
Storage address(s): scst.pvcl.afracloud.local, trying to ping
Pinging storage address: scst.pvcl.afracloud.local
PING scst.pvcl.afracloud.local (172.24.48.100): 56 data bytes
64 bytes from 172.24.48.100: icmp_seq=0 ttl=61 time=0.629 ms
64 bytes from 172.24.48.100: icmp_seq=1 ttl=61 time=0.522 ms
--- scst.pvcl.afracloud.local ping statistics ---
2 packets transmitted, 2 packets received, 0% packet loss
round-trip min/avg/max/stddev = 0.522/0.576/0.629/0.054 ms
Good: Can ping nfs storage address
================================================
Management server is 172.24.48.133,172.24.48.134. Checking connectivity.
Good: Can connect to management server 172.24.48.133 port 8250
Good: Can connect to management server 172.24.48.134 port 8250
================================================
Good: Java process is running
================================================
Tests Complete. Look for ERROR or WARNING above.
root@s-5333-VM:~# ^C
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14474023
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 edited a comment on the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
@weizhouapache
The problem was solved with this command
But when I try to upload a template as a url, I get an error on management
514a63 with error: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
and also get an error on ssvm
2025-09-24T09:41:57,759 INFO [storage.template.DownloadManagerImpl] (pool-2-thread-4:[]) local: /mnt/SecStorage/054aca04-065d-3b12-84e6-504ff84130cb/template/tmpl/9/258/dnld2045255748598754523tmp_, bytes=(0 bytes) 0, error=PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target, pct=0
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14496748
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "weizhouapache (via GitHub)" <gi...@apache.org>.
GitHub user weizhouapache added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
I cannot find any clue @Hossein4185
the issue is different as #11081
I suspect it is due to network configuration (on mgmt server or esxi host which block the SSL handshake) as the error is SSL Handshake timeout (not SSL error)
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14487630
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "weizhouapache (via GitHub)" <gi...@apache.org>.
GitHub user weizhouapache added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
@Hossein4185
can you register a new SYSTEM template with URL https://download.cloudstack.org/systemvm/4.20/systemvmtemplate-4.20.2-x86_64-vmware.ova ?
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14474589
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
@weizhouapache
I executed this command but the problem was not solved.
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14475283
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "weizhouapache (via GitHub)" <gi...@apache.org>.
GitHub user weizhouapache added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
@Hossein4185
the command is used to list the certificates in keystore, you need to run the command in #11081, see below
KS_FILE=/usr/local/cloud/systemvm/conf/cloud.jks KS_PASS=$(grep keystore.passphrase /usr/local/cloud/systemvm/conf/agent.properties |cut -d "=" -f2) keytool -import -noprompt -storepass "$KS_PASS" -alias "cloudca.1" -file "/usr/local/cloud/systemvm/conf/cloud.ca.crt" -keystore "$KS_FILE"
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14496039
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "weizhouapache (via GitHub)" <gi...@apache.org>.
GitHub user weizhouapache added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
oh, sorry I thought you uploaded template from local
if you upload template with URL, it could be due to the root CA is not registered in the default `cacerts`.
you can use http instead of https.
btw: this is another issue. Can you summerize the original issue ? Is it caused by network configuration ?
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14498733
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
@DaanHoogland
@prashanthr2
I can mount it manually, but the ssvm itself doesn't do it. It doesn't seem to be due to a certificate issue?
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14496018
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 edited a comment on the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
@weizhouapache
The problem was solved with this command
But when I try to upload a template as a local upload, I get an error on management
514a63 with error: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
and also get an error on ssvm
2025-09-24T09:41:57,759 INFO [storage.template.DownloadManagerImpl] (pool-2-thread-4:[]) local: /mnt/SecStorage/054aca04-065d-3b12-84e6-504ff84130cb/template/tmpl/9/258/dnld2045255748598754523tmp_, bytes=(0 bytes) 0, error=PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target, pct=0
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14496748
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
@weizhouapache
2025-09-23T23:21:32,605 INFO [cloud.agent.AgentShell] (main:[]) Agent started
2025-09-23T23:21:32,612 INFO [cloud.agent.AgentShell] (main:[]) Implementation Version is 4.21.0.0
2025-09-23T23:21:32,613 INFO [cloud.agent.AgentShell] (main:[]) agent.properties found at /usr/local/cloud/systemvm/conf/agent.properties
2025-09-23T23:21:32,634 DEBUG [agent.properties.AgentPropertiesFileHandler] (main:[]) Property [guid] was altered. Now using the value [s-5333-VM].
2025-09-23T23:21:32,690 DEBUG [agent.properties.AgentPropertiesFileHandler] (main:[]) Property [consoleproxy.httpListenPort] has empty or null value. Using default value [443].
2025-09-23T23:21:32,691 DEBUG [agent.properties.AgentPropertiesFileHandler] (main:[]) Property [ping.retries] has empty or null value. Using default value [5].
2025-09-23T23:21:32,692 DEBUG [agent.properties.AgentPropertiesFileHandler] (main:[]) Property [host.lb.check.interval] has empty or null value. Using default value [null].
2025-09-23T23:21:32,693 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: private.network.device
2025-09-23T23:21:32,696 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: storagegateway
2025-09-23T23:21:32,696 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: eth2mask
2025-09-23T23:21:32,698 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: sslcopy
2025-09-23T23:21:32,698 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: eth0ip
2025-09-23T23:21:32,701 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: host
2025-09-23T23:21:32,704 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: nfsVersion
2025-09-23T23:21:32,705 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: template
2025-09-23T23:21:32,707 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: useHttpsToUpload
2025-09-23T23:21:32,708 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: workers
2025-09-23T23:21:32,708 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: storagenetmask
2025-09-23T23:21:32,709 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: dns2
2025-09-23T23:21:32,710 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: zone
2025-09-23T23:21:32,717 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: dns1
2025-09-23T23:21:32,717 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: keystore_password
2025-09-23T23:21:32,718 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: name
2025-09-23T23:21:32,720 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: mtu
2025-09-23T23:21:32,720 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: gateway
2025-09-23T23:21:32,721 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: eth1mask
2025-09-23T23:21:32,722 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: secondaryStorageServerAddress
2025-09-23T23:21:32,723 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: keystore.passphrase
2025-09-23T23:21:32,724 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: guid
2025-09-23T23:21:32,725 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: eth0mask
2025-09-23T23:21:32,726 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: resource
2025-09-23T23:21:32,726 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: role
2025-09-23T23:21:32,727 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: internaldns2
2025-09-23T23:21:32,728 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: internaldns1
2025-09-23T23:21:32,728 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: port
2025-09-23T23:21:32,729 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: eth3ip
2025-09-23T23:21:32,730 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: pod
2025-09-23T23:21:32,730 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: storageip
2025-09-23T23:21:32,732 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: eth3mask
2025-09-23T23:21:32,732 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: instance
2025-09-23T23:21:32,733 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: eth2ip
2025-09-23T23:21:32,734 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: localgw
2025-09-23T23:21:32,738 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: mgmtcidr
2025-09-23T23:21:32,739 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: eth1ip
2025-09-23T23:21:32,739 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: authorized_key
2025-09-23T23:21:32,740 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: public.network.device
2025-09-23T23:21:32,740 DEBUG [cloud.agent.AgentShell] (main:[]) Found property: type
2025-09-23T23:21:32,740 INFO [cloud.agent.AgentShell] (main:[]) Defaulting to using properties file for storage
2025-09-23T23:21:32,742 INFO [cloud.agent.AgentShell] (main:[]) Defaulting to the constant time backoff algorithm
2025-09-23T23:21:32,787 INFO [cloud.utils.LogUtils] (main:[]) log4j configuration found at /usr/local/cloud/systemvm/conf/log4j-cloud.xml
2025-09-23T23:21:32,792 INFO [cloud.agent.AgentShell] (main:[]) Using default Java settings for IPv6 preference for agent connection
2025-09-23T23:21:32,793 DEBUG [cloud.agent.AgentShell] (main:[]) Checking to see if agent.SecStorage.pid exists.
2025-09-23T23:21:32,796 DEBUG [cloud.utils.ProcessUtil] (main:[]) environment.properties could not be opened
2025-09-23T23:21:32,806 DEBUG [cloud.utils.ProcessUtil] (main:[]) Executing command [bash -c echo $PPID ].
2025-09-23T23:21:32,836 DEBUG [cloud.utils.ProcessUtil] (main:[]) Successfully executed process [7697] for command [bash -c echo $PPID ].
2025-09-23T23:21:32,848 DEBUG [agent.properties.AgentPropertiesFileHandler] (main:[]) Property [resource] was altered. Now using the value [com.cloud.storage.resource.PremiumSecondaryStorageResource].
2025-09-23T23:21:32,900 INFO [cloud.agent.Agent] (main:[]) Initialising agent [id: , uuid: null, name: null]
2025-09-23T23:21:32,901 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) conf secondary.storage.vm is true, act as if executing in SSVM
2025-09-23T23:21:32,909 DEBUG [utils.net.NetUtils] (main:[]) Retrieving network interface [eth1].
2025-09-23T23:21:32,909 DEBUG [utils.net.NetUtils] (main:[]) Retrieving network interface [eth2].
2025-09-23T23:21:32,910 DEBUG [utils.net.NetUtils] (main:[]) Retrieving network interface [null].
2025-09-23T23:21:32,911 DEBUG [utils.net.NetUtils] (main:[]) Retrieving network interface [null].
2025-09-23T23:21:32,912 DEBUG [utils.net.NetUtils] (main:[]) Retrieving network params of NIC [name:eth1 (eth1)].
2025-09-23T23:21:32,917 DEBUG [utils.net.NetUtils] (main:[]) Retrieving params of address [/172.17.26.82/24 [/172.17.26.255]] of NIC [name:eth1 (eth1)].
2025-09-23T23:21:32,924 DEBUG [utils.script.Script] (main:[]) Looking for config_ssl.sh in the classpath
2025-09-23T23:21:32,925 DEBUG [utils.script.Script] (main:[]) System resource: file:/usr/local/cloud/systemvm/config_ssl.sh
2025-09-23T23:21:32,926 DEBUG [utils.script.Script] (main:[]) Absolute path = /usr/local/cloud/systemvm/config_ssl.sh
2025-09-23T23:21:32,928 INFO [storage.resource.NfsSecondaryStorageResource] (main:[]) config_ssl.sh found in /usr/local/cloud/systemvm/config_ssl.sh
2025-09-23T23:21:32,928 DEBUG [utils.script.Script] (main:[]) Looking for config_auth.sh in the classpath
2025-09-23T23:21:32,929 DEBUG [utils.script.Script] (main:[]) System resource: file:/usr/local/cloud/systemvm/config_auth.sh
2025-09-23T23:21:32,929 DEBUG [utils.script.Script] (main:[]) Absolute path = /usr/local/cloud/systemvm/config_auth.sh
2025-09-23T23:21:32,929 INFO [storage.resource.NfsSecondaryStorageResource] (main:[]) config_auth.sh found in /usr/local/cloud/systemvm/config_auth.sh
2025-09-23T23:21:32,930 DEBUG [utils.script.Script] (main:[]) Looking for ipfirewall.sh in the classpath
2025-09-23T23:21:32,932 DEBUG [utils.script.Script] (main:[]) System resource: file:/usr/local/cloud/systemvm/ipfirewall.sh
2025-09-23T23:21:32,932 DEBUG [utils.script.Script] (main:[]) Absolute path = /usr/local/cloud/systemvm/ipfirewall.sh
2025-09-23T23:21:32,933 INFO [storage.resource.NfsSecondaryStorageResource] (main:[]) _configIpFirewallScr found in /usr/local/cloud/systemvm/ipfirewall.sh
2025-09-23T23:21:32,936 DEBUG [utils.script.Script] (main:[]) Looking for create_privatetemplate_from_snapshot_xen.sh in the classpath
2025-09-23T23:21:32,936 DEBUG [utils.script.Script] (main:[]) System resource: null
2025-09-23T23:21:32,937 DEBUG [utils.script.Script] (main:[]) Classpath resource: file:/usr/local/cloud/systemvm/scripts/storage/secondary/create_privatetemplate_from_snapshot_xen.sh
2025-09-23T23:21:32,938 DEBUG [utils.script.Script] (main:[]) Absolute path = /usr/local/cloud/systemvm/scripts/storage/secondary/create_privatetemplate_from_snapshot_xen.sh
2025-09-23T23:21:32,939 INFO [storage.resource.NfsSecondaryStorageResource] (main:[]) Secondary storage runs in role templateProcessor
2025-09-23T23:21:32,951 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) addRouteToInternalIp: localgw=172.17.26.1, eth1ip=172.17.26.82, eth1mask=255.255.255.0,destIp=172.24.48.133
2025-09-23T23:21:32,957 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Executing command [/bin/bash -c ip route delete 172.24.48.133 ].
2025-09-23T23:21:32,982 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Successfully executed process [7700] for command [/bin/bash -c ip route delete 172.24.48.133 ].
2025-09-23T23:21:32,983 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Executing command [/bin/bash -c ip route add 172.24.48.133 via 172.17.26.1 ].
2025-09-23T23:21:32,988 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Successfully executed process [7702] for command [/bin/bash -c ip route add 172.24.48.133 via 172.17.26.1 ].
2025-09-23T23:21:32,989 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) addRouteToInternalIp: added route to internal ip=172.24.48.133 via 172.17.26.1
2025-09-23T23:21:32,989 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) addRouteToInternalIp: localgw=172.17.26.1, eth1ip=172.17.26.82, eth1mask=255.255.255.0,destIp=172.24.48.134
2025-09-23T23:21:32,990 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Executing command [/bin/bash -c ip route delete 172.24.48.134 ].
2025-09-23T23:21:32,993 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Successfully executed process [7704] for command [/bin/bash -c ip route delete 172.24.48.134 ].
2025-09-23T23:21:32,994 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Executing command [/bin/bash -c ip route add 172.24.48.134 via 172.17.26.1 ].
2025-09-23T23:21:32,998 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Successfully executed process [7706] for command [/bin/bash -c ip route add 172.24.48.134 via 172.17.26.1 ].
2025-09-23T23:21:33,000 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) addRouteToInternalIp: added route to internal ip=172.24.48.134 via 172.17.26.1
2025-09-23T23:21:33,000 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) addRouteToInternalIp: localgw=172.17.26.1, eth1ip=172.17.26.82, eth1mask=255.255.255.0,destIp=172.24.48.195
2025-09-23T23:21:33,001 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Executing command [/bin/bash -c ip route delete 172.24.48.195 ].
2025-09-23T23:21:33,009 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Successfully executed process [7708] for command [/bin/bash -c ip route delete 172.24.48.195 ].
2025-09-23T23:21:33,010 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Executing command [/bin/bash -c ip route add 172.24.48.195 via 172.17.26.1 ].
2025-09-23T23:21:33,015 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Successfully executed process [7710] for command [/bin/bash -c ip route add 172.24.48.195 via 172.17.26.1 ].
2025-09-23T23:21:33,016 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) addRouteToInternalIp: added route to internal ip=172.24.48.195 via 172.17.26.1
2025-09-23T23:21:33,017 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) addRouteToInternalIp: localgw=172.17.26.1, eth1ip=172.17.26.82, eth1mask=255.255.255.0,destIp=172.24.48.196
2025-09-23T23:21:33,018 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Executing command [/bin/bash -c ip route delete 172.24.48.196 ].
2025-09-23T23:21:33,025 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Successfully executed process [7712] for command [/bin/bash -c ip route delete 172.24.48.196 ].
2025-09-23T23:21:33,026 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Executing command [/bin/bash -c ip route add 172.24.48.196 via 172.17.26.1 ].
2025-09-23T23:21:33,031 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Successfully executed process [7714] for command [/bin/bash -c ip route add 172.24.48.196 via 172.17.26.1 ].
2025-09-23T23:21:33,032 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) addRouteToInternalIp: added route to internal ip=172.24.48.196 via 172.17.26.1
2025-09-23T23:21:33,033 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Executing command [/bin/systemctl restart ssh ].
2025-09-23T23:21:33,134 DEBUG [storage.resource.NfsSecondaryStorageResource] (main:[]) Successfully executed process [7716] for command [/bin/systemctl restart ssh ].
2025-09-23T23:21:33,135 INFO [storage.resource.IpTablesHelper] (main:[]) Adding rule [-i eth1 -p tcp -m state --state NEW -m tcp --dport 3922 -j ACCEPT] to [INPUT] if required.
2025-09-23T23:21:33,139 DEBUG [storage.resource.IpTablesHelper] (main:[]) Executing command [/bin/bash -c iptables -C INPUT -i eth1 -p tcp -m state --state NEW -m tcp --dport 3922 -j ACCEPT ].
2025-09-23T23:21:33,155 DEBUG [storage.resource.IpTablesHelper] (main:[]) Successfully executed process [7720] for command [/bin/bash -c iptables -C INPUT -i eth1 -p tcp -m state --state NEW -m tcp --dport 3922 -j ACCEPT ].
2025-09-23T23:21:33,155 DEBUG [storage.resource.IpTablesHelper] (main:[]) Rule [-i eth1 -p tcp -m state --state NEW -m tcp --dport 3922 -j ACCEPT], doesn't need adding to [INPUT] : null
2025-09-23T23:21:33,156 WARN [storage.resource.IpTablesHelper] (main:[]) Rule already defined in SVM: -i eth1 -p tcp -m state --state NEW -m tcp --dport 3922 -j ACCEPT
2025-09-23T23:21:33,160 INFO [storage.template.DownloadManagerImpl] (main:[]) DownloadManager: starting additional services since we are inside system vm
2025-09-23T23:21:33,160 DEBUG [storage.template.DownloadManagerImpl] (main:[]) Executing command [/bin/systemctl stop apache2 ].
2025-09-23T23:21:33,288 DEBUG [storage.template.DownloadManagerImpl] (main:[]) Successfully executed process [7721] for command [/bin/systemctl stop apache2 ].
2025-09-23T23:21:33,290 INFO [storage.resource.IpTablesHelper] (main:[]) Adding rule [-i eth2 -p tcp -m state --state NEW -m tcp --dport 80 -j ACCEPT] to [INPUT] if required.
2025-09-23T23:21:33,290 DEBUG [storage.resource.IpTablesHelper] (main:[]) Executing command [/bin/bash -c iptables -C INPUT -i eth2 -p tcp -m state --state NEW -m tcp --dport 80 -j ACCEPT ].
2025-09-23T23:21:33,296 DEBUG [storage.resource.IpTablesHelper] (main:[]) Successfully executed process [7727] for command [/bin/bash -c iptables -C INPUT -i eth2 -p tcp -m state --state NEW -m tcp --dport 80 -j ACCEPT ].
2025-09-23T23:21:33,296 DEBUG [storage.resource.IpTablesHelper] (main:[]) Rule [-i eth2 -p tcp -m state --state NEW -m tcp --dport 80 -j ACCEPT], doesn't need adding to [INPUT] : null
2025-09-23T23:21:33,297 WARN [storage.resource.IpTablesHelper] (main:[]) Rule already defined in SVM: -i eth2 -p tcp -m state --state NEW -m tcp --dport 80 -j ACCEPT
2025-09-23T23:21:33,297 INFO [storage.resource.IpTablesHelper] (main:[]) Adding rule [-i eth2 -p tcp -m state --state NEW -m tcp --dport 443 -j ACCEPT;] to [INPUT] if required.
2025-09-23T23:21:33,300 DEBUG [storage.resource.IpTablesHelper] (main:[]) Executing command [/bin/bash -c iptables -C INPUT -i eth2 -p tcp -m state --state NEW -m tcp --dport 443 -j ACCEPT; ].
2025-09-23T23:21:33,309 DEBUG [storage.resource.IpTablesHelper] (main:[]) Successfully executed process [7728] for command [/bin/bash -c iptables -C INPUT -i eth2 -p tcp -m state --state NEW -m tcp --dport 443 -j ACCEPT; ].
2025-09-23T23:21:33,309 DEBUG [storage.resource.IpTablesHelper] (main:[]) Rule [-i eth2 -p tcp -m state --state NEW -m tcp --dport 443 -j ACCEPT;], doesn't need adding to [INPUT] : null
2025-09-23T23:21:33,310 WARN [storage.resource.IpTablesHelper] (main:[]) Rule already defined in SVM: -i eth2 -p tcp -m state --state NEW -m tcp --dport 443 -j ACCEPT;
2025-09-23T23:21:33,311 DEBUG [storage.template.DownloadManagerImpl] (main:[]) Executing command [/bin/systemctl start apache2 ].
2025-09-23T23:21:33,352 DEBUG [storage.template.DownloadManagerImpl] (main:[]) Successfully executed process [7729] for command [/bin/systemctl start apache2 ].
2025-09-23T23:21:33,352 DEBUG [storage.template.DownloadManagerImpl] (main:[]) Executing command [/bin/su -s /bin/bash -c mkdir -p /var/www/html/copy/template www-data ].
2025-09-23T23:21:33,565 DEBUG [storage.template.DownloadManagerImpl] (main:[]) Successfully executed process [7735] for command [/bin/su -s /bin/bash -c mkdir -p /var/www/html/copy/template www-data ].
2025-09-23T23:21:33,566 INFO [storage.resource.IpTablesHelper] (main:[]) Adding rule [-o eth1 -p tcp -m state --state NEW -m tcp --dport 80 -j REJECT;] to [OUTPUT] if required.
2025-09-23T23:21:33,566 DEBUG [storage.resource.IpTablesHelper] (main:[]) Executing command [/bin/bash -c iptables -C OUTPUT -o eth1 -p tcp -m state --state NEW -m tcp --dport 80 -j REJECT; ].
2025-09-23T23:21:33,573 DEBUG [storage.resource.IpTablesHelper] (main:[]) Successfully executed process [7810] for command [/bin/bash -c iptables -C OUTPUT -o eth1 -p tcp -m state --state NEW -m tcp --dport 80 -j REJECT; ].
2025-09-23T23:21:33,574 DEBUG [storage.resource.IpTablesHelper] (main:[]) Rule [-o eth1 -p tcp -m state --state NEW -m tcp --dport 80 -j REJECT;], doesn't need adding to [OUTPUT] : null
2025-09-23T23:21:33,575 WARN [storage.resource.IpTablesHelper] (main:[]) Rule already defined in SVM: -o eth1 -p tcp -m state --state NEW -m tcp --dport 80 -j REJECT;
2025-09-23T23:21:33,575 INFO [storage.resource.IpTablesHelper] (main:[]) Adding rule [-o eth1 -p tcp -m state --state NEW -m tcp --dport 443 -j REJECT;] to [OUTPUT] if required.
2025-09-23T23:21:33,575 DEBUG [storage.resource.IpTablesHelper] (main:[]) Executing command [/bin/bash -c iptables -C OUTPUT -o eth1 -p tcp -m state --state NEW -m tcp --dport 443 -j REJECT; ].
2025-09-23T23:21:33,579 DEBUG [storage.resource.IpTablesHelper] (main:[]) Successfully executed process [7811] for command [/bin/bash -c iptables -C OUTPUT -o eth1 -p tcp -m state --state NEW -m tcp --dport 443 -j REJECT; ].
2025-09-23T23:21:33,579 DEBUG [storage.resource.IpTablesHelper] (main:[]) Rule [-o eth1 -p tcp -m state --state NEW -m tcp --dport 443 -j REJECT;], doesn't need adding to [OUTPUT] : null
2025-09-23T23:21:33,581 WARN [storage.resource.IpTablesHelper] (main:[]) Rule already defined in SVM: -o eth1 -p tcp -m state --state NEW -m tcp --dport 443 -j REJECT;
2025-09-23T23:21:33,581 DEBUG [utils.script.Script] (main:[]) Looking for listvmtmplt.sh in the classpath
2025-09-23T23:21:33,582 DEBUG [utils.script.Script] (main:[]) System resource: null
2025-09-23T23:21:33,582 DEBUG [utils.script.Script] (main:[]) Classpath resource: file:/usr/local/cloud/systemvm/scripts/storage/secondary/listvmtmplt.sh
2025-09-23T23:21:33,583 DEBUG [utils.script.Script] (main:[]) Absolute path = /usr/local/cloud/systemvm/scripts/storage/secondary/listvmtmplt.sh
2025-09-23T23:21:33,584 INFO [storage.template.DownloadManagerImpl] (main:[]) listvmtmplt.sh found in /usr/local/cloud/systemvm/scripts/storage/secondary/listvmtmplt.sh
2025-09-23T23:21:33,585 DEBUG [utils.script.Script] (main:[]) Looking for createtmplt.sh in the classpath
2025-09-23T23:21:33,588 DEBUG [utils.script.Script] (main:[]) System resource: null
2025-09-23T23:21:33,589 DEBUG [utils.script.Script] (main:[]) Classpath resource: file:/usr/local/cloud/systemvm/scripts/storage/secondary/createtmplt.sh
2025-09-23T23:21:33,589 DEBUG [utils.script.Script] (main:[]) Absolute path = /usr/local/cloud/systemvm/scripts/storage/secondary/createtmplt.sh
2025-09-23T23:21:33,590 INFO [storage.template.DownloadManagerImpl] (main:[]) createtmplt.sh found in /usr/local/cloud/systemvm/scripts/storage/secondary/createtmplt.sh
2025-09-23T23:21:33,592 DEBUG [utils.script.Script] (main:[]) Looking for listvolume.sh in the classpath
2025-09-23T23:21:33,593 DEBUG [utils.script.Script] (main:[]) System resource: null
2025-09-23T23:21:33,595 DEBUG [utils.script.Script] (main:[]) Classpath resource: file:/usr/local/cloud/systemvm/scripts/storage/secondary/listvolume.sh
2025-09-23T23:21:33,596 DEBUG [utils.script.Script] (main:[]) Absolute path = /usr/local/cloud/systemvm/scripts/storage/secondary/listvolume.sh
2025-09-23T23:21:33,596 INFO [storage.template.DownloadManagerImpl] (main:[]) listvolume.sh found in /usr/local/cloud/systemvm/scripts/storage/secondary/listvolume.sh
2025-09-23T23:21:33,599 DEBUG [utils.script.Script] (main:[]) Looking for createvolume.sh in the classpath
2025-09-23T23:21:33,600 DEBUG [utils.script.Script] (main:[]) System resource: null
2025-09-23T23:21:33,601 DEBUG [utils.script.Script] (main:[]) Classpath resource: file:/usr/local/cloud/systemvm/scripts/storage/secondary/createvolume.sh
2025-09-23T23:21:33,601 DEBUG [utils.script.Script] (main:[]) Absolute path = /usr/local/cloud/systemvm/scripts/storage/secondary/createvolume.sh
2025-09-23T23:21:33,601 INFO [storage.template.DownloadManagerImpl] (main:[]) createvolume.sh found in /usr/local/cloud/systemvm/scripts/storage/secondary/createvolume.sh
2025-09-23T23:21:33,615 INFO [storage.template.UploadManagerImpl] (main:[]) UploadManager: starting additional services since we are inside system vm
2025-09-23T23:21:33,622 DEBUG [storage.template.UploadManagerImpl] (main:[]) Executing command [rm -rf /mnt/SecStorage/extractmnt ].
2025-09-23T23:21:33,628 DEBUG [storage.template.UploadManagerImpl] (main:[]) Successfully executed process [7812] for command [rm -rf /mnt/SecStorage/extractmnt ].
2025-09-23T23:21:33,628 DEBUG [storage.template.UploadManagerImpl] (main:[]) Executing command [touch /mnt/SecStorage/extractmnt ].
2025-09-23T23:21:33,636 DEBUG [storage.template.UploadManagerImpl] (main:[]) Successfully executed process [7813] for command [touch /mnt/SecStorage/extractmnt ].
2025-09-23T23:21:33,637 DEBUG [storage.template.UploadManagerImpl] (main:[]) Executing command [/bin/bash -c ln -sf null /mnt/SecStorage/extractmnt ].
2025-09-23T23:21:33,642 DEBUG [storage.template.UploadManagerImpl] (main:[]) Successfully executed process [7814] for command [/bin/bash -c ln -sf null /mnt/SecStorage/extractmnt ].
2025-09-23T23:21:33,670 INFO [cloud.serializer.GsonHelper] (main:[]) Default Builder inited.
2025-09-23T23:21:33,701 DEBUG [agent.properties.AgentPropertiesFileHandler] (main:[]) Property [ssl.handshake.timeout] has empty or null value. Using default value [30].
2025-09-23T23:21:33,703 INFO [cloud.agent.Agent] (main:[]) Agent [id = new, uuid = null, name = null, type = PremiumSecondaryStorageResource, zone = 3, pod = 3, workers = 5, port = 8250] with host = 172.24.48.133, local id = 1
2025-09-23T23:21:33,704 DEBUG [utils.script.Script] (main:[]) Looking for keystore-setup in the classpath
2025-09-23T23:21:33,705 DEBUG [utils.script.Script] (main:[]) System resource: null
2025-09-23T23:21:33,707 DEBUG [utils.script.Script] (main:[]) Classpath resource: file:/usr/local/cloud/systemvm/scripts/util/keystore-setup
2025-09-23T23:21:33,708 DEBUG [utils.script.Script] (main:[]) Absolute path = /usr/local/cloud/systemvm/scripts/util/keystore-setup
2025-09-23T23:21:33,709 DEBUG [utils.script.Script] (main:[]) Looking for keystore-cert-import in the classpath
2025-09-23T23:21:33,711 DEBUG [utils.script.Script] (main:[]) System resource: null
2025-09-23T23:21:33,711 DEBUG [utils.script.Script] (main:[]) Classpath resource: file:/usr/local/cloud/systemvm/scripts/util/keystore-cert-import
2025-09-23T23:21:33,712 DEBUG [utils.script.Script] (main:[]) Absolute path = /usr/local/cloud/systemvm/scripts/util/keystore-cert-import
2025-09-23T23:21:33,713 INFO [utils.nio.NioClient] (main:[]) Connecting to 172.24.48.133:8250
2025-09-23T23:21:33,730 INFO [utils.nio.NioClient] (main:[]) Connected to 172.24.48.133:8250
2025-09-23T23:21:33,734 INFO [utils.nio.Link] (main:[]) Conf file found: /usr/local/cloud/systemvm/conf/agent.properties
2025-09-23T23:22:04,338 WARN [utils.nio.Link] (main:[]) SSL Handshake has taken more than 30000 ms to connect to: /172.24.48.133:8250 while status: NEED_UNWRAP. Please investigate this connection.
2025-09-23T23:22:04,341 ERROR [utils.nio.NioClient] (main:[]) IOException while connecting to 172.24.48.133:8250 java.io.IOException: SSL Handshake failed while connecting to host: 172.24.48.133:8250
at com.cloud.utils.nio.NioClient.init(NioClient.java:75)
at com.cloud.utils.nio.NioConnection.start(NioConnection.java:109)
at com.cloud.agent.Agent.start(Agent.java:327)
at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:477)
at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:454)
at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:438)
at com.cloud.agent.AgentShell.start(AgentShell.java:539)
at com.cloud.agent.AgentShell.main(AgentShell.java:569)
2025-09-23T23:22:04,342 ERROR [utils.nio.NioClient] (main:[]) Unable to initialize the threads. java.io.IOException: SSL Handshake failed while connecting to host: 172.24.48.133:8250
at com.cloud.utils.nio.NioClient.init(NioClient.java:75)
at com.cloud.utils.nio.NioConnection.start(NioConnection.java:109)
at com.cloud.agent.Agent.start(Agent.java:327)
at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:477)
at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:454)
at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:438)
at com.cloud.agent.AgentShell.start(AgentShell.java:539)
at com.cloud.agent.AgentShell.main(AgentShell.java:569)
2025-09-23T23:22:04,344 WARN [cloud.agent.Agent] (main:[]) Attempt to connect to server generated NIO Connection Exception SSL Handshake failed while connecting to host: 172.24.48.133:8250, trying again
2025-09-23T23:22:09,346 DEBUG [agent.properties.AgentPropertiesFileHandler] (main:[]) Property [ssl.handshake.timeout] has empty or null value. Using default value [30].
2025-09-23T23:22:09,348 INFO [cloud.agent.Agent] (main:[]) Connecting to host: 172.24.48.134
2025-09-23T23:22:09,351 INFO [utils.nio.NioClient] (main:[]) Connecting to 172.24.48.134:8250
2025-09-23T23:22:09,353 INFO [utils.nio.NioClient] (main:[]) Connected to 172.24.48.134:8250
2025-09-23T23:22:09,355 INFO [utils.nio.Link] (main:[]) Conf file found: /usr/local/cloud/systemvm/conf/agent.properties
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14485163
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "weizhouapache (via GitHub)" <gi...@apache.org>.
GitHub user weizhouapache added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
@Hossein4185
can you upload the full cloud.log in ssvm and some error logs on management server ?
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14477456
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
[Downloads.zip](https://github.com/user-attachments/files/22487404/Downloads.zip)
The management log and SSVM Log were uploaded.
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14483056
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "weizhouapache (via GitHub)" <gi...@apache.org>.
GitHub user weizhouapache added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
> I tested this solution but it didn't solve the problem. #11081
#11081 only applies on vmware 8, not ubuntu 24.04
any error log on management server ?
can you destroy ssvm and check the new ssvm ?
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14472920
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
@weizhouapache
I execute this command and restarted the Cloud service on ssvm, but the problem was not solved.
keytool -list -keystore /usr/local/cloud/systemvm/conf/cloud.jks -storepass $(grep keystore.passphrase /usr/local/cloud/systemvm/conf/agent.properties |cut -d "=" -f2)
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14495972
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 edited a comment on the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
@weizhouapache
[Downloads.zip](https://github.com/user-attachments/files/22487404/Downloads.zip)
The management log and SSVM Log were uploaded.
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14483056
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
@DaanHoogland
Should I do this with a script? Or mount it in a specific path?
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14487333
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "prashanthr2 (via GitHub)" <gi...@apache.org>.
GitHub user prashanthr2 added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
@Hossein4185 you can try to mount your Secondary Storage NFS on any directory in the SSVM (create a new test directory if you are not sure) and see if it works. Based on the error seen it looks like SSVM cannot mount your secondary storage.
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14487665
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
@weizhouapache
I have already registered with this template.
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14474818
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
Yes, of course.
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14475161
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
Yes, of course.
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14475341
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "DaanHoogland (via GitHub)" <gi...@apache.org>.
GitHub user DaanHoogland added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
> ERROR: Storage nfs is not currently mounted
> Verifying if we can at least ping the storage
> Storage address(s): scst.pvcl.afracloud.local, trying to ping
> Pinging storage address: scst.pvcl.afracloud.local
> PING scst.pvcl.afracloud.local (172.24.48.100): 56 data bytes
> 64 bytes from 172.24.48.100: icmp_seq=0 ttl=61 time=0.629 ms
> 64 bytes from 172.24.48.100: icmp_seq=1 ttl=61 time=0.522 ms
> --- scst.pvcl.afracloud.local ping statistics ---
> 2 packets transmitted, 2 packets received, 0% packet loss
> round-trip min/avg/max/stddev = 0.522/0.576/0.629/0.054 ms
> Good: Can ping nfs storage address
@Hossein4185 , this piece sugests a problem with your storage nfs server configuration. You can try to mount it manually to troubleshoot.
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14474532
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "weizhouapache (via GitHub)" <gi...@apache.org>.
GitHub user weizhouapache added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
> @weizhouapache I executed this command but the problem was not solved.
have you restarted `cloud` service ?
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14475296
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
@weizhouapache
@weizhouapache
I changed the management IP in global setting and the error changed. Please check.
Wed Sep 24 08:10:52 PM UTC 2025 Starting guest services for vmware
Wed Sep 24 08:10:59 PM UTC 2025 Applying iptables rules
Wed Sep 24 08:10:59 PM UTC 2025 Setting up interface: eth0
Wed Sep 24 08:10:59 PM UTC 2025 Setting up interface: eth1
Wed Sep 24 08:10:59 PM UTC 2025 Setting up interface: eth2
Wed Sep 24 08:10:59 PM UTC 2025 Received mgmt cidr : 172.24.48.128/26
Wed Sep 24 08:10:59 PM UTC 2025 Configuring sshd
Wed Sep 24 08:11:00 PM UTC 2025 Executing cloud-early-config
Wed Sep 24 08:11:00 PM UTC 2025 Scripts checksum detected: oldmd5=b0bf21ef8e4aa6df495c71f7d96b6aeb newmd5=b0bf21ef8e4aa6df495c71f7d96b6aeb
Wed Sep 24 08:11:02 PM UTC 2025 Could not find patch file, retrying
Wed Sep 24 08:11:04 PM UTC 2025 Could not find patch file, retrying
Wed Sep 24 08:11:06 PM UTC 2025 Could not find patch file, retrying
Wed Sep 24 08:11:08 PM UTC 2025 Could not find patch file, retrying
Wed Sep 24 08:11:10 PM UTC 2025 Could not find patch file, retrying
Wed Sep 24 08:11:10 PM UTC 2025 Scripts checksum detected: oldmd5=b0bf21ef8e4aa6df495c71f7d96b6aeb newmd5=125120ec9fbf442a2cdb23c17d2f56b5
Wed Sep 24 08:11:10 PM UTC 2025 Patched scripts using /var/cache/cloud/cloud-scripts.tgz
Wed Sep 24 08:11:10 PM UTC 2025 Bootstrapping systemvm appliance
Wed Sep 24 08:11:10 PM UTC 2025 Unziping /var/cache/cloud//agent.zip
Wed Sep 24 08:11:11 PM UTC 2025 As system VM type is secstorage, we will remove the default properties 'instance' and 'resource' from usr/local/cloud/systemvm/conf/agent.properties
Wed Sep 24 08:11:11 PM UTC 2025 Copying content of /var/cache/cloud/cmdline to usr/local/cloud/systemvm/conf/agent.properties
Wed Sep 24 08:11:12 PM UTC 2025 Configuring systemvm type=secstorage
Wed Sep 24 08:11:13 PM UTC 2025 Setting up secondary storage system vm
Wed Sep 24 08:11:13 PM UTC 2025 Setting up interface: eth3
Wed Sep 24 08:11:13 PM UTC 2025 Successfully setup storage network with STORAGE_IP:172.24.14.62, STORAGE_NETMASK:255.255.255.240, STORAGE_CIDR:
Wed Sep 24 08:11:13 PM UTC 2025 Setting up route of RFC1918 space to 172.17.26.1
Wed Sep 24 08:11:13 PM UTC 2025 Setting up entry in hosts
Wed Sep 24 08:11:13 PM UTC 2025 Applying iptables rules
Wed Sep 24 08:11:13 PM UTC 2025 Configuring apache2
Wed Sep 24 08:11:13 PM UTC 2025 Setting up apache web server
Wed Sep 24 08:11:13 PM UTC 2025 Setting up apache2 for post upload of volume/template
Wed Sep 24 08:11:13 PM UTC 2025 cloud: disable rp_filter
Wed Sep 24 08:11:13 PM UTC 2025 disable rpfilter
Wed Sep 24 08:11:13 PM UTC 2025 cloud: enable_fwding = 0
Wed Sep 24 08:11:13 PM UTC 2025 enable_fwding = 0
Wed Sep 24 08:11:13 PM UTC 2025 Processors = 1 Enable service = 0
Wed Sep 24 08:11:13 PM UTC 2025 Setting up NTP
Wed Sep 24 08:11:13 PM UTC 2025 Adding PubkeyAcceptedAlgorithms=+ssh-rsa to sshd_config
Wed Sep 24 08:11:13 PM UTC 2025 Skipped the installation of package python-is-python3 on Debian 12 as it can only be installed on Debian 11.
Wed Sep 24 08:11:13 PM UTC 2025 Skipped the installation of package python3-netaddr on Debian 12 as it can only be installed on Debian 11.
Wed Sep 24 08:11:13 PM UTC 2025 Finished setting up systemvm
Wed Sep 24 08:11:13 PM UTC 2025 Finished setting up systemvm
2025-09-24T20:11:20,664 INFO [cloud.agent.AgentShell] (main:[]) Agent started
2025-09-24T20:11:20,675 INFO [cloud.agent.AgentShell] (main:[]) Implementation Version is 4.21.0.0
2025-09-24T20:11:20,676 INFO [cloud.agent.AgentShell] (main:[]) agent.properties found at /usr/local/cloud/systemvm/conf/agent.properties
2025-09-24T20:11:20,741 INFO [cloud.agent.AgentShell] (main:[]) Defaulting to using properties file for storage
2025-09-24T20:11:20,742 INFO [cloud.agent.AgentShell] (main:[]) Defaulting to the constant time backoff algorithm
2025-09-24T20:11:20,785 INFO [cloud.utils.LogUtils] (main:[]) log4j configuration found at /usr/local/cloud/systemvm/conf/log4j-cloud.xml
2025-09-24T20:11:20,786 INFO [cloud.agent.AgentShell] (main:[]) Using default Java settings for IPv6 preference for agent connection
2025-09-24T20:11:20,893 INFO [cloud.agent.Agent] (main:[]) Initialising agent [id: , uuid: null, name: null]
2025-09-24T20:11:20,908 INFO [storage.resource.NfsSecondaryStorageResource] (main:[]) config_ssl.sh found in /usr/local/cloud/systemvm/config_ssl.sh
2025-09-24T20:11:20,908 INFO [storage.resource.NfsSecondaryStorageResource] (main:[]) config_auth.sh found in /usr/local/cloud/systemvm/config_auth.sh
2025-09-24T20:11:20,909 INFO [storage.resource.NfsSecondaryStorageResource] (main:[]) _configIpFirewallScr found in /usr/local/cloud/systemvm/ipfirewall.sh
2025-09-24T20:11:20,915 INFO [storage.resource.NfsSecondaryStorageResource] (main:[]) Secondary storage runs in role templateProcessor
2025-09-24T20:11:20,938 WARN [storage.resource.NfsSecondaryStorageResource] (main:[]) Execution of process [3817] for command [/bin/bash -c ip route delete 172.24.48.197 ] failed.
2025-09-24T20:11:20,938 WARN [storage.resource.NfsSecondaryStorageResource] (main:[]) Process [3817] for command [/bin/bash -c ip route delete 172.24.48.197 ] encountered the error: [RTNETLINK answers: No such process].
2025-09-24T20:11:20,954 WARN [storage.resource.NfsSecondaryStorageResource] (main:[]) Execution of process [3821] for command [/bin/bash -c ip route delete 172.24.48.198 ] failed.
2025-09-24T20:11:20,955 WARN [storage.resource.NfsSecondaryStorageResource] (main:[]) Process [3821] for command [/bin/bash -c ip route delete 172.24.48.198 ] encountered the error: [RTNETLINK answers: No such process].
2025-09-24T20:11:20,969 WARN [storage.resource.NfsSecondaryStorageResource] (main:[]) Execution of process [3825] for command [/bin/bash -c ip route delete 172.24.48.195 ] failed.
2025-09-24T20:11:20,969 WARN [storage.resource.NfsSecondaryStorageResource] (main:[]) Process [3825] for command [/bin/bash -c ip route delete 172.24.48.195 ] encountered the error: [RTNETLINK answers: No such process].
2025-09-24T20:11:20,984 WARN [storage.resource.NfsSecondaryStorageResource] (main:[]) Execution of process [3829] for command [/bin/bash -c ip route delete 172.24.48.196 ] failed.
2025-09-24T20:11:20,984 WARN [storage.resource.NfsSecondaryStorageResource] (main:[]) Process [3829] for command [/bin/bash -c ip route delete 172.24.48.196 ] encountered the error: [RTNETLINK answers: No such process].
2025-09-24T20:11:21,045 INFO [storage.resource.IpTablesHelper] (main:[]) Adding rule [-i eth1 -p tcp -m state --state NEW -m tcp --dport 3922 -j ACCEPT] to [INPUT] if required.
2025-09-24T20:11:21,053 WARN [storage.resource.IpTablesHelper] (main:[]) Execution of process [3837] for command [/bin/bash -c iptables -C INPUT -i eth1 -p tcp -m state --state NEW -m tcp --dport 3922 -j ACCEPT ] failed.
2025-09-24T20:11:21,314 WARN [storage.resource.IpTablesHelper] (main:[]) Process [3934] for command [/bin/bash -c iptables -C OUTPUT -o eth1 -p tcp -m state --state NEW -m tcp --dport 443 -j REJECT; ] encountered the error: [iptables: Bad rule (does a matching rule exist in that chain?).].
2025-09-24T20:11:21,318 INFO [storage.template.DownloadManagerImpl] (main:[]) listvmtmplt.sh found in /usr/local/cloud/systemvm/scripts/storage/secondary/listvmtmplt.sh
2025-09-24T20:11:21,323 INFO [storage.template.DownloadManagerImpl] (main:[]) createtmplt.sh found in /usr/local/cloud/systemvm/scripts/storage/secondary/createtmplt.sh
2025-09-24T20:11:21,324 INFO [storage.template.DownloadManagerImpl] (main:[]) listvolume.sh found in /usr/local/cloud/systemvm/scripts/storage/secondary/listvolume.sh
2025-09-24T20:11:21,327 INFO [storage.template.DownloadManagerImpl] (main:[]) createvolume.sh found in /usr/local/cloud/systemvm/scripts/storage/secondary/createvolume.sh
2025-09-24T20:11:21,338 INFO [storage.template.UploadManagerImpl] (main:[]) UploadManager: starting additional services since we are inside system vm
2025-09-24T20:11:21,378 INFO [cloud.serializer.GsonHelper] (main:[]) Default Builder inited.
2025-09-24T20:11:21,397 INFO [cloud.agent.Agent] (main:[]) Agent [id = new, uuid = null, name = null, type = PremiumSecondaryStorageResource, zone = 3, pod = 3, workers = 5, port = 8250] with host = 172.24.48.197, local id = 1
2025-09-24T20:11:21,401 INFO [utils.nio.NioClient] (main:[]) Connecting to 172.24.48.197:8250
2025-09-24T20:11:21,418 INFO [utils.nio.NioClient] (main:[]) Connected to 172.24.48.197:8250
2025-09-24T20:11:21,421 INFO [utils.nio.Link] (main:[]) Conf file found: /usr/local/cloud/systemvm/conf/agent.properties
2025-09-24T20:11:22,062 ERROR [utils.nio.Link] (main:[]) SSL error caught during wrap data: No trusted certificate found, for local address=/172.17.26.85:34672, remote address=/172.24.48.197:8250.
2025-09-24T20:11:22,063 INFO [utils.nio.NioClient] (main:[]) SSL: Handshake done
2025-09-24T20:11:22,144 WARN [cloud.agent.Agent] (Agent-Handler-1:[]) Unable to send request to /172.24.48.197:8250 due to 'null', request: null
2025-09-24T20:11:27,094 INFO [cloud.agent.Agent] (Agent-Handler-2:[]) Lost connection to host: 172.24.48.197. Attempting reconnection while we still have 0 commands in progress.
2025-09-24T20:11:27,098 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) NioClient connection closed
2025-09-24T20:11:32,100 INFO [cloud.agent.Agent] (Agent-Handler-2:[]) Reconnecting to host: 172.24.48.198
2025-09-24T20:11:32,109 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) Connecting to 172.24.48.198:8250
2025-09-24T20:11:32,111 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) Connected to 172.24.48.198:8250
2025-09-24T20:11:32,113 INFO [utils.nio.Link] (Agent-Handler-2:[]) Conf file found: /usr/local/cloud/systemvm/conf/agent.properties
2025-09-24T20:11:32,227 ERROR [utils.nio.Link] (Agent-Handler-2:[]) SSL error caught during wrap data: No trusted certificate found, for local address=/172.17.26.85:60296, remote address=/172.24.48.198:8250.
2025-09-24T20:11:32,228 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) SSL: Handshake done
2025-09-24T20:11:32,241 WARN [cloud.agent.Agent] (Agent-Handler-1:[]) Unable to send request to /172.24.48.198:8250 due to 'null', request: null
2025-09-24T20:11:37,231 INFO [cloud.agent.Agent] (Agent-Handler-2:[]) Connected to the host: 172.24.48.198
2025-09-24T20:11:37,238 INFO [cloud.agent.Agent] (Agent-Handler-2:[]) Lost connection to host: 172.24.48.198. Attempting reconnection while we still have 0 commands in progress.
2025-09-24T20:11:37,240 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) NioClient connection closed
2025-09-24T20:11:42,242 INFO [cloud.agent.Agent] (Agent-Handler-2:[]) Reconnecting to host: 172.24.48.198
2025-09-24T20:11:42,247 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) Connecting to 172.24.48.198:8250
2025-09-24T20:11:42,254 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) Connected to 172.24.48.198:8250
2025-09-24T20:11:42,255 INFO [utils.nio.Link] (Agent-Handler-2:[]) Conf file found: /usr/local/cloud/systemvm/conf/agent.properties
2025-09-24T20:11:42,354 ERROR [utils.nio.Link] (Agent-Handler-2:[]) SSL error caught during wrap data: No trusted certificate found, for local address=/172.17.26.85:57034, remote address=/172.24.48.198:8250.
2025-09-24T20:11:42,358 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) SSL: Handshake done
2025-09-24T20:11:42,376 WARN [cloud.agent.Agent] (Agent-Handler-1:[]) Unable to send request to /172.24.48.198:8250 due to 'null', request: null
2025-09-24T20:11:47,368 INFO [cloud.agent.Agent] (Agent-Handler-2:[]) Lost connection to host: 172.24.48.198. Attempting reconnection while we still have 0 commands in progress.
2025-09-24T20:11:47,376 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) NioClient connection closed
2025-09-24T20:11:47,364 INFO [cloud.agent.Agent] (Agent-Handler-2:[]) Connected to the host: 172.24.48.198
2025-09-24T20:11:52,378 INFO [cloud.agent.Agent] (Agent-Handler-2:[]) Reconnecting to host: 172.24.48.198
2025-09-24T20:11:52,383 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) Connecting to 172.24.48.198:8250
2025-09-24T20:11:52,387 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) Connected to 172.24.48.198:8250
2025-09-24T20:11:52,389 INFO [utils.nio.Link] (Agent-Handler-2:[]) Conf file found: /usr/local/cloud/systemvm/conf/agent.properties
2025-09-24T20:11:52,538 ERROR [utils.nio.Link] (Agent-Handler-2:[]) SSL error caught during wrap data: No trusted certificate found, for local address=/172.17.26.85:37370, remote address=/172.24.48.198:8250.
2025-09-24T20:11:52,543 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) SSL: Handshake done
2025-09-24T20:11:52,561 WARN [cloud.agent.Agent] (Agent-Handler-1:[]) Unable to send request to /172.24.48.198:8250 due to 'null', request: null
2025-09-24T20:11:57,547 INFO [cloud.agent.Agent] (Agent-Handler-2:[]) Connected to the host: 172.24.48.198
2025-09-24T20:11:57,549 INFO [cloud.agent.Agent] (Agent-Handler-2:[]) Lost connection to host: 172.24.48.198. Attempting reconnection while we still have 0 commands in progress.
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14495363
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 edited a comment on the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
@weizhouapache
I changed the management IP in global setting and the error changed. Please check.
Wed Sep 24 08:10:52 PM UTC 2025 Starting guest services for vmware
Wed Sep 24 08:10:59 PM UTC 2025 Applying iptables rules
Wed Sep 24 08:10:59 PM UTC 2025 Setting up interface: eth0
Wed Sep 24 08:10:59 PM UTC 2025 Setting up interface: eth1
Wed Sep 24 08:10:59 PM UTC 2025 Setting up interface: eth2
Wed Sep 24 08:10:59 PM UTC 2025 Received mgmt cidr : 172.24.48.128/26
Wed Sep 24 08:10:59 PM UTC 2025 Configuring sshd
Wed Sep 24 08:11:00 PM UTC 2025 Executing cloud-early-config
Wed Sep 24 08:11:00 PM UTC 2025 Scripts checksum detected: oldmd5=b0bf21ef8e4aa6df495c71f7d96b6aeb newmd5=b0bf21ef8e4aa6df495c71f7d96b6aeb
Wed Sep 24 08:11:02 PM UTC 2025 Could not find patch file, retrying
Wed Sep 24 08:11:04 PM UTC 2025 Could not find patch file, retrying
Wed Sep 24 08:11:06 PM UTC 2025 Could not find patch file, retrying
Wed Sep 24 08:11:08 PM UTC 2025 Could not find patch file, retrying
Wed Sep 24 08:11:10 PM UTC 2025 Could not find patch file, retrying
Wed Sep 24 08:11:10 PM UTC 2025 Scripts checksum detected: oldmd5=b0bf21ef8e4aa6df495c71f7d96b6aeb newmd5=125120ec9fbf442a2cdb23c17d2f56b5
Wed Sep 24 08:11:10 PM UTC 2025 Patched scripts using /var/cache/cloud/cloud-scripts.tgz
Wed Sep 24 08:11:10 PM UTC 2025 Bootstrapping systemvm appliance
Wed Sep 24 08:11:10 PM UTC 2025 Unziping /var/cache/cloud//agent.zip
Wed Sep 24 08:11:11 PM UTC 2025 As system VM type is secstorage, we will remove the default properties 'instance' and 'resource' from usr/local/cloud/systemvm/conf/agent.properties
Wed Sep 24 08:11:11 PM UTC 2025 Copying content of /var/cache/cloud/cmdline to usr/local/cloud/systemvm/conf/agent.properties
Wed Sep 24 08:11:12 PM UTC 2025 Configuring systemvm type=secstorage
Wed Sep 24 08:11:13 PM UTC 2025 Setting up secondary storage system vm
Wed Sep 24 08:11:13 PM UTC 2025 Setting up interface: eth3
Wed Sep 24 08:11:13 PM UTC 2025 Successfully setup storage network with STORAGE_IP:172.24.14.62, STORAGE_NETMASK:255.255.255.240, STORAGE_CIDR:
Wed Sep 24 08:11:13 PM UTC 2025 Setting up route of RFC1918 space to 172.17.26.1
Wed Sep 24 08:11:13 PM UTC 2025 Setting up entry in hosts
Wed Sep 24 08:11:13 PM UTC 2025 Applying iptables rules
Wed Sep 24 08:11:13 PM UTC 2025 Configuring apache2
Wed Sep 24 08:11:13 PM UTC 2025 Setting up apache web server
Wed Sep 24 08:11:13 PM UTC 2025 Setting up apache2 for post upload of volume/template
Wed Sep 24 08:11:13 PM UTC 2025 cloud: disable rp_filter
Wed Sep 24 08:11:13 PM UTC 2025 disable rpfilter
Wed Sep 24 08:11:13 PM UTC 2025 cloud: enable_fwding = 0
Wed Sep 24 08:11:13 PM UTC 2025 enable_fwding = 0
Wed Sep 24 08:11:13 PM UTC 2025 Processors = 1 Enable service = 0
Wed Sep 24 08:11:13 PM UTC 2025 Setting up NTP
Wed Sep 24 08:11:13 PM UTC 2025 Adding PubkeyAcceptedAlgorithms=+ssh-rsa to sshd_config
Wed Sep 24 08:11:13 PM UTC 2025 Skipped the installation of package python-is-python3 on Debian 12 as it can only be installed on Debian 11.
Wed Sep 24 08:11:13 PM UTC 2025 Skipped the installation of package python3-netaddr on Debian 12 as it can only be installed on Debian 11.
Wed Sep 24 08:11:13 PM UTC 2025 Finished setting up systemvm
Wed Sep 24 08:11:13 PM UTC 2025 Finished setting up systemvm
2025-09-24T20:11:20,664 INFO [cloud.agent.AgentShell] (main:[]) Agent started
2025-09-24T20:11:20,675 INFO [cloud.agent.AgentShell] (main:[]) Implementation Version is 4.21.0.0
2025-09-24T20:11:20,676 INFO [cloud.agent.AgentShell] (main:[]) agent.properties found at /usr/local/cloud/systemvm/conf/agent.properties
2025-09-24T20:11:20,741 INFO [cloud.agent.AgentShell] (main:[]) Defaulting to using properties file for storage
2025-09-24T20:11:20,742 INFO [cloud.agent.AgentShell] (main:[]) Defaulting to the constant time backoff algorithm
2025-09-24T20:11:20,785 INFO [cloud.utils.LogUtils] (main:[]) log4j configuration found at /usr/local/cloud/systemvm/conf/log4j-cloud.xml
2025-09-24T20:11:20,786 INFO [cloud.agent.AgentShell] (main:[]) Using default Java settings for IPv6 preference for agent connection
2025-09-24T20:11:20,893 INFO [cloud.agent.Agent] (main:[]) Initialising agent [id: , uuid: null, name: null]
2025-09-24T20:11:20,908 INFO [storage.resource.NfsSecondaryStorageResource] (main:[]) config_ssl.sh found in /usr/local/cloud/systemvm/config_ssl.sh
2025-09-24T20:11:20,908 INFO [storage.resource.NfsSecondaryStorageResource] (main:[]) config_auth.sh found in /usr/local/cloud/systemvm/config_auth.sh
2025-09-24T20:11:20,909 INFO [storage.resource.NfsSecondaryStorageResource] (main:[]) _configIpFirewallScr found in /usr/local/cloud/systemvm/ipfirewall.sh
2025-09-24T20:11:20,915 INFO [storage.resource.NfsSecondaryStorageResource] (main:[]) Secondary storage runs in role templateProcessor
2025-09-24T20:11:20,938 WARN [storage.resource.NfsSecondaryStorageResource] (main:[]) Execution of process [3817] for command [/bin/bash -c ip route delete 172.24.48.197 ] failed.
2025-09-24T20:11:20,938 WARN [storage.resource.NfsSecondaryStorageResource] (main:[]) Process [3817] for command [/bin/bash -c ip route delete 172.24.48.197 ] encountered the error: [RTNETLINK answers: No such process].
2025-09-24T20:11:20,954 WARN [storage.resource.NfsSecondaryStorageResource] (main:[]) Execution of process [3821] for command [/bin/bash -c ip route delete 172.24.48.198 ] failed.
2025-09-24T20:11:20,955 WARN [storage.resource.NfsSecondaryStorageResource] (main:[]) Process [3821] for command [/bin/bash -c ip route delete 172.24.48.198 ] encountered the error: [RTNETLINK answers: No such process].
2025-09-24T20:11:20,969 WARN [storage.resource.NfsSecondaryStorageResource] (main:[]) Execution of process [3825] for command [/bin/bash -c ip route delete 172.24.48.195 ] failed.
2025-09-24T20:11:20,969 WARN [storage.resource.NfsSecondaryStorageResource] (main:[]) Process [3825] for command [/bin/bash -c ip route delete 172.24.48.195 ] encountered the error: [RTNETLINK answers: No such process].
2025-09-24T20:11:20,984 WARN [storage.resource.NfsSecondaryStorageResource] (main:[]) Execution of process [3829] for command [/bin/bash -c ip route delete 172.24.48.196 ] failed.
2025-09-24T20:11:20,984 WARN [storage.resource.NfsSecondaryStorageResource] (main:[]) Process [3829] for command [/bin/bash -c ip route delete 172.24.48.196 ] encountered the error: [RTNETLINK answers: No such process].
2025-09-24T20:11:21,045 INFO [storage.resource.IpTablesHelper] (main:[]) Adding rule [-i eth1 -p tcp -m state --state NEW -m tcp --dport 3922 -j ACCEPT] to [INPUT] if required.
2025-09-24T20:11:21,053 WARN [storage.resource.IpTablesHelper] (main:[]) Execution of process [3837] for command [/bin/bash -c iptables -C INPUT -i eth1 -p tcp -m state --state NEW -m tcp --dport 3922 -j ACCEPT ] failed.
2025-09-24T20:11:21,314 WARN [storage.resource.IpTablesHelper] (main:[]) Process [3934] for command [/bin/bash -c iptables -C OUTPUT -o eth1 -p tcp -m state --state NEW -m tcp --dport 443 -j REJECT; ] encountered the error: [iptables: Bad rule (does a matching rule exist in that chain?).].
2025-09-24T20:11:21,318 INFO [storage.template.DownloadManagerImpl] (main:[]) listvmtmplt.sh found in /usr/local/cloud/systemvm/scripts/storage/secondary/listvmtmplt.sh
2025-09-24T20:11:21,323 INFO [storage.template.DownloadManagerImpl] (main:[]) createtmplt.sh found in /usr/local/cloud/systemvm/scripts/storage/secondary/createtmplt.sh
2025-09-24T20:11:21,324 INFO [storage.template.DownloadManagerImpl] (main:[]) listvolume.sh found in /usr/local/cloud/systemvm/scripts/storage/secondary/listvolume.sh
2025-09-24T20:11:21,327 INFO [storage.template.DownloadManagerImpl] (main:[]) createvolume.sh found in /usr/local/cloud/systemvm/scripts/storage/secondary/createvolume.sh
2025-09-24T20:11:21,338 INFO [storage.template.UploadManagerImpl] (main:[]) UploadManager: starting additional services since we are inside system vm
2025-09-24T20:11:21,378 INFO [cloud.serializer.GsonHelper] (main:[]) Default Builder inited.
2025-09-24T20:11:21,397 INFO [cloud.agent.Agent] (main:[]) Agent [id = new, uuid = null, name = null, type = PremiumSecondaryStorageResource, zone = 3, pod = 3, workers = 5, port = 8250] with host = 172.24.48.197, local id = 1
2025-09-24T20:11:21,401 INFO [utils.nio.NioClient] (main:[]) Connecting to 172.24.48.197:8250
2025-09-24T20:11:21,418 INFO [utils.nio.NioClient] (main:[]) Connected to 172.24.48.197:8250
2025-09-24T20:11:21,421 INFO [utils.nio.Link] (main:[]) Conf file found: /usr/local/cloud/systemvm/conf/agent.properties
2025-09-24T20:11:22,062 ERROR [utils.nio.Link] (main:[]) SSL error caught during wrap data: No trusted certificate found, for local address=/172.17.26.85:34672, remote address=/172.24.48.197:8250.
2025-09-24T20:11:22,063 INFO [utils.nio.NioClient] (main:[]) SSL: Handshake done
2025-09-24T20:11:22,144 WARN [cloud.agent.Agent] (Agent-Handler-1:[]) Unable to send request to /172.24.48.197:8250 due to 'null', request: null
2025-09-24T20:11:27,094 INFO [cloud.agent.Agent] (Agent-Handler-2:[]) Lost connection to host: 172.24.48.197. Attempting reconnection while we still have 0 commands in progress.
2025-09-24T20:11:27,098 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) NioClient connection closed
2025-09-24T20:11:32,100 INFO [cloud.agent.Agent] (Agent-Handler-2:[]) Reconnecting to host: 172.24.48.198
2025-09-24T20:11:32,109 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) Connecting to 172.24.48.198:8250
2025-09-24T20:11:32,111 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) Connected to 172.24.48.198:8250
2025-09-24T20:11:32,113 INFO [utils.nio.Link] (Agent-Handler-2:[]) Conf file found: /usr/local/cloud/systemvm/conf/agent.properties
2025-09-24T20:11:32,227 ERROR [utils.nio.Link] (Agent-Handler-2:[]) SSL error caught during wrap data: No trusted certificate found, for local address=/172.17.26.85:60296, remote address=/172.24.48.198:8250.
2025-09-24T20:11:32,228 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) SSL: Handshake done
2025-09-24T20:11:32,241 WARN [cloud.agent.Agent] (Agent-Handler-1:[]) Unable to send request to /172.24.48.198:8250 due to 'null', request: null
2025-09-24T20:11:37,231 INFO [cloud.agent.Agent] (Agent-Handler-2:[]) Connected to the host: 172.24.48.198
2025-09-24T20:11:37,238 INFO [cloud.agent.Agent] (Agent-Handler-2:[]) Lost connection to host: 172.24.48.198. Attempting reconnection while we still have 0 commands in progress.
2025-09-24T20:11:37,240 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) NioClient connection closed
2025-09-24T20:11:42,242 INFO [cloud.agent.Agent] (Agent-Handler-2:[]) Reconnecting to host: 172.24.48.198
2025-09-24T20:11:42,247 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) Connecting to 172.24.48.198:8250
2025-09-24T20:11:42,254 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) Connected to 172.24.48.198:8250
2025-09-24T20:11:42,255 INFO [utils.nio.Link] (Agent-Handler-2:[]) Conf file found: /usr/local/cloud/systemvm/conf/agent.properties
2025-09-24T20:11:42,354 ERROR [utils.nio.Link] (Agent-Handler-2:[]) SSL error caught during wrap data: No trusted certificate found, for local address=/172.17.26.85:57034, remote address=/172.24.48.198:8250.
2025-09-24T20:11:42,358 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) SSL: Handshake done
2025-09-24T20:11:42,376 WARN [cloud.agent.Agent] (Agent-Handler-1:[]) Unable to send request to /172.24.48.198:8250 due to 'null', request: null
2025-09-24T20:11:47,368 INFO [cloud.agent.Agent] (Agent-Handler-2:[]) Lost connection to host: 172.24.48.198. Attempting reconnection while we still have 0 commands in progress.
2025-09-24T20:11:47,376 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) NioClient connection closed
2025-09-24T20:11:47,364 INFO [cloud.agent.Agent] (Agent-Handler-2:[]) Connected to the host: 172.24.48.198
2025-09-24T20:11:52,378 INFO [cloud.agent.Agent] (Agent-Handler-2:[]) Reconnecting to host: 172.24.48.198
2025-09-24T20:11:52,383 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) Connecting to 172.24.48.198:8250
2025-09-24T20:11:52,387 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) Connected to 172.24.48.198:8250
2025-09-24T20:11:52,389 INFO [utils.nio.Link] (Agent-Handler-2:[]) Conf file found: /usr/local/cloud/systemvm/conf/agent.properties
2025-09-24T20:11:52,538 ERROR [utils.nio.Link] (Agent-Handler-2:[]) SSL error caught during wrap data: No trusted certificate found, for local address=/172.17.26.85:37370, remote address=/172.24.48.198:8250.
2025-09-24T20:11:52,543 INFO [utils.nio.NioClient] (Agent-Handler-2:[]) SSL: Handshake done
2025-09-24T20:11:52,561 WARN [cloud.agent.Agent] (Agent-Handler-1:[]) Unable to send request to /172.24.48.198:8250 due to 'null', request: null
2025-09-24T20:11:57,547 INFO [cloud.agent.Agent] (Agent-Handler-2:[]) Connected to the host: 172.24.48.198
2025-09-24T20:11:57,549 INFO [cloud.agent.Agent] (Agent-Handler-2:[]) Lost connection to host: 172.24.48.198. Attempting reconnection while we still have 0 commands in progress.
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14495363
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
The problem was solved with this command
But when I try to upload a template as a URL, I get an error on management
514a63 with error: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
and also get an error on ssvm
2025-09-24T09:41:57,759 INFO [storage.template.DownloadManagerImpl] (pool-2-thread-4:[]) local: /mnt/SecStorage/054aca04-065d-3b12-84e6-504ff84130cb/template/tmpl/9/258/dnld2045255748598754523tmp_, bytes=(0 bytes) 0, error=PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target, pct=0
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14496748
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "weizhouapache (via GitHub)" <gi...@apache.org>.
GitHub user weizhouapache added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
still no clue
can you upload /var/log/daemon.log inside ssvm ?
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14485209
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 edited a discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
### problem
ssvm can connect to management port 8250. This has been tested with Telnet but it gives an SSL error.
2025-09-21T20:58:53,248 WARN [utils.nio.Link] (main:[]) SSL Handshake has taken more than 30000 ms to connect to: /172.24.48.134:8250 while status: NEED_UNWRAP. Please investigate this connection.
2025-09-21T20:58:53,249 ERROR [utils.nio.NioClient] (main:[]) IOException while connecting to 172.24.48.134:8250 java.io.IOException: SSL Handshake failed while connecting to host: 172.24.48.134:8250
at com.cloud.utils.nio.NioClient.init(NioClient.java:75)
at com.cloud.utils.nio.NioConnection.start(NioConnection.java:109)
at com.cloud.agent.Agent.start(Agent.java:338)
at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:477)
at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:454)
at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:438)
at com.cloud.agent.AgentShell.start(AgentShell.java:539)
at com.cloud.agent.AgentShell.main(AgentShell.java:569)
2025-09-21T20:58:53,250 ERROR [utils.nio.NioClient] (main:[]) Unable to initialize the threads. java.io.IOException: SSL Handshake failed while connecting to host: 172.24.48.134:8250
2025-09-21T20:47:12,447 ERROR [utils.nio.NioClient] (main:[]) IOException while connecting to 172.24.48.134:8250 java.io.IOException: SSL Handshake failed while connecting to host: 172.24.48.134:8250
at com.cloud.utils.nio.NioClient.init(NioClient.java:75)
at com.cloud.utils.nio.NioConnection.start(NioConnection.java:109)
at com.cloud.agent.Agent.start(Agent.java:338)
at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:477)
at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:454)
at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:438)
at com.cloud.agent.AgentShell.start(AgentShell.java:539)
at com.cloud.agent.AgentShell.main(AgentShell.java:569)
2025-09-21T20:47:12,448 ERROR [utils.nio.NioClient] (main:[]) Unable to initialize the threads. java.io.IOException: SSL Handshake failed while connecting to host: 172.24.48.134:8250
at com.cloud.utils.nio.NioClient.init(NioClient.java:75)
at com.cloud.utils.nio.NioConnection.start(NioConnection.java:109)
at com.cloud.agent.Agent.start(Agent.java:338)
at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:477)
at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:454)
at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:438)
at com.cloud.agent.AgentShell.start(AgentShell.java:539)
at com.cloud.agent.AgentShell.main(AgentShell.java:569)
2025-09-21T20:47:12,449 INFO [utils.nio.NioClient] (main:[]) NioClient connection closed
2025-09-21T20:47:12,449 INFO [cloud.agent.Agent] (main:[]) Attempted to connect to the server, but received an unexpected exception, trying again... com.cloud.utils.exception.NioConnectionException: SSL Handshake failed while connecting to host: 172.24.48.134:8250
at com.cloud.utils.nio.NioConnection.start(NioConnection.java:115)
at com.cloud.agent.Agent.start(Agent.java:338)
at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:477)
at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:454)
at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:438)
at com.cloud.agent.AgentShell.start(AgentShell.java:539)
at com.cloud.agent.AgentShell.main(AgentShell.java:569)
Caused by: java.io.IOException: SSL Handshake failed while connecting to host: 172.24.48.134:8250
at com.cloud.utils.nio.NioClient.init(NioClient.java:75)
at com.cloud.utils.nio.NioConnection.start(NioConnection.java:109)
... 6 more
2025-09-21T20:47:17,450 INFO [cloud.agent.Agent] (main:[]) Connecting to host: 172.24.48.133
2025-09-21T20:47:17,453 INFO [utils.nio.NioClient] (main:[]) Connecting to 172.24.48.133:8250
2025-09-21T20:47:17,454 INFO [utils.nio.NioClient] (main:[]) Connected to 172.24.48.133:8250
2025-09-21T20:47:17,455 INFO [utils.nio.Link] (main:[]) Conf file found: /usr/local/cloud/systemvm/conf/agent.properties
### versions
4.21
OS: Ubuntu 24.04
Vmware version is 8.0.3
GitHub link: https://github.com/apache/cloudstack/discussions/11694
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 added a comment to the discussion: Secondary Storage Vm (SSVM) SSL Handshake failed error
We don't have any logs on the management, the Vmware version is 8.0.3, so rebuilding the SSVM doesn't solve the problem, and then the third health check log is sent.
root@s-5333-VM:~# bash /usr/local/cloud/systemvm/ssvm-check.sh
================================================
First DNS server is 172.24.48.195
PING 172.24.48.195 (172.24.48.195): 56 data bytes
64 bytes from 172.24.48.195: icmp_seq=0 ttl=61 time=0.621 ms
64 bytes from 172.24.48.195: icmp_seq=1 ttl=61 time=0.552 ms
--- 172.24.48.195 ping statistics ---
2 packets transmitted, 2 packets received, 0% packet loss
round-trip min/avg/max/stddev = 0.552/0.587/0.621/0.035 ms
Good: Can ping DNS server
================================================
Good: DNS resolves cloudstack.apache.org
================================================
ERROR: Storage nfs is not currently mounted
Verifying if we can at least ping the storage
Storage address(s): scst.pvcl.afracloud.local, trying to ping
Pinging storage address: scst.pvcl.afracloud.local
PING scst.pvcl.afracloud.local (172.24.48.100): 56 data bytes
64 bytes from 172.24.48.100: icmp_seq=0 ttl=61 time=0.629 ms
64 bytes from 172.24.48.100: icmp_seq=1 ttl=61 time=0.522 ms
--- scst.pvcl.afracloud.local ping statistics ---
2 packets transmitted, 2 packets received, 0% packet loss
round-trip min/avg/max/stddev = 0.522/0.576/0.629/0.054 ms
Good: Can ping nfs storage address
================================================
Management server is 172.24.48.133,172.24.48.134. Checking connectivity.
Good: Can connect to management server 172.24.48.133 port 8250
Good: Can connect to management server 172.24.48.134 port 8250
================================================
Good: Java process is running
================================================
Tests Complete. Look for ERROR or WARNING above.
root@s-5333-VM:~# ^C
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14474023
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org
Re: [D] Secondary Storage Vm (SSVM) SSL Handshake failed error [cloudstack]
Posted by "Hossein4185 (via GitHub)" <gi...@apache.org>.
GitHub user Hossein4185 closed the discussion with a comment: Secondary Storage Vm (SSVM) SSL Handshake failed error
@weizhouapache
Yes, there was a network problem. After solving the network problem and running the script, the certificate problem was solved.
GitHub link: https://github.com/apache/cloudstack/discussions/11694#discussioncomment-14529090
----
This is an automatically sent email for users@cloudstack.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@cloudstack.apache.org