You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by jaejong <cb...@naver.com> on 2023/10/03 04:05:09 UTC

Management server not connected from SSVM

I try tried install acs on rocky9.2, but I can't config network by nmcli for acs manuals.

I have experience acs 4.17.2 on rocky 8.7 successsfully.
So I try install acs 4.18.1 on rocky8.8.

But I can ping system VMs.
public ip status for system VMs are :
* ip is allocated status.
* stactic and source NAT is disabled.
* virtual route is not exist.

At management server,  netstat -tulpn | grep LISTEN report 
8080,8250,9090 port are listening, But 8443 not.

I checked SSVM by sh ssvm-check.sh;

First DNS server is  8.8.8.8
PING 8.8.8.8 (8.8.8.8): 56 data bytes
64 bytes from 8.8.8.8: icmp_seq=0 ttl=115 time=27.206 ms
64 bytes from 8.8.8.8: icmp_seq=1 ttl=115 time=26.872 ms
--- 8.8.8.8 ping statistics ---
2 packets transmitted, 2 packets received, 0% packet loss
round-trip min/avg/max/stddev = 26.872/27.039/27.206/0.167 ms
Good: Can ping DNS server
================================================
Good: DNS resolves cloudstack.apache.org
================================================
nfs is currently mounted
Mount point is /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7
Good: Can write to mount point
================================================
Management server is 10.0.*. Checking connectivity.
ssvm-check.sh: 143: Syntax error: redirection unexpected

I want to add kubernetes ISO.

How can i fix this?

Thanks.


Re: Management server not connected from SSVM

Posted by jaejong <cb...@naver.com>.
Thanks Jithin Raju!!

I  tried send all about settngs and log.
But the mail rejected due to limited size.

SSVM can ping to management server, but can not connected.
After analyzed the log file and checked the port status of the server.
I found server only listen on ipv6.

So I created another titled mail as  "server listen ipv6 not ipv4";

I trying install acs 4.18 for two months on rockylinux 9.

I guess the problems are drived not listening ipv4 address.

Let me know how to up;oad logs.

thanks.





-----Original Message-----
From: "Jithin Raju"<ji...@shapeblue.com>
To: "users@cloudstack.apache.org"<us...@cloudstack.apache.org>;
Cc:
Sent: 2023-10-04 (수) 13:41:27 (GMT+09:00)
Subject: Re: Management server not connected from SSVM

Hi Jaejong,

I doubt we can share any files attached over this mailing list, you could create a github issue?

-Jithin

From: jaejong <cb...@naver.com>
Date: Tuesday, 3 October 2023 at 5:39 PM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Subject: Re: Management server not connected from SSVM
Hi Jithin Raju
I wonder it is right way to present log state as attached file.

I do'nt understand you said "I am assuming you are not using a hostname?"
For the port connectivity, see ip-listen-state file.


I send log files.

during installation configuration, I set stroage traffic ips as from 10.0.33.1 to 10.0.33.10
I  only add nfs server of 10.0.33.1 as secondary storage. but I see at cloud.log as follows;
Mon 02 Oct 2023 01:11:30 PM UTC Successfully setup storage network with STORAGE_IP:10.0.33.2, STORAGE_NETMASK:255.255.240.0, STORAGE_CIDR

except it, I can find any problems.

I hope you can help me.

Thanks a lot.





-----Original Message-----
From: "jaejong"<cb...@naver.com>
To: <us...@cloudstack.apache.org>;
Cc:
Sent: 2023-10-03 (화) 16:40:12 (GMT+09:00)
Subject: Re: Management server not connected from SSVM
I will reboot for clean log.
I will report server and host settig all.
Can i upload log and settings as file attached?

I need help for this. I will be back.


-----Original Message-----
From: "Jithin Raju"<ji...@shapeblue.com>
To: "users@cloudstack.apache.org"<us...@cloudstack.apache.org>;
Cc:
Sent: 2023-10-03 (화) 16:28:26 (GMT+09:00)
Subject: Re: Management server not connected from SSVM

Hi Jeojong,

Since you mentioned the management server IP is reachable from the SSVM I am not sure why this error should appear, can you check the port connectivity? I am assuming you are not using a hostname?

-Jithin

From: jaejong <cb...@naver.com>
Date: Tuesday, 3 October 2023 at 11:58 AM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Subject: Re: Management server not connected from SSVM
Hi  Jithin Raju
error messages from cloud.log:

2023-10-03 04:17:26,867 INFO  [utils.nio.NioClient] (main:null) Connecting to serverIP:8250
2023-10-03 04:17:29,935 ERROR [utils.nio.NioConnection] (main:null) Unable to initialize the threads.
java.net.NoRouteToHostException: No route to host
     at java.base/sun.nio.ch.Net.connect0(Native Method)
     at java.base/sun.nio.ch.Net.connect(Net.java:483)
     at java.base/sun.nio.ch.Net.connect(Net.java:472)
     at java.base/sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:692)
     at com.cloud.utils.nio.NioClient.init(NioClient.java:56)
     at com.cloud.utils.nio.NioConnection.start(NioConnection.java:95)
     at com.cloud.agent.Agent.start(Agent.java:283)
     at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:454)
     at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:431)
     at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:415)
     at com.cloud.agent.AgentShell.start(AgentShell.java:511)
     at com.cloud.agent.AgentShell.main(AgentShell.java:541)
2023-10-03 04:17:29,939 WARN  [cloud.agent.Agent] (main:null) NIO Connection Exception  com.cloud.utils.exception.NioConnectionException: No route to host
...
2023-10-03 04:17:37,999 INFO  [cloud.agent.Agent] (main:null) Attempted to connect to the server, but received an unexpected exception, trying again...
com.cloud.utils.exception.NioConnectionException: No route to host
     at com.cloud.utils.nio.NioConnection.start(NioConnection.java:101)
     at com.cloud.agent.Agent.start(Agent.java:294)
     at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:454)
     at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:431)
     at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:415)
     at com.cloud.agent.AgentShell.start(AgentShell.java:511)
     at com.cloud.agent.AgentShell.main(AgentShell.java:541)
Caused by: java.net.NoRouteToHostException: No route to host
     at java.base/sun.nio.ch.Net.connect0(Native Method)
     at java.base/sun.nio.ch.Net.connect(Net.java:483)
     at java.base/sun.nio.ch.Net.connect(Net.java:472)
     at java.base/sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:692)
     at com.cloud.utils.nio.NioClient.init(NioClient.java:56)
     at com.cloud.utils.nio.NioConnection.start(NioConnection.java:95)
     ... 6 more
.....
2023-10-03 04:17:44,187 INFO  [storage.template.DownloadManagerImpl] (agentRequest-Handler-2:null) found 3 templates[/mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/3/db2b01f1-5a4f-44b5-a0e7-bd2dac5c3b6e.qcow2, /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/4/, /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/202/]
2023-10-03 04:17:44,195 WARN  [storage.template.DownloadManagerImpl] (agentRequest-Handler-2:null) Post download installation was not completed for /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/4
2023-10-03 04:17:44,197 WARN  [storage.template.DownloadManagerImpl] (agentRequest-Handler-2:null) Post download installation was not completed for /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/202
.....
2023-10-03 04:17:49,170 INFO  [storage.template.DownloadManagerImpl] (pool-1-thread-2:null) Download Completion for jobId: 5b5d49d2-284f-4300-a428-1e9f38a7a8c6, status=UNRECOVERABLE_ERROR
2023-10-03 04:17:49,171 INFO  [storage.template.DownloadManagerImpl] (pool-1-thread-1:null) Download Completion for jobId: 6f7be7ed-259e-4ca3-b803-326ad779ae3b, status=UNRECOVERABLE_ERROR
2023-10-03 04:17:49,176 INFO  [storage.template.DownloadManagerImpl] (pool-1-thread-1:null) local: /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/4/dnld4779556823249392615tmp_, bytes=(0 bytes) 0, error=No route to host (Host unreachable), pct=0
2023-10-03 04:17:49,177 INFO  [storage.template.DownloadManagerImpl] (pool-1-thread-2:null) local: /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/202/dnld1894069453551272666tmp_, bytes=(0 bytes) 0, error=No route to host (Host unreachable), pct=0

thanks!!




-----Original Message-----
From: "Jithin Raju"<ji...@shapeblue.com>
To: "users@cloudstack.apache.org"<us...@cloudstack.apache.org>;
Cc:
Sent: 2023-10-03 (화) 15:03:39 (GMT+09:00)
Subject: Re: Management server not connected from SSVM

Hi Jaejong,

If the SSVM can connect the management server the SSVM agent should get connected, any errors you can see in the cloud.log in SSVM?

-Jithin

From: jaejong <cb...@naver.com>
Date: Tuesday, 3 October 2023 at 11:28 AM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Subject: Re: Management server not connected from SSVM
Thank tou Jithin!

The management server IP is currect.
I can ping to management server from SSVM, but can not to public IP of system VMs from management server.
There is no route on the SSVM.

Thanks again!!




-----Original Message-----
From: "Jithin Raju"<ji...@shapeblue.com>
To: "users@cloudstack.apache.org"<us...@cloudstack.apache.org>;
Cc:
Sent: 2023-10-03 (화) 14:04:53 (GMT+09:00)
Subject: Re: Management server not connected from SSVM

Hi Jaejong,

Could you verify whether the management server IP is correct in the global configuration parameter ‘host’?
Is there a route on the SSVM to route the management server IP via eth1?
Can you ping the management server IP from SSVM?

-Jithin

From: jaejong <cb...@naver.com>
Date: Tuesday, 3 October 2023 at 9:35 AM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Subject: Management server not connected from SSVM
I try tried install acs on rocky9.2, but I can't config network by nmcli for acs manuals.

I have experience acs 4.17.2 on rocky 8.7 successsfully.
So I try install acs 4.18.1 on rocky8.8.

But I can ping system VMs.
public ip status for system VMs are :
* ip is allocated status.
* stactic and source NAT is disabled.
* virtual route is not exist.

At management server,  netstat -tulpn | grep LISTEN report
8080,8250,9090 port are listening, But 8443 not.

I checked SSVM by sh ssvm-check.sh;

First DNS server is  8.8.8.8
PING 8.8.8.8 (8.8.8.8): 56 data bytes
64 bytes from 8.8.8.8: icmp_seq=0 ttl=115 time=27.206 ms
64 bytes from 8.8.8.8: icmp_seq=1 ttl=115 time=26.872 ms
--- 8.8.8.8 ping statistics ---
2 packets transmitted, 2 packets received, 0% packet loss
round-trip min/avg/max/stddev = 26.872/27.039/27.206/0.167 ms
Good: Can ping DNS server
================================================
Good: DNS resolves cloudstack.apache.org
================================================
nfs is currently mounted
Mount point is /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7
Good: Can write to mount point
================================================
Management server is 10.0.*. Checking connectivity.
ssvm-check.sh: 143: Syntax error: redirection unexpected

I want to add kubernetes ISO.

How can i fix this?

Thanks.

[Image removed by sender.]


Re: Management server not connected from SSVM

Posted by Jithin Raju <ji...@shapeblue.com>.
Hi Jaejong,

I doubt we can share any files attached over this mailing list, you could create a github issue?

-Jithin

From: jaejong <cb...@naver.com>
Date: Tuesday, 3 October 2023 at 5:39 PM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Subject: Re: Management server not connected from SSVM
Hi Jithin Raju
I wonder it is right way to present log state as attached file.

I do'nt understand you said "I am assuming you are not using a hostname?"
For the port connectivity, see ip-listen-state file.


I send log files.

during installation configuration, I set stroage traffic ips as from 10.0.33.1 to 10.0.33.10
I  only add nfs server of 10.0.33.1 as secondary storage. but I see at cloud.log as follows;
Mon 02 Oct 2023 01:11:30 PM UTC Successfully setup storage network with STORAGE_IP:10.0.33.2, STORAGE_NETMASK:255.255.240.0, STORAGE_CIDR

except it, I can find any problems.

I hope you can help me.

Thanks a lot.


 


-----Original Message-----
From: "jaejong"<cb...@naver.com>
To: <us...@cloudstack.apache.org>;
Cc:
Sent: 2023-10-03 (화) 16:40:12 (GMT+09:00)
Subject: Re: Management server not connected from SSVM
I will reboot for clean log.
I will report server and host settig all.
Can i upload log and settings as file attached?

I need help for this. I will be back.


-----Original Message-----
From: "Jithin Raju"<ji...@shapeblue.com>
To: "users@cloudstack.apache.org"<us...@cloudstack.apache.org>;
Cc:
Sent: 2023-10-03 (화) 16:28:26 (GMT+09:00)
Subject: Re: Management server not connected from SSVM

Hi Jeojong,

Since you mentioned the management server IP is reachable from the SSVM I am not sure why this error should appear, can you check the port connectivity? I am assuming you are not using a hostname?

-Jithin

From: jaejong <cb...@naver.com>
Date: Tuesday, 3 October 2023 at 11:58 AM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Subject: Re: Management server not connected from SSVM
Hi  Jithin Raju
error messages from cloud.log:

2023-10-03 04:17:26,867 INFO  [utils.nio.NioClient] (main:null) Connecting to serverIP:8250
2023-10-03 04:17:29,935 ERROR [utils.nio.NioConnection] (main:null) Unable to initialize the threads.
java.net.NoRouteToHostException: No route to host
      at java.base/sun.nio.ch.Net.connect0(Native Method)
      at java.base/sun.nio.ch.Net.connect(Net.java:483)
      at java.base/sun.nio.ch.Net.connect(Net.java:472)
      at java.base/sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:692)
      at com.cloud.utils.nio.NioClient.init(NioClient.java:56)
      at com.cloud.utils.nio.NioConnection.start(NioConnection.java:95)
      at com.cloud.agent.Agent.start(Agent.java:283)
      at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:454)
      at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:431)
      at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:415)
      at com.cloud.agent.AgentShell.start(AgentShell.java:511)
      at com.cloud.agent.AgentShell.main(AgentShell.java:541)
2023-10-03 04:17:29,939 WARN  [cloud.agent.Agent] (main:null) NIO Connection Exception  com.cloud.utils.exception.NioConnectionException: No route to host
...
2023-10-03 04:17:37,999 INFO  [cloud.agent.Agent] (main:null) Attempted to connect to the server, but received an unexpected exception, trying again...
com.cloud.utils.exception.NioConnectionException: No route to host
      at com.cloud.utils.nio.NioConnection.start(NioConnection.java:101)
      at com.cloud.agent.Agent.start(Agent.java:294)
      at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:454)
      at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:431)
      at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:415)
      at com.cloud.agent.AgentShell.start(AgentShell.java:511)
      at com.cloud.agent.AgentShell.main(AgentShell.java:541)
Caused by: java.net.NoRouteToHostException: No route to host
      at java.base/sun.nio.ch.Net.connect0(Native Method)
      at java.base/sun.nio.ch.Net.connect(Net.java:483)
      at java.base/sun.nio.ch.Net.connect(Net.java:472)
      at java.base/sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:692)
      at com.cloud.utils.nio.NioClient.init(NioClient.java:56)
      at com.cloud.utils.nio.NioConnection.start(NioConnection.java:95)
      ... 6 more
.....
2023-10-03 04:17:44,187 INFO  [storage.template.DownloadManagerImpl] (agentRequest-Handler-2:null) found 3 templates[/mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/3/db2b01f1-5a4f-44b5-a0e7-bd2dac5c3b6e.qcow2, /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/4/, /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/202/]
2023-10-03 04:17:44,195 WARN  [storage.template.DownloadManagerImpl] (agentRequest-Handler-2:null) Post download installation was not completed for /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/4
2023-10-03 04:17:44,197 WARN  [storage.template.DownloadManagerImpl] (agentRequest-Handler-2:null) Post download installation was not completed for /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/202
.....
2023-10-03 04:17:49,170 INFO  [storage.template.DownloadManagerImpl] (pool-1-thread-2:null) Download Completion for jobId: 5b5d49d2-284f-4300-a428-1e9f38a7a8c6, status=UNRECOVERABLE_ERROR
2023-10-03 04:17:49,171 INFO  [storage.template.DownloadManagerImpl] (pool-1-thread-1:null) Download Completion for jobId: 6f7be7ed-259e-4ca3-b803-326ad779ae3b, status=UNRECOVERABLE_ERROR
2023-10-03 04:17:49,176 INFO  [storage.template.DownloadManagerImpl] (pool-1-thread-1:null) local: /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/4/dnld4779556823249392615tmp_, bytes=(0 bytes) 0, error=No route to host (Host unreachable), pct=0
2023-10-03 04:17:49,177 INFO  [storage.template.DownloadManagerImpl] (pool-1-thread-2:null) local: /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/202/dnld1894069453551272666tmp_, bytes=(0 bytes) 0, error=No route to host (Host unreachable), pct=0

thanks!!




-----Original Message-----
From: "Jithin Raju"<ji...@shapeblue.com>
To: "users@cloudstack.apache.org"<us...@cloudstack.apache.org>;
Cc:
Sent: 2023-10-03 (화) 15:03:39 (GMT+09:00)
Subject: Re: Management server not connected from SSVM

Hi Jaejong,

If the SSVM can connect the management server the SSVM agent should get connected, any errors you can see in the cloud.log in SSVM?

-Jithin

From: jaejong <cb...@naver.com>
Date: Tuesday, 3 October 2023 at 11:28 AM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Subject: Re: Management server not connected from SSVM
Thank tou Jithin!

The management server IP is currect.
I can ping to management server from SSVM, but can not to public IP of system VMs from management server.
There is no route on the SSVM.

Thanks again!!




-----Original Message-----
From: "Jithin Raju"<ji...@shapeblue.com>
To: "users@cloudstack.apache.org"<us...@cloudstack.apache.org>;
Cc:
Sent: 2023-10-03 (화) 14:04:53 (GMT+09:00)
Subject: Re: Management server not connected from SSVM

Hi Jaejong,

Could you verify whether the management server IP is correct in the global configuration parameter ‘host’?
Is there a route on the SSVM to route the management server IP via eth1?
Can you ping the management server IP from SSVM?

-Jithin

From: jaejong <cb...@naver.com>
Date: Tuesday, 3 October 2023 at 9:35 AM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Subject: Management server not connected from SSVM
I try tried install acs on rocky9.2, but I can't config network by nmcli for acs manuals.

I have experience acs 4.17.2 on rocky 8.7 successsfully.
So I try install acs 4.18.1 on rocky8.8.

But I can ping system VMs.
public ip status for system VMs are :
* ip is allocated status.
* stactic and source NAT is disabled.
* virtual route is not exist.

At management server,  netstat -tulpn | grep LISTEN report
8080,8250,9090 port are listening, But 8443 not.

I checked SSVM by sh ssvm-check.sh;

First DNS server is  8.8.8.8
PING 8.8.8.8 (8.8.8.8): 56 data bytes
64 bytes from 8.8.8.8: icmp_seq=0 ttl=115 time=27.206 ms
64 bytes from 8.8.8.8: icmp_seq=1 ttl=115 time=26.872 ms
--- 8.8.8.8 ping statistics ---
2 packets transmitted, 2 packets received, 0% packet loss
round-trip min/avg/max/stddev = 26.872/27.039/27.206/0.167 ms
Good: Can ping DNS server
================================================
Good: DNS resolves cloudstack.apache.org
================================================
nfs is currently mounted
Mount point is /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7
Good: Can write to mount point
================================================
Management server is 10.0.*. Checking connectivity.
ssvm-check.sh: 143: Syntax error: redirection unexpected

I want to add kubernetes ISO.

How can i fix this?

Thanks.

[Image removed by sender.]


Re: Management server not connected from SSVM

Posted by jaejong <cb...@naver.com>.
Hi Jithin Raju
I wonder it is right way to present log state as attached file.

I do'nt understand you said "I am assuming you are not using a hostname?"
For the port connectivity, see ip-listen-state file.

I send log files.

during installation configuration, I set stroage traffic ips as from 10.0.33.1 to 10.0.33.10
I  only add nfs server of 10.0.33.1 as secondary storage. but I see at cloud.log as follows;
Mon 02 Oct 2023 01:11:30 PM UTC Successfully setup storage network with STORAGE_IP:10.0.33.2, STORAGE_NETMASK:255.255.240.0, STORAGE_CIDR

except it, I can find any problems.

I hope you can help me.

Thanks a lot.

-----Original Message-----
From: "jaejong"<cb...@naver.com>
To: <us...@cloudstack.apache.org>;
Cc:
Sent: 2023-10-03 (화) 16:40:12 (GMT+09:00)
Subject: Re: Management server not connected from SSVM

I will reboot for clean log.
I will report server and host settig all.
Can i upload log and settings as file attached?

I need help for this. I will be back.


-----Original Message-----
From: "Jithin Raju"<ji...@shapeblue.com>
To: "users@cloudstack.apache.org"<us...@cloudstack.apache.org>;
Cc:
Sent: 2023-10-03 (화) 16:28:26 (GMT+09:00)
Subject: Re: Management server not connected from SSVM

Hi Jeojong,

Since you mentioned the management server IP is reachable from the SSVM I am not sure why this error should appear, can you check the port connectivity? I am assuming you are not using a hostname?

-Jithin

From: jaejong <cb...@naver.com>
Date: Tuesday, 3 October 2023 at 11:58 AM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Subject: Re: Management server not connected from SSVM
Hi  Jithin Raju
error messages from cloud.log:

2023-10-03 04:17:26,867 INFO  [utils.nio.NioClient] (main:null) Connecting to serverIP:8250
2023-10-03 04:17:29,935 ERROR [utils.nio.NioConnection] (main:null) Unable to initialize the threads.
java.net.NoRouteToHostException: No route to host
      at java.base/sun.nio.ch.Net.connect0(Native Method)
      at java.base/sun.nio.ch.Net.connect(Net.java:483)
      at java.base/sun.nio.ch.Net.connect(Net.java:472)
      at java.base/sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:692)
      at com.cloud.utils.nio.NioClient.init(NioClient.java:56)
      at com.cloud.utils.nio.NioConnection.start(NioConnection.java:95)
      at com.cloud.agent.Agent.start(Agent.java:283)
      at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:454)
      at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:431)
      at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:415)
      at com.cloud.agent.AgentShell.start(AgentShell.java:511)
      at com.cloud.agent.AgentShell.main(AgentShell.java:541)
2023-10-03 04:17:29,939 WARN  [cloud.agent.Agent] (main:null) NIO Connection Exception  com.cloud.utils.exception.NioConnectionException: No route to host
...
2023-10-03 04:17:37,999 INFO  [cloud.agent.Agent] (main:null) Attempted to connect to the server, but received an unexpected exception, trying again...
com.cloud.utils.exception.NioConnectionException: No route to host
      at com.cloud.utils.nio.NioConnection.start(NioConnection.java:101)
      at com.cloud.agent.Agent.start(Agent.java:294)
      at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:454)
      at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:431)
      at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:415)
      at com.cloud.agent.AgentShell.start(AgentShell.java:511)
      at com.cloud.agent.AgentShell.main(AgentShell.java:541)
Caused by: java.net.NoRouteToHostException: No route to host
      at java.base/sun.nio.ch.Net.connect0(Native Method)
      at java.base/sun.nio.ch.Net.connect(Net.java:483)
      at java.base/sun.nio.ch.Net.connect(Net.java:472)
      at java.base/sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:692)
      at com.cloud.utils.nio.NioClient.init(NioClient.java:56)
      at com.cloud.utils.nio.NioConnection.start(NioConnection.java:95)
      ... 6 more
.....
2023-10-03 04:17:44,187 INFO  [storage.template.DownloadManagerImpl] (agentRequest-Handler-2:null) found 3 templates[/mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/3/db2b01f1-5a4f-44b5-a0e7-bd2dac5c3b6e.qcow2, /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/4/, /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/202/]
2023-10-03 04:17:44,195 WARN  [storage.template.DownloadManagerImpl] (agentRequest-Handler-2:null) Post download installation was not completed for /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/4
2023-10-03 04:17:44,197 WARN  [storage.template.DownloadManagerImpl] (agentRequest-Handler-2:null) Post download installation was not completed for /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/202
.....
2023-10-03 04:17:49,170 INFO  [storage.template.DownloadManagerImpl] (pool-1-thread-2:null) Download Completion for jobId: 5b5d49d2-284f-4300-a428-1e9f38a7a8c6, status=UNRECOVERABLE_ERROR
2023-10-03 04:17:49,171 INFO  [storage.template.DownloadManagerImpl] (pool-1-thread-1:null) Download Completion for jobId: 6f7be7ed-259e-4ca3-b803-326ad779ae3b, status=UNRECOVERABLE_ERROR
2023-10-03 04:17:49,176 INFO  [storage.template.DownloadManagerImpl] (pool-1-thread-1:null) local: /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/4/dnld4779556823249392615tmp_, bytes=(0 bytes) 0, error=No route to host (Host unreachable), pct=0
2023-10-03 04:17:49,177 INFO  [storage.template.DownloadManagerImpl] (pool-1-thread-2:null) local: /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/202/dnld1894069453551272666tmp_, bytes=(0 bytes) 0, error=No route to host (Host unreachable), pct=0

thanks!!




-----Original Message-----
From: "Jithin Raju"<ji...@shapeblue.com>
To: "users@cloudstack.apache.org"<us...@cloudstack.apache.org>;
Cc:
Sent: 2023-10-03 (화) 15:03:39 (GMT+09:00)
Subject: Re: Management server not connected from SSVM

Hi Jaejong,

If the SSVM can connect the management server the SSVM agent should get connected, any errors you can see in the cloud.log in SSVM?

-Jithin

From: jaejong <cb...@naver.com>
Date: Tuesday, 3 October 2023 at 11:28 AM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Subject: Re: Management server not connected from SSVM
Thank tou Jithin!

The management server IP is currect.
I can ping to management server from SSVM, but can not to public IP of system VMs from management server.
There is no route on the SSVM.

Thanks again!!




-----Original Message-----
From: "Jithin Raju"<ji...@shapeblue.com>
To: "users@cloudstack.apache.org"<us...@cloudstack.apache.org>;
Cc:
Sent: 2023-10-03 (화) 14:04:53 (GMT+09:00)
Subject: Re: Management server not connected from SSVM

Hi Jaejong,

Could you verify whether the management server IP is correct in the global configuration parameter ‘host’?
Is there a route on the SSVM to route the management server IP via eth1?
Can you ping the management server IP from SSVM?

-Jithin

From: jaejong <cb...@naver.com>
Date: Tuesday, 3 October 2023 at 9:35 AM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Subject: Management server not connected from SSVM
I try tried install acs on rocky9.2, but I can't config network by nmcli for acs manuals.

I have experience acs 4.17.2 on rocky 8.7 successsfully.
So I try install acs 4.18.1 on rocky8.8.

But I can ping system VMs.
public ip status for system VMs are :
* ip is allocated status.
* stactic and source NAT is disabled.
* virtual route is not exist.

At management server,  netstat -tulpn | grep LISTEN report
8080,8250,9090 port are listening, But 8443 not.

I checked SSVM by sh ssvm-check.sh;

First DNS server is  8.8.8.8
PING 8.8.8.8 (8.8.8.8): 56 data bytes
64 bytes from 8.8.8.8: icmp_seq=0 ttl=115 time=27.206 ms
64 bytes from 8.8.8.8: icmp_seq=1 ttl=115 time=26.872 ms
--- 8.8.8.8 ping statistics ---
2 packets transmitted, 2 packets received, 0% packet loss
round-trip min/avg/max/stddev = 26.872/27.039/27.206/0.167 ms
Good: Can ping DNS server
================================================
Good: DNS resolves cloudstack.apache.org
================================================
nfs is currently mounted
Mount point is /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7
Good: Can write to mount point
================================================
Management server is 10.0.*. Checking connectivity.
ssvm-check.sh: 143: Syntax error: redirection unexpected

I want to add kubernetes ISO.

How can i fix this?

Thanks.



Re: Management server not connected from SSVM

Posted by jaejong <cb...@naver.com>.
I will reboot for clean log.
I will report server and host settig all.
Can i upload log and settings as file attached?

I need help for this. I will be back.


-----Original Message-----
From: "Jithin Raju"<ji...@shapeblue.com>
To: "users@cloudstack.apache.org"<us...@cloudstack.apache.org>;
Cc:
Sent: 2023-10-03 (화) 16:28:26 (GMT+09:00)
Subject: Re: Management server not connected from SSVM

Hi Jeojong,

Since you mentioned the management server IP is reachable from the SSVM I am not sure why this error should appear, can you check the port connectivity? I am assuming you are not using a hostname?

-Jithin

From: jaejong <cb...@naver.com>
Date: Tuesday, 3 October 2023 at 11:58 AM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Subject: Re: Management server not connected from SSVM
Hi  Jithin Raju
error messages from cloud.log:

2023-10-03 04:17:26,867 INFO  [utils.nio.NioClient] (main:null) Connecting to serverIP:8250
2023-10-03 04:17:29,935 ERROR [utils.nio.NioConnection] (main:null) Unable to initialize the threads.
java.net.NoRouteToHostException: No route to host
       at java.base/sun.nio.ch.Net.connect0(Native Method)
       at java.base/sun.nio.ch.Net.connect(Net.java:483)
       at java.base/sun.nio.ch.Net.connect(Net.java:472)
       at java.base/sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:692)
       at com.cloud.utils.nio.NioClient.init(NioClient.java:56)
       at com.cloud.utils.nio.NioConnection.start(NioConnection.java:95)
       at com.cloud.agent.Agent.start(Agent.java:283)
       at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:454)
       at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:431)
       at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:415)
       at com.cloud.agent.AgentShell.start(AgentShell.java:511)
       at com.cloud.agent.AgentShell.main(AgentShell.java:541)
2023-10-03 04:17:29,939 WARN  [cloud.agent.Agent] (main:null) NIO Connection Exception  com.cloud.utils.exception.NioConnectionException: No route to host
...
2023-10-03 04:17:37,999 INFO  [cloud.agent.Agent] (main:null) Attempted to connect to the server, but received an unexpected exception, trying again...
com.cloud.utils.exception.NioConnectionException: No route to host
       at com.cloud.utils.nio.NioConnection.start(NioConnection.java:101)
       at com.cloud.agent.Agent.start(Agent.java:294)
       at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:454)
       at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:431)
       at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:415)
       at com.cloud.agent.AgentShell.start(AgentShell.java:511)
       at com.cloud.agent.AgentShell.main(AgentShell.java:541)
Caused by: java.net.NoRouteToHostException: No route to host
       at java.base/sun.nio.ch.Net.connect0(Native Method)
       at java.base/sun.nio.ch.Net.connect(Net.java:483)
       at java.base/sun.nio.ch.Net.connect(Net.java:472)
       at java.base/sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:692)
       at com.cloud.utils.nio.NioClient.init(NioClient.java:56)
       at com.cloud.utils.nio.NioConnection.start(NioConnection.java:95)
       ... 6 more
.....
2023-10-03 04:17:44,187 INFO  [storage.template.DownloadManagerImpl] (agentRequest-Handler-2:null) found 3 templates[/mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/3/db2b01f1-5a4f-44b5-a0e7-bd2dac5c3b6e.qcow2, /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/4/, /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/202/]
2023-10-03 04:17:44,195 WARN  [storage.template.DownloadManagerImpl] (agentRequest-Handler-2:null) Post download installation was not completed for /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/4
2023-10-03 04:17:44,197 WARN  [storage.template.DownloadManagerImpl] (agentRequest-Handler-2:null) Post download installation was not completed for /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/202
.....
2023-10-03 04:17:49,170 INFO  [storage.template.DownloadManagerImpl] (pool-1-thread-2:null) Download Completion for jobId: 5b5d49d2-284f-4300-a428-1e9f38a7a8c6, status=UNRECOVERABLE_ERROR
2023-10-03 04:17:49,171 INFO  [storage.template.DownloadManagerImpl] (pool-1-thread-1:null) Download Completion for jobId: 6f7be7ed-259e-4ca3-b803-326ad779ae3b, status=UNRECOVERABLE_ERROR
2023-10-03 04:17:49,176 INFO  [storage.template.DownloadManagerImpl] (pool-1-thread-1:null) local: /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/4/dnld4779556823249392615tmp_, bytes=(0 bytes) 0, error=No route to host (Host unreachable), pct=0
2023-10-03 04:17:49,177 INFO  [storage.template.DownloadManagerImpl] (pool-1-thread-2:null) local: /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/202/dnld1894069453551272666tmp_, bytes=(0 bytes) 0, error=No route to host (Host unreachable), pct=0

thanks!!




-----Original Message-----
From: "Jithin Raju"<ji...@shapeblue.com>
To: "users@cloudstack.apache.org"<us...@cloudstack.apache.org>;
Cc:
Sent: 2023-10-03 (화) 15:03:39 (GMT+09:00)
Subject: Re: Management server not connected from SSVM

Hi Jaejong,

If the SSVM can connect the management server the SSVM agent should get connected, any errors you can see in the cloud.log in SSVM?

-Jithin

From: jaejong <cb...@naver.com>
Date: Tuesday, 3 October 2023 at 11:28 AM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Subject: Re: Management server not connected from SSVM
Thank tou Jithin!

The management server IP is currect.
I can ping to management server from SSVM, but can not to public IP of system VMs from management server.
There is no route on the SSVM.

Thanks again!!




-----Original Message-----
From: "Jithin Raju"<ji...@shapeblue.com>
To: "users@cloudstack.apache.org"<us...@cloudstack.apache.org>;
Cc:
Sent: 2023-10-03 (화) 14:04:53 (GMT+09:00)
Subject: Re: Management server not connected from SSVM

Hi Jaejong,

Could you verify whether the management server IP is correct in the global configuration parameter ‘host’?
Is there a route on the SSVM to route the management server IP via eth1?
Can you ping the management server IP from SSVM?

-Jithin

From: jaejong <cb...@naver.com>
Date: Tuesday, 3 October 2023 at 9:35 AM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Subject: Management server not connected from SSVM
I try tried install acs on rocky9.2, but I can't config network by nmcli for acs manuals.

I have experience acs 4.17.2 on rocky 8.7 successsfully.
So I try install acs 4.18.1 on rocky8.8.

But I can ping system VMs.
public ip status for system VMs are :
* ip is allocated status.
* stactic and source NAT is disabled.
* virtual route is not exist.

At management server,  netstat -tulpn | grep LISTEN report
8080,8250,9090 port are listening, But 8443 not.

I checked SSVM by sh ssvm-check.sh;

First DNS server is  8.8.8.8
PING 8.8.8.8 (8.8.8.8): 56 data bytes
64 bytes from 8.8.8.8: icmp_seq=0 ttl=115 time=27.206 ms
64 bytes from 8.8.8.8: icmp_seq=1 ttl=115 time=26.872 ms
--- 8.8.8.8 ping statistics ---
2 packets transmitted, 2 packets received, 0% packet loss
round-trip min/avg/max/stddev = 26.872/27.039/27.206/0.167 ms
Good: Can ping DNS server
================================================
Good: DNS resolves cloudstack.apache.org
================================================
nfs is currently mounted
Mount point is /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7
Good: Can write to mount point
================================================
Management server is 10.0.*. Checking connectivity.
ssvm-check.sh: 143: Syntax error: redirection unexpected

I want to add kubernetes ISO.

How can i fix this?

Thanks.



Re: Management server not connected from SSVM

Posted by Jithin Raju <ji...@shapeblue.com>.
Hi Jeojong,

Since you mentioned the management server IP is reachable from the SSVM I am not sure why this error should appear, can you check the port connectivity? I am assuming you are not using a hostname?

-Jithin

From: jaejong <cb...@naver.com>
Date: Tuesday, 3 October 2023 at 11:58 AM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Subject: Re: Management server not connected from SSVM
Hi  Jithin Raju
error messages from cloud.log:

2023-10-03 04:17:26,867 INFO  [utils.nio.NioClient] (main:null) Connecting to serverIP:8250
2023-10-03 04:17:29,935 ERROR [utils.nio.NioConnection] (main:null) Unable to initialize the threads.
java.net.NoRouteToHostException: No route to host
        at java.base/sun.nio.ch.Net.connect0(Native Method)
        at java.base/sun.nio.ch.Net.connect(Net.java:483)
        at java.base/sun.nio.ch.Net.connect(Net.java:472)
        at java.base/sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:692)
        at com.cloud.utils.nio.NioClient.init(NioClient.java:56)
        at com.cloud.utils.nio.NioConnection.start(NioConnection.java:95)
        at com.cloud.agent.Agent.start(Agent.java:283)
        at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:454)
        at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:431)
        at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:415)
        at com.cloud.agent.AgentShell.start(AgentShell.java:511)
        at com.cloud.agent.AgentShell.main(AgentShell.java:541)
2023-10-03 04:17:29,939 WARN  [cloud.agent.Agent] (main:null) NIO Connection Exception  com.cloud.utils.exception.NioConnectionException: No route to host
...
2023-10-03 04:17:37,999 INFO  [cloud.agent.Agent] (main:null) Attempted to connect to the server, but received an unexpected exception, trying again...
com.cloud.utils.exception.NioConnectionException: No route to host
        at com.cloud.utils.nio.NioConnection.start(NioConnection.java:101)
        at com.cloud.agent.Agent.start(Agent.java:294)
        at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:454)
        at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:431)
        at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:415)
        at com.cloud.agent.AgentShell.start(AgentShell.java:511)
        at com.cloud.agent.AgentShell.main(AgentShell.java:541)
Caused by: java.net.NoRouteToHostException: No route to host
        at java.base/sun.nio.ch.Net.connect0(Native Method)
        at java.base/sun.nio.ch.Net.connect(Net.java:483)
        at java.base/sun.nio.ch.Net.connect(Net.java:472)
        at java.base/sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:692)
        at com.cloud.utils.nio.NioClient.init(NioClient.java:56)
        at com.cloud.utils.nio.NioConnection.start(NioConnection.java:95)
        ... 6 more
.....
2023-10-03 04:17:44,187 INFO  [storage.template.DownloadManagerImpl] (agentRequest-Handler-2:null) found 3 templates[/mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/3/db2b01f1-5a4f-44b5-a0e7-bd2dac5c3b6e.qcow2, /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/4/, /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/202/]
2023-10-03 04:17:44,195 WARN  [storage.template.DownloadManagerImpl] (agentRequest-Handler-2:null) Post download installation was not completed for /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/4
2023-10-03 04:17:44,197 WARN  [storage.template.DownloadManagerImpl] (agentRequest-Handler-2:null) Post download installation was not completed for /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/202
.....
2023-10-03 04:17:49,170 INFO  [storage.template.DownloadManagerImpl] (pool-1-thread-2:null) Download Completion for jobId: 5b5d49d2-284f-4300-a428-1e9f38a7a8c6, status=UNRECOVERABLE_ERROR
2023-10-03 04:17:49,171 INFO  [storage.template.DownloadManagerImpl] (pool-1-thread-1:null) Download Completion for jobId: 6f7be7ed-259e-4ca3-b803-326ad779ae3b, status=UNRECOVERABLE_ERROR
2023-10-03 04:17:49,176 INFO  [storage.template.DownloadManagerImpl] (pool-1-thread-1:null) local: /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/4/dnld4779556823249392615tmp_, bytes=(0 bytes) 0, error=No route to host (Host unreachable), pct=0
2023-10-03 04:17:49,177 INFO  [storage.template.DownloadManagerImpl] (pool-1-thread-2:null) local: /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/202/dnld1894069453551272666tmp_, bytes=(0 bytes) 0, error=No route to host (Host unreachable), pct=0

thanks!!

 


-----Original Message-----
From: "Jithin Raju"<ji...@shapeblue.com>
To: "users@cloudstack.apache.org"<us...@cloudstack.apache.org>;
Cc:
Sent: 2023-10-03 (화) 15:03:39 (GMT+09:00)
Subject: Re: Management server not connected from SSVM

Hi Jaejong,

If the SSVM can connect the management server the SSVM agent should get connected, any errors you can see in the cloud.log in SSVM?

-Jithin

From: jaejong <cb...@naver.com>
Date: Tuesday, 3 October 2023 at 11:28 AM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Subject: Re: Management server not connected from SSVM
Thank tou Jithin!

The management server IP is currect.
I can ping to management server from SSVM, but can not to public IP of system VMs from management server.
There is no route on the SSVM.

Thanks again!!




-----Original Message-----
From: "Jithin Raju"<ji...@shapeblue.com>
To: "users@cloudstack.apache.org"<us...@cloudstack.apache.org>;
Cc:
Sent: 2023-10-03 (화) 14:04:53 (GMT+09:00)
Subject: Re: Management server not connected from SSVM

Hi Jaejong,

Could you verify whether the management server IP is correct in the global configuration parameter ‘host’?
Is there a route on the SSVM to route the management server IP via eth1?
Can you ping the management server IP from SSVM?

-Jithin

From: jaejong <cb...@naver.com>
Date: Tuesday, 3 October 2023 at 9:35 AM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Subject: Management server not connected from SSVM
I try tried install acs on rocky9.2, but I can't config network by nmcli for acs manuals.

I have experience acs 4.17.2 on rocky 8.7 successsfully.
So I try install acs 4.18.1 on rocky8.8.

But I can ping system VMs.
public ip status for system VMs are :
* ip is allocated status.
* stactic and source NAT is disabled.
* virtual route is not exist.

At management server,  netstat -tulpn | grep LISTEN report
8080,8250,9090 port are listening, But 8443 not.

I checked SSVM by sh ssvm-check.sh;

First DNS server is  8.8.8.8
PING 8.8.8.8 (8.8.8.8): 56 data bytes
64 bytes from 8.8.8.8: icmp_seq=0 ttl=115 time=27.206 ms
64 bytes from 8.8.8.8: icmp_seq=1 ttl=115 time=26.872 ms
--- 8.8.8.8 ping statistics ---
2 packets transmitted, 2 packets received, 0% packet loss
round-trip min/avg/max/stddev = 26.872/27.039/27.206/0.167 ms
Good: Can ping DNS server
================================================
Good: DNS resolves cloudstack.apache.org
================================================
nfs is currently mounted
Mount point is /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7
Good: Can write to mount point
================================================
Management server is 10.0.*. Checking connectivity.
ssvm-check.sh: 143: Syntax error: redirection unexpected

I want to add kubernetes ISO.

How can i fix this?

Thanks.



Re: Management server not connected from SSVM

Posted by jaejong <cb...@naver.com>.
Hi  Jithin Raju
error messages from cloud.log:

2023-10-03 04:17:26,867 INFO  [utils.nio.NioClient] (main:null) Connecting to serverIP:8250
2023-10-03 04:17:29,935 ERROR [utils.nio.NioConnection] (main:null) Unable to initialize the threads.
java.net.NoRouteToHostException: No route to host
        at java.base/sun.nio.ch.Net.connect0(Native Method)
        at java.base/sun.nio.ch.Net.connect(Net.java:483)
        at java.base/sun.nio.ch.Net.connect(Net.java:472)
        at java.base/sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:692)
        at com.cloud.utils.nio.NioClient.init(NioClient.java:56)
        at com.cloud.utils.nio.NioConnection.start(NioConnection.java:95)
        at com.cloud.agent.Agent.start(Agent.java:283)
        at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:454)
        at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:431)
        at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:415)
        at com.cloud.agent.AgentShell.start(AgentShell.java:511)
        at com.cloud.agent.AgentShell.main(AgentShell.java:541)
2023-10-03 04:17:29,939 WARN  [cloud.agent.Agent] (main:null) NIO Connection Exception  com.cloud.utils.exception.NioConnectionException: No route to host
...
2023-10-03 04:17:37,999 INFO  [cloud.agent.Agent] (main:null) Attempted to connect to the server, but received an unexpected exception, trying again...
com.cloud.utils.exception.NioConnectionException: No route to host
        at com.cloud.utils.nio.NioConnection.start(NioConnection.java:101)
        at com.cloud.agent.Agent.start(Agent.java:294)
        at com.cloud.agent.AgentShell.launchNewAgent(AgentShell.java:454)
        at com.cloud.agent.AgentShell.launchAgentFromClassInfo(AgentShell.java:431)
        at com.cloud.agent.AgentShell.launchAgent(AgentShell.java:415)
        at com.cloud.agent.AgentShell.start(AgentShell.java:511)
        at com.cloud.agent.AgentShell.main(AgentShell.java:541)
Caused by: java.net.NoRouteToHostException: No route to host
        at java.base/sun.nio.ch.Net.connect0(Native Method)
        at java.base/sun.nio.ch.Net.connect(Net.java:483)
        at java.base/sun.nio.ch.Net.connect(Net.java:472)
        at java.base/sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:692)
        at com.cloud.utils.nio.NioClient.init(NioClient.java:56)
        at com.cloud.utils.nio.NioConnection.start(NioConnection.java:95)
        ... 6 more
.....
2023-10-03 04:17:44,187 INFO  [storage.template.DownloadManagerImpl] (agentRequest-Handler-2:null) found 3 templates[/mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/3/db2b01f1-5a4f-44b5-a0e7-bd2dac5c3b6e.qcow2, /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/4/, /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/202/]
2023-10-03 04:17:44,195 WARN  [storage.template.DownloadManagerImpl] (agentRequest-Handler-2:null) Post download installation was not completed for /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/4
2023-10-03 04:17:44,197 WARN  [storage.template.DownloadManagerImpl] (agentRequest-Handler-2:null) Post download installation was not completed for /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/202
.....
2023-10-03 04:17:49,170 INFO  [storage.template.DownloadManagerImpl] (pool-1-thread-2:null) Download Completion for jobId: 5b5d49d2-284f-4300-a428-1e9f38a7a8c6, status=UNRECOVERABLE_ERROR
2023-10-03 04:17:49,171 INFO  [storage.template.DownloadManagerImpl] (pool-1-thread-1:null) Download Completion for jobId: 6f7be7ed-259e-4ca3-b803-326ad779ae3b, status=UNRECOVERABLE_ERROR
2023-10-03 04:17:49,176 INFO  [storage.template.DownloadManagerImpl] (pool-1-thread-1:null) local: /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/4/dnld4779556823249392615tmp_, bytes=(0 bytes) 0, error=No route to host (Host unreachable), pct=0
2023-10-03 04:17:49,177 INFO  [storage.template.DownloadManagerImpl] (pool-1-thread-2:null) local: /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7/template/tmpl/1/202/dnld1894069453551272666tmp_, bytes=(0 bytes) 0, error=No route to host (Host unreachable), pct=0

thanks!!

-----Original Message-----
From: "Jithin Raju"<ji...@shapeblue.com>
To: "users@cloudstack.apache.org"<us...@cloudstack.apache.org>;
Cc:
Sent: 2023-10-03 (화) 15:03:39 (GMT+09:00)
Subject: Re: Management server not connected from SSVM

Hi Jaejong,

If the SSVM can connect the management server the SSVM agent should get connected, any errors you can see in the cloud.log in SSVM?

-Jithin

From: jaejong <cb...@naver.com>
Date: Tuesday, 3 October 2023 at 11:28 AM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Subject: Re: Management server not connected from SSVM
Thank tou Jithin!

The management server IP is currect.
I can ping to management server from SSVM, but can not to public IP of system VMs from management server.
There is no route on the SSVM.

Thanks again!!




-----Original Message-----
From: "Jithin Raju"<ji...@shapeblue.com>
To: "users@cloudstack.apache.org"<us...@cloudstack.apache.org>;
Cc:
Sent: 2023-10-03 (화) 14:04:53 (GMT+09:00)
Subject: Re: Management server not connected from SSVM

Hi Jaejong,

Could you verify whether the management server IP is correct in the global configuration parameter ‘host’?
Is there a route on the SSVM to route the management server IP via eth1?
Can you ping the management server IP from SSVM?

-Jithin

From: jaejong <cb...@naver.com>
Date: Tuesday, 3 October 2023 at 9:35 AM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Subject: Management server not connected from SSVM
I try tried install acs on rocky9.2, but I can't config network by nmcli for acs manuals.

I have experience acs 4.17.2 on rocky 8.7 successsfully.
So I try install acs 4.18.1 on rocky8.8.

But I can ping system VMs.
public ip status for system VMs are :
* ip is allocated status.
* stactic and source NAT is disabled.
* virtual route is not exist.

At management server,  netstat -tulpn | grep LISTEN report
8080,8250,9090 port are listening, But 8443 not.

I checked SSVM by sh ssvm-check.sh;

First DNS server is  8.8.8.8
PING 8.8.8.8 (8.8.8.8): 56 data bytes
64 bytes from 8.8.8.8: icmp_seq=0 ttl=115 time=27.206 ms
64 bytes from 8.8.8.8: icmp_seq=1 ttl=115 time=26.872 ms
--- 8.8.8.8 ping statistics ---
2 packets transmitted, 2 packets received, 0% packet loss
round-trip min/avg/max/stddev = 26.872/27.039/27.206/0.167 ms
Good: Can ping DNS server
================================================
Good: DNS resolves cloudstack.apache.org
================================================
nfs is currently mounted
Mount point is /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7
Good: Can write to mount point
================================================
Management server is 10.0.*. Checking connectivity.
ssvm-check.sh: 143: Syntax error: redirection unexpected

I want to add kubernetes ISO.

How can i fix this?

Thanks.




Re: Management server not connected from SSVM

Posted by Jithin Raju <ji...@shapeblue.com>.
Hi Jaejong,

If the SSVM can connect the management server the SSVM agent should get connected, any errors you can see in the cloud.log in SSVM?

-Jithin

From: jaejong <cb...@naver.com>
Date: Tuesday, 3 October 2023 at 11:28 AM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Subject: Re: Management server not connected from SSVM
Thank tou Jithin!

The management server IP is currect.
I can ping to management server from SSVM, but can not to public IP of system VMs from management server.
There is no route on the SSVM.

Thanks again!!

 


-----Original Message-----
From: "Jithin Raju"<ji...@shapeblue.com>
To: "users@cloudstack.apache.org"<us...@cloudstack.apache.org>;
Cc:
Sent: 2023-10-03 (화) 14:04:53 (GMT+09:00)
Subject: Re: Management server not connected from SSVM

Hi Jaejong,

Could you verify whether the management server IP is correct in the global configuration parameter ‘host’?
Is there a route on the SSVM to route the management server IP via eth1?
Can you ping the management server IP from SSVM?

-Jithin

From: jaejong <cb...@naver.com>
Date: Tuesday, 3 October 2023 at 9:35 AM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Subject: Management server not connected from SSVM
I try tried install acs on rocky9.2, but I can't config network by nmcli for acs manuals.

I have experience acs 4.17.2 on rocky 8.7 successsfully.
So I try install acs 4.18.1 on rocky8.8.

But I can ping system VMs.
public ip status for system VMs are :
* ip is allocated status.
* stactic and source NAT is disabled.
* virtual route is not exist.

At management server,  netstat -tulpn | grep LISTEN report
8080,8250,9090 port are listening, But 8443 not.

I checked SSVM by sh ssvm-check.sh;

First DNS server is  8.8.8.8
PING 8.8.8.8 (8.8.8.8): 56 data bytes
64 bytes from 8.8.8.8: icmp_seq=0 ttl=115 time=27.206 ms
64 bytes from 8.8.8.8: icmp_seq=1 ttl=115 time=26.872 ms
--- 8.8.8.8 ping statistics ---
2 packets transmitted, 2 packets received, 0% packet loss
round-trip min/avg/max/stddev = 26.872/27.039/27.206/0.167 ms
Good: Can ping DNS server
================================================
Good: DNS resolves cloudstack.apache.org
================================================
nfs is currently mounted
Mount point is /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7
Good: Can write to mount point
================================================
Management server is 10.0.*. Checking connectivity.
ssvm-check.sh: 143: Syntax error: redirection unexpected

I want to add kubernetes ISO.

How can i fix this?

Thanks.




Re: Management server not connected from SSVM

Posted by jaejong <cb...@naver.com>.
Thank tou Jithin!

The management server IP is currect.
I can ping to management server from SSVM, but can not to public IP of system VMs from management server.
There is no route on the SSVM.

Thanks again!!

-----Original Message-----
From: "Jithin Raju"<ji...@shapeblue.com>
To: "users@cloudstack.apache.org"<us...@cloudstack.apache.org>;
Cc:
Sent: 2023-10-03 (화) 14:04:53 (GMT+09:00)
Subject: Re: Management server not connected from SSVM

Hi Jaejong,

Could you verify whether the management server IP is correct in the global configuration parameter ‘host’?
Is there a route on the SSVM to route the management server IP via eth1?
Can you ping the management server IP from SSVM?

-Jithin

From: jaejong <cb...@naver.com>
Date: Tuesday, 3 October 2023 at 9:35 AM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Subject: Management server not connected from SSVM
I try tried install acs on rocky9.2, but I can't config network by nmcli for acs manuals.

I have experience acs 4.17.2 on rocky 8.7 successsfully.
So I try install acs 4.18.1 on rocky8.8.

But I can ping system VMs.
public ip status for system VMs are :
* ip is allocated status.
* stactic and source NAT is disabled.
* virtual route is not exist.

At management server,  netstat -tulpn | grep LISTEN report
8080,8250,9090 port are listening, But 8443 not.

I checked SSVM by sh ssvm-check.sh;

First DNS server is  8.8.8.8
PING 8.8.8.8 (8.8.8.8): 56 data bytes
64 bytes from 8.8.8.8: icmp_seq=0 ttl=115 time=27.206 ms
64 bytes from 8.8.8.8: icmp_seq=1 ttl=115 time=26.872 ms
--- 8.8.8.8 ping statistics ---
2 packets transmitted, 2 packets received, 0% packet loss
round-trip min/avg/max/stddev = 26.872/27.039/27.206/0.167 ms
Good: Can ping DNS server
================================================
Good: DNS resolves cloudstack.apache.org
================================================
nfs is currently mounted
Mount point is /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7
Good: Can write to mount point
================================================
Management server is 10.0.*. Checking connectivity.
ssvm-check.sh: 143: Syntax error: redirection unexpected

I want to add kubernetes ISO.

How can i fix this?

Thanks.





Re: Management server not connected from SSVM

Posted by Jithin Raju <ji...@shapeblue.com>.
Hi Jaejong,

Could you verify whether the management server IP is correct in the global configuration parameter ‘host’?
Is there a route on the SSVM to route the management server IP via eth1?
Can you ping the management server IP from SSVM?

-Jithin

From: jaejong <cb...@naver.com>
Date: Tuesday, 3 October 2023 at 9:35 AM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Subject: Management server not connected from SSVM
I try tried install acs on rocky9.2, but I can't config network by nmcli for acs manuals.

I have experience acs 4.17.2 on rocky 8.7 successsfully.
So I try install acs 4.18.1 on rocky8.8.

But I can ping system VMs.
public ip status for system VMs are :
* ip is allocated status.
* stactic and source NAT is disabled.
* virtual route is not exist.

At management server,  netstat -tulpn | grep LISTEN report
8080,8250,9090 port are listening, But 8443 not.

I checked SSVM by sh ssvm-check.sh;

First DNS server is  8.8.8.8
PING 8.8.8.8 (8.8.8.8): 56 data bytes
64 bytes from 8.8.8.8: icmp_seq=0 ttl=115 time=27.206 ms
64 bytes from 8.8.8.8: icmp_seq=1 ttl=115 time=26.872 ms
--- 8.8.8.8 ping statistics ---
2 packets transmitted, 2 packets received, 0% packet loss
round-trip min/avg/max/stddev = 26.872/27.039/27.206/0.167 ms
Good: Can ping DNS server
================================================
Good: DNS resolves cloudstack.apache.org
================================================
nfs is currently mounted
Mount point is /mnt/SecStorage/7d99d8d2-539f-3850-8a7c-7ec93eec7ea7
Good: Can write to mount point
================================================
Management server is 10.0.*. Checking connectivity.
ssvm-check.sh: 143: Syntax error: redirection unexpected

I want to add kubernetes ISO.

How can i fix this?

Thanks.