You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by Muhammad Adeel Zahid <16...@lums.edu.pk> on 2017/04/18 16:14:37 UTC
Trouble Adding Ubuntu-KVM hosts on Cloudstack
Hi Guys,
Few weeks ago, I installed cloudsack management on one machine and KVM on other machine. Both were using CentOS 6. All is working fine with these two machines. Now, I installed ubuntu and KVM on third machine and wanted to add it to the cluster but I never seem to be able to do it. I always get "failed adding host" message.
I followed http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/4.9/hypervisor/kvm.htmlfor KVM installation on ubuntu. The only difference is that, I don't have eth0 interface. The only ethernet interface showing in my machine is enso1. So I replaced every occurance of eth0 with enso1? I don't know if that might be creating problem?
And the following seems to be the relevant portion from management-server.log
2017-04-18 20:56:50,340 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done executing cpu/ram capacity update
2017-04-18 20:56:50,340 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Executing storage capacity update
2017-04-18 20:56:50,343 DEBUG [c.c.s.StorageManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Found storage pool Primary 1 of type NetworkFilesystem with overprovisioning factor 2
2017-04-18 20:56:50,343 DEBUG [c.c.s.StorageManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Total over provisioned capacity calculated is 2 * 52710866944
2017-04-18 20:56:50,343 DEBUG [c.c.s.StorageManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Total over provisioned capacity of the pool Primary 1 id: 1 is 105421733888
2017-04-18 20:56:50,407 DEBUG [c.c.s.StorageManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Successfully set Capacity - 105421733888 for capacity type - 3 , DataCenterId - 1, HostOrPoolId - 1, PodId null
2017-04-18 20:56:50,407 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done executing storage capacity update
2017-04-18 20:56:50,407 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Executing capacity updates for public ip and Vlans
2017-04-18 20:56:50,409 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done capacity updates for public ip and Vlans
2017-04-18 20:56:50,409 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Executing capacity updates for private ip
2017-04-18 20:56:50,410 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done executing capacity updates for private ip
2017-04-18 20:56:50,410 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done recalculating system capacity
2017-04-18 20:56:50,416 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done running Capacity Checker ...
2017-04-18 20:56:50,617 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-bc905976) (logid:e7d551f4) Found 0 routers to update status.
2017-04-18 20:56:50,619 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-bc905976) (logid:e7d551f4) Found 0 VPC networks to update Redundant State.
2017-04-18 20:56:50,621 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-bc905976) (logid:e7d551f4) Found 0 networks to update RvR status.
2017-04-18 20:56:50,990 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-478: Processing Seq 5-478: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-18 20:56:51,057 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-478: Sending Seq 5-478: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-18 20:56:59,715 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-e043b5e1) (logid:0203bb00) Begin cleanup expired async-jobs
2017-04-18 20:56:59,717 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-e043b5e1) (logid:0203bb00) End cleanup expired async-jobs
2017-04-18 20:56:59,963 DEBUG [c.c.h.k.d.LibvirtServerDiscoverer] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) Timeout, to wait for the host connecting to mgt svr, assuming it is failed
2017-04-18 20:56:59,963 WARN [c.c.r.ResourceManagerImpl] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) Unable to find the server resources at http://10.0.0.5
2017-04-18 20:56:59,964 INFO [c.c.u.e.CSExceptionErrorCode] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) Could not find exception: com.cloud.exception.DiscoveryException in error code list for exceptions
2017-04-18 20:56:59,964 WARN [o.a.c.a.c.a.h.AddHostCmd] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) Exception:
com.cloud.exception.DiscoveryException: Unable to add the host
at com.cloud.resource.ResourceManagerImpl.discoverHostsFull(ResourceManagerImpl.java:806)
at com.cloud.resource.ResourceManagerImpl.discoverHosts(ResourceManagerImpl.java:598)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at com.sun.proxy.$Proxy160.discoverHosts(Unknown Source)
at org.apache.cloudstack.api.command.admin.host.AddHostCmd.execute(AddHostCmd.java:142)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
at com.cloud.api.ApiServer.queueCommand(ApiServer.java:709)
at com.cloud.api.ApiServer.handleRequest(ApiServer.java:533)
at com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:299)
at com.cloud.api.ApiServlet$1.run(ApiServlet.java:129)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:126)
at com.cloud.api.ApiServlet.doPost(ApiServlet.java:93)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:643)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:723)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:299)
at org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:896)
at org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:732)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2277)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2017-04-18 20:56:59,964 INFO [c.c.a.ApiServer] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) Unable to add the host
2017-04-18 20:56:59,965 DEBUG [c.c.a.ApiServlet] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) ===END=== 10.0.0.2 -- POST command=addHost&response=json
2017-04-18 20:57:00,988 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-14:null) (logid:) SeqA 5-479: Processing Seq 5-479: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-18 20:57:01,074 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-14:null) (logid:) SeqA 5-479: Sending Seq 5-479: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-18 20:57:09,465 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-15:null) (logid:) Ping from 5(v-6-VM)
2017-04-18 20:57:09,647 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-1:null) (logid:) Ping from 3(s-2-VM)
2017-04-18 20:57:09,719 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-b38b767a) (logid:5b5de7b7) Begin cleanup expired async-jobs
2017-04-18 20:57:09,725 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-b38b767a) (logid:5b5de7b7) End cleanup expired async-jobs
2017-04-18 20:57:10,928 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-db45f56a) (logid:a742d33f) Zone 1 is ready to launch secondary storage VM
2017-04-18 20:57:10,999 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-892e3eec) (logid:739e8590) Zone 1 is ready to launch console proxy
2017-04-18 20:57:11,030 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-9:null) (logid:) SeqA 5-481: Processing Seq 5-481: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-18 20:57:11,150 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-9:null) (logid:) SeqA 5-481: Sending Seq 5-481: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-18 20:57:15,992 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-2:null) (logid:) SeqA 5-482: Processing Seq 5-482: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-18 20:57:16,067 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-2:null) (logid:) SeqA 5-482: Sending Seq 5-482: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-18 20:57:19,719 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-0d968653) (logid:74a5d87b) Begin cleanup expired async-jobs
2017-04-18 20:57:19,725 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-0d968653) (logid:74a5d87b) End cleanup expired async-jobs
2017-04-18 20:57:19,944 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-80589e90) (logid:80d37fa8) Found 0 routers to update status.
2017-04-18 20:57:19,946 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-80589e90) (logid:80d37fa8) Found 0 VPC networks to update Redundant State.
Is there a way, we can check if a host is ready to be added to cluster before adding it from cloudstack management UI?
Regards
Adeel
Host KVM Installation — Apache CloudStack Installation ...<http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/4.9/hypervisor/kvm.html>
docs.cloudstack.apache.org
KVM Installation Overview¶ If you want to use the Linux Kernel Virtual Machine (KVM) hypervisor to run guest virtual machines, install KVM on the host(s) in your cloud.
Re: Trouble Adding Ubuntu-KVM hosts on Cloudstack
Posted by Muhammad Adeel Zahid <16...@lums.edu.pk>.
Tried with Ubuntu 14.04.5. Installation process went smooth except the network configuration for eth0.100, eth0.200 and eth0.300. Following the said configuration from http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/4.9/hypervisor/kvm.htmlcaused my network to halt. it was not able to ping even within LAN. So I used network setup from http://www.greenhills.co.uk/2013/08/30/cloudstack-single-server-on-ubuntu-with-kvm.html that resolved network connectivity issue. After that, when I tried to add the host from cloudstack management, I was unable to do so and presented with "unable to add Host" message. Below are some relevant logs from management server
2017-04-19 02:44:35,829 DEBUG [c.c.s.StatsCollector] (StatsCollector-1:ctx-799381b1) (logid:8caa0f54) AutoScaling Monitor is running...
[root@cld adeel]# tail /var/log/cloudstack/management/management-server.log
2017-04-19 02:44:29,866 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-65eedde4) (logid:f2969bb6) End cleanup expired async-jobs
2017-04-19 02:44:34,357 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-10:null) (logid:) SeqA 5-3580: Processing Seq 5-3580: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:44:34,416 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-10:null) (logid:) SeqA 5-3580: Sending Seq 5-3580: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:44:35,829 DEBUG [c.c.s.StatsCollector] (StatsCollector-1:ctx-799381b1) (logid:8caa0f54) AutoScaling Monitor is running...
2017-04-19 02:44:39,359 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-6:null) (logid:) SeqA 5-3581: Processing Seq 5-3581: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:44:39,433 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-6:null) (logid:) SeqA 5-3581: Sending Seq 5-3581: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:44:39,868 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-454e4dff) (logid:e9fa8887) Begin cleanup expired async-jobs
2017-04-19 02:44:39,874 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-454e4dff) (logid:e9fa8887) End cleanup expired async-jobs
2017-04-19 02:44:41,065 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-2bd8dde6) (logid:e67ccfed) Zone 1 is ready to launch secondary storage VM
2017-04-19 02:44:41,142 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-fef56e24) (logid:2a05d8c8) Zone 1 is ready to launch console proxy
[root@cld adeel]# tail /var/log/cloudstack/management/management-server.log
2017-04-19 02:44:29,866 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-65eedde4) (logid:f2969bb6) End cleanup expired async-jobs
2017-04-19 02:44:34,357 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-10:null) (logid:) SeqA 5-3580: Processing Seq 5-3580: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:44:34,416 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-10:null) (logid:) SeqA 5-3580: Sending Seq 5-3580: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:44:35,829 DEBUG [c.c.s.StatsCollector] (StatsCollector-1:ctx-799381b1) (logid:8caa0f54) AutoScaling Monitor is running...
2017-04-19 02:44:39,359 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-6:null) (logid:) SeqA 5-3581: Processing Seq 5-3581: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:44:39,433 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-6:null) (logid:) SeqA 5-3581: Sending Seq 5-3581: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:44:39,868 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-454e4dff) (logid:e9fa8887) Begin cleanup expired async-jobs
2017-04-19 02:44:39,874 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-454e4dff) (logid:e9fa8887) End cleanup expired async-jobs
2017-04-19 02:44:41,065 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-2bd8dde6) (logid:e67ccfed) Zone 1 is ready to launch secondary storage VM
2017-04-19 02:44:41,142 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-fef56e24) (logid:2a05d8c8) Zone 1 is ready to launch console proxy
[root@cld adeel]# tail /var/log/cloudstack/management/management-server.log
2017-04-19 02:44:39,874 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-454e4dff) (logid:e9fa8887) End cleanup expired async-jobs
2017-04-19 02:44:41,065 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-2bd8dde6) (logid:e67ccfed) Zone 1 is ready to launch secondary storage VM
2017-04-19 02:44:41,142 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-fef56e24) (logid:2a05d8c8) Zone 1 is ready to launch console proxy
2017-04-19 02:44:49,358 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-3582: Processing Seq 5-3582: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:44:49,426 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-3582: Sending Seq 5-3582: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:44:49,864 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-9d4271b6) (logid:0434dde6) Begin cleanup expired async-jobs
2017-04-19 02:44:49,865 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-9d4271b6) (logid:0434dde6) End cleanup expired async-jobs
2017-04-19 02:44:50,093 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 routers to update status.
2017-04-19 02:44:50,095 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 VPC networks to update Redundant State.
2017-04-19 02:44:50,097 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 networks to update RvR status.
[root@cld adeel]# tail /var/log/cloudstack/management/management-server.log
2017-04-19 02:44:49,358 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-3582: Processing Seq 5-3582: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:44:49,426 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-3582: Sending Seq 5-3582: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:44:49,864 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-9d4271b6) (logid:0434dde6) Begin cleanup expired async-jobs
2017-04-19 02:44:49,865 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-9d4271b6) (logid:0434dde6) End cleanup expired async-jobs
2017-04-19 02:44:50,093 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 routers to update status.
2017-04-19 02:44:50,095 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 VPC networks to update Redundant State.
2017-04-19 02:44:50,097 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 networks to update RvR status.
2017-04-19 02:44:50,765 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-9ff9faaa) (logid:7ad30c56) Found 0 routers to update status.
2017-04-19 02:44:50,766 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-9ff9faaa) (logid:7ad30c56) Found 0 VPC networks to update Redundant State.
2017-04-19 02:44:50,766 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-9ff9faaa) (logid:7ad30c56) Found 0 networks to update RvR status.
[root@cld adeel]# tail /var/log/cloudstack/management/management-server.log
2017-04-19 02:44:49,358 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-3582: Processing Seq 5-3582: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:44:49,426 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-3582: Sending Seq 5-3582: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:44:49,864 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-9d4271b6) (logid:0434dde6) Begin cleanup expired async-jobs
2017-04-19 02:44:49,865 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-9d4271b6) (logid:0434dde6) End cleanup expired async-jobs
2017-04-19 02:44:50,093 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 routers to update status.
2017-04-19 02:44:50,095 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 VPC networks to update Redundant State.
2017-04-19 02:44:50,097 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 networks to update RvR status.
2017-04-19 02:44:50,765 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-9ff9faaa) (logid:7ad30c56) Found 0 routers to update status.
2017-04-19 02:44:50,766 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-9ff9faaa) (logid:7ad30c56) Found 0 VPC networks to update Redundant State.
2017-04-19 02:44:50,766 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-9ff9faaa) (logid:7ad30c56) Found 0 networks to update RvR status.
[root@cld adeel]# tail /var/log/cloudstack/management/management-server.log
2017-04-19 02:44:49,358 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-3582: Processing Seq 5-3582: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:44:49,426 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-3582: Sending Seq 5-3582: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:44:49,864 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-9d4271b6) (logid:0434dde6) Begin cleanup expired async-jobs
2017-04-19 02:44:49,865 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-9d4271b6) (logid:0434dde6) End cleanup expired async-jobs
2017-04-19 02:44:50,093 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 routers to update status.
2017-04-19 02:44:50,095 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 VPC networks to update Redundant State.
2017-04-19 02:44:50,097 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 networks to update RvR status.
2017-04-19 02:44:50,765 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-9ff9faaa) (logid:7ad30c56) Found 0 routers to update status.
2017-04-19 02:44:50,766 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-9ff9faaa) (logid:7ad30c56) Found 0 VPC networks to update Redundant State.
2017-04-19 02:44:50,766 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-9ff9faaa) (logid:7ad30c56) Found 0 networks to update RvR status.
[root@cld adeel]# tail /var/log/cloudstack/management/management-server.log
2017-04-19 02:44:49,358 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-3582: Processing Seq 5-3582: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:44:49,426 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-3582: Sending Seq 5-3582: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:44:49,864 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-9d4271b6) (logid:0434dde6) Begin cleanup expired async-jobs
2017-04-19 02:44:49,865 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-9d4271b6) (logid:0434dde6) End cleanup expired async-jobs
2017-04-19 02:44:50,093 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 routers to update status.
2017-04-19 02:44:50,095 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 VPC networks to update Redundant State.
2017-04-19 02:44:50,097 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 networks to update RvR status.
2017-04-19 02:44:50,765 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-9ff9faaa) (logid:7ad30c56) Found 0 routers to update status.
2017-04-19 02:44:50,766 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-9ff9faaa) (logid:7ad30c56) Found 0 VPC networks to update Redundant State.
2017-04-19 02:44:50,766 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-9ff9faaa) (logid:7ad30c56) Found 0 networks to update RvR status.
[root@cld adeel]# tail /var/log/cloudstack/management/management-server.log
2017-04-19 02:44:49,358 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-3582: Processing Seq 5-3582: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:44:49,426 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-3582: Sending Seq 5-3582: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:44:49,864 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-9d4271b6) (logid:0434dde6) Begin cleanup expired async-jobs
2017-04-19 02:44:49,865 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-9d4271b6) (logid:0434dde6) End cleanup expired async-jobs
2017-04-19 02:44:50,093 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 routers to update status.
2017-04-19 02:44:50,095 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 VPC networks to update Redundant State.
2017-04-19 02:44:50,097 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 networks to update RvR status.
2017-04-19 02:44:50,765 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-9ff9faaa) (logid:7ad30c56) Found 0 routers to update status.
2017-04-19 02:44:50,766 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-9ff9faaa) (logid:7ad30c56) Found 0 VPC networks to update Redundant State.
2017-04-19 02:44:50,766 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-9ff9faaa) (logid:7ad30c56) Found 0 networks to update RvR status.
[root@cld adeel]# tail /var/log/cloudstack/management/management-server.log
2017-04-19 02:44:49,358 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-3582: Processing Seq 5-3582: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:44:49,426 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-3582: Sending Seq 5-3582: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:44:49,864 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-9d4271b6) (logid:0434dde6) Begin cleanup expired async-jobs
2017-04-19 02:44:49,865 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-9d4271b6) (logid:0434dde6) End cleanup expired async-jobs
2017-04-19 02:44:50,093 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 routers to update status.
2017-04-19 02:44:50,095 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 VPC networks to update Redundant State.
2017-04-19 02:44:50,097 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 networks to update RvR status.
2017-04-19 02:44:50,765 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-9ff9faaa) (logid:7ad30c56) Found 0 routers to update status.
2017-04-19 02:44:50,766 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-9ff9faaa) (logid:7ad30c56) Found 0 VPC networks to update Redundant State.
2017-04-19 02:44:50,766 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-9ff9faaa) (logid:7ad30c56) Found 0 networks to update RvR status.
[root@cld adeel]# tail /var/log/cloudstack/management/management-server.log
2017-04-19 02:44:49,358 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-3582: Processing Seq 5-3582: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:44:49,426 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-3582: Sending Seq 5-3582: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:44:49,864 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-9d4271b6) (logid:0434dde6) Begin cleanup expired async-jobs
2017-04-19 02:44:49,865 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-9d4271b6) (logid:0434dde6) End cleanup expired async-jobs
2017-04-19 02:44:50,093 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 routers to update status.
2017-04-19 02:44:50,095 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 VPC networks to update Redundant State.
2017-04-19 02:44:50,097 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 networks to update RvR status.
2017-04-19 02:44:50,765 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-9ff9faaa) (logid:7ad30c56) Found 0 routers to update status.
2017-04-19 02:44:50,766 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-9ff9faaa) (logid:7ad30c56) Found 0 VPC networks to update Redundant State.
2017-04-19 02:44:50,766 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-9ff9faaa) (logid:7ad30c56) Found 0 networks to update RvR status.
[root@cld adeel]# tail /var/log/cloudstack/management/management-server.log
2017-04-19 02:44:49,358 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-3582: Processing Seq 5-3582: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:44:49,426 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-3582: Sending Seq 5-3582: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:44:49,864 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-9d4271b6) (logid:0434dde6) Begin cleanup expired async-jobs
2017-04-19 02:44:49,865 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-9d4271b6) (logid:0434dde6) End cleanup expired async-jobs
2017-04-19 02:44:50,093 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 routers to update status.
2017-04-19 02:44:50,095 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 VPC networks to update Redundant State.
2017-04-19 02:44:50,097 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 networks to update RvR status.
2017-04-19 02:44:50,765 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-9ff9faaa) (logid:7ad30c56) Found 0 routers to update status.
2017-04-19 02:44:50,766 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-9ff9faaa) (logid:7ad30c56) Found 0 VPC networks to update Redundant State.
2017-04-19 02:44:50,766 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-9ff9faaa) (logid:7ad30c56) Found 0 networks to update RvR status.
[root@cld adeel]# tail /var/log/cloudstack/management/management-server.log
2017-04-19 02:44:50,093 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 routers to update status.
2017-04-19 02:44:50,095 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 VPC networks to update Redundant State.
2017-04-19 02:44:50,097 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 networks to update RvR status.
2017-04-19 02:44:50,765 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-9ff9faaa) (logid:7ad30c56) Found 0 routers to update status.
2017-04-19 02:44:50,766 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-9ff9faaa) (logid:7ad30c56) Found 0 VPC networks to update Redundant State.
2017-04-19 02:44:50,766 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-9ff9faaa) (logid:7ad30c56) Found 0 networks to update RvR status.
2017-04-19 02:44:58,372 DEBUG [c.c.s.StatsCollector] (StatsCollector-5:ctx-a9513d2d) (logid:1a7e1065) HostStatsCollector is running...
2017-04-19 02:44:58,416 DEBUG [c.c.a.t.Request] (StatsCollector-5:ctx-a9513d2d) (logid:1a7e1065) Seq 1-5412200852192494809: Received: { Ans: , MgmtId: 187757519710468, via: 1(cld), Ver: v1, Flags: 10, { GetHostStatsAnswer } }
2017-04-19 02:44:59,360 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-14:null) (logid:) SeqA 5-3583: Processing Seq 5-3583: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:44:59,428 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-14:null) (logid:) SeqA 5-3583: Sending Seq 5-3583: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
[root@cld adeel]# tail /var/log/cloudstack/management/management-server.log
2017-04-19 02:44:50,097 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-cb60db0d) (logid:75619a3d) Found 0 networks to update RvR status.
2017-04-19 02:44:50,765 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-9ff9faaa) (logid:7ad30c56) Found 0 routers to update status.
2017-04-19 02:44:50,766 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-9ff9faaa) (logid:7ad30c56) Found 0 VPC networks to update Redundant State.
2017-04-19 02:44:50,766 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-9ff9faaa) (logid:7ad30c56) Found 0 networks to update RvR status.
2017-04-19 02:44:58,372 DEBUG [c.c.s.StatsCollector] (StatsCollector-5:ctx-a9513d2d) (logid:1a7e1065) HostStatsCollector is running...
2017-04-19 02:44:58,416 DEBUG [c.c.a.t.Request] (StatsCollector-5:ctx-a9513d2d) (logid:1a7e1065) Seq 1-5412200852192494809: Received: { Ans: , MgmtId: 187757519710468, via: 1(cld), Ver: v1, Flags: 10, { GetHostStatsAnswer } }
2017-04-19 02:44:59,360 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-14:null) (logid:) SeqA 5-3583: Processing Seq 5-3583: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:44:59,428 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-14:null) (logid:) SeqA 5-3583: Sending Seq 5-3583: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:44:59,864 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-12b7d21a) (logid:7e4d40e1) Begin cleanup expired async-jobs
2017-04-19 02:44:59,865 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-12b7d21a) (logid:7e4d40e1) End cleanup expired async-jobs
[root@cld adeel]# tail /var/log/cloudstack/management/management-server.log
at org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:896)
at org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:732)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2277)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2017-04-19 02:45:01,694 INFO [c.c.a.ApiServer] (catalina-exec-10:ctx-26abd251 ctx-e8bc5086) (logid:5eeb9265) Unable to add the host
2017-04-19 02:45:01,695 DEBUG [c.c.a.ApiServlet] (catalina-exec-10:ctx-26abd251 ctx-e8bc5086) (logid:5eeb9265) ===END=== 10.0.0.2 -- POST command=addHost&response=json
2017-04-19 02:45:04,361 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-11:null) (logid:) SeqA 5-3584: Processing Seq 5-3584: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:45:04,437 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-11:null) (logid:) SeqA 5-3584: Sending Seq 5-3584: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
[root@cld adeel]# tail /var/log/cloudstack/management/management-server.log
2017-04-19 02:45:50,097 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-224aadbf) (logid:2db6a77a) Found 0 networks to update RvR status.
2017-04-19 02:45:50,766 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-4cba63f6) (logid:84cf67a9) Found 0 routers to update status.
2017-04-19 02:45:50,767 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-4cba63f6) (logid:84cf67a9) Found 0 VPC networks to update Redundant State.
2017-04-19 02:45:50,768 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-4cba63f6) (logid:84cf67a9) Found 0 networks to update RvR status.
2017-04-19 02:45:54,364 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-3591: Processing Seq 5-3591: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:45:54,444 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-3591: Sending Seq 5-3591: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:45:58,416 DEBUG [c.c.s.StatsCollector] (StatsCollector-4:ctx-84b87ee4) (logid:13085567) HostStatsCollector is running...
2017-04-19 02:45:58,462 DEBUG [c.c.a.t.Request] (StatsCollector-4:ctx-84b87ee4) (logid:13085567) Seq 1-5412200852192494812: Received: { Ans: , MgmtId: 187757519710468, via: 1(cld), Ver: v1, Flags: 10, { GetHostStatsAnswer } }
2017-04-19 02:45:59,868 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-be156abf) (logid:978c9e53) Begin cleanup expired async-jobs
2017-04-19 02:45:59,874 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-be156abf) (logid:978c9e53) End cleanup expired async-jobs
[root@cld adeel]# tail 100 /var/log/cloudstack/management/management-server.log
tail: cannot open `100' for reading: No such file or directory
==> /var/log/cloudstack/management/management-server.log <==
2017-04-19 02:47:29,423 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-4:null) (logid:) SeqA 5-3604: Sending Seq 5-3604: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:47:29,868 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-7b575179) (logid:ad723b88) Begin cleanup expired async-jobs
2017-04-19 02:47:29,874 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-7b575179) (logid:ad723b88) End cleanup expired async-jobs
2017-04-19 02:47:35,835 DEBUG [c.c.s.StatsCollector] (StatsCollector-5:ctx-ba3d04c5) (logid:c8163a63) AutoScaling Monitor is running...
2017-04-19 02:47:39,374 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-5:null) (logid:) SeqA 5-3605: Processing Seq 5-3605: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:47:39,449 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-5:null) (logid:) SeqA 5-3605: Sending Seq 5-3605: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:47:39,868 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-e162f3d2) (logid:bc58a6d3) Begin cleanup expired async-jobs
2017-04-19 02:47:39,873 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-e162f3d2) (logid:bc58a6d3) End cleanup expired async-jobs
2017-04-19 02:47:41,076 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-128f6013) (logid:ae0ebdd0) Zone 1 is ready to launch secondary storage VM
2017-04-19 02:47:41,137 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-cb010dc6) (logid:8122266d) Zone 1 is ready to launch console proxy
[root@cld adeel]# tail --lines=100 /var/log/cloudstack/management/management-server.log
2017-04-19 02:47:49,868 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-d8c8d0cf) (logid:b916c907) Begin cleanup expired async-jobs
2017-04-19 02:47:49,874 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-d8c8d0cf) (logid:b916c907) End cleanup expired async-jobs
2017-04-19 02:47:50,093 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-5679b40a) (logid:f0fd7928) Found 0 routers to update status.
2017-04-19 02:47:50,095 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-5679b40a) (logid:f0fd7928) Found 0 VPC networks to update Redundant State.
2017-04-19 02:47:50,097 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-5679b40a) (logid:f0fd7928) Found 0 networks to update RvR status.
2017-04-19 02:47:50,766 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-795ef873) (logid:e963790e) Found 0 routers to update status.
2017-04-19 02:47:50,768 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-795ef873) (logid:e963790e) Found 0 VPC networks to update Redundant State.
2017-04-19 02:47:50,770 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-795ef873) (logid:e963790e) Found 0 networks to update RvR status.
2017-04-19 02:47:54,376 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-10:null) (logid:) SeqA 5-3607: Processing Seq 5-3607: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:47:54,459 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-10:null) (logid:) SeqA 5-3607: Sending Seq 5-3607: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:47:58,509 DEBUG [c.c.s.StatsCollector] (StatsCollector-6:ctx-e3fed8ca) (logid:e49ac0b9) HostStatsCollector is running...
2017-04-19 02:47:58,555 DEBUG [c.c.a.t.Request] (StatsCollector-6:ctx-e3fed8ca) (logid:e49ac0b9) Seq 1-5412200852192494818: Received: { Ans: , MgmtId: 187757519710468, via: 1(cld), Ver: v1, Flags: 10, { GetHostStatsAnswer } }
2017-04-19 02:47:59,872 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-d1e2b72a) (logid:a9631656) Begin cleanup expired async-jobs
2017-04-19 02:47:59,879 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-d1e2b72a) (logid:a9631656) End cleanup expired async-jobs
2017-04-19 02:48:04,377 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-3608: Processing Seq 5-3608: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:48:04,485 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-3608: Sending Seq 5-3608: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:48:08,516 DEBUG [c.c.s.StatsCollector] (StatsCollector-3:ctx-d1d9c892) (logid:281da7f8) VmStatsCollector is running...
2017-04-19 02:48:08,628 DEBUG [c.c.a.t.Request] (StatsCollector-3:ctx-d1d9c892) (logid:281da7f8) Seq 1-5412200852192494819: Received: { Ans: , MgmtId: 187757519710468, via: 1(cld), Ver: v1, Flags: 10, { GetVmStatsAnswer } }
2017-04-19 02:48:09,610 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-14:null) (logid:) Ping from 5(v-6-VM)
2017-04-19 02:48:09,872 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-55a73a76) (logid:f1ea690f) Begin cleanup expired async-jobs
2017-04-19 02:48:09,878 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-55a73a76) (logid:f1ea690f) End cleanup expired async-jobs
2017-04-19 02:48:10,073 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-11:null) (logid:) Ping from 3(s-2-VM)
2017-04-19 02:48:11,065 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-51a407cb) (logid:f8c2bd7a) Zone 1 is ready to launch secondary storage VM
2017-04-19 02:48:11,146 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-8a542b73) (logid:f2cec347) Zone 1 is ready to launch console proxy
2017-04-19 02:48:14,418 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-8:null) (logid:) SeqA 5-3610: Processing Seq 5-3610: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:48:14,495 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-8:null) (logid:) SeqA 5-3610: Sending Seq 5-3610: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:48:19,378 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-15:null) (logid:) SeqA 5-3611: Processing Seq 5-3611: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:48:19,454 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-15:null) (logid:) SeqA 5-3611: Sending Seq 5-3611: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:48:19,871 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-d35267ab) (logid:e7e24516) Begin cleanup expired async-jobs
2017-04-19 02:48:19,877 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-d35267ab) (logid:e7e24516) End cleanup expired async-jobs
2017-04-19 02:48:20,093 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-3fdadbb9) (logid:cb57b6ea) Found 0 routers to update status.
2017-04-19 02:48:20,094 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-3fdadbb9) (logid:cb57b6ea) Found 0 VPC networks to update Redundant State.
2017-04-19 02:48:20,096 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-3fdadbb9) (logid:cb57b6ea) Found 0 networks to update RvR status.
2017-04-19 02:48:20,765 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-f68387aa) (logid:b8f54d44) Found 0 routers to update status.
2017-04-19 02:48:20,765 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-f68387aa) (logid:b8f54d44) Found 0 VPC networks to update Redundant State.
2017-04-19 02:48:20,766 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-f68387aa) (logid:b8f54d44) Found 0 networks to update RvR status.
2017-04-19 02:48:24,920 DEBUG [c.c.s.StatsCollector] (StatsCollector-2:ctx-68b3f6b9) (logid:b45fc319) StorageCollector is running...
2017-04-19 02:48:24,931 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (StatsCollector-2:ctx-68b3f6b9) (logid:b45fc319) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
2017-04-19 02:48:24,932 DEBUG [c.c.h.XenServerGuru] (StatsCollector-2:ctx-68b3f6b9) (logid:b45fc319) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
2017-04-19 02:48:24,985 DEBUG [c.c.a.t.Request] (StatsCollector-2:ctx-68b3f6b9) (logid:b45fc319) Seq 3-5366320430988657045: Received: { Ans: , MgmtId: 187757519710468, via: 3(s-2-VM), Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
2017-04-19 02:48:24,988 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (StatsCollector-2:ctx-68b3f6b9) (logid:b45fc319) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
2017-04-19 02:48:24,988 DEBUG [c.c.h.XenServerGuru] (StatsCollector-2:ctx-68b3f6b9) (logid:b45fc319) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
2017-04-19 02:48:25,021 DEBUG [c.c.a.t.Request] (StatsCollector-2:ctx-68b3f6b9) (logid:b45fc319) Seq 1-5412200852192494820: Received: { Ans: , MgmtId: 187757519710468, via: 1(cld), Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
2017-04-19 02:48:25,451 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-b34441fc) (logid:13428a54) Resetting hosts suitable for reconnect
2017-04-19 02:48:25,452 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-b34441fc) (logid:13428a54) Completed resetting hosts suitable for reconnect
2017-04-19 02:48:25,452 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-b34441fc) (logid:13428a54) Acquiring hosts for clusters already owned by this management server
2017-04-19 02:48:25,452 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-b34441fc) (logid:13428a54) Completed acquiring hosts for clusters already owned by this management server
2017-04-19 02:48:25,452 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-b34441fc) (logid:13428a54) Acquiring hosts for clusters not owned by any management server
2017-04-19 02:48:25,452 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager Timer:ctx-b34441fc) (logid:13428a54) Completed acquiring hosts for clusters not owned by any management server
2017-04-19 02:48:26,540 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-2:null) (logid:) Ping from 1(cld)
2017-04-19 02:48:26,541 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-2:null) (logid:) Process host VM state report from ping process. host: 1
2017-04-19 02:48:26,544 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-2:null) (logid:) Process VM state report. host: 1, number of records in report: 4
2017-04-19 02:48:26,544 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-2:null) (logid:) VM state report. host: 1, vm id: 2, power state: PowerOn
2017-04-19 02:48:26,545 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-2:null) (logid:) VM power state does not change, skip DB writing. vm id: 2
2017-04-19 02:48:26,545 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-2:null) (logid:) VM state report. host: 1, vm id: 4, power state: PowerOn
2017-04-19 02:48:26,546 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-2:null) (logid:) VM power state does not change, skip DB writing. vm id: 4
2017-04-19 02:48:26,546 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-2:null) (logid:) VM state report. host: 1, vm id: 6, power state: PowerOn
2017-04-19 02:48:26,546 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-2:null) (logid:) VM power state does not change, skip DB writing. vm id: 6
2017-04-19 02:48:26,546 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-2:null) (logid:) VM state report. host: 1, vm id: 7, power state: PowerOn
2017-04-19 02:48:26,547 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-2:null) (logid:) VM power state does not change, skip DB writing. vm id: 7
2017-04-19 02:48:26,548 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-2:null) (logid:) Done with process of VM state report. host: 1
2017-04-19 02:48:29,379 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-3:null) (logid:) SeqA 5-3612: Processing Seq 5-3612: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:48:29,463 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-3:null) (logid:) SeqA 5-3612: Sending Seq 5-3612: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:48:29,872 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-28d909a1) (logid:00d98238) Begin cleanup expired async-jobs
2017-04-19 02:48:29,877 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-28d909a1) (logid:00d98238) End cleanup expired async-jobs
2017-04-19 02:48:35,837 DEBUG [c.c.s.StatsCollector] (StatsCollector-4:ctx-54bc40a0) (logid:1a8a36c5) AutoScaling Monitor is running...
2017-04-19 02:48:39,380 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-4:null) (logid:) SeqA 5-3613: Processing Seq 5-3613: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:48:39,456 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-4:null) (logid:) SeqA 5-3613: Sending Seq 5-3613: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:48:39,870 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-ea9d76a8) (logid:41432db2) Begin cleanup expired async-jobs
2017-04-19 02:48:39,877 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-ea9d76a8) (logid:41432db2) End cleanup expired async-jobs
2017-04-19 02:48:41,076 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-3fd059b6) (logid:1e6f5e24) Zone 1 is ready to launch secondary storage VM
2017-04-19 02:48:41,138 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-f42594a3) (logid:3cd692f2) Zone 1 is ready to launch console proxy
2017-04-19 02:48:44,381 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-5:null) (logid:) SeqA 5-3614: Processing Seq 5-3614: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:48:44,465 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-5:null) (logid:) SeqA 5-3614: Sending Seq 5-3614: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:48:49,869 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-5f71a209) (logid:9699b327) Begin cleanup expired async-jobs
2017-04-19 02:48:49,874 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-5f71a209) (logid:9699b327) End cleanup expired async-jobs
2017-04-19 02:48:50,092 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-5f2041af) (logid:f955a351) Found 0 routers to update status.
2017-04-19 02:48:50,092 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-5f2041af) (logid:f955a351) Found 0 VPC networks to update Redundant State.
2017-04-19 02:48:50,092 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-5f2041af) (logid:f955a351) Found 0 networks to update RvR status.
2017-04-19 02:48:50,766 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-38225af3) (logid:9827a7d9) Found 0 routers to update status.
2017-04-19 02:48:50,768 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-38225af3) (logid:9827a7d9) Found 0 VPC networks to update Redundant State.
2017-04-19 02:48:50,770 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-38225af3) (logid:9827a7d9) Found 0 networks to update RvR status.
2017-04-19 02:48:54,381 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-7:null) (logid:) SeqA 5-3615: Processing Seq 5-3615: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:48:54,450 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-7:null) (logid:) SeqA 5-3615: Sending Seq 5-3615: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:48:58,556 DEBUG [c.c.s.StatsCollector] (StatsCollector-1:ctx-fc81f361) (logid:1487e240) HostStatsCollector is running...
2017-04-19 02:48:58,615 DEBUG [c.c.a.t.Request] (StatsCollector-1:ctx-fc81f361) (logid:1487e240) Seq 1-5412200852192494821: Received: { Ans: , MgmtId: 187757519710468, via: 1(cld), Ver: v1, Flags: 10, { GetHostStatsAnswer } }
2017-04-19 02:48:59,870 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-733b76f8) (logid:a4f906ab) Begin cleanup expired async-jobs
2017-04-19 02:48:59,875 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-733b76f8) (logid:a4f906ab) End cleanup expired async-jobs
2017-04-19 02:49:04,381 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-6:null) (logid:) SeqA 5-3616: Processing Seq 5-3616: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:49:04,452 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-6:null) (logid:) SeqA 5-3616: Sending Seq 5-3616: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:49:08,628 DEBUG [c.c.s.StatsCollector] (StatsCollector-5:ctx-9287552f) (logid:7783a76e) VmStatsCollector is running...
2017-04-19 02:49:08,722 DEBUG [c.c.a.t.Request] (StatsCollector-5:ctx-9287552f) (logid:7783a76e) Seq 1-5412200852192494822: Received: { Ans: , MgmtId: 187757519710468, via: 1(cld), Ver: v1, Flags: 10, { GetVmStatsAnswer } }
2017-04-19 02:49:09,383 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-12:null) (logid:) SeqA 5-3617: Processing Seq 5-3617: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:49:09,452 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-12:null) (logid:) SeqA 5-3617: Sending Seq 5-3617: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:49:09,610 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-14:null) (logid:) Ping from 5(v-6-VM)
2017-04-19 02:49:09,870 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-657eff31) (logid:19ce9859) Begin cleanup expired async-jobs
2017-04-19 02:49:09,875 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-657eff31) (logid:19ce9859) End cleanup expired async-jobs
2017-04-19 02:49:10,073 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-11:null) (logid:) Ping from 3(s-2-VM)
2017-04-19 02:49:11,079 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-0bf1353b) (logid:f5e64752) Zone 1 is ready to launch secondary storage VM
2017-04-19 02:49:11,138 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-202c4dc2) (logid:d55c75b8) Zone 1 is ready to launch console proxy
[root@cld adeel]# clear
[root@cld adeel]# tail --lines=100 /var/log/cloudstack/management/management-server.log
2017-04-19 02:48:59,870 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-733b76f8) (logid:a4f906ab) Begin cleanup expired async-jobs
2017-04-19 02:48:59,875 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-733b76f8) (logid:a4f906ab) End cleanup expired async-jobs
2017-04-19 02:49:04,381 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-6:null) (logid:) SeqA 5-3616: Processing Seq 5-3616: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:49:04,452 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-6:null) (logid:) SeqA 5-3616: Sending Seq 5-3616: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:49:08,628 DEBUG [c.c.s.StatsCollector] (StatsCollector-5:ctx-9287552f) (logid:7783a76e) VmStatsCollector is running...
2017-04-19 02:49:08,722 DEBUG [c.c.a.t.Request] (StatsCollector-5:ctx-9287552f) (logid:7783a76e) Seq 1-5412200852192494822: Received: { Ans: , MgmtId: 187757519710468, via: 1(cld), Ver: v1, Flags: 10, { GetVmStatsAnswer } }
2017-04-19 02:49:09,383 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-12:null) (logid:) SeqA 5-3617: Processing Seq 5-3617: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:49:09,452 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-12:null) (logid:) SeqA 5-3617: Sending Seq 5-3617: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:49:09,610 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-14:null) (logid:) Ping from 5(v-6-VM)
2017-04-19 02:49:09,870 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-657eff31) (logid:19ce9859) Begin cleanup expired async-jobs
2017-04-19 02:49:09,875 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-657eff31) (logid:19ce9859) End cleanup expired async-jobs
2017-04-19 02:49:10,073 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-11:null) (logid:) Ping from 3(s-2-VM)
2017-04-19 02:49:11,079 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-0bf1353b) (logid:f5e64752) Zone 1 is ready to launch secondary storage VM
2017-04-19 02:49:11,138 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-202c4dc2) (logid:d55c75b8) Zone 1 is ready to launch console proxy
2017-04-19 02:49:14,424 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-8:null) (logid:) SeqA 5-3619: Processing Seq 5-3619: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:49:14,486 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-8:null) (logid:) SeqA 5-3619: Sending Seq 5-3619: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:49:19,868 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-cc6c3447) (logid:7a723afd) Begin cleanup expired async-jobs
2017-04-19 02:49:19,874 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-cc6c3447) (logid:7a723afd) End cleanup expired async-jobs
2017-04-19 02:49:20,093 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-3da3de86) (logid:90d9d9f4) Found 0 routers to update status.
2017-04-19 02:49:20,094 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-3da3de86) (logid:90d9d9f4) Found 0 VPC networks to update Redundant State.
2017-04-19 02:49:20,095 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-3da3de86) (logid:90d9d9f4) Found 0 networks to update RvR status.
2017-04-19 02:49:20,766 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-83abde29) (logid:61d3823d) Found 0 routers to update status.
2017-04-19 02:49:20,768 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-83abde29) (logid:61d3823d) Found 0 VPC networks to update Redundant State.
2017-04-19 02:49:20,770 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-83abde29) (logid:61d3823d) Found 0 networks to update RvR status.
2017-04-19 02:49:24,373 DEBUG [c.c.h.k.d.LibvirtServerDiscoverer] (catalina-exec-22:ctx-bec968ff ctx-95de5112) (logid:c0e3163c) Timeout, to wait for the host connecting to mgt svr, assuming it is failed
2017-04-19 02:49:24,375 WARN [c.c.r.ResourceManagerImpl] (catalina-exec-22:ctx-bec968ff ctx-95de5112) (logid:c0e3163c) Unable to find the server resources at http://10.0.0.5
2017-04-19 02:49:24,376 INFO [c.c.u.e.CSExceptionErrorCode] (catalina-exec-22:ctx-bec968ff ctx-95de5112) (logid:c0e3163c) Could not find exception: com.cloud.exception.DiscoveryException in error code list for exceptions
2017-04-19 02:49:24,376 WARN [o.a.c.a.c.a.h.AddHostCmd] (catalina-exec-22:ctx-bec968ff ctx-95de5112) (logid:c0e3163c) Exception:
com.cloud.exception.DiscoveryException: Unable to add the host
at com.cloud.resource.ResourceManagerImpl.discoverHostsFull(ResourceManagerImpl.java:806)
at com.cloud.resource.ResourceManagerImpl.discoverHosts(ResourceManagerImpl.java:598)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at com.sun.proxy.$Proxy160.discoverHosts(Unknown Source)
at org.apache.cloudstack.api.command.admin.host.AddHostCmd.execute(AddHostCmd.java:142)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
at com.cloud.api.ApiServer.queueCommand(ApiServer.java:709)
at com.cloud.api.ApiServer.handleRequest(ApiServer.java:533)
at com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:299)
at com.cloud.api.ApiServlet$1.run(ApiServlet.java:129)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:126)
at com.cloud.api.ApiServlet.doPost(ApiServlet.java:93)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:643)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:723)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:299)
at org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:896)
at org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:732)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2277)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2017-04-19 02:49:24,378 INFO [c.c.a.ApiServer] (catalina-exec-22:ctx-bec968ff ctx-95de5112) (logid:c0e3163c) Unable to add the host
2017-04-19 02:49:24,379 DEBUG [c.c.a.ApiServlet] (catalina-exec-22:ctx-bec968ff ctx-95de5112) (logid:c0e3163c) ===END=== 10.0.0.2 -- POST command=addHost&response=json
2017-04-19 02:49:24,385 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-15:null) (logid:) SeqA 5-3620: Processing Seq 5-3620: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:49:24,462 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-15:null) (logid:) SeqA 5-3620: Sending Seq 5-3620: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:49:25,021 DEBUG [c.c.s.StatsCollector] (StatsCollector-6:ctx-4048b4cf) (logid:202bc42a) StorageCollector is running...
2017-04-19 02:49:25,033 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (StatsCollector-6:ctx-4048b4cf) (logid:202bc42a) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
2017-04-19 02:49:25,033 DEBUG [c.c.h.XenServerGuru] (StatsCollector-6:ctx-4048b4cf) (logid:202bc42a) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
2017-04-19 02:49:25,088 DEBUG [c.c.a.t.Request] (StatsCollector-6:ctx-4048b4cf) (logid:202bc42a) Seq 3-5366320430988657046: Received: { Ans: , MgmtId: 187757519710468, via: 3(s-2-VM), Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
2017-04-19 02:49:25,092 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (StatsCollector-6:ctx-4048b4cf) (logid:202bc42a) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
2017-04-19 02:49:25,092 DEBUG [c.c.h.XenServerGuru] (StatsCollector-6:ctx-4048b4cf) (logid:202bc42a) getCommandHostDelegation: class com.cloud.agent.api.GetStorageStatsCommand
2017-04-19 02:49:25,145 DEBUG [c.c.a.t.Request] (StatsCollector-6:ctx-4048b4cf) (logid:202bc42a) Seq 1-5412200852192494823: Received: { Ans: , MgmtId: 187757519710468, via: 1(cld), Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
2017-04-19 02:49:26,536 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-2:null) (logid:) Ping from 1(cld)
2017-04-19 02:49:26,536 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-2:null) (logid:) Process host VM state report from ping process. host: 1
2017-04-19 02:49:26,539 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-2:null) (logid:) Process VM state report. host: 1, number of records in report: 4
2017-04-19 02:49:26,539 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-2:null) (logid:) VM state report. host: 1, vm id: 2, power state: PowerOn
2017-04-19 02:49:26,540 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-2:null) (logid:) VM power state does not change, skip DB writing. vm id: 2
2017-04-19 02:49:26,540 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-2:null) (logid:) VM state report. host: 1, vm id: 4, power state: PowerOn
2017-04-19 02:49:26,540 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-2:null) (logid:) VM power state does not change, skip DB writing. vm id: 4
2017-04-19 02:49:26,540 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-2:null) (logid:) VM state report. host: 1, vm id: 6, power state: PowerOn
2017-04-19 02:49:26,541 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-2:null) (logid:) VM power state does not change, skip DB writing. vm id: 6
2017-04-19 02:49:26,541 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-2:null) (logid:) VM state report. host: 1, vm id: 7, power state: PowerOn
2017-04-19 02:49:26,542 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-2:null) (logid:) VM power state does not change, skip DB writing. vm id: 7
2017-04-19 02:49:26,543 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl] (AgentManager-Handler-2:null) (logid:) Done with process of VM state report. host: 1
2017-04-19 02:49:29,864 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-e20a7dba) (logid:fbf3be73) Begin cleanup expired async-jobs
2017-04-19 02:49:29,865 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-e20a7dba) (logid:fbf3be73) End cleanup expired async-jobs
2017-04-19 02:49:34,384 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-3:null) (logid:) SeqA 5-3621: Processing Seq 5-3621: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-19 02:49:34,497 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-3:null) (logid:) SeqA 5-3621: Sending Seq 5-3621: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-19 02:49:35,839 DEBUG [c.c.s.StatsCollector] (StatsCollector-3:ctx-0a89e510) (logid:43a68a63) AutoScaling Monitor is running...
2017-04-19 02:49:39,869 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-c8981b13) (logid:2f742114) Begin cleanup expired async-jobs
2017-04-19 02:49:39,877 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-c8981b13) (logid:2f742114) End cleanup expired async-jobs
Regards
Adeel
CloudStack Single Server on Ubuntu with KVM - Martijn Koster<http://www.greenhills.co.uk/2013/08/30/cloudstack-single-server-on-ubuntu-with-kvm.html>
www.greenhills.co.uk
CloudStack Single Server on Ubuntu with KVM. 30 Aug 2013. This guide documents the steps I did for my installation of CloudStack in a single-server configuration with ...
CloudStack Single Server on Ubuntu with KVM - Martijn Koster<http://www.greenhills.co.uk/2013/08/30/cloudstack-single-server-on-ubuntu-with-kvm.html>
www.greenhills.co.uk
CloudStack Single Server on Ubuntu with KVM. 30 Aug 2013. This guide documents the steps I did for my installation of CloudStack in a single-server configuration with ...
Host KVM Installation — Apache CloudStack Installation ...<http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/4.9/hypervisor/kvm.html>
docs.cloudstack.apache.org
KVM Installation Overview¶ If you want to use the Linux Kernel Virtual Machine (KVM) hypervisor to run guest virtual machines, install KVM on the host(s) in your cloud.
________________________________
From: Muhammad Adeel Zahid <16...@lums.edu.pk>
Sent: Tuesday, April 18, 2017 9:14:37 PM
To: users@cloudstack.apache.org
Subject: Trouble Adding Ubuntu-KVM hosts on Cloudstack
Hi Guys,
Few weeks ago, I installed cloudsack management on one machine and KVM on other machine. Both were using CentOS 6. All is working fine with these two machines. Now, I installed ubuntu and KVM on third machine and wanted to add it to the cluster but I never seem to be able to do it. I always get "failed adding host" message.
I followed http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/4.9/hypervisor/kvm.htmlfor KVM installation on ubuntu. The only difference is that, I don't have eth0 interface. The only ethernet interface showing in my machine is enso1. So I replaced every occurance of eth0 with enso1? I don't know if that might be creating problem?
And the following seems to be the relevant portion from management-server.log
2017-04-18 20:56:50,340 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done executing cpu/ram capacity update
2017-04-18 20:56:50,340 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Executing storage capacity update
2017-04-18 20:56:50,343 DEBUG [c.c.s.StorageManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Found storage pool Primary 1 of type NetworkFilesystem with overprovisioning factor 2
2017-04-18 20:56:50,343 DEBUG [c.c.s.StorageManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Total over provisioned capacity calculated is 2 * 52710866944
2017-04-18 20:56:50,343 DEBUG [c.c.s.StorageManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Total over provisioned capacity of the pool Primary 1 id: 1 is 105421733888
2017-04-18 20:56:50,407 DEBUG [c.c.s.StorageManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Successfully set Capacity - 105421733888 for capacity type - 3 , DataCenterId - 1, HostOrPoolId - 1, PodId null
2017-04-18 20:56:50,407 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done executing storage capacity update
2017-04-18 20:56:50,407 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Executing capacity updates for public ip and Vlans
2017-04-18 20:56:50,409 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done capacity updates for public ip and Vlans
2017-04-18 20:56:50,409 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Executing capacity updates for private ip
2017-04-18 20:56:50,410 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done executing capacity updates for private ip
2017-04-18 20:56:50,410 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done recalculating system capacity
2017-04-18 20:56:50,416 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done running Capacity Checker ...
2017-04-18 20:56:50,617 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-bc905976) (logid:e7d551f4) Found 0 routers to update status.
2017-04-18 20:56:50,619 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-bc905976) (logid:e7d551f4) Found 0 VPC networks to update Redundant State.
2017-04-18 20:56:50,621 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-bc905976) (logid:e7d551f4) Found 0 networks to update RvR status.
2017-04-18 20:56:50,990 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-478: Processing Seq 5-478: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-18 20:56:51,057 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-478: Sending Seq 5-478: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-18 20:56:59,715 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-e043b5e1) (logid:0203bb00) Begin cleanup expired async-jobs
2017-04-18 20:56:59,717 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-e043b5e1) (logid:0203bb00) End cleanup expired async-jobs
2017-04-18 20:56:59,963 DEBUG [c.c.h.k.d.LibvirtServerDiscoverer] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) Timeout, to wait for the host connecting to mgt svr, assuming it is failed
2017-04-18 20:56:59,963 WARN [c.c.r.ResourceManagerImpl] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) Unable to find the server resources at http://10.0.0.5
2017-04-18 20:56:59,964 INFO [c.c.u.e.CSExceptionErrorCode] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) Could not find exception: com.cloud.exception.DiscoveryException in error code list for exceptions
2017-04-18 20:56:59,964 WARN [o.a.c.a.c.a.h.AddHostCmd] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) Exception:
com.cloud.exception.DiscoveryException: Unable to add the host
at com.cloud.resource.ResourceManagerImpl.discoverHostsFull(ResourceManagerImpl.java:806)
at com.cloud.resource.ResourceManagerImpl.discoverHosts(ResourceManagerImpl.java:598)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at com.sun.proxy.$Proxy160.discoverHosts(Unknown Source)
at org.apache.cloudstack.api.command.admin.host.AddHostCmd.execute(AddHostCmd.java:142)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
at com.cloud.api.ApiServer.queueCommand(ApiServer.java:709)
at com.cloud.api.ApiServer.handleRequest(ApiServer.java:533)
at com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:299)
at com.cloud.api.ApiServlet$1.run(ApiServlet.java:129)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:126)
at com.cloud.api.ApiServlet.doPost(ApiServlet.java:93)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:643)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:723)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:299)
at org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:896)
at org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:732)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2277)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2017-04-18 20:56:59,964 INFO [c.c.a.ApiServer] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) Unable to add the host
2017-04-18 20:56:59,965 DEBUG [c.c.a.ApiServlet] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) ===END=== 10.0.0.2 -- POST command=addHost&response=json
2017-04-18 20:57:00,988 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-14:null) (logid:) SeqA 5-479: Processing Seq 5-479: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-18 20:57:01,074 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-14:null) (logid:) SeqA 5-479: Sending Seq 5-479: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-18 20:57:09,465 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-15:null) (logid:) Ping from 5(v-6-VM)
2017-04-18 20:57:09,647 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-1:null) (logid:) Ping from 3(s-2-VM)
2017-04-18 20:57:09,719 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-b38b767a) (logid:5b5de7b7) Begin cleanup expired async-jobs
2017-04-18 20:57:09,725 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-b38b767a) (logid:5b5de7b7) End cleanup expired async-jobs
2017-04-18 20:57:10,928 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-db45f56a) (logid:a742d33f) Zone 1 is ready to launch secondary storage VM
2017-04-18 20:57:10,999 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-892e3eec) (logid:739e8590) Zone 1 is ready to launch console proxy
2017-04-18 20:57:11,030 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-9:null) (logid:) SeqA 5-481: Processing Seq 5-481: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-18 20:57:11,150 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-9:null) (logid:) SeqA 5-481: Sending Seq 5-481: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-18 20:57:15,992 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-2:null) (logid:) SeqA 5-482: Processing Seq 5-482: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-18 20:57:16,067 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-2:null) (logid:) SeqA 5-482: Sending Seq 5-482: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-18 20:57:19,719 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-0d968653) (logid:74a5d87b) Begin cleanup expired async-jobs
2017-04-18 20:57:19,725 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-0d968653) (logid:74a5d87b) End cleanup expired async-jobs
2017-04-18 20:57:19,944 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-80589e90) (logid:80d37fa8) Found 0 routers to update status.
2017-04-18 20:57:19,946 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-80589e90) (logid:80d37fa8) Found 0 VPC networks to update Redundant State.
Is there a way, we can check if a host is ready to be added to cluster before adding it from cloudstack management UI?
Regards
Adeel
Host KVM Installation — Apache CloudStack Installation ...<http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/4.9/hypervisor/kvm.html>
docs.cloudstack.apache.org
KVM Installation Overview¶ If you want to use the Linux Kernel Virtual Machine (KVM) hypervisor to run guest virtual machines, install KVM on the host(s) in your cloud.
Re: Trouble Adding Ubuntu-KVM hosts on Cloudstack
Posted by Muhammad Adeel Zahid <16...@lums.edu.pk>.
OK, how I can switch back to 14.04. BTW, can we somehow test a host using terminal commands to see if it is ready to be added as a host?
Regards
Adeel
________________________________
From: Rene Moser <ma...@renemoser.net>
Sent: Tuesday, April 18, 2017 9:37:17 PM
To: users@cloudstack.apache.org
Subject: Re: Trouble Adding Ubuntu-KVM hosts on Cloudstack
On 04/18/2017 06:33 PM, Muhammad Adeel Zahid wrote:
> I am on Ubuntu 16.04 LTS
AFAIK 16.04 is not yet be supported. And the offical docs only mention
14.04. I would give 14.04 a try.
Regards
René
Re: Trouble Adding Ubuntu-KVM hosts on Cloudstack
Posted by Rene Moser <ma...@renemoser.net>.
On 04/18/2017 06:33 PM, Muhammad Adeel Zahid wrote:
> I am on Ubuntu 16.04 LTS
AFAIK 16.04 is not yet be supported. And the offical docs only mention
14.04. I would give 14.04 a try.
Regards
Ren
Re: Trouble Adding Ubuntu-KVM hosts on Cloudstack
Posted by Muhammad Adeel Zahid <16...@lums.edu.pk>.
I am on Ubuntu 16.04 LTS
________________________________
From: Rene Moser <ma...@renemoser.net>
Sent: Tuesday, April 18, 2017 9:19:17 PM
To: users@cloudstack.apache.org
Subject: Re: Trouble Adding Ubuntu-KVM hosts on Cloudstack
Hi Adeel
On 04/18/2017 06:14 PM, Muhammad Adeel Zahid wrote:
> Hi Guys,
>
>
> Few weeks ago, I installed cloudsack management on one machine and KVM on other machine. Both were using CentOS 6. All is working fine with these two machines. Now, I installed ubuntu and KVM on third machine and wanted to add it to the cluster but I never seem to be able to do it. I always get "failed adding host" message.
>
>
> I followed http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/4.9/hypervisor/kvm.htmlfor KVM installation on ubuntu. The only difference is that, I don't have eth0 interface. The only ethernet interface showing in my machine is enso1. So I replaced every occurance of eth0 with enso1? I don't know if that might be creating problem?
Which Ubuntu version did you take?
Regards
René
Re: Trouble Adding Ubuntu-KVM hosts on Cloudstack
Posted by Rene Moser <ma...@renemoser.net>.
Hi Adeel
On 04/18/2017 06:14 PM, Muhammad Adeel Zahid wrote:
> Hi Guys,
>
>
> Few weeks ago, I installed cloudsack management on one machine and KVM on other machine. Both were using CentOS 6. All is working fine with these two machines. Now, I installed ubuntu and KVM on third machine and wanted to add it to the cluster but I never seem to be able to do it. I always get "failed adding host" message.
>
>
> I followed http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/4.9/hypervisor/kvm.htmlfor KVM installation on ubuntu. The only difference is that, I don't have eth0 interface. The only ethernet interface showing in my machine is enso1. So I replaced every occurance of eth0 with enso1? I don't know if that might be creating problem?
Which Ubuntu version did you take?
Regards
Ren
Re: Trouble Adding Ubuntu-KVM hosts on Cloudstack
Posted by Muhammad Adeel Zahid <16...@lums.edu.pk>.
And do we need to create /export/primary /export/secondary for KVM hosts as well?
________________________________
From: Muhammad Adeel Zahid <16...@lums.edu.pk>
Sent: Wednesday, April 19, 2017 4:34:22 AM
To: users@cloudstack.apache.org
Subject: Re: Trouble Adding Ubuntu-KVM hosts on Cloudstack
And following is how agent logs look like on KVM host I am trying to add. I think, its having some problem with storage pool and it is receiving sig-kill too often
2017-04-19 02:56:49,432 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Proccess agent startup answer, agent id = 0
2017-04-19 02:56:49,433 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Set agent id 0
2017-04-19 02:56:49,433 INFO [cloud.agent.Agent] (AgentShutdownThread:null) (logid:) Stopping the agent: Reason = sig.kill
2017-04-19 02:56:49,459 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Startup Response Received: agent id = 0
2017-04-19 02:58:16,014 INFO [cloud.agent.AgentShell] (main:null) (logid:) Agent started
2017-04-19 02:58:16,015 INFO [cloud.agent.AgentShell] (main:null) (logid:) Implementation Version is 4.9.2.0
2017-04-19 02:58:16,016 INFO [cloud.agent.AgentShell] (main:null) (logid:) agent.properties found at /etc/cloudstack/agent/agent.properties
2017-04-19 02:58:16,019 INFO [cloud.agent.AgentShell] (main:null) (logid:) Defaulting to using properties file for storage
2017-04-19 02:58:16,020 INFO [cloud.agent.AgentShell] (main:null) (logid:) Defaulting to the constant time backoff algorithm
2017-04-19 02:58:16,028 INFO [cloud.utils.LogUtils] (main:null) (logid:) log4j configuration found at /etc/cloudstack/agent/log4j-cloud.xml
2017-04-19 02:58:16,037 INFO [cloud.agent.AgentShell] (main:null) (logid:) Using default Java settings for IPv6 preference for agent connection
2017-04-19 02:58:16,070 INFO [cloud.agent.Agent] (main:null) (logid:) id is 0
2017-04-19 02:58:16,091 INFO [kvm.resource.LibvirtConnection] (main:null) (logid:) No existing libvirtd connection found. Opening a new one
2017-04-19 02:58:16,306 INFO [org.reflections.Reflections] (main:null) (logid:) Reflections took 52 ms to scan 1 urls, producing 7 keys and 10 values
2017-04-19 02:58:16,362 INFO [kvm.resource.LibvirtComputingResource] (main:null) (logid:) No libvirt.vif.driver specified. Defaults to BridgeVifDriver.
2017-04-19 02:58:16,375 INFO [cloud.agent.Agent] (main:null) (logid:) Agent [id = 0 : type = LibvirtComputingResource : zone = 1 : pod = 1 : workers = 5 : host = 10.0.0.2 : port = 8250
2017-04-19 02:58:16,377 INFO [utils.nio.NioClient] (main:null) (logid:) Connecting to 10.0.0.2:8250
2017-04-19 02:58:16,557 INFO [utils.nio.NioClient] (main:null) (logid:) SSL: Handshake done
2017-04-19 02:58:16,558 INFO [utils.nio.NioClient] (main:null) (logid:) Connected to 10.0.0.2:8250
2017-04-19 02:58:16,589 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Attempting to create storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 (Filesystem) in libvirt
2017-04-19 02:58:16,593 WARN [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 was not found running in libvirt. Need to create it.
2017-04-19 02:58:16,593 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Didn't find an existing storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 by UUID, checking for pools with duplicate paths
2017-04-19 02:58:16,595 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Trying to fetch storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 from libvirt
2017-04-19 02:58:16,633 INFO [cloud.serializer.GsonHelper] (Agent-Handler-1:null) (logid:) Default Builder inited.
2017-04-19 02:58:19,448 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Proccess agent startup answer, agent id = 0
2017-04-19 02:58:19,448 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Set agent id 0
2017-04-19 02:58:19,448 INFO [cloud.agent.Agent] (AgentShutdownThread:null) (logid:) Stopping the agent: Reason = sig.kill
2017-04-19 02:58:19,452 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Startup Response Received: agent id = 0
2017-04-19 04:13:46,596 INFO [cloud.agent.AgentShell] (main:null) (logid:) Agent started
2017-04-19 04:13:46,630 INFO [cloud.agent.AgentShell] (main:null) (logid:) Implementation Version is 4.9.2.0
2017-04-19 04:13:46,631 INFO [cloud.agent.AgentShell] (main:null) (logid:) agent.properties found at /etc/cloudstack/agent/agent.properties
2017-04-19 04:13:46,634 INFO [cloud.agent.AgentShell] (main:null) (logid:) Defaulting to using properties file for storage
2017-04-19 04:13:46,635 INFO [cloud.agent.AgentShell] (main:null) (logid:) Defaulting to the constant time backoff algorithm
2017-04-19 04:13:46,654 INFO [cloud.utils.LogUtils] (main:null) (logid:) log4j configuration found at /etc/cloudstack/agent/log4j-cloud.xml
2017-04-19 04:13:46,662 INFO [cloud.agent.AgentShell] (main:null) (logid:) Using default Java settings for IPv6 preference for agent connection
2017-04-19 04:13:46,821 INFO [cloud.agent.Agent] (main:null) (logid:) id is 0
2017-04-19 04:13:47,013 INFO [kvm.resource.LibvirtConnection] (main:null) (logid:) No existing libvirtd connection found. Opening a new one
2017-04-19 04:13:48,061 INFO [org.reflections.Reflections] (main:null) (logid:) Reflections took 162 ms to scan 1 urls, producing 7 keys and 10 values
2017-04-19 04:13:48,449 INFO [kvm.resource.LibvirtComputingResource] (main:null) (logid:) No libvirt.vif.driver specified. Defaults to BridgeVifDriver.
2017-04-19 04:13:48,473 INFO [cloud.agent.Agent] (main:null) (logid:) Agent [id = 0 : type = LibvirtComputingResource : zone = 1 : pod = 1 : workers = 5 : host = 10.0.0.2 : port = 8250
2017-04-19 04:13:48,478 INFO [utils.nio.NioClient] (main:null) (logid:) Connecting to 10.0.0.2:8250
2017-04-19 04:13:48,913 INFO [utils.nio.NioClient] (main:null) (logid:) SSL: Handshake done
2017-04-19 04:13:48,913 INFO [utils.nio.NioClient] (main:null) (logid:) Connected to 10.0.0.2:8250
2017-04-19 04:13:49,127 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Attempting to create storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 (Filesystem) in libvirt
2017-04-19 04:13:49,167 WARN [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 was not found running in libvirt. Need to create it.
2017-04-19 04:13:49,167 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Didn't find an existing storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 by UUID, checking for pools with duplicate paths
2017-04-19 04:13:49,284 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Trying to fetch storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 from libvirt
2017-04-19 04:13:49,431 INFO [cloud.serializer.GsonHelper] (Agent-Handler-1:null) (logid:) Default Builder inited.
2017-04-19 04:13:54,999 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Proccess agent startup answer, agent id = 0
2017-04-19 04:13:54,999 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Set agent id 0
2017-04-19 04:13:55,001 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Startup Response Received: agent id = 0
2017-04-19 04:13:55,005 INFO [cloud.agent.Agent] (AgentShutdownThread:null) (logid:) Stopping the agent: Reason = sig.kill
2017-04-19 04:15:14,373 INFO [cloud.agent.AgentShell] (main:null) (logid:) Agent started
2017-04-19 04:15:14,374 INFO [cloud.agent.AgentShell] (main:null) (logid:) Implementation Version is 4.9.2.0
2017-04-19 04:15:14,375 INFO [cloud.agent.AgentShell] (main:null) (logid:) agent.properties found at /etc/cloudstack/agent/agent.properties
2017-04-19 04:15:14,378 INFO [cloud.agent.AgentShell] (main:null) (logid:) Defaulting to using properties file for storage
2017-04-19 04:15:14,379 INFO [cloud.agent.AgentShell] (main:null) (logid:) Defaulting to the constant time backoff algorithm
2017-04-19 04:15:14,387 INFO [cloud.utils.LogUtils] (main:null) (logid:) log4j configuration found at /etc/cloudstack/agent/log4j-cloud.xml
2017-04-19 04:15:14,396 INFO [cloud.agent.AgentShell] (main:null) (logid:) Using default Java settings for IPv6 preference for agent connection
2017-04-19 04:15:14,430 INFO [cloud.agent.Agent] (main:null) (logid:) id is 0
2017-04-19 04:15:14,450 INFO [kvm.resource.LibvirtConnection] (main:null) (logid:) No existing libvirtd connection found. Opening a new one
2017-04-19 04:15:14,669 INFO [org.reflections.Reflections] (main:null) (logid:) Reflections took 52 ms to scan 1 urls, producing 7 keys and 10 values
2017-04-19 04:15:14,725 INFO [kvm.resource.LibvirtComputingResource] (main:null) (logid:) No libvirt.vif.driver specified. Defaults to BridgeVifDriver.
2017-04-19 04:15:14,738 INFO [cloud.agent.Agent] (main:null) (logid:) Agent [id = 0 : type = LibvirtComputingResource : zone = 1 : pod = 1 : workers = 5 : host = 10.0.0.2 : port = 8250
2017-04-19 04:15:14,741 INFO [utils.nio.NioClient] (main:null) (logid:) Connecting to 10.0.0.2:8250
2017-04-19 04:15:14,919 INFO [utils.nio.NioClient] (main:null) (logid:) SSL: Handshake done
2017-04-19 04:15:14,919 INFO [utils.nio.NioClient] (main:null) (logid:) Connected to 10.0.0.2:8250
2017-04-19 04:15:14,949 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Attempting to create storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 (Filesystem) in libvirt
2017-04-19 04:15:14,953 WARN [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 was not found running in libvirt. Need to create it.
2017-04-19 04:15:14,953 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Didn't find an existing storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 by UUID, checking for pools with duplicate paths
2017-04-19 04:15:14,955 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Trying to fetch storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 from libvirt
2017-04-19 04:15:14,992 INFO [cloud.serializer.GsonHelper] (Agent-Handler-1:null) (logid:) Default Builder inited.
2017-04-19 04:15:15,875 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Proccess agent startup answer, agent id = 0
2017-04-19 04:15:15,875 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Set agent id 0
2017-04-19 04:15:15,876 INFO [cloud.agent.Agent] (AgentShutdownThread:null) (logid:) Stopping the agent: Reason = sig.kill
2017-04-19 04:15:15,880 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Startup Response Received: agent id = 0
2017-04-19 04:30:21,032 INFO [cloud.agent.AgentShell] (main:null) (logid:) Agent started
2017-04-19 04:30:21,033 INFO [cloud.agent.AgentShell] (main:null) (logid:) Implementation Version is 4.9.2.0
2017-04-19 04:30:21,034 INFO [cloud.agent.AgentShell] (main:null) (logid:) agent.properties found at /etc/cloudstack/agent/agent.properties
2017-04-19 04:30:21,037 INFO [cloud.agent.AgentShell] (main:null) (logid:) Defaulting to using properties file for storage
2017-04-19 04:30:21,037 INFO [cloud.agent.AgentShell] (main:null) (logid:) Defaulting to the constant time backoff algorithm
2017-04-19 04:30:21,046 INFO [cloud.utils.LogUtils] (main:null) (logid:) log4j configuration found at /etc/cloudstack/agent/log4j-cloud.xml
2017-04-19 04:30:21,054 INFO [cloud.agent.AgentShell] (main:null) (logid:) Using default Java settings for IPv6 preference for agent connection
2017-04-19 04:30:21,088 INFO [cloud.agent.Agent] (main:null) (logid:) id is 0
2017-04-19 04:30:21,109 INFO [kvm.resource.LibvirtConnection] (main:null) (logid:) No existing libvirtd connection found. Opening a new one
2017-04-19 04:30:21,287 INFO [org.reflections.Reflections] (main:null) (logid:) Reflections took 52 ms to scan 1 urls, producing 7 keys and 10 values
2017-04-19 04:30:21,342 INFO [kvm.resource.LibvirtComputingResource] (main:null) (logid:) No libvirt.vif.driver specified. Defaults to BridgeVifDriver.
2017-04-19 04:30:21,355 INFO [cloud.agent.Agent] (main:null) (logid:) Agent [id = 0 : type = LibvirtComputingResource : zone = 1 : pod = 1 : workers = 5 : host = 10.0.0.2 : port = 8250
2017-04-19 04:30:21,357 INFO [utils.nio.NioClient] (main:null) (logid:) Connecting to 10.0.0.2:8250
2017-04-19 04:30:21,535 INFO [utils.nio.NioClient] (main:null) (logid:) SSL: Handshake done
2017-04-19 04:30:21,535 INFO [utils.nio.NioClient] (main:null) (logid:) Connected to 10.0.0.2:8250
2017-04-19 04:30:21,565 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Attempting to create storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 (Filesystem) in libvirt
2017-04-19 04:30:21,568 WARN [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 was not found running in libvirt. Need to create it.
2017-04-19 04:30:21,568 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Didn't find an existing storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 by UUID, checking for pools with duplicate paths
2017-04-19 04:30:21,571 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Trying to fetch storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 from libvirt
2017-04-19 04:30:21,608 INFO [cloud.serializer.GsonHelper] (Agent-Handler-1:null) (logid:) Default Builder inited.
2017-04-19 04:30:26,638 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Proccess agent startup answer, agent id = 0
2017-04-19 04:30:26,638 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Set agent id 0
2017-04-19 04:30:26,639 INFO [cloud.agent.Agent] (AgentShutdownThread:null) (logid:) Stopping the agent: Reason = sig.kill
2017-04-19 04:30:26,644 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Startup Response Received: agent id = 0
Regards
Adeel
________________________________
From: Muhammad Adeel Zahid <16...@lums.edu.pk>
Sent: Tuesday, April 18, 2017 9:14:37 PM
To: users@cloudstack.apache.org
Subject: Trouble Adding Ubuntu-KVM hosts on Cloudstack
Hi Guys,
Few weeks ago, I installed cloudsack management on one machine and KVM on other machine. Both were using CentOS 6. All is working fine with these two machines. Now, I installed ubuntu and KVM on third machine and wanted to add it to the cluster but I never seem to be able to do it. I always get "failed adding host" message.
I followed http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/4.9/hypervisor/kvm.htmlfor KVM installation on ubuntu. The only difference is that, I don't have eth0 interface. The only ethernet interface showing in my machine is enso1. So I replaced every occurance of eth0 with enso1? I don't know if that might be creating problem?
And the following seems to be the relevant portion from management-server.log
2017-04-18 20:56:50,340 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done executing cpu/ram capacity update
2017-04-18 20:56:50,340 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Executing storage capacity update
2017-04-18 20:56:50,343 DEBUG [c.c.s.StorageManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Found storage pool Primary 1 of type NetworkFilesystem with overprovisioning factor 2
2017-04-18 20:56:50,343 DEBUG [c.c.s.StorageManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Total over provisioned capacity calculated is 2 * 52710866944
2017-04-18 20:56:50,343 DEBUG [c.c.s.StorageManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Total over provisioned capacity of the pool Primary 1 id: 1 is 105421733888
2017-04-18 20:56:50,407 DEBUG [c.c.s.StorageManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Successfully set Capacity - 105421733888 for capacity type - 3 , DataCenterId - 1, HostOrPoolId - 1, PodId null
2017-04-18 20:56:50,407 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done executing storage capacity update
2017-04-18 20:56:50,407 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Executing capacity updates for public ip and Vlans
2017-04-18 20:56:50,409 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done capacity updates for public ip and Vlans
2017-04-18 20:56:50,409 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Executing capacity updates for private ip
2017-04-18 20:56:50,410 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done executing capacity updates for private ip
2017-04-18 20:56:50,410 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done recalculating system capacity
2017-04-18 20:56:50,416 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done running Capacity Checker ...
2017-04-18 20:56:50,617 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-bc905976) (logid:e7d551f4) Found 0 routers to update status.
2017-04-18 20:56:50,619 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-bc905976) (logid:e7d551f4) Found 0 VPC networks to update Redundant State.
2017-04-18 20:56:50,621 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-bc905976) (logid:e7d551f4) Found 0 networks to update RvR status.
2017-04-18 20:56:50,990 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-478: Processing Seq 5-478: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-18 20:56:51,057 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-478: Sending Seq 5-478: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-18 20:56:59,715 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-e043b5e1) (logid:0203bb00) Begin cleanup expired async-jobs
2017-04-18 20:56:59,717 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-e043b5e1) (logid:0203bb00) End cleanup expired async-jobs
2017-04-18 20:56:59,963 DEBUG [c.c.h.k.d.LibvirtServerDiscoverer] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) Timeout, to wait for the host connecting to mgt svr, assuming it is failed
2017-04-18 20:56:59,963 WARN [c.c.r.ResourceManagerImpl] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) Unable to find the server resources at http://10.0.0.5
2017-04-18 20:56:59,964 INFO [c.c.u.e.CSExceptionErrorCode] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) Could not find exception: com.cloud.exception.DiscoveryException in error code list for exceptions
2017-04-18 20:56:59,964 WARN [o.a.c.a.c.a.h.AddHostCmd] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) Exception:
com.cloud.exception.DiscoveryException: Unable to add the host
at com.cloud.resource.ResourceManagerImpl.discoverHostsFull(ResourceManagerImpl.java:806)
at com.cloud.resource.ResourceManagerImpl.discoverHosts(ResourceManagerImpl.java:598)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at com.sun.proxy.$Proxy160.discoverHosts(Unknown Source)
at org.apache.cloudstack.api.command.admin.host.AddHostCmd.execute(AddHostCmd.java:142)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
at com.cloud.api.ApiServer.queueCommand(ApiServer.java:709)
at com.cloud.api.ApiServer.handleRequest(ApiServer.java:533)
at com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:299)
at com.cloud.api.ApiServlet$1.run(ApiServlet.java:129)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:126)
at com.cloud.api.ApiServlet.doPost(ApiServlet.java:93)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:643)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:723)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:299)
at org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:896)
at org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:732)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2277)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2017-04-18 20:56:59,964 INFO [c.c.a.ApiServer] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) Unable to add the host
2017-04-18 20:56:59,965 DEBUG [c.c.a.ApiServlet] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) ===END=== 10.0.0.2 -- POST command=addHost&response=json
2017-04-18 20:57:00,988 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-14:null) (logid:) SeqA 5-479: Processing Seq 5-479: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-18 20:57:01,074 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-14:null) (logid:) SeqA 5-479: Sending Seq 5-479: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-18 20:57:09,465 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-15:null) (logid:) Ping from 5(v-6-VM)
2017-04-18 20:57:09,647 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-1:null) (logid:) Ping from 3(s-2-VM)
2017-04-18 20:57:09,719 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-b38b767a) (logid:5b5de7b7) Begin cleanup expired async-jobs
2017-04-18 20:57:09,725 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-b38b767a) (logid:5b5de7b7) End cleanup expired async-jobs
2017-04-18 20:57:10,928 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-db45f56a) (logid:a742d33f) Zone 1 is ready to launch secondary storage VM
2017-04-18 20:57:10,999 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-892e3eec) (logid:739e8590) Zone 1 is ready to launch console proxy
2017-04-18 20:57:11,030 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-9:null) (logid:) SeqA 5-481: Processing Seq 5-481: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-18 20:57:11,150 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-9:null) (logid:) SeqA 5-481: Sending Seq 5-481: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-18 20:57:15,992 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-2:null) (logid:) SeqA 5-482: Processing Seq 5-482: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-18 20:57:16,067 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-2:null) (logid:) SeqA 5-482: Sending Seq 5-482: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-18 20:57:19,719 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-0d968653) (logid:74a5d87b) Begin cleanup expired async-jobs
2017-04-18 20:57:19,725 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-0d968653) (logid:74a5d87b) End cleanup expired async-jobs
2017-04-18 20:57:19,944 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-80589e90) (logid:80d37fa8) Found 0 routers to update status.
2017-04-18 20:57:19,946 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-80589e90) (logid:80d37fa8) Found 0 VPC networks to update Redundant State.
Is there a way, we can check if a host is ready to be added to cluster before adding it from cloudstack management UI?
Regards
Adeel
Host KVM Installation — Apache CloudStack Installation ...<http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/4.9/hypervisor/kvm.html>
docs.cloudstack.apache.org
KVM Installation Overview¶ If you want to use the Linux Kernel Virtual Machine (KVM) hypervisor to run guest virtual machines, install KVM on the host(s) in your cloud.
Re: Trouble Adding Ubuntu-KVM hosts on Cloudstack
Posted by Muhammad Adeel Zahid <16...@lums.edu.pk>.
And following is how agent logs look like on KVM host I am trying to add. I think, its having some problem with storage pool and it is receiving sig-kill too often
2017-04-19 02:56:49,432 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Proccess agent startup answer, agent id = 0
2017-04-19 02:56:49,433 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Set agent id 0
2017-04-19 02:56:49,433 INFO [cloud.agent.Agent] (AgentShutdownThread:null) (logid:) Stopping the agent: Reason = sig.kill
2017-04-19 02:56:49,459 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Startup Response Received: agent id = 0
2017-04-19 02:58:16,014 INFO [cloud.agent.AgentShell] (main:null) (logid:) Agent started
2017-04-19 02:58:16,015 INFO [cloud.agent.AgentShell] (main:null) (logid:) Implementation Version is 4.9.2.0
2017-04-19 02:58:16,016 INFO [cloud.agent.AgentShell] (main:null) (logid:) agent.properties found at /etc/cloudstack/agent/agent.properties
2017-04-19 02:58:16,019 INFO [cloud.agent.AgentShell] (main:null) (logid:) Defaulting to using properties file for storage
2017-04-19 02:58:16,020 INFO [cloud.agent.AgentShell] (main:null) (logid:) Defaulting to the constant time backoff algorithm
2017-04-19 02:58:16,028 INFO [cloud.utils.LogUtils] (main:null) (logid:) log4j configuration found at /etc/cloudstack/agent/log4j-cloud.xml
2017-04-19 02:58:16,037 INFO [cloud.agent.AgentShell] (main:null) (logid:) Using default Java settings for IPv6 preference for agent connection
2017-04-19 02:58:16,070 INFO [cloud.agent.Agent] (main:null) (logid:) id is 0
2017-04-19 02:58:16,091 INFO [kvm.resource.LibvirtConnection] (main:null) (logid:) No existing libvirtd connection found. Opening a new one
2017-04-19 02:58:16,306 INFO [org.reflections.Reflections] (main:null) (logid:) Reflections took 52 ms to scan 1 urls, producing 7 keys and 10 values
2017-04-19 02:58:16,362 INFO [kvm.resource.LibvirtComputingResource] (main:null) (logid:) No libvirt.vif.driver specified. Defaults to BridgeVifDriver.
2017-04-19 02:58:16,375 INFO [cloud.agent.Agent] (main:null) (logid:) Agent [id = 0 : type = LibvirtComputingResource : zone = 1 : pod = 1 : workers = 5 : host = 10.0.0.2 : port = 8250
2017-04-19 02:58:16,377 INFO [utils.nio.NioClient] (main:null) (logid:) Connecting to 10.0.0.2:8250
2017-04-19 02:58:16,557 INFO [utils.nio.NioClient] (main:null) (logid:) SSL: Handshake done
2017-04-19 02:58:16,558 INFO [utils.nio.NioClient] (main:null) (logid:) Connected to 10.0.0.2:8250
2017-04-19 02:58:16,589 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Attempting to create storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 (Filesystem) in libvirt
2017-04-19 02:58:16,593 WARN [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 was not found running in libvirt. Need to create it.
2017-04-19 02:58:16,593 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Didn't find an existing storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 by UUID, checking for pools with duplicate paths
2017-04-19 02:58:16,595 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Trying to fetch storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 from libvirt
2017-04-19 02:58:16,633 INFO [cloud.serializer.GsonHelper] (Agent-Handler-1:null) (logid:) Default Builder inited.
2017-04-19 02:58:19,448 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Proccess agent startup answer, agent id = 0
2017-04-19 02:58:19,448 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Set agent id 0
2017-04-19 02:58:19,448 INFO [cloud.agent.Agent] (AgentShutdownThread:null) (logid:) Stopping the agent: Reason = sig.kill
2017-04-19 02:58:19,452 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Startup Response Received: agent id = 0
2017-04-19 04:13:46,596 INFO [cloud.agent.AgentShell] (main:null) (logid:) Agent started
2017-04-19 04:13:46,630 INFO [cloud.agent.AgentShell] (main:null) (logid:) Implementation Version is 4.9.2.0
2017-04-19 04:13:46,631 INFO [cloud.agent.AgentShell] (main:null) (logid:) agent.properties found at /etc/cloudstack/agent/agent.properties
2017-04-19 04:13:46,634 INFO [cloud.agent.AgentShell] (main:null) (logid:) Defaulting to using properties file for storage
2017-04-19 04:13:46,635 INFO [cloud.agent.AgentShell] (main:null) (logid:) Defaulting to the constant time backoff algorithm
2017-04-19 04:13:46,654 INFO [cloud.utils.LogUtils] (main:null) (logid:) log4j configuration found at /etc/cloudstack/agent/log4j-cloud.xml
2017-04-19 04:13:46,662 INFO [cloud.agent.AgentShell] (main:null) (logid:) Using default Java settings for IPv6 preference for agent connection
2017-04-19 04:13:46,821 INFO [cloud.agent.Agent] (main:null) (logid:) id is 0
2017-04-19 04:13:47,013 INFO [kvm.resource.LibvirtConnection] (main:null) (logid:) No existing libvirtd connection found. Opening a new one
2017-04-19 04:13:48,061 INFO [org.reflections.Reflections] (main:null) (logid:) Reflections took 162 ms to scan 1 urls, producing 7 keys and 10 values
2017-04-19 04:13:48,449 INFO [kvm.resource.LibvirtComputingResource] (main:null) (logid:) No libvirt.vif.driver specified. Defaults to BridgeVifDriver.
2017-04-19 04:13:48,473 INFO [cloud.agent.Agent] (main:null) (logid:) Agent [id = 0 : type = LibvirtComputingResource : zone = 1 : pod = 1 : workers = 5 : host = 10.0.0.2 : port = 8250
2017-04-19 04:13:48,478 INFO [utils.nio.NioClient] (main:null) (logid:) Connecting to 10.0.0.2:8250
2017-04-19 04:13:48,913 INFO [utils.nio.NioClient] (main:null) (logid:) SSL: Handshake done
2017-04-19 04:13:48,913 INFO [utils.nio.NioClient] (main:null) (logid:) Connected to 10.0.0.2:8250
2017-04-19 04:13:49,127 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Attempting to create storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 (Filesystem) in libvirt
2017-04-19 04:13:49,167 WARN [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 was not found running in libvirt. Need to create it.
2017-04-19 04:13:49,167 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Didn't find an existing storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 by UUID, checking for pools with duplicate paths
2017-04-19 04:13:49,284 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Trying to fetch storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 from libvirt
2017-04-19 04:13:49,431 INFO [cloud.serializer.GsonHelper] (Agent-Handler-1:null) (logid:) Default Builder inited.
2017-04-19 04:13:54,999 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Proccess agent startup answer, agent id = 0
2017-04-19 04:13:54,999 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Set agent id 0
2017-04-19 04:13:55,001 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Startup Response Received: agent id = 0
2017-04-19 04:13:55,005 INFO [cloud.agent.Agent] (AgentShutdownThread:null) (logid:) Stopping the agent: Reason = sig.kill
2017-04-19 04:15:14,373 INFO [cloud.agent.AgentShell] (main:null) (logid:) Agent started
2017-04-19 04:15:14,374 INFO [cloud.agent.AgentShell] (main:null) (logid:) Implementation Version is 4.9.2.0
2017-04-19 04:15:14,375 INFO [cloud.agent.AgentShell] (main:null) (logid:) agent.properties found at /etc/cloudstack/agent/agent.properties
2017-04-19 04:15:14,378 INFO [cloud.agent.AgentShell] (main:null) (logid:) Defaulting to using properties file for storage
2017-04-19 04:15:14,379 INFO [cloud.agent.AgentShell] (main:null) (logid:) Defaulting to the constant time backoff algorithm
2017-04-19 04:15:14,387 INFO [cloud.utils.LogUtils] (main:null) (logid:) log4j configuration found at /etc/cloudstack/agent/log4j-cloud.xml
2017-04-19 04:15:14,396 INFO [cloud.agent.AgentShell] (main:null) (logid:) Using default Java settings for IPv6 preference for agent connection
2017-04-19 04:15:14,430 INFO [cloud.agent.Agent] (main:null) (logid:) id is 0
2017-04-19 04:15:14,450 INFO [kvm.resource.LibvirtConnection] (main:null) (logid:) No existing libvirtd connection found. Opening a new one
2017-04-19 04:15:14,669 INFO [org.reflections.Reflections] (main:null) (logid:) Reflections took 52 ms to scan 1 urls, producing 7 keys and 10 values
2017-04-19 04:15:14,725 INFO [kvm.resource.LibvirtComputingResource] (main:null) (logid:) No libvirt.vif.driver specified. Defaults to BridgeVifDriver.
2017-04-19 04:15:14,738 INFO [cloud.agent.Agent] (main:null) (logid:) Agent [id = 0 : type = LibvirtComputingResource : zone = 1 : pod = 1 : workers = 5 : host = 10.0.0.2 : port = 8250
2017-04-19 04:15:14,741 INFO [utils.nio.NioClient] (main:null) (logid:) Connecting to 10.0.0.2:8250
2017-04-19 04:15:14,919 INFO [utils.nio.NioClient] (main:null) (logid:) SSL: Handshake done
2017-04-19 04:15:14,919 INFO [utils.nio.NioClient] (main:null) (logid:) Connected to 10.0.0.2:8250
2017-04-19 04:15:14,949 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Attempting to create storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 (Filesystem) in libvirt
2017-04-19 04:15:14,953 WARN [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 was not found running in libvirt. Need to create it.
2017-04-19 04:15:14,953 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Didn't find an existing storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 by UUID, checking for pools with duplicate paths
2017-04-19 04:15:14,955 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Trying to fetch storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 from libvirt
2017-04-19 04:15:14,992 INFO [cloud.serializer.GsonHelper] (Agent-Handler-1:null) (logid:) Default Builder inited.
2017-04-19 04:15:15,875 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Proccess agent startup answer, agent id = 0
2017-04-19 04:15:15,875 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Set agent id 0
2017-04-19 04:15:15,876 INFO [cloud.agent.Agent] (AgentShutdownThread:null) (logid:) Stopping the agent: Reason = sig.kill
2017-04-19 04:15:15,880 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Startup Response Received: agent id = 0
2017-04-19 04:30:21,032 INFO [cloud.agent.AgentShell] (main:null) (logid:) Agent started
2017-04-19 04:30:21,033 INFO [cloud.agent.AgentShell] (main:null) (logid:) Implementation Version is 4.9.2.0
2017-04-19 04:30:21,034 INFO [cloud.agent.AgentShell] (main:null) (logid:) agent.properties found at /etc/cloudstack/agent/agent.properties
2017-04-19 04:30:21,037 INFO [cloud.agent.AgentShell] (main:null) (logid:) Defaulting to using properties file for storage
2017-04-19 04:30:21,037 INFO [cloud.agent.AgentShell] (main:null) (logid:) Defaulting to the constant time backoff algorithm
2017-04-19 04:30:21,046 INFO [cloud.utils.LogUtils] (main:null) (logid:) log4j configuration found at /etc/cloudstack/agent/log4j-cloud.xml
2017-04-19 04:30:21,054 INFO [cloud.agent.AgentShell] (main:null) (logid:) Using default Java settings for IPv6 preference for agent connection
2017-04-19 04:30:21,088 INFO [cloud.agent.Agent] (main:null) (logid:) id is 0
2017-04-19 04:30:21,109 INFO [kvm.resource.LibvirtConnection] (main:null) (logid:) No existing libvirtd connection found. Opening a new one
2017-04-19 04:30:21,287 INFO [org.reflections.Reflections] (main:null) (logid:) Reflections took 52 ms to scan 1 urls, producing 7 keys and 10 values
2017-04-19 04:30:21,342 INFO [kvm.resource.LibvirtComputingResource] (main:null) (logid:) No libvirt.vif.driver specified. Defaults to BridgeVifDriver.
2017-04-19 04:30:21,355 INFO [cloud.agent.Agent] (main:null) (logid:) Agent [id = 0 : type = LibvirtComputingResource : zone = 1 : pod = 1 : workers = 5 : host = 10.0.0.2 : port = 8250
2017-04-19 04:30:21,357 INFO [utils.nio.NioClient] (main:null) (logid:) Connecting to 10.0.0.2:8250
2017-04-19 04:30:21,535 INFO [utils.nio.NioClient] (main:null) (logid:) SSL: Handshake done
2017-04-19 04:30:21,535 INFO [utils.nio.NioClient] (main:null) (logid:) Connected to 10.0.0.2:8250
2017-04-19 04:30:21,565 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Attempting to create storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 (Filesystem) in libvirt
2017-04-19 04:30:21,568 WARN [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 was not found running in libvirt. Need to create it.
2017-04-19 04:30:21,568 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Didn't find an existing storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 by UUID, checking for pools with duplicate paths
2017-04-19 04:30:21,571 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Trying to fetch storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 from libvirt
2017-04-19 04:30:21,608 INFO [cloud.serializer.GsonHelper] (Agent-Handler-1:null) (logid:) Default Builder inited.
2017-04-19 04:30:26,638 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Proccess agent startup answer, agent id = 0
2017-04-19 04:30:26,638 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Set agent id 0
2017-04-19 04:30:26,639 INFO [cloud.agent.Agent] (AgentShutdownThread:null) (logid:) Stopping the agent: Reason = sig.kill
2017-04-19 04:30:26,644 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Startup Response Received: agent id = 0
Regards
Adeel
________________________________
From: Muhammad Adeel Zahid <16...@lums.edu.pk>
Sent: Tuesday, April 18, 2017 9:14:37 PM
To: users@cloudstack.apache.org
Subject: Trouble Adding Ubuntu-KVM hosts on Cloudstack
Hi Guys,
Few weeks ago, I installed cloudsack management on one machine and KVM on other machine. Both were using CentOS 6. All is working fine with these two machines. Now, I installed ubuntu and KVM on third machine and wanted to add it to the cluster but I never seem to be able to do it. I always get "failed adding host" message.
I followed http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/4.9/hypervisor/kvm.htmlfor KVM installation on ubuntu. The only difference is that, I don't have eth0 interface. The only ethernet interface showing in my machine is enso1. So I replaced every occurance of eth0 with enso1? I don't know if that might be creating problem?
And the following seems to be the relevant portion from management-server.log
2017-04-18 20:56:50,340 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done executing cpu/ram capacity update
2017-04-18 20:56:50,340 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Executing storage capacity update
2017-04-18 20:56:50,343 DEBUG [c.c.s.StorageManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Found storage pool Primary 1 of type NetworkFilesystem with overprovisioning factor 2
2017-04-18 20:56:50,343 DEBUG [c.c.s.StorageManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Total over provisioned capacity calculated is 2 * 52710866944
2017-04-18 20:56:50,343 DEBUG [c.c.s.StorageManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Total over provisioned capacity of the pool Primary 1 id: 1 is 105421733888
2017-04-18 20:56:50,407 DEBUG [c.c.s.StorageManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Successfully set Capacity - 105421733888 for capacity type - 3 , DataCenterId - 1, HostOrPoolId - 1, PodId null
2017-04-18 20:56:50,407 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done executing storage capacity update
2017-04-18 20:56:50,407 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Executing capacity updates for public ip and Vlans
2017-04-18 20:56:50,409 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done capacity updates for public ip and Vlans
2017-04-18 20:56:50,409 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Executing capacity updates for private ip
2017-04-18 20:56:50,410 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done executing capacity updates for private ip
2017-04-18 20:56:50,410 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done recalculating system capacity
2017-04-18 20:56:50,416 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done running Capacity Checker ...
2017-04-18 20:56:50,617 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-bc905976) (logid:e7d551f4) Found 0 routers to update status.
2017-04-18 20:56:50,619 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-bc905976) (logid:e7d551f4) Found 0 VPC networks to update Redundant State.
2017-04-18 20:56:50,621 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-bc905976) (logid:e7d551f4) Found 0 networks to update RvR status.
2017-04-18 20:56:50,990 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-478: Processing Seq 5-478: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-18 20:56:51,057 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-478: Sending Seq 5-478: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-18 20:56:59,715 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-e043b5e1) (logid:0203bb00) Begin cleanup expired async-jobs
2017-04-18 20:56:59,717 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-e043b5e1) (logid:0203bb00) End cleanup expired async-jobs
2017-04-18 20:56:59,963 DEBUG [c.c.h.k.d.LibvirtServerDiscoverer] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) Timeout, to wait for the host connecting to mgt svr, assuming it is failed
2017-04-18 20:56:59,963 WARN [c.c.r.ResourceManagerImpl] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) Unable to find the server resources at http://10.0.0.5
2017-04-18 20:56:59,964 INFO [c.c.u.e.CSExceptionErrorCode] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) Could not find exception: com.cloud.exception.DiscoveryException in error code list for exceptions
2017-04-18 20:56:59,964 WARN [o.a.c.a.c.a.h.AddHostCmd] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) Exception:
com.cloud.exception.DiscoveryException: Unable to add the host
at com.cloud.resource.ResourceManagerImpl.discoverHostsFull(ResourceManagerImpl.java:806)
at com.cloud.resource.ResourceManagerImpl.discoverHosts(ResourceManagerImpl.java:598)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at com.sun.proxy.$Proxy160.discoverHosts(Unknown Source)
at org.apache.cloudstack.api.command.admin.host.AddHostCmd.execute(AddHostCmd.java:142)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
at com.cloud.api.ApiServer.queueCommand(ApiServer.java:709)
at com.cloud.api.ApiServer.handleRequest(ApiServer.java:533)
at com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:299)
at com.cloud.api.ApiServlet$1.run(ApiServlet.java:129)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:126)
at com.cloud.api.ApiServlet.doPost(ApiServlet.java:93)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:643)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:723)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:299)
at org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:896)
at org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:732)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2277)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2017-04-18 20:56:59,964 INFO [c.c.a.ApiServer] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) Unable to add the host
2017-04-18 20:56:59,965 DEBUG [c.c.a.ApiServlet] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) ===END=== 10.0.0.2 -- POST command=addHost&response=json
2017-04-18 20:57:00,988 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-14:null) (logid:) SeqA 5-479: Processing Seq 5-479: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-18 20:57:01,074 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-14:null) (logid:) SeqA 5-479: Sending Seq 5-479: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-18 20:57:09,465 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-15:null) (logid:) Ping from 5(v-6-VM)
2017-04-18 20:57:09,647 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-1:null) (logid:) Ping from 3(s-2-VM)
2017-04-18 20:57:09,719 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-b38b767a) (logid:5b5de7b7) Begin cleanup expired async-jobs
2017-04-18 20:57:09,725 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-b38b767a) (logid:5b5de7b7) End cleanup expired async-jobs
2017-04-18 20:57:10,928 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-db45f56a) (logid:a742d33f) Zone 1 is ready to launch secondary storage VM
2017-04-18 20:57:10,999 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-892e3eec) (logid:739e8590) Zone 1 is ready to launch console proxy
2017-04-18 20:57:11,030 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-9:null) (logid:) SeqA 5-481: Processing Seq 5-481: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-18 20:57:11,150 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-9:null) (logid:) SeqA 5-481: Sending Seq 5-481: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-18 20:57:15,992 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-2:null) (logid:) SeqA 5-482: Processing Seq 5-482: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2017-04-18 20:57:16,067 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-2:null) (logid:) SeqA 5-482: Sending Seq 5-482: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2017-04-18 20:57:19,719 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-0d968653) (logid:74a5d87b) Begin cleanup expired async-jobs
2017-04-18 20:57:19,725 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-0d968653) (logid:74a5d87b) End cleanup expired async-jobs
2017-04-18 20:57:19,944 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-80589e90) (logid:80d37fa8) Found 0 routers to update status.
2017-04-18 20:57:19,946 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-80589e90) (logid:80d37fa8) Found 0 VPC networks to update Redundant State.
Is there a way, we can check if a host is ready to be added to cluster before adding it from cloudstack management UI?
Regards
Adeel
Host KVM Installation — Apache CloudStack Installation ...<http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/4.9/hypervisor/kvm.html>
docs.cloudstack.apache.org
KVM Installation Overview¶ If you want to use the Linux Kernel Virtual Machine (KVM) hypervisor to run guest virtual machines, install KVM on the host(s) in your cloud.