You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by "Vogel, Sven" <Sv...@kupper-computer.com> on 2016/11/15 10:52:33 UTC

KVM + CentOS 7.2 + after connection agent state for long time in alert mode

Hi,

i already opened a bug report in jira. https://issues.apache.org/jira/browse/CLOUDSTACK-9590

maybe anyone in mailing list can help.


1. first of all i add the host from cs management
2. Management Host cloudstack-setup-agent  -m 192.168.85.25 -z 3 -p 3 -c 9 -g 6e6cff15-3183-3cca-9389-ed1a78f6236a -a --pubNic=cloudbr2 --prvNic=cloudbr0 --guestNic=cloudbr1 --hypervisor=kvm
3. agent will be dead after add to the host
4. restart agent
6. agent reconnect to server and wait with alert

In cs manager I get the following error.


2016-11-14 16:44:56,034 WARN  [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Monitor NetworkOrchestrator says there is an error in the connect process for 70 due to Unable to get an answer to the Check

NetworkCommand from agent: 70

2016-11-14 16:44:56,034 INFO  [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Host 70 is disconnecting with event AgentDisconnected

2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) The next status of agent 70is Alert, current status is Connecting

2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Deregistering link for 70 with state Alert

2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Remove Agent : 70

2016-11-14 16:44:56,040 DEBUG [c.c.a.m.ConnectedAgentAttache] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Processing Disconnect.

2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.hypervisor.xenserver.discoverer.XcpServerDiscoverer

2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.hypervisor.hyperv.discoverer.HypervServerDiscoverer

2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.storage.secondary.SecondaryStorageListener

2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.storage.listener.StoragePoolMonitor

2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.vm.ClusteredVirtualMachineManagerImpl

2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.network.security.SecurityGroupListener

2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.deploy.DeploymentPlanningManagerImpl

2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: org.apache.cloudstack.engine.orchestration.NetworkOrchestrator

2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.network.SshKeysDistriMonitor

2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.network.router.VpcVirtualNetworkApplianceManagerImpl

2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.storage.LocalStoragePoolListener

2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.capacity.StorageCapacityListener

2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.capacity.ComputeCapacityListener

2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.network.SshKeysDistriMonitor

2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.network.router.VirtualNetworkApplianceManagerImpl

2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.storage.upload.UploadListener

2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.network.NetworkUsageManagerImpl$DirectNetworkStatsListener

2016-11-14 16:44:56,041 DEBUG [c.c.n.NetworkUsageManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Disconnected called on 70 with status Alert

2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.agent.manager.AgentManagerImpl$BehindOnPingListener

2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.consoleproxy.ConsoleProxyListener

2016-11-14 16:44:56,043 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.storage.download.DownloadListener

2016-11-14 16:44:56,044 DEBUG [c.c.h.Status] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Transition:[Resource state = Enabled, Agent event = AgentDisconnected, Host id = 70, name = kvm03.oscloud.local]

2016-11-14 16:44:56,054 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Notifying other nodes of to disconnect

2016-11-14 16:44:56,060 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Failed to handle host connection: com.cloud.exception.ConnectionException: Unable to get an answer to the CheckNetworkCommand from agent: 70

2016-11-14 16:44:56,064 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Can not send command com.cloud.agent.api.ReadyCommand due to Host 70 is not up

2016-11-14 16:44:58,384 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-3:null) (logid:) SeqA 39-159363: Processing Seq 39-159363:  { Cmd , MgmtId: -1, via: 39, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":13179,"_loadInfo":"{\n  \"connections\": []\n}","wait":0}}] }

2016-11-14 16:44:58,394 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-3:null) (logid:) SeqA 39-159363: Sending Seq 39-159363:  { Ans: , MgmtId: 3232257305, via: 39, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }

I don't know why he cant get the check networkcommand.

Anyone can help me?

regards,
Sven Vogel



AW: KVM + CentOS 7.2 + after connection agent state for long time in alert mode

Posted by "Vogel, Sven" <Sv...@kupper-computer.com>.
Hi Dag,

Yes you are right it was the only problem - OpenJDK 1.8

1. i removed the cloudstack agent and OpenJDK 1.8.
2. i removed the host for tests.
3. i installed the OpenJDK 1.7.X Patchlevel and installed cloudstack agent again.
4. add host back to cloudstack management. Alert is gone after any seconds.

After that all things run fine.

Thanks and Regards, 

Sven



-----Ursprüngliche Nachricht-----
Von: Dag Sonstebo [mailto:Dag.Sonstebo@shapeblue.com] 
Gesendet: Montag, 21. November 2016 14:37
An: users@cloudstack.apache.org
Betreff: Re: KVM + CentOS 7.2 + after connection agent state for long time in alert mode

For completeness sake – this issue was traced back to a potential issue with OpenJDK 1.8. Once host was downgraded to OpenJDK 1.7 the issue seemed to be resolved.

Sven – if I missed any steps you carried out can you update?

Regards,
Dag Sonstebo
Cloud Architect
ShapeBlue

On 15/11/2016, 10:52, "Vogel, Sven" <Sv...@kupper-computer.com> wrote:

    Hi,
    
    i already opened a bug report in jira. https://issues.apache.org/jira/browse/CLOUDSTACK-9590
    
    maybe anyone in mailing list can help.
    
    
    1. first of all i add the host from cs management
    2. Management Host cloudstack-setup-agent  -m 192.168.85.25 -z 3 -p 3 -c 9 -g 6e6cff15-3183-3cca-9389-ed1a78f6236a -a --pubNic=cloudbr2 --prvNic=cloudbr0 --guestNic=cloudbr1 --hypervisor=kvm
    3. agent will be dead after add to the host
    4. restart agent
    6. agent reconnect to server and wait with alert
    
    In cs manager I get the following error.
    
    
    2016-11-14 16:44:56,034 WARN  [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Monitor NetworkOrchestrator says there is an error in the connect process for 70 due to Unable to get an answer to the Check
    
    NetworkCommand from agent: 70
    
    2016-11-14 16:44:56,034 INFO  [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Host 70 is disconnecting with event AgentDisconnected
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) The next status of agent 70is Alert, current status is Connecting
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Deregistering link for 70 with state Alert
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Remove Agent : 70
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.ConnectedAgentAttache] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Processing Disconnect.
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.hypervisor.xenserver.discoverer.XcpServerDiscoverer
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.hypervisor.hyperv.discoverer.HypervServerDiscoverer
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.storage.secondary.SecondaryStorageListener
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.storage.listener.StoragePoolMonitor
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.vm.ClusteredVirtualMachineManagerImpl
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.network.security.SecurityGroupListener
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.deploy.DeploymentPlanningManagerImpl
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: org.apache.cloudstack.engine.orchestration.NetworkOrchestrator
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.network.SshKeysDistriMonitor
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.network.router.VpcVirtualNetworkApplianceManagerImpl
    
    2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.storage.LocalStoragePoolListener
    
    2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.capacity.StorageCapacityListener
    
    2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.capacity.ComputeCapacityListener
    
    2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.network.SshKeysDistriMonitor
    
    2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.network.router.VirtualNetworkApplianceManagerImpl
    
    2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.storage.upload.UploadListener
    
    2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.network.NetworkUsageManagerImpl$DirectNetworkStatsListener
    
    2016-11-14 16:44:56,041 DEBUG [c.c.n.NetworkUsageManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Disconnected called on 70 with status Alert
    
    2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.agent.manager.AgentManagerImpl$BehindOnPingListener
    
    2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.consoleproxy.ConsoleProxyListener
    
    2016-11-14 16:44:56,043 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.storage.download.DownloadListener
    
    2016-11-14 16:44:56,044 DEBUG [c.c.h.Status] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Transition:[Resource state = Enabled, Agent event = AgentDisconnected, Host id = 70, name = kvm03.oscloud.local]
    
    2016-11-14 16:44:56,054 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Notifying other nodes of to disconnect
    
    2016-11-14 16:44:56,060 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Failed to handle host connection: com.cloud.exception.ConnectionException: Unable to get an answer to the CheckNetworkCommand from agent: 70
    
    2016-11-14 16:44:56,064 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Can not send command com.cloud.agent.api.ReadyCommand due to Host 70 is not up
    
    2016-11-14 16:44:58,384 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-3:null) (logid:) SeqA 39-159363: Processing Seq 39-159363:  { Cmd , MgmtId: -1, via: 39, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":13179,"_loadInfo":"{\n  \"connections\": []\n}","wait":0}}] }
    
    2016-11-14 16:44:58,394 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-3:null) (logid:) SeqA 39-159363: Sending Seq 39-159363:  { Ans: , MgmtId: 3232257305, via: 39, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
    
    I don't know why he cant get the check networkcommand.
    
    Anyone can help me?
    
    regards,
    Sven Vogel
    
    
    


Dag.Sonstebo@shapeblue.com
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK @shapeblue
  
 


Re: KVM + CentOS 7.2 + after connection agent state for long time in alert mode

Posted by Dag Sonstebo <Da...@shapeblue.com>.
For completeness sake – this issue was traced back to a potential issue with OpenJDK 1.8. Once host was downgraded to OpenJDK 1.7 the issue seemed to be resolved.

Sven – if I missed any steps you carried out can you update?

Regards,
Dag Sonstebo
Cloud Architect
ShapeBlue

On 15/11/2016, 10:52, "Vogel, Sven" <Sv...@kupper-computer.com> wrote:

    Hi,
    
    i already opened a bug report in jira. https://issues.apache.org/jira/browse/CLOUDSTACK-9590
    
    maybe anyone in mailing list can help.
    
    
    1. first of all i add the host from cs management
    2. Management Host cloudstack-setup-agent  -m 192.168.85.25 -z 3 -p 3 -c 9 -g 6e6cff15-3183-3cca-9389-ed1a78f6236a -a --pubNic=cloudbr2 --prvNic=cloudbr0 --guestNic=cloudbr1 --hypervisor=kvm
    3. agent will be dead after add to the host
    4. restart agent
    6. agent reconnect to server and wait with alert
    
    In cs manager I get the following error.
    
    
    2016-11-14 16:44:56,034 WARN  [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Monitor NetworkOrchestrator says there is an error in the connect process for 70 due to Unable to get an answer to the Check
    
    NetworkCommand from agent: 70
    
    2016-11-14 16:44:56,034 INFO  [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Host 70 is disconnecting with event AgentDisconnected
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) The next status of agent 70is Alert, current status is Connecting
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Deregistering link for 70 with state Alert
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Remove Agent : 70
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.ConnectedAgentAttache] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Processing Disconnect.
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.hypervisor.xenserver.discoverer.XcpServerDiscoverer
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.hypervisor.hyperv.discoverer.HypervServerDiscoverer
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.storage.secondary.SecondaryStorageListener
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.storage.listener.StoragePoolMonitor
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.vm.ClusteredVirtualMachineManagerImpl
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.network.security.SecurityGroupListener
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.deploy.DeploymentPlanningManagerImpl
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: org.apache.cloudstack.engine.orchestration.NetworkOrchestrator
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.network.SshKeysDistriMonitor
    
    2016-11-14 16:44:56,040 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.network.router.VpcVirtualNetworkApplianceManagerImpl
    
    2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.storage.LocalStoragePoolListener
    
    2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.capacity.StorageCapacityListener
    
    2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.capacity.ComputeCapacityListener
    
    2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.network.SshKeysDistriMonitor
    
    2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.network.router.VirtualNetworkApplianceManagerImpl
    
    2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.storage.upload.UploadListener
    
    2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.network.NetworkUsageManagerImpl$DirectNetworkStatsListener
    
    2016-11-14 16:44:56,041 DEBUG [c.c.n.NetworkUsageManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Disconnected called on 70 with status Alert
    
    2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.agent.manager.AgentManagerImpl$BehindOnPingListener
    
    2016-11-14 16:44:56,041 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.consoleproxy.ConsoleProxyListener
    
    2016-11-14 16:44:56,043 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Sending Disconnect to listener: com.cloud.storage.download.DownloadListener
    
    2016-11-14 16:44:56,044 DEBUG [c.c.h.Status] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Transition:[Resource state = Enabled, Agent event = AgentDisconnected, Host id = 70, name = kvm03.oscloud.local]
    
    2016-11-14 16:44:56,054 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Notifying other nodes of to disconnect
    
    2016-11-14 16:44:56,060 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Failed to handle host connection: com.cloud.exception.ConnectionException: Unable to get an answer to the CheckNetworkCommand from agent: 70
    
    2016-11-14 16:44:56,064 DEBUG [c.c.a.m.AgentManagerImpl] (AgentConnectTaskPool-15:ctx-f99e936f) (logid:6cdf713e) Can not send command com.cloud.agent.api.ReadyCommand due to Host 70 is not up
    
    2016-11-14 16:44:58,384 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-3:null) (logid:) SeqA 39-159363: Processing Seq 39-159363:  { Cmd , MgmtId: -1, via: 39, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":13179,"_loadInfo":"{\n  \"connections\": []\n}","wait":0}}] }
    
    2016-11-14 16:44:58,394 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-3:null) (logid:) SeqA 39-159363: Sending Seq 39-159363:  { Ans: , MgmtId: 3232257305, via: 39, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
    
    I don't know why he cant get the check networkcommand.
    
    Anyone can help me?
    
    regards,
    Sven Vogel
    
    
    


Dag.Sonstebo@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue