You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@cloudstack.apache.org by "Simon Weller (JIRA)" <ji...@apache.org> on 2013/07/23 01:26:48 UTC
[jira] [Commented] (CLOUDSTACK-3716) NPE triggered in
DownloadListener
[ https://issues.apache.org/jira/browse/CLOUDSTACK-3716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13715854#comment-13715854 ]
Simon Weller commented on CLOUDSTACK-3716:
------------------------------------------
I've been working on trying to reproduce this in our lab environment, and have so far failed. I'm going to continue looking at it this evening.
As you can probably see in the debug, we're running KVM. This NPE also existed in 4.0.x.
> NPE triggered in DownloadListener
> ---------------------------------
>
> Key: CLOUDSTACK-3716
> URL: https://issues.apache.org/jira/browse/CLOUDSTACK-3716
> Project: CloudStack
> Issue Type: Bug
> Security Level: Public(Anyone can view this level - this is the default.)
> Components: Management Server
> Affects Versions: 4.1.0, 4.2.0
> Environment: RHEL 6.3 platform.
> Reporter: Simon Weller
> Assignee: Min Chen
> Priority: Blocker
>
> NPE thrown in DownLoadListener process:
> 2013-07-22 11:46:51,670 DEBUG [agent.transport.Request] (AgentConnectTaskPool-2323:null) Seq 30-1100873733: Received: { Ans: , MgmtId: 159090354809909, via: 30, Ver: v1, Flags: 110, { ListTemplateAnswer } }
> 2013-07-22 11:46:51,670 DEBUG [agent.manager.AgentManagerImpl] (AgentConnectTaskPool-2323:null) Details from executing class com.cloud.agent.api.storage.ListTemplateCommand: success
> 2013-07-22 11:46:51,682 INFO [storage.download.DownloadMonitorImpl] (AgentConnectTaskPool-2323:null) Template Sync found routing-3 already in the template host table
> 2013-07-22 11:46:51,685 INFO [storage.download.DownloadMonitorImpl] (AgentConnectTaskPool-2323:null) Template Sync found centos55-x86_64 already in the template host table
> 2013-07-22 11:46:51,688 INFO [storage.download.DownloadMonitorImpl] (AgentConnectTaskPool-2323:null) Template Sync did not find centos56-x86_64-xen ready on server 11, will request download to start/resume shortly
> 2013-07-22 11:46:51,689 INFO [storage.download.DownloadMonitorImpl] (AgentConnectTaskPool-2323:null) Template Sync did not find centos53-x64 ready on server 11, will request download to start/resume shortly
> 2013-07-22 11:46:51,693 INFO [storage.download.DownloadMonitorImpl] (AgentConnectTaskPool-2323:null) Template Sync found 225-19-353032af-fd13-33d5-843b-1f7b1c321182 already in the template host table
> 2013-07-22 11:46:51,696 INFO [storage.download.DownloadMonitorImpl] (AgentConnectTaskPool-2323:null) Template Sync found 226-19-08172144-a8e2-3377-9d76-9a6231de5060 already in the template host table
> 2013-07-22 11:46:51,699 INFO [storage.download.DownloadMonitorImpl] (AgentConnectTaskPool-2323:null) Template Sync found 7686af3e-34f7-4ae3-ac69-0d089bcbd55e already in the template host table
> 2013-07-22 11:46:51,702 INFO [storage.download.DownloadMonitorImpl] (AgentConnectTaskPool-2323:null) Template Sync found 5e0726a4-73db-45d6-be2a-003c6ce8ff6e already in the template host table
> 2013-07-22 11:46:51,705 INFO [storage.download.DownloadMonitorImpl] (AgentConnectTaskPool-2323:null) Template Sync found a647c887-59ef-4b81-aa54-1d15bba5272a already in the template host table
> 2013-07-22 11:46:51,708 INFO [storage.download.DownloadMonitorImpl] (AgentConnectTaskPool-2323:null) Template Sync found 272-9-699a6075-54fb-3505-aa5b-68191614286e already in the template host table
> 2013-07-22 11:46:51,711 INFO [storage.download.DownloadMonitorImpl] (AgentConnectTaskPool-2323:null) Template Sync found 273-19-ffa343f8-6933-384c-846a-cf150a970791 already in the template host table
> 2013-07-22 11:46:51,714 INFO [storage.download.DownloadMonitorImpl] (AgentConnectTaskPool-2323:null) Template Sync found a2b9fcd7-2f19-48dd-affa-a60c574a75b1 already in the template host table
> 2013-07-22 11:46:51,716 INFO [storage.download.DownloadMonitorImpl] (AgentConnectTaskPool-2323:null) Template Sync found 5545c5fb-1b45-4dbc-8b1d-3cdac2c6394e already in the template host table
> 2013-07-22 11:46:51,729 DEBUG [agent.transport.Request] (AgentConnectTaskPool-2323:null) Seq 30-1100873734: Sending { Cmd , MgmtId: 159090354809909, via: 30, Ver: v1, Flags: 100111, [{"storage.ListVolumeCommand":{"secUrl":"nfs://172.27.68.201/secondarystorage","wait":0}}] }
> 2013-07-22 11:46:51,832 DEBUG [agent.transport.Request] (AgentManager-Handler-9:null) Seq 30-1100873734: Processing: { Ans: , MgmtId: 159090354809909, via: 30, Ver: v1, Flags: 110, [{"storage.ListVolumeAnswer":{"secUrl":"nfs://172.27.68.201/secondarystorage","templateInfos":{"215":{"templateName":"deviis01_1","installPath":"volumes/215//82c2d426-3361-347c-93f4-c355d49fc7e2.qcow2","size":21487961088,"physicalSize":8349614080,"id":215,"isPublic":true,"isCorrupted":false}},"result":true,"details":"success","wait":0}}] }
> 2013-07-22 11:46:51,832 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-9:null) Seq 30-1100873734: No more commands found
> 2013-07-22 11:46:51,832 DEBUG [agent.transport.Request] (AgentConnectTaskPool-2323:null) Seq 30-1100873734: Received: { Ans: , MgmtId: 159090354809909, via: 30, Ver: v1, Flags: 110, { ListVolumeAnswer } }
> 2013-07-22 11:46:51,832 DEBUG [agent.manager.AgentManagerImpl] (AgentConnectTaskPool-2323:null) Details from executing class com.cloud.agent.api.storage.ListVolumeCommand: success
> 2013-07-22 11:46:51,836 ERROR [agent.manager.AgentManagerImpl] (AgentConnectTaskPool-2323:null) Monitor DownloadListener says there is an error in the connect process for 30 due to null
> java.lang.NullPointerException
> at com.cloud.storage.download.DownloadMonitorImpl.handleVolumeSync(DownloadMonitorImpl.java:694)
> at com.cloud.storage.download.DownloadMonitorImpl.handleSync(DownloadMonitorImpl.java:620)
> at com.cloud.storage.download.DownloadListener.processConnect(DownloadListener.java:385)
> at com.cloud.agent.manager.AgentManagerImpl.notifyMonitorsOfConnection(AgentManagerImpl.java:611)
> at com.cloud.agent.manager.AgentManagerImpl.handleConnectedAgent(AgentManagerImpl.java:1111)
> at com.cloud.agent.manager.AgentManagerImpl.access$100(AgentManagerImpl.java:145)
> at com.cloud.agent.manager.AgentManagerImpl$HandleAgentConnectTask.run(AgentManagerImpl.java:1186)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:679)
> 2013-07-22 11:46:51,837 INFO [agent.manager.AgentManagerImpl] (AgentConnectTaskPool-2323:null) Host 30 is disconnecting with event AgentDisconnected
> 2013-07-22 11:46:51,838 DEBUG [agent.manager.AgentManagerImpl] (AgentConnectTaskPool-2323:null) The next status of agent 30is Alert, current status is Connecting
> 2013-07-22 11:46:51,838 DEBUG [agent.manager.AgentManagerImpl] (AgentConnectTaskPool-2323:null) Deregistering link for 30 with state Alert
> 2013-07-22 11:46:51,838 DEBUG [agent.manager.AgentManagerImpl] (AgentConnectTaskPool-2323:null) Remove Agent : 30
> 2013-07-22 11:46:51,838 DEBUG [agent.manager.ConnectedAgentAttache] (AgentConnectTaskPool-2323:null) Processing Disconnect.
> 2013-07-22 11:46:51,838 DEBUG [agent.manager.AgentManagerImpl] (AgentConnectTaskPool-2323:null) Sending Disconnect to listener: com.cloud.hypervisor.xen.discoverer.XcpServerDiscoverer_EnhancerByCloudStack_cd2a016e
> 2013-07-22 11:46:51,838 DEBUG [agent.manager.AgentManagerImpl] (AgentConnectTaskPool-2323:null) Sending Disconnect to listener: com.cloud.network.NetworkManagerImpl_EnhancerByCloudStack_a57f9d77
> 2013-07-22 11:46:51,839 DEBUG [agent.manager.AgentManagerImpl] (AgentConnectTaskPool-2323:null) Sending Disconnect to listener: com.cloud.storage.secondary.SecondaryStorageListener
> 2013-07-22 11:46:51,839 DEBUG [agent.manager.AgentManagerImpl] (AgentConnectTaskPool-2323:null) Sending Disconnect to listener: com.cloud.hypervisor.vmware.manager.VmwareManagerImpl_EnhancerByCloudStack_3cf49c71
> 2013-07-22 11:46:51,839 DEBUG [agent.manager.AgentManagerImpl] (AgentConnectTaskPool-2323:null) Sending Disconnect to listener: com.cloud.network.security.SecurityGroupListener
> 2013-07-22 11:46:51,839 DEBUG [agent.manager.AgentManagerImpl] (AgentConnectTaskPool-2323:null) Sending Disconnect to listener: com.cloud.storage.listener.StoragePoolMonitor
> 2013-07-22 11:46:51,839 DEBUG [agent.manager.AgentManagerImpl] (AgentConnectTaskPool-2323:null) Sending Disconnect to listener: com.cloud.vm.ClusteredVirtualMachineManagerImpl_EnhancerByCloudStack_d2404e7b
> 2013-07-22 11:46:51,839 DEBUG [agent.manager.AgentManagerImpl] (AgentConnectTaskPool-2323:null) Sending Disconnect to listener: com.cloud.storage.LocalStoragePoolListener
> 2013-07-22 11:46:51,839 DEBUG [agent.manager.AgentManagerImpl] (AgentConnectTaskPool-2323:null) Sending Disconnect to listener: com.cloud.network.SshKeysDistriMonitor
> 2013-07-22 11:46:51,839 DEBUG [agent.manager.AgentManagerImpl] (AgentConnectTaskPool-2323:null) Sending Disconnect to listener: com.cloud.network.router.VirtualNetworkApplianceManagerImpl_EnhancerByCloudStack_6bb1bb1c
> 2013-07-22 11:46:51,839 DEBUG [agent.manager.AgentManagerImpl] (AgentConnectTaskPool-2323:null) Sending Disconnect to listener: com.cloud.network.SshKeysDistriMonitor
> 2013-07-22 11:46:51,839 DEBUG [agent.manager.AgentManagerImpl] (AgentConnectTaskPool-2323:null) Sending Disconnect to listener: com.cloud.network.router.VpcVirtualNetworkApplianceManagerImpl_EnhancerByCloudStack_e695833f
> 2013-07-22 11:46:51,839 DEBUG [agent.manager.AgentManagerImpl] (AgentConnectTaskPool-2323:null) Sending Disconnect to listener: com.cloud.storage.upload.UploadListener
> 2013-07-22 11:46:51,839 DEBUG [agent.manager.AgentManagerImpl] (AgentConnectTaskPool-2323:null) Sending Disconnect to listener: com.cloud.storage.download.DownloadListener
> 2013-07-22 11:46:51,839 DEBUG [agent.manager.AgentManagerImpl] (AgentConnectTaskPool-2323:null) Sending Disconnect to listener: com.cloud.agent.manager.AgentMonitor
> 2013-07-22 11:46:51,839 DEBUG [agent.manager.AgentManagerImpl] (AgentConnectTaskPool-2323:null) Sending Disconnect to listener: com.cloud.capacity.StorageCapacityListener
> 2013-07-22 11:46:51,839 DEBUG [agent.manager.AgentManagerImpl] (AgentConnectTaskPool-2323:null) Sending Disconnect to listener: com.cloud.capacity.ComputeCapacityListener
> 2013-07-22 11:46:51,839 DEBUG [agent.manager.AgentManagerImpl] (AgentConnectTaskPool-2323:null) Sending Disconnect to listener: com.cloud.network.NetworkUsageManagerImpl$DirectNetworkStatsListener
> 2013-07-22 11:46:51,839 DEBUG [cloud.network.NetworkUsageManagerImpl] (AgentConnectTaskPool-2323:null) Disconnected called on 30 with status Alert
> 2013-07-22 11:46:51,839 DEBUG [agent.manager.AgentManagerImpl] (AgentConnectTaskPool-2323:null) Sending Disconnect to listener: com.cloud.consoleproxy.ConsoleProxyListener
> 2013-07-22 11:46:51,841 DEBUG [cloud.host.Status] (AgentConnectTaskPool-2323:null) Transition:[Resource state = Enabled, Agent event = AgentDisconnected, Host id = 30, name = s-295-VM]
> 2013-07-22 11:46:51,844 DEBUG [cloud.host.Status] (AgentConnectTaskPool-2323:null) Agent status update: [id = 30; name = s-295-VM; old status = Connecting; event = AgentDisconnected; new status = Alert; old update count = 39532; new update count = 39533]
> 2013-07-22 11:46:51,844 DEBUG [agent.manager.ClusteredAgentManagerImpl] (AgentConnectTaskPool-2323:null) Notifying other nodes of to disconnect
> 2013-07-22 11:46:51,845 DEBUG [cloud.cluster.ClusterManagerImpl] (AgentConnectTaskPool-2323:null) Forwarding com.cloud.agent.api.ChangeAgentCommand to 159090354811326
> 2013-07-22 11:46:51,846 DEBUG [cloud.cluster.ClusterManagerImpl] (Cluster-Worker-5:null) Cluster PDU 159090354809909 -> 159090354811326. agent: 30, pdu seq: 2312, pdu ack seq: 0, json: [{"ChangeAgentCommand":{"agentId":30,"event":"AgentDisconnected","contextMap":{},"wait":0}}]
> 2013-07-22 11:46:51,846 DEBUG [agent.manager.AgentManagerImpl] (AgentConnectTaskPool-2323:null) Failed to handle host connection: com.cloud.utils.exception.CloudRuntimeException: Unable to connect 30
> This bug is also referenced in CLOUDSTACK-2177 and CLOUDSTACK-2188. Was patched in master, but code has been significantly re-factored and patch is incompatible with 4.1 branch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira