You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@cloudstack.apache.org by "Chandan Purushothama (JIRA)" <ji...@apache.org> on 2013/08/24 02:55:52 UTC
[jira] [Updated] (CLOUDSTACK-4485) 3.0.6 to ASF 4.2 Upgrade
[VMWare]: System VMs Fail to create in the Cluster due to invalid path
information of the template on the Primary Storage in the cluster
[ https://issues.apache.org/jira/browse/CLOUDSTACK-4485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chandan Purushothama updated CLOUDSTACK-4485:
---------------------------------------------
Attachment: mysqldumpsbeforeandafterupgrade.zip
management-server.zip
> 3.0.6 to ASF 4.2 Upgrade [VMWare]: System VMs Fail to create in the Cluster due to invalid path information of the template on the Primary Storage in the cluster
> -----------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: CLOUDSTACK-4485
> URL: https://issues.apache.org/jira/browse/CLOUDSTACK-4485
> Project: CloudStack
> Issue Type: Bug
> Security Level: Public(Anyone can view this level - this is the default.)
> Components: Management Server, VMware
> Affects Versions: 4.2.0
> Environment: 3.0.6-1 to 4.2 Upgraded Environment, VMWare ESXi 5.0 Hosts in two different clusters
> Reporter: Chandan Purushothama
> Priority: Critical
> Fix For: 4.2.1
>
> Attachments: management-server.zip, mysqldumpsbeforeandafterupgrade.zip
>
>
> Upgraded Setup Configuration:
> 3.0.6-1 Management Server;
> Two Clusters on the Setup: DC1-Cluster1; DC2-Cluster2;
> Each Clusters have one Shared Primary storage
> Each Cluster has one ESXi 5.0 Host.
> Upgraded it to 4.2 Build
> ======================================
> Observed the Bug when I did the following Steps:
> ======================================
> 1. Create a new account
> 2. Login as the new User
> 3. Create a VPC
> ============
> Observations:
> ============
> 2013-08-23 12:19:24,280 DEBUG [agent.transport.Request] (Job-Executor-23:job-124 = [ 5e3d7605-2f54-4a08-985d-4da655dd82ad ]) Seq 1-449844129: Sending { Cmd , MgmtId: 7471666038533, via: 1, Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"a873d86aa6cb3aec9d3510350a0717f1","origUrl":"http://download.cloud.com/templates/4.2/systemvmtemplate-4.2-vh7.ova","uuid":"5d970767-5a9d-47fe-8a48-7c5f3847ddc8","id":202,"format":"OVA","accountId":2,"checksum":"8fde62b1089e5844a9cd3b9b953f9596","hvm":true,"displayText":"systemvm-vmware-4.2","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"d89e306d-88e8-3997-ade6-fa97fed423bf","id":200,"poolType":"NetworkFilesystem","host":"10.223.110.232","path":"/export/home/chandan/307PB-195-103/primary1","port":2049}},"name":"202-2-b045d1fb-76d9-38e8-b569-3f7690565fb7","hypervisorType":"VMware"}},"destTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"2984549b-ab6f-41b5-9448-2c51bbb36290","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"d89e306d-88e8-3997-ade6-fa97fed423bf","id":200,"poolType":"NetworkFilesystem","host":"10.223.110.232","path":"/export/home/chandan/307PB-195-103/primary1","port":2049}},"name":"ROOT-20","size":2097152000,"volumeId":30,"vmName":"r-20-VMWARERETEST","accountId":5,"format":"OVA","id":30,"hypervisorType":"None"}},"executeInSequence":false,"wait":0}}] }
> 2013-08-23 12:19:24,281 DEBUG [agent.transport.Request] (Job-Executor-23:job-124 = [ 5e3d7605-2f54-4a08-985d-4da655dd82ad ]) Seq 1-449844129: Executing: { Cmd , MgmtId: 7471666038533, via: 1, Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"a873d86aa6cb3aec9d3510350a0717f1","origUrl":"http://download.cloud.com/templates/4.2/systemvmtemplate-4.2-vh7.ova","uuid":"5d970767-5a9d-47fe-8a48-7c5f3847ddc8","id":202,"format":"OVA","accountId":2,"checksum":"8fde62b1089e5844a9cd3b9b953f9596","hvm":true,"displayText":"systemvm-vmware-4.2","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"d89e306d-88e8-3997-ade6-fa97fed423bf","id":200,"poolType":"NetworkFilesystem","host":"10.223.110.232","path":"/export/home/chandan/307PB-195-103/primary1","port":2049}},"name":"202-2-b045d1fb-76d9-38e8-b569-3f7690565fb7","hypervisorType":"VMware"}},"destTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"2984549b-ab6f-41b5-9448-2c51bbb36290","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"d89e306d-88e8-3997-ade6-fa97fed423bf","id":200,"poolType":"NetworkFilesystem","host":"10.223.110.232","path":"/export/home/chandan/307PB-195-103/primary1","port":2049}},"name":"ROOT-20","size":2097152000,"volumeId":30,"vmName":"r-20-VMWARERETEST","accountId":5,"format":"OVA","id":30,"hypervisorType":"None"}},"executeInSequence":false,"wait":0}}] }
> 2013-08-23 12:19:24,281 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-470:null) Seq 1-449844129: Executing request
> 2013-08-23 12:19:24,329 WARN [storage.resource.VmwareStorageProcessor] (DirectAgent-470:10.223.59.66) Template host in vSphere is not in connected state, request template reload
> 2013-08-23 12:19:24,330 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-470:null) Seq 1-449844129: Response Received:
> 2013-08-23 12:19:24,330 DEBUG [agent.transport.Request] (DirectAgent-470:null) Seq 1-449844129: Processing: { Ans: , MgmtId: 7471666038533, via: 1, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Template host in vSphere is not in connected state, request template reload","wait":0}}] }
> 2013-08-23 12:19:24,330 DEBUG [agent.transport.Request] (Job-Executor-23:job-124 = [ 5e3d7605-2f54-4a08-985d-4da655dd82ad ]) Seq 1-449844129: Received: { Ans: , MgmtId: 7471666038533, via: 1, Ver: v1, Flags: 10, { CopyCmdAnswer } }
> 2013-08-23 12:19:24,338 WARN [storage.datastore.ObjectInDataStoreManagerImpl] (Job-Executor-23:job-124 = [ 5e3d7605-2f54-4a08-985d-4da655dd82ad ]) Unsupported data object (VOLUME, org.apache.cloudstack.storage.datastore.PrimaryDataStoreImpl@10c976a0), no need to delete from object in store ref table
> 2013-08-23 12:19:24,340 DEBUG [cloud.storage.VolumeManagerImpl] (Job-Executor-23:job-124 = [ 5e3d7605-2f54-4a08-985d-4da655dd82ad ]) Unable to create Vol[30|vm=20|ROOT]:Template host in vSphere is not in connected state, request template reload
> 2013-08-23 12:19:24,340 INFO [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-23:job-124 = [ 5e3d7605-2f54-4a08-985d-4da655dd82ad ]) Unable to contact resource.
> com.cloud.exception.StorageUnavailableException: Resource [StoragePool:200] is unreachable: Unable to create Vol[30|vm=20|ROOT]:Template host in vSphere is not in connected state, request template reload
> at com.cloud.storage.VolumeManagerImpl.recreateVolume(VolumeManagerImpl.java:2534)
> at com.cloud.storage.VolumeManagerImpl.prepare(VolumeManagerImpl.java:2582)
> at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:885)
> at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:575)
> at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.start(VirtualNetworkApplianceManagerImpl.java:2740)
> at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.startVirtualRouter(VirtualNetworkApplianceManagerImpl.java:1872)
> at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.deployRouter(VirtualNetworkApplianceManagerImpl.java:1664)
> at com.cloud.network.router.VpcVirtualNetworkApplianceManagerImpl.deployVpcRouter(VpcVirtualNetworkApplianceManagerImpl.java:331)
> at com.cloud.network.router.VpcVirtualNetworkApplianceManagerImpl.findOrDeployVirtualRouterInVpc(VpcVirtualNetworkApplianceManagerImpl.java:227)
> at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
> at com.cloud.network.router.VpcVirtualNetworkApplianceManagerImpl.deployVirtualRouterInVpc(VpcVirtualNetworkApplianceManagerImpl.java:176)
> at com.cloud.network.element.VpcVirtualRouterElement.implementVpc(VpcVirtualRouterElement.java:126)
> at com.cloud.network.vpc.VpcManagerImpl.startVpc(VpcManagerImpl.java:994)
> CopyCommand is searching for "path":"a873d86aa6cb3aec9d3510350a0717f1" of the System VM Template to create the VPC Router. That is the name of the template that is supposed to be present on the primary storage. But it is not present on the primary storage but on the database it is mentioned as Downloaded.
> mysql> select * from template_spool_ref where template_id=202;
> +----+---------+-------------+---------------------+--------------+--------+--------------+----------------+-----------+----------------------------------+----------------------------------+---------------+---------------+-------+--------------+---------------------+
> | id | pool_id | template_id | created | last_updated | job_id | download_pct | download_state | error_str | local_path | install_path | template_size | marked_for_gc | state | update_count | updated |
> +----+---------+-------------+---------------------+--------------+--------+--------------+----------------+-----------+----------------------------------+----------------------------------+---------------+---------------+-------+--------------+---------------------+
> | 8 | 200 | 202 | 2013-08-20 22:41:18 | NULL | NULL | 100 | DOWNLOADED | NULL | a873d86aa6cb3aec9d3510350a0717f1 | a873d86aa6cb3aec9d3510350a0717f1 | 0 | 0 | Ready | 2 | 2013-08-20 22:41:18 |
> | 6 | 201 | 202 | 2013-08-20 22:07:23 | NULL | NULL | 100 | DOWNLOADED | NULL | d42e159e3a7b31b0ba7b5f978a992060 | d42e159e3a7b31b0ba7b5f978a992060 | 0 | 0 | Ready | 2 | 2013-08-20 22:07:58 |
> +----+---------+-------------+---------------------+--------------+--------+--------------+----------------+-----------+----------------------------------+----------------------------------+---------------+---------------+-------+--------------+---------------------+
> 2 rows in set (0.00 sec)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira