You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@cloudstack.apache.org by "Sangeetha Hariharan (JIRA)" <ji...@apache.org> on 2013/06/13 02:27:20 UTC
[jira] [Created] (CLOUDSTACK-2971) Object_Store_Refactor - KVM -
When deploying Vms , we see the "storage.command.CopyCommand" being sent to
ssvm and failing before it gets sent to host.
Sangeetha Hariharan created CLOUDSTACK-2971:
-----------------------------------------------
Summary: Object_Store_Refactor - KVM - When deploying Vms , we see the "storage.command.CopyCommand" being sent to ssvm and failing before it gets sent to host.
Key: CLOUDSTACK-2971
URL: https://issues.apache.org/jira/browse/CLOUDSTACK-2971
Project: CloudStack
Issue Type: Bug
Security Level: Public (Anyone can view this level - this is the default.)
Components: Management Server
Affects Versions: 4.2.0
Environment: Build from object_store
Reporter: Sangeetha Hariharan
Priority: Critical
Fix For: 4.2.0
Object_Store_Refactor - KVM - When deploying Vms , we see the "storage.command.CopyCommand" being sent to ssvm and failing before it gets sent to host.
Steps to reproduce the problem:
Register a template.
Deploy a Vm using this template.
When deploying Vms , we see the "storage.command.CopyCommand" being sent to ssvm and failing.
This results in the Vm to be stopped.
But there is a retry again to start the Vm and this time we see the "storage.command.CopyCommand" being send to host and succeeds.
Exception seen in management server logs:
2013-06-12 16:32:03,174 DEBUG [cloud.storage.VolumeManagerImpl] (Job-Executor-13:job-13) Checking if we need to prepare 1 volumes for VM[User|test-1]
2013-06-12 16:32:03,205 DEBUG [agent.transport.Request] (Job-Executor-13:job-13) Seq 2-1087045696: Sending { Cmd , MgmtId: 7647994577963, via: 2, Ver: v1, Flags: 100111, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/2/202/b23cf30b-6197-36cf-9111-533fe2230279.qcow2","origUrl":"http://nfs1.lab.vmops.com/templates/passwordssh/centos55-64bit.qcow2","uuid":"0434c2da-884a-458a-8238-7b2b406fb940","id":202,"format":"QCOW2","accountId":2,"checksum":"bec22db040790c9cdd5ed2ec47ac5972","hvm":true,"displayText":"test","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.223.110.232/export/home/sangeetha/kvm-objectstore/secondary","_role":"Image"}},"name":"202-2-34a649c6-f770-32aa-9608-7e62e5bbf25c"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"http://nfs1.lab.vmops.com/templates/passwordssh/centos55-64bit.qcow2","uuid":"0434c2da-884a-458a-8238-7b2b406fb940","id":202,"format":"QCOW2","accountId":2,"checksum":"bec22db040790c9cdd5ed2ec47ac5972","hvm":true,"displayText":"test","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"22f8647a-607f-303b-b7bc-a3235a7943ff","id":1,"poolType":"NetworkFilesystem","host":"10.223.110.232","path":"/export/home/sangeetha/kvm-objectstore/primary","port":2049}},"name":"202-2-34a649c6-f770-32aa-9608-7e62e5bbf25c"}},"wait":10800}}] }
2013-06-12 16:32:03,418 DEBUG [agent.transport.Request] (AgentManager-Handler-9:null) Seq 2-1087045696: Processing: { Ans: , MgmtId: 7647994577963, via: 2, Ver: v1, Flags: 110, [{"com.cloud.agent.api.UnsupportedAnswer":{"result":false,"details":"Unsupported command issued:org.apache.cloudstack.storage.command.CopyCommand. Are you sure you got the right type of server?","wait":0}}] }
2013-06-12 16:32:03,418 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-9:null) Seq 2-1087045696: No more commands found
2013-06-12 16:32:03,418 DEBUG [agent.transport.Request] (Job-Executor-13:job-13) Seq 2-1087045696: Received: { Ans: , MgmtId: 7647994577963, via: 2, Ver: v1, Flags: 110, { UnsupportedAnswer } }
2013-06-12 16:32:03,419 WARN [agent.manager.AgentManagerImpl] (Job-Executor-13:job-13) Unsupported Command: Unsupported command issued:org.apache.cloudstack.storage.command.CopyCommand. Are you sure you got the right type of server?
2013-06-12 16:32:03,443 DEBUG [cloud.storage.VolumeManagerImpl] (Job-Executor-13:job-13) Unable to create Vol[3|vm=3|ROOT]:Unsupported command issued:org.apache.cloudstack.storage.command.CopyCommand. Are you sure you got the right type of server?
2013-06-12 16:32:03,461 INFO [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-13) Unable to contact resource.
com.cloud.exception.StorageUnavailableException: Resource [StoragePool:1] is unreachable: Unable to create Vol[3|vm=3|ROOT]:Unsupported command issued:org.apache.cloudstack.storage.command.CopyCommand. Are you sure you got the right type of server?
at com.cloud.storage.VolumeManagerImpl.recreateVolume(VolumeManagerImpl.java:2406)
at com.cloud.storage.VolumeManagerImpl.prepare(VolumeManagerImpl.java:2455)
at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:844)
at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:550)
at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:239)
at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:209)
at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3318)
at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2867)
at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2853)
at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
at org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCmd.java:420)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:155)
at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:437)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
2013-06-12 16:32:03,477 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-13) Cleaning up resources for the vm VM[User|test-1] in Starting state
mysql> select * from host;
+----+------------------------+--------------------------------------+--------+--------------------+--------------------+-----------------+---------------------+--------------------+-----------------+---------------------+----------------------+-----------------------+-------------------+------------+-------------------+-----------------+--------------------+------------+----------------+--------+------+-------+-------+---------+-----------------+--------------------+-------------+----------+----------------+--------+------------+--------------+---------------------------------------------------------------+-----------+-------+-------------+------------+----------------+--------------+---------------------+---------+--------------+----------------+-------+-------------+--------------+
| id | name | uuid | status | type | private_ip_address | private_netmask | private_mac_address | storage_ip_address | storage_netmask | storage_mac_address | storage_ip_address_2 | storage_mac_address_2 | storage_netmask_2 | cluster_id | public_ip_address | public_netmask | public_mac_address | proxy_port | data_center_id | pod_id | cpus | speed | url | fs_type | hypervisor_type | hypervisor_version | ram | resource | version | parent | total_size | capabilities | guid | available | setup | dom0_memory | last_ping | mgmt_server_id | disconnected | created | removed | update_count | resource_state | owner | lastUpdated | engine_state |
+----+------------------------+--------------------------------------+--------+--------------------+--------------------+-----------------+---------------------+--------------------+-----------------+---------------------+----------------------+-----------------------+-------------------+------------+-------------------+-----------------+--------------------+------------+----------------+--------+------+-------+-------+---------+-----------------+--------------------+-------------+----------+----------------+--------+------------+--------------+---------------------------------------------------------------+-----------+-------+-------------+------------+----------------+--------------+---------------------+---------+--------------+----------------+-------+-------------+--------------+
| 1 | amarillo.lab.vmops.com | 3f264dbb-60c3-47e7-b9ce-20cf566c88a7 | Up | Routing | 10.223.250.2 | 255.255.255.192 | 90:b1:1c:0b:81:22 | 10.223.250.2 | 255.255.255.192 | 90:b1:1c:0b:81:22 | NULL | NULL | NULL | 1 | 10.223.250.2 | 255.255.255.192 | 90:b1:1c:0b:81:22 | NULL | 1 | 1 | 4 | 2200 | NULL | NULL | KVM | NULL | 16640241664 | NULL | 4.2.0-SNAPSHOT | NULL | NULL | hvm,snapshot | e00715cb-b82e-35c7-82b2-4466049ab611-LibvirtComputingResource | 1 | 0 | 0 | 1338944379 | 7647994577963 | NULL | 2013-06-12 23:17:23 | NULL | 2 | Enabled | NULL | NULL | Disabled |
| 2 | s-1-VM | 91400001-41b6-4260-830e-f84d2efea8dc | Up | SecondaryStorageVM | 10.223.250.4 | 255.255.255.192 | 06:6b:a2:00:00:02 | 10.223.250.4 | 255.255.255.192 | 06:6b:a2:00:00:02 | NULL | NULL | NULL | NULL | 10.223.242.130 | 255.255.255.192 | 06:76:52:00:00:09 | NULL | 1 | 1 | NULL | NULL | NoIqn | NULL | NULL | NULL | 0 | NULL | 4.2.0-SNAPSHOT | NULL | NULL | NULL | s-1-VM-NfsSecondaryStorageResource | 1 | 0 | 0 | 1338944524 | 7647994577963 | NULL | 2013-06-12 23:19:53 | NULL | 2 | Enabled | NULL | NULL | Disabled |
| 3 | v-2-VM | d2c2e509-7c9a-4f3f-b030-895f23337e41 | Up | ConsoleProxy | 10.223.250.7 | 255.255.255.192 | 06:d1:c8:00:00:05 | 10.223.250.7 | 255.255.255.192 | 06:d1:c8:00:00:05 | NULL | NULL | NULL | NULL | 10.223.242.131 | 255.255.255.192 | 06:5c:1e:00:00:0a | NULL | 1 | 1 | NULL | NULL | NoIqn | NULL | NULL | NULL | 0 | NULL | 4.2.0-SNAPSHOT | NULL | NULL | NULL | Proxy.2-ConsoleProxyResource | 1 | 0 | 0 | 1338944620 | 7647994577963 | NULL | 2013-06-12 23:21:31 | NULL | 2 | Enabled | NULL | NULL | Disabled |
+----+------------------------+--------------------------------------+--------+--------------------+--------------------+-----------------+---------------------+--------------------+-----------------+---------------------+----------------------+-----------------------+-------------------+------------+-------------------+-----------------+--------------------+------------+----------------+--------+------+-------+-------+---------+-----------------+--------------------+-------------+----------+----------------+--------+------------+--------------+---------------------------------------------------------------+-----------+-------+-------------+------------+----------------+--------------+---------------------+---------+--------------+----------------+-------+-------------+--------------+
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira