You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cloudstack.apache.org by Bjoern Teipel <bj...@gmail.com> on 2014/05/29 06:23:20 UTC
4.2.1: CLVM to CLVM migrate storage not successfull
Hi devs,
I think I have found a bug affecting a primary storage migration if
the source and destination volume are on a CLVM storage.
So far I could follow the trail at :
- secondary storage is mounted on the source host with a new template id
- cp is issued to copy /dev/volgrpoup/uuid CLVM LV to NFS mount fom
the sec storage
- sec storage is mounted on the destination host
- a LV is created on the destination CLVM
- qemu-img convert is launched to migrate sec storage disk to CLVM lv
but it fails with
014-05-28 19:54:07,421 ERROR [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-2:null) Failed to convert
/mnt/b3a9edfb-2ce7-3c96-ae77-78131bffaa4f/99bddb1b-13aa-4559-aac2-080d5c9576fc.qcow2
to /dev/vg_vmem-003a74_vdi5/3811e2e5-9ef8-4825-9b84-7f5c6fdf87fd the
error was: qemu-img: Could not open
'/mnt/b3a9edfb-2ce7-3c96-ae77-78131bffaa4f/99bddb1b-13aa-4559-aac2-080d5c9576fc.qcow2'qemu-img:
Could not open '/mnt/b3a9edfb-2ce7-3c96-ae77-78131bffaa4f/99bddb1b-13aa-4559-aac2-080d5c9576fc.qcow2'
At this point I have no clue what might be wrong. All storage is
available and has enough space available. Help would be good, I can
also create a bug if it turns out.
When I do the same convert from CLVM to NFS volume on the same hosts,
all operation are complete, with the exception of another bug that RAW
volumes get converted to qcow2 and windows VMs suddenly can't boot
anymore so I have to convert those back to RAW mode.
Thanks for any help,
Bjoern
Cloustack log :
2014-05-28 19:38:46,952 DEBUG [cloud.async.AsyncJobManagerImpl]
(catalina-exec-1:null) submit async job-3613 = [
68bcafc5-9db8-4de9-bcee-e174d6982ab8 ], details: AsyncJobVO {id:3613,
userId: 3, accountId: 3, sessionKey: null, instanceType: None,
instanceId: null, cmd:
org.apache.cloudstack.api.command.admin.vm.MigrateVMCmd,
cmdOriginator: null, cmdInfo:
{"response":"json","sessionkey":"zG/kiTfpBAgaaNNmCz7tjQRJ7qs\u003d","virtualmachineid":"7d2ae1c9-f306-4050-b53c-deec39d90f8a","cmdEventType":"VM.MIGRATE","ctxUserId":"3","storageid":"f451646b-9e04-42ab-9787-41e4dd5e90c6","httpmethod":"GET","_":"1401331288946","projectid":"a98b95ee-1eba-44f1-a714-00254ec068c5","ctxAccountId":"3","ctxStartEventId":"14750"},
cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0,
processStatus: 0, resultCode: 0, result: null, initMsid: 110493003717,
completeMsid: null, lastUpdated: null, lastPolled: null, created:
null}
2014-05-28 19:38:46,953 DEBUG [cloud.async.AsyncJobManagerImpl]
(Job-Executor-65:job-3613 = [ 68bcafc5-9db8-4de9-bcee-e174d6982ab8 ])
Executing org.apache.cloudstack.api.command.admin.vm.MigrateVMCmd for
job-3613 = [ 68bcafc5-9db8-4de9-bcee-e174d6982ab8 ]
2014-05-28 19:38:46,983 DEBUG [cloud.capacity.CapacityManagerImpl]
(Job-Executor-65:job-3613 = [ 68bcafc5-9db8-4de9-bcee-e174d6982ab8 ])
VM state transitted from :Stopped to Migrating with event:
StorageMigrationRequestedvm's original host id: 7 new host id: null
host id before state transition: null
2014-05-28 19:38:47,006 DEBUG
[storage.motion.AncientDataMotionStrategy] (Job-Executor-65:job-3613 =
[ 68bcafc5-9db8-4de9-bcee-e174d6982ab8 ]) copyAsync inspecting src
type VOLUME copyAsync inspecting dest type VOLUME
2014-05-28 19:38:47,009 DEBUG
[cache.allocator.StorageCacheRandomAllocator]
(Job-Executor-65:job-3613 = [ 68bcafc5-9db8-4de9-bcee-e174d6982ab8 ])
Can't find staging storage in zone: 1
2014-05-28 19:38:47,035 DEBUG [agent.transport.Request]
(Job-Executor-65:job-3613 = [ 68bcafc5-9db8-4de9-bcee-e174d6982ab8 ])
Seq 35-134884895: Sending { Cmd , MgmtId: 110493003717, via: 35, Ver:
v1, Flags: 100111,
[{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"59c7ca2e-dbd1-4d09-a9a2-8c4e28f773f8","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"da7702e3-9629-4a5d-908d-d0d31eb9ba18","id":11,"poolType":"CLVM","host":"localhost","path":"/vg_vmem-003a74_vdi2","port":0}},"name":"ROOT-106","size":42949672960,"path":"c31934cc-bc60-460f-9a36-d7c9b6eb466b","volumeId":163,"vmName":"i-7-106-VM","accountId":7,"format":"QCOW2","id":163,"hypervisorType":"KVM"}},"destTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"59c7ca2e-dbd1-4d09-a9a2-8c4e28f773f8","volumeType":"ROOT","dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://xxxxxx/vol/cloud_sec_1","_role":"Image"}},"name":"ROOT-106","size":42949672960,"path":"volumes/7/163","volumeId":163,"vmName":"i-7-106-VM","accountId":7,"format":"QCOW2","id":163,"hypervisorType":"KVM"}},"executeInSequence":true,"wait":10800}}]
}
2014-05-28 19:54:06,689 DEBUG [agent.transport.Request]
(Job-Executor-65:job-3613 = [ 68bcafc5-9db8-4de9-bcee-e174d6982ab8 ])
Seq 35-134884895: Received: { Ans: , MgmtId: 110493003717, via: 35,
Ver: v1, Flags: 110, { CopyCmdAnswer } }
2014-05-28 19:54:06,706 DEBUG [agent.transport.Request]
(Job-Executor-65:job-3613 = [ 68bcafc5-9db8-4de9-bcee-e174d6982ab8 ])
Seq 45-2103117064: Sending { Cmd , MgmtId: 110493003717, via: 45,
Ver: v1, Flags: 100111,
[{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"59c7ca2e-dbd1-4d09-a9a2-8c4e28f773f8","volumeType":"ROOT","dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://nas2-a-519.lax1.uw1.ibcloud.local/vol/cloud_sec_1","_role":"Image"}},"name":"ROOT-106","size":42949672960,"path":"volumes/7/163/99bddb1b-13aa-4559-aac2-080d5c9576fc.qcow2","volumeId":163,"vmName":"i-7-106-VM","accountId":7,"format":"QCOW2","id":163,"hypervisorType":"KVM"}},"destTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"36f5f650-676b-4045-b200-2be241524af5","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"f451646b-9e04-42ab-9787-41e4dd5e90c6","id":54,"poolType":"CLVM","host":"localhost","path":"/vg_vmem-003a74_vdi5","port":0}},"name":"ROOT-106","size":42949672960,"path":"c31934cc-bc60-460f-9a36-d7c9b6eb466b","volumeId":723,"vmName":"i-7-106-VM","accountId":7,"format":"QCOW2","id":723,"hypervisorType":"KVM"}},"executeInSequence":true,"wait":10800}}]
}
2014-05-28 19:54:07,458 DEBUG [agent.transport.Request]
(Job-Executor-65:job-3613 = [ 68bcafc5-9db8-4de9-bcee-e174d6982ab8 ])
Seq 45-2103117064: Received: { Ans: , MgmtId: 110493003717, via: 45,
Ver: v1, Flags: 110, { CopyCmdAnswer } }
2014-05-28 19:54:07,458 DEBUG
[storage.motion.AncientDataMotionStrategy] (Job-Executor-65:job-3613 =
[ 68bcafc5-9db8-4de9-bcee-e174d6982ab8 ]) copy to primary store
failed: com.cloud.utils.exception.CloudRuntimeException: Failed to
copy /mnt/b3a9edfb-2ce7-3c96-ae77-78131bffaa4f/99bddb1b-13aa-4559-aac2-080d5c9576fc.qcow2
to 3811e2e5-9ef8-4825-9b84-7f5c6fdf87fd
2014-05-28 19:54:07,461 WARN
[storage.datastore.ObjectInDataStoreManagerImpl]
(Job-Executor-65:job-3613 = [ 68bcafc5-9db8-4de9-bcee-e174d6982ab8 ])
Volume 163 is not found on image store 2, so no need to delete
2014-05-28 19:54:07,468 DEBUG [agent.transport.Request]
(Job-Executor-65:job-3613 = [ 68bcafc5-9db8-4de9-bcee-e174d6982ab8 ])
Seq 33-434177039: Sending { Cmd , MgmtId: 110493003717, via: 33, Ver:
v1, Flags: 100011,
[{"org.apache.cloudstack.storage.command.DeleteCommand":{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"59c7ca2e-dbd1-4d09-a9a2-8c4e28f773f8","volumeType":"ROOT","dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://nas2-a-519.lax1.uw1.ibcloud.local/vol/cloud_sec_1","_role":"Image"}},"name":"ROOT-106","size":42949672960,"path":"volumes/7/163/99bddb1b-13aa-4559-aac2-080d5c9576fc.qcow2","volumeId":163,"vmName":"i-7-106-VM","accountId":7,"format":"QCOW2","id":163,"hypervisorType":"KVM"}},"wait":0}}]
}
2014-05-28 19:54:07,551 DEBUG [agent.transport.Request]
(Job-Executor-65:job-3613 = [ 68bcafc5-9db8-4de9-bcee-e174d6982ab8 ])
Seq 33-434177039: Received: { Ans: , MgmtId: 110493003717, via: 33,
Ver: v1, Flags: 10, { Answer } }
2014-05-28 19:54:07,562 WARN
[storage.datastore.ObjectInDataStoreManagerImpl]
(Job-Executor-65:job-3613 = [ 68bcafc5-9db8-4de9-bcee-e174d6982ab8 ])
Unsupported data object (VOLUME,
org.apache.cloudstack.storage.datastore.PrimaryDataStoreImpl@245538d7),
no need to delete from object in store ref table
2014-05-28 19:54:07,566 WARN
[storage.datastore.ObjectInDataStoreManagerImpl]
(Job-Executor-65:job-3613 = [ 68bcafc5-9db8-4de9-bcee-e174d6982ab8 ])
Unsupported data object (VOLUME,
org.apache.cloudstack.storage.datastore.PrimaryDataStoreImpl@3f373dec),
no need to delete from object in store ref table
2014-05-28 19:54:07,598 DEBUG [agent.transport.Request]
(Job-Executor-65:job-3613 = [ 68bcafc5-9db8-4de9-bcee-e174d6982ab8 ])
Seq 45-2103117065: Sending { Cmd , MgmtId: 110493003717, via: 45,
Ver: v1, Flags: 100011,
[{"org.apache.cloudstack.storage.command.DeleteCommand":{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"36f5f650-676b-4045-b200-2be241524af5","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"f451646b-9e04-42ab-9787-41e4dd5e90c6","id":54,"poolType":"CLVM","host":"localhost","path":"/vg_vmem-003a74_vdi5","port":0}},"name":"ROOT-106","size":42949672960,"path":"c31934cc-bc60-460f-9a36-d7c9b6eb466b","volumeId":723,"vmName":"i-7-106-VM","accountId":7,"format":"QCOW2","id":723,"hypervisorType":"KVM"}},"wait":0}}]
}
2014-05-28 19:54:07,855 DEBUG [agent.transport.Request]
(Job-Executor-65:job-3613 = [ 68bcafc5-9db8-4de9-bcee-e174d6982ab8 ])
Seq 45-2103117065: Received: { Ans: , MgmtId: 110493003717, via: 45,
Ver: v1, Flags: 10, { Answer } }
2014-05-28 19:54:07,860 INFO [storage.volume.VolumeServiceImpl]
(Job-Executor-65:job-3613 = [ 68bcafc5-9db8-4de9-bcee-e174d6982ab8 ])
Volume 723 is not referred anywhere, remove it from volumes table
2014-05-28 19:54:07,862 ERROR [cloud.storage.VolumeManagerImpl]
(Job-Executor-65:job-3613 = [ 68bcafc5-9db8-4de9-bcee-e174d6982ab8 ])
migrate volume failed:com.cloud.utils.exception.CloudRuntimeException:
Failed to copy /mnt/b3a9edfb-2ce7-3c96-ae77-78131bffaa4f/99bddb1b-13aa-4559-aac2-080d5c9576fc.qcow2
to 3811e2e5-9ef8-4825-9b84-7f5c6fdf87fd
2014-05-28 19:54:07,863 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(Job-Executor-65:job-3613 = [ 68bcafc5-9db8-4de9-bcee-e174d6982ab8 ])
Failed to migration: com.cloud.exception.StorageUnavailableException:
Resource [StoragePool:54] is unreachable: migrate volume failed:
com.cloud.utils.exception.CloudRuntimeException: Failed to copy
/mnt/b3a9edfb-2ce7-3c96-ae77-78131bffaa4f/99bddb1b-13aa-4559-aac2-080d5c9576fc.qcow2
to 3811e2e5-9ef8-4825-9b84-7f5c6fdf87fd
2014-05-28 19:54:07,872 DEBUG [cloud.capacity.CapacityManagerImpl]
(Job-Executor-65:job-3613 = [ 68bcafc5-9db8-4de9-bcee-e174d6982ab8 ])
VM state transitted from :Migrating to Stopped with event:
AgentReportStoppedvm's original host id: 7 new host id: null host id
before state transition: null
2014-05-28 19:54:07,878 DEBUG [cloud.capacity.CapacityManagerImpl]
(Job-Executor-65:job-3613 = [ 68bcafc5-9db8-4de9-bcee-e174d6982ab8 ])
Hosts's actual total CPU: 38400 and CPU after applying
overprovisioning: 307200
2014-05-28 19:54:07,878 DEBUG [cloud.capacity.CapacityManagerImpl]
(Job-Executor-65:job-3613 = [ 68bcafc5-9db8-4de9-bcee-e174d6982ab8 ])
Hosts's actual total RAM: 203056635904 and RAM after applying
overprovisioning: 203056644096
2014-05-28 19:54:07,878 DEBUG [cloud.capacity.CapacityManagerImpl]
(Job-Executor-65:job-3613 = [ 68bcafc5-9db8-4de9-bcee-e174d6982ab8 ])
release cpu from host: 7, old used: 70400,reserved: 4400, actual
total: 38400, total with overprovisioning: 307200; new used:
66000,reserved:4400; movedfromreserved: false,moveToReserveredfalse
2014-05-28 19:54:07,878 DEBUG [cloud.capacity.CapacityManagerImpl]
(Job-Executor-65:job-3613 = [ 68bcafc5-9db8-4de9-bcee-e174d6982ab8 ])
release mem from host: 7, old used: 73014444032,reserved: 4294967296,
total: 203056644096; new used: 68719476736,reserved:4294967296;
movedfromreserved: false,moveToReserveredfalse
2014-05-28 19:54:07,886 ERROR [cloud.async.AsyncJobManagerImpl]
(Job-Executor-65:job-3613 = [ 68bcafc5-9db8-4de9-bcee-e174d6982ab8 ])
Unexpected exception while executing
org.apache.cloudstack.api.command.admin.vm.MigrateVMCmd
2014-05-28 19:54:07,888 DEBUG [cloud.async.AsyncJobManagerImpl]
(Job-Executor-65:job-3613 = [ 68bcafc5-9db8-4de9-bcee-e174d6982ab8 ])
Complete async job-3613 = [ 68bcafc5-9db8-4de9-bcee-e174d6982ab8 ],
jobStatus: 2, resultCode: 530, result: Error Code: 530 Error text:
Failed to migration: com.cloud.exception.StorageUnavailableException:
Resource [StoragePool:54] is unreachable: migrate volume failed:
com.cloud.utils.exception.CloudRuntimeException: Failed to copy
/mnt/b3a9edfb-2ce7-3c96-ae77-78131bffaa4f/99bddb1b-13aa-4559-aac2-080d5c9576fc.qcow2
to 3811e2e5-9ef8-4825-9b84-7f5c6fdf87fd
Hypervisor :
Flags: 100111, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"59c7ca2e-dbd1-4d09
-a9a2-8c4e28f773f8","volumeType":"ROOT","dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://xxxx/vol/cloud_sec_1","_role
":"Image"}},"name":"ROOT-106","size":42949672960,"path":"volumes/7/163/99bddb1b-13aa-4559-aac2-080d5c9576fc.qcow2","volumeId":163,"vmName":"i-7-106-VM","acc
ountId":7,"format":"QCOW2","id":163,"hypervisorType":"KVM"}},"destTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"36f5f650-676b-4045-b200-2b
e241524af5","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"f451646b-9e04-42ab-9787-41e4dd5e90c6","id":54,"p
oolType":"CLVM","host":"localhost","path":"/vg_vmem-003a74_vdi5","port":0}},"name":"ROOT-106","size":42949672960,"path":"c31934cc-bc60-460f-9a36-d7c9b6eb466
b","volumeId":723,"vmName":"i-7-106-VM","accountId":7,"format":"QCOW2","id":723,"hypervisorType":"KVM"}},"executeInSequence":true,"wait":10800}}]
}
2014-05-28 19:54:06,775 DEBUG [cloud.agent.Agent]
(agentRequest-Handler-2:null) Processing command:
org.apache.cloudstack.storage.command.CopyCommand
2014-05-28 19:54:06,909 DEBUG [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-2:null) createStoragePool didn't find existing
running pool: org.lib
virt.LibvirtException: Storage pool not found: no pool with matching
uuid, need to create it
2014-05-28 19:54:06,909 DEBUG [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-2:null) Didn't find an existing storage pool
b3a9edfb-2ce7-3c96-ae77
-78131bffaa4f by UUID, checking for pools with duplicate paths
2014-05-28 19:54:06,913 DEBUG [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-2:null) Checking path of existing pool
9b223647-fc0c-4172-ba1c-dbf75ab5e6a2 against pool we want to create
2014-05-28 19:54:06,918 DEBUG [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-2:null) Checking path of existing pool
vg_vmem-003a74_vdi5 against pool we want to create
2014-05-28 19:54:06,923 DEBUG [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-2:null) Checking path of existing pool
0edc66a6-f912-3c34-b6c3-21069926edec against pool we want to create
2014-05-28 19:54:06,927 DEBUG [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-2:null) Attempting to create storage pool
b3a9edfb-2ce7-3c96-ae77-78131bffaa4f
2014-05-28 19:54:06,928 DEBUG [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-2:null) <pool type='netfs'>
<name>b3a9edfb-2ce7-3c96-ae77-78131bffaa4f</name>
<uuid>b3a9edfb-2ce7-3c96-ae77-78131bffaa4f</uuid>
<source>
<host name='nas2-a-519.lax1.uw1.ibcloud.local'/>
<dir path='/vol/cloud_sec_1/volumes/7/163'/>
</source>
<target>
<path>/mnt/b3a9edfb-2ce7-3c96-ae77-78131bffaa4f</path>
</target>
</pool>
2014-05-28 19:54:06,998 DEBUG [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-2:null) <volume>
<name>3811e2e5-9ef8-4825-9b84-7f5c6fdf87fd</name>
<capacity>42949672960</capacity>
<target>
<format type='raw'/>
<permissions><mode>0744</mode></permissions></target>
</volume>
2014-05-28 19:54:07,392 DEBUG [utils.script.Script]
(agentRequest-Handler-2:null) Executing: qemu-img info
/mnt/b3a9edfb-2ce7-3c96-ae77-78131bffaa4f/99bddb1b-13aa-4559-aac2-080d5c9576fc.qcow2
2014-05-28 19:54:07,407 DEBUG [utils.script.Script]
(agentRequest-Handler-2:null) Execution is successful.
2014-05-28 19:54:07,409 DEBUG [utils.script.Script]
(agentRequest-Handler-2:null) Executing: qemu-img convert -f qcow2 -O
raw /mnt/b3a9edfb-2ce7-3c96-ae77-78131bffaa4f/99bddb1b-13aa-4559-aac2-080d5c9576fc.qcow2
/dev/vg_vmem-003a74_vdi5/3811e2e5-9ef8-4825-9b84-7f5c6fdf87fd
2014-05-28 19:54:07,419 DEBUG [utils.script.Script]
(agentRequest-Handler-2:null) Exit value is 1
2014-05-28 19:54:07,421 DEBUG [utils.script.Script]
(agentRequest-Handler-2:null) qemu-img: Could not open
'/mnt/b3a9edfb-2ce7-3c96-ae77-78131bffaa4f/99bddb1b-13aa-4559-aac2-080d5c9576fc.qcow2'qemu-img:
Could not open '/mnt/b3a9edfb-2ce7-3c96-ae77-78131bffaa4f/99bddb1b-13aa-4559-aac2-080d5c9576fc.qcow2'
2014-05-28 19:54:07,421 ERROR [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-2:null) Failed to convert
/mnt/b3a9edfb-2ce7-3c96-ae77-78131bffaa4f/99bddb1b-13aa-4559-aac2-080d5c9576fc.qcow2
to /dev/vg_vmem-003a74_vdi5/3811e2e5-9ef8-4825-9b84-7f5c6fdf87fd the
error was: qemu-img: Could not open
'/mnt/b3a9edfb-2ce7-3c96-ae77-78131bffaa4f/99bddb1b-13aa-4559-aac2-080d5c9576fc.qcow2'qemu-img:
Could not open '/mnt/b3a9edfb-2ce7-3c96-ae77-78131bffaa4f/99bddb1b-13aa-4559-aac2-080d5c9576fc.qcow2'
2014-05-28 19:54:07,455 DEBUG [cloud.agent.Agent]
(agentRequest-Handler-2:null) Seq 45-2103117064: { Ans: , MgmtId:
110493003717, via: 45, Ver: v1, Flags: 110,
[{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"com.cloud.utils.exception.CloudRuntimeException:
Failed to copy /mnt/b3a9edfb-2ce7-3c96-ae77-78131bffaa4f/99bddb1b-13aa-4559-aac2-080d5c9576fc.qcow2
to 3811e2e5-9ef8-4825-9b84-7f5c6fdf87fd","wait":0}}] }
2014-05-28 19:54:07,602 DEBUG [cloud.agent.Agent]
(agentRequest-Handler-4:null) Request:Seq 45-2103117065: { Cmd ,
MgmtId: 110493003717, via: 45, Ver: v1, Flags: 100011,
[{"org.apache.cloudstack.storage.command.DeleteCommand":{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"36f5f650-676b-4045-b200-2be241524af5","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"f451646b-9e04-42ab-9787-41e4dd5e90c6","id":54,"poolType":"CLVM","host":"localhost","path":"/vg_vmem-003a74_vdi5","port":0}},"name":"ROOT-106","size":42949672960,"path":"c31934cc-bc60-460f-9a36-d7c9b6eb466b","volumeId":723,"vmName":"i-7-106-VM","accountId":7,"format":"QCOW2","id":723,"hypervisorType":"KVM"}},"wait":0}}]
}
2014-05-28 19:54:07,603 DEBUG [cloud.agent.Agent]
(agentRequest-Handler-4:null) Processing command:
org.apache.cloudstack.storage.command.DeleteCommand
2014-05-28 19:54:07,734 DEBUG [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-4:null) Can't find volume:
org.libvirt.LibvirtException: Storage volume not found: no storage vol
with matching name 'c31934cc-bc60-460f-9a36-d7c9b6eb466b'
--- Logical volume ---
LV Path
/dev/vg_vmem-003a74_vdi5/3811e2e5-9ef8-4825-9b84-7f5c6fdf87fd
LV Name 3811e2e5-9ef8-4825-9b84-7f5c6fdf87fd
VG Name vg_vmem-003a74_vdi5
LV UUID 1HduXP-hQy5-wC2o-3CKT-Eshf-MrAy-GwNQrJ
LV Write Access read/write
LV Creation host, time hv-123 , 2014-05-28 19:54:07 -0700
LV Status available
# open 0
LV Size 40.00 GiB
Current LE 10240
Segments 1
Allocation inherit
Read ahead sectors auto
- currently set to 256
Block device 253:5