You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@cloudstack.apache.org by "Animesh Chaturvedi (JIRA)" <ji...@apache.org> on 2013/07/27 02:17:48 UTC
[jira] [Commented] (CLOUDSTACK-3737) Uploaded volume is not getting
deleted from secondary storage after attaching it to guest vm
[ https://issues.apache.org/jira/browse/CLOUDSTACK-3737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13721422#comment-13721422 ]
Animesh Chaturvedi commented on CLOUDSTACK-3737:
------------------------------------------------
Can you also pass on your setup details
> Uploaded volume is not getting deleted from secondary storage after attaching it to guest vm
> --------------------------------------------------------------------------------------------
>
> Key: CLOUDSTACK-3737
> URL: https://issues.apache.org/jira/browse/CLOUDSTACK-3737
> Project: CloudStack
> Issue Type: Bug
> Security Level: Public(Anyone can view this level - this is the default.)
> Components: Storage Controller, Volumes
> Affects Versions: 4.2.0
> Environment: Latest build from ACS 4.2 branch
> Storage: NFS for both primary and secondary
> Reporter: Sanjeev N
> Fix For: 4.2.0
>
> Attachments: management-server.rar
>
>
> Uploaded volume is not getting deleted from secondary storage after attaching it to guest vm
> Steps to Reproduce:
> ================
> 1.Bring up CS with xen hypervisor and use NFS as the storage for both primary and secondary storage
> 2.Deploy guest vm using default cent of template just with root disk
> 3.Upload volume to CS using following API:
> http://10.147.59.126:8096/client/api?command=uploadVolume&format=VHD&name=cent62&url=http://10.147.28.7/templates/CentOS62-64bit/280c2a70-e37f-4863-bff8-d318122fd61b.vhd&zoneid=5c5c0b8a-9d5a-4b95-8f13-b31058ffdb37&account=admin&domainid=1
> 4.After the volume download is complete to secondary storage , attache it to vm using API:
> http://10.147.59.126:8096/client/api?command=attachVolume&id=0d627eec-3824-4d35-8997-853472502454&virtualmachineid=6ef83f81-2577-4be2-9720-5fdcf3912e5f
> Observations:
> ===========
> After step4 volume should be moved from secondary to primary. But the observation is it is just getting copied to primary and still present in the secondary. It should be deleted from secondary storage after successful copying to primary storage.
> Volume state in DB after attaching to VM:
> mysql> select * from volumes where uuid='0d627eec-3824-4d35-8997-853472502454'\G;
> *************************** 1. row ***************************
> id: 10
> account_id: 2
> domain_id: 1
> pool_id: 1
> last_pool_id: NULL
> instance_id: 3
> device_id: 1
> name: cent62
> uuid: 0d627eec-3824-4d35-8997-853472502454
> size: 10737418240
> folder: NULL
> path: b2b96197-665a-40cd-a52b-de0506c45a8e
> pod_id: NULL
> data_center_id: 1
> iscsi_name: NULL
> host_ip: NULL
> volume_type: DATADISK
> pool_type: NULL
> disk_offering_id: 6
> template_id: NULL
> first_snapshot_backup_uuid: NULL
> recreatable: 0
> created: 2013-07-23 12:36:22
> attached: 2013-07-23 12:52:40
> updated: 2013-07-23 13:09:08
> removed: NULL
> state: Ready
> chain_info: NULL
> update_count: 6
> disk_type: NULL
> display_volume: 0
> format: VHD
> min_iops: NULL
> max_iops: NULL
> 1 row in set (0.00 sec)
> ERROR:
> No query specified
> In volume_store_ref the volume state is remained in "Creating" state. Still attaching volume was succeeded.
> Here is the volume state in volume_store_ref from cloud db:
> mysql> select * from volume_store_ref where id=4\G;
> *************************** 1. row ***************************
> id: 4
> store_id: 1
> volume_id: 10
> zone_id: 0
> created: 2013-07-23 13:09:07
> last_updated: NULL
> job_id: NULL
> download_pct: 0
> size: 0
> physical_size: 0
> download_state: NULL
> checksum: NULL
> error_str: NULL
> local_path: NULL
> install_path: volumes/2/10
> url: NULL
> download_url: NULL
> state: Creating
> destroyed: 0
> update_count: 1
> ref_cnt: 0
> updated: 2013-07-23 13:09:07
> 1 row in set (0.00 sec)
> ERROR:
> No query specified
> Log snippet for upload volume:
> 2013-07-23 08:36:22,827 DEBUG [cloud.async.AsyncJobManagerImpl] (ApiServer-1:null) submit async job-22 = [ 63bf80a6-5142-489e-ab5d-7a5ef061140d ], details: AsyncJobVO {id:22, userId: 1, accountId: 1, sessionKey: null, instanceType: None, instanceId: null, cmd: org.apache.cloudstack.api.command.user.volume.UploadVolumeCmd, cmdOriginator: null, cmdInfo: {"cmdEventType":"VOLUME.UPLOAD","ctxUserId":"1","zoneid":"5c5c0b8a-9d5a-4b95-8f13-b31058ffdb37","name":"cent62","account":"admin","httpmethod":"GET","domainid":"1","ctxAccountId":"1","format":"VHD","ctxStartEventId":"91","url":"http://10.147.28.7/templates/CentOS62-64bit/280c2a70-e37f-4863-bff8-d318122fd61b.vhd"}, cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0, processStatus: 0, resultCode: 0, result: null, initMsid: 6615759585382, completeMsid: null, lastUpdated: null, lastPolled: null, created: null}
> 2013-07-23 08:36:22,837 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-22:job-22 = [ 63bf80a6-5142-489e-ab5d-7a5ef061140d ]) Executing org.apache.cloudstack.api.command.user.volume.UploadVolumeCmd for job-22 = [ 63bf80a6-5142-489e-ab5d-7a5ef061140d ]
> 2013-07-23 08:36:23,066 DEBUG [storage.image.BaseImageStoreDriverImpl] (Job-Executor-22:job-22 = [ 63bf80a6-5142-489e-ab5d-7a5ef061140d ]) Downloading volume to data store 1
> 2013-07-23 08:36:23,121 DEBUG [cloudstack.storage.RemoteHostEndPoint] (Job-Executor-22:job-22 = [ 63bf80a6-5142-489e-ab5d-7a5ef061140d ]) Sending command org.apache.cloudstack.storage.command.DownloadCommand to host: 3
> 2013-07-23 08:36:23,125 DEBUG [agent.transport.Request] (Job-Executor-22:job-22 = [ 63bf80a6-5142-489e-ab5d-7a5ef061140d ]) Seq 3-1340014758: Sending { Cmd , MgmtId: 6615759585382, via: 3, Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.DownloadCommand":{"hvm":false,"maxDownloadSizeInBytes":536870912000,"id":10,"resourceType":"VOLUME","installPath":"volumes/2/10","_store":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.147.28.7/export/home/sanjeev/sec_xen_os","_role":"Image"}},"url":"http://10.147.28.7/templates/CentOS62-64bit/280c2a70-e37f-4863-bff8-d318122fd61b.vhd","format":"VHD","accountId":2,"name":"cent62","wait":0}}] }
> 2013-07-23 08:36:23,149 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-22:job-22 = [ 63bf80a6-5142-489e-ab5d-7a5ef061140d ]) Complete async job-22 = [ 63bf80a6-5142-489e-ab5d-7a5ef061140d ], jobStatus: 1, resultCode: 0, result: org.apache.cloudstack.api.response.VolumeResponse@2a5b5372
> 2013-07-23 08:36:23,163 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-22:job-22 = [ 63bf80a6-5142-489e-ab5d-7a5ef061140d ]) Done executing org.apache.cloudstack.api.command.user.volume.UploadVolumeCmd for job-22 = [ 63bf80a6-5142-489e-ab5d-7a5ef061140d ]
> 2013-07-23 08:36:26,660 DEBUG [agent.transport.Request] (AgentManager-Handler-14:null) Seq 3-1340014758: Processing: { Ans: , MgmtId: 6615759585382, via: 3, Ver: v1, Flags: 10, [{"com.cloud.agent.api.storage.DownloadAnswer":{"jobId":"9d1225f8-4dd3-44fb-b39d-391583e95281","downloadPct":1,"errorString":" ","downloadStatus":"DOWNLOAD_IN_PROGRESS","downloadPath":"/mnt/SecStorage/1f24310b-8f0b-3563-aecc-779179564245/volumes/2/10/dnld6777686660366560545tmp_","installPath":"volumes/2/10","templateSize":0,"templatePhySicalSize":0,"result":true,"details":" ","wait":0}}] }
> After some time volume was successfully downloaded to secondary storage:
> 2013-07-23 08:45:31,785 DEBUG [agent.transport.Request] (AgentManager-Handler-4:null) Seq 3-1340014793: Processing: { Ans: , MgmtId: 6615759585382, via: 3, Ver: v1, Flags: 10, [{"com.cloud.agent.api.storage.DownloadAnswer":{"jobId":"9d1225f8-4dd3-44fb-b39d-391583e95281","downloadPct":100,"errorString":"Install completed successfully at 7/23/13 12:45 PM","downloadStatus":"DOWNLOADED","downloadPath":"/mnt/SecStorage/1f24310b-8f0b-3563-aecc-779179564245/volumes/2/10/dnld6777686660366560545tmp_","installPath":"volumes/2/10/a58b5e0e-8548-34e3-a22f-8a4b52701ac4.vhd","templateSize":10737418240,"templatePhySicalSize":2132787712,"checkSum":"bebf14997dd834de2053ce2dd6a903b6","result":true,"details":"Install completed successfully at 7/23/13 12:45 PM","wait":0}}] }
> Executed Attachevolume cmd to attach it to guest vm:
> 2013-07-23 08:50:36,484 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-23:job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) Executing org.apache.cloudstack.api.command.user.volume.AttachVolumeCmd for job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]
> 2013-07-23 08:50:36,549 DEBUG [storage.allocator.LocalStoragePoolAllocator] (Job-Executor-23:job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) LocalStoragePoolAllocator trying to find storage pool to fit the vm
> 2013-07-23 08:50:36,551 DEBUG [storage.allocator.ClusterScopeStoragePoolAllocator] (Job-Executor-23:job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) ClusterScopeStoragePoolAllocator looking for storage pool
> 2013-07-23 08:50:36,551 DEBUG [storage.allocator.ClusterScopeStoragePoolAllocator] (Job-Executor-23:job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) Looking for pools in dc: 1 pod:1 cluster:1
> 2013-07-23 08:50:36,559 DEBUG [storage.allocator.AbstractStoragePoolAllocator] (Job-Executor-23:job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) Checking if storage pool is suitable, name: null ,poolId: 1
> 2013-07-23 08:50:36,567 DEBUG [cloud.storage.StorageManagerImpl] (Job-Executor-23:job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) Checking pool 1 for storage, totalSize: 5902284816384, usedBytes: 3927302963200, usedPct: 0.6653868942919022, disable threshold: 0.85
> 2013-07-23 08:50:36,598 DEBUG [cloud.storage.StorageManagerImpl] (Job-Executor-23:job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) Checking pool: 1 for volume allocation [Vol[10|vm=null|DATADISK]], maxSize : 11804569632768, totalAllocatedSize : 54609838080, askingSize : 10737418240, allocated disable threshold: 0.85
> 2013-07-23 08:50:36,598 DEBUG [storage.allocator.ClusterScopeStoragePoolAllocator] (Job-Executor-23:job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) FirstFitStoragePoolAllocator returning 1 suitable storage pools
> 2013-07-23 08:50:36,638 DEBUG [storage.motion.AncientDataMotionStrategy] (Job-Executor-23:job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) copyAsync inspecting src type VOLUME copyAsync inspecting dest type VOLUME
> 2013-07-23 08:50:36,653 DEBUG [agent.transport.Request] (Job-Executor-23:job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) Seq 1-1929052680: Sending { Cmd , MgmtId: 6615759585382, via: 1, Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"0d627eec-3824-4d35-8997-853472502454","volumeType":"DATADISK","dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.147.28.7/export/home/sanjeev/sec_xen_os","_role":"Image"}},"name":"cent62","size":10737418240,"path":"volumes/2/10/a58b5e0e-8548-34e3-a22f-8a4b52701ac4.vhd","volumeId":10,"accountId":2,"format":"VHD","id":10}},"destTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"0d627eec-3824-4d35-8997-853472502454","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"c65a038a-750c-3b4f-bf26-7ce3b74e1c85","id":1,"poolType":"NetworkFilesystem","host":"10.147.28.7","path":"/export/home/sanjeev/pri_xen_os","port":2049}},"name":"cent62","size":10737418240,"volumeId":10,"accountId":2,"format":"VHD","id":10}},"executeInSequence":false,"wait":10800}}] }
> 2013-07-23 08:50:36,654 DEBUG [agent.transport.Request] (Job-Executor-23:job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) Seq 1-1929052680: Executing: { Cmd , MgmtId: 6615759585382, via: 1, Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"0d627eec-3824-4d35-8997-853472502454","volumeType":"DATADISK","dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.147.28.7/export/home/sanjeev/sec_xen_os","_role":"Image"}},"name":"cent62","size":10737418240,"path":"volumes/2/10/a58b5e0e-8548-34e3-a22f-8a4b52701ac4.vhd","volumeId":10,"accountId":2,"format":"VHD","id":10}},"destTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"0d627eec-3824-4d35-8997-853472502454","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"c65a038a-750c-3b4f-bf26-7ce3b74e1c85","id":1,"poolType":"NetworkFilesystem","host":"10.147.28.7","path":"/export/home/sanjeev/pri_xen_os","port":2049}},"name":"cent62","size":10737418240,"volumeId":10,"accountId":2,"format":"VHD","id":10}},"executeInSequence":false,"wait":10800}}] }
> 2013-07-23 08:50:36,655 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-17:null) Seq 1-1929052680: Executing request
> 2013-07-23 08:52:39,712 DEBUG [agent.transport.Request] (Job-Executor-23:job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) Seq 1-1929052687: Sending { Cmd , MgmtId: 6615759585382, via: 1, Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.AttachCommand":{"disk":{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"0d627eec-3824-4d35-8997-853472502454","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"c65a038a-750c-3b4f-bf26-7ce3b74e1c85","id":1,"poolType":"NetworkFilesystem","host":"10.147.28.7","path":"/export/home/sanjeev/pri_xen_os","port":2049}},"name":"cent62","size":10737418240,"path":"b2b96197-665a-40cd-a52b-de0506c45a8e","volumeId":10,"accountId":2,"format":"VHD","id":10}},"diskSeq":1,"type":"DATADISK"},"vmName":"i-2-3-VM","_storageHost":"10.147.28.7","_storagePort":2049,"_managed":false,"wait":0}}] }
> 2013-07-23 08:52:39,713 DEBUG [agent.transport.Request] (Job-Executor-23:job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) Seq 1-1929052687: Executing: { Cmd , MgmtId: 6615759585382, via: 1, Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.AttachCommand":{"disk":{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"0d627eec-3824-4d35-8997-853472502454","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"c65a038a-750c-3b4f-bf26-7ce3b74e1c85","id":1,"poolType":"NetworkFilesystem","host":"10.147.28.7","path":"/export/home/sanjeev/pri_xen_os","port":2049}},"name":"cent62","size":10737418240,"path":"b2b96197-665a-40cd-a52b-de0506c45a8e","volumeId":10,"accountId":2,"format":"VHD","id":10}},"diskSeq":1,"type":"DATADISK"},"vmName":"i-2-3-VM","_storageHost":"10.147.28.7","_storagePort":2049,"_managed":false,"wait":0}}] }
> 2013-07-23 08:52:39,714 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-399:null) Seq 1-1929052687: Executing request
> 2013-07-23 08:52:40,868 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-399:null) Seq 1-1929052687: Response Received:
> 2013-07-23 08:52:40,870 DEBUG [agent.transport.Request] (DirectAgent-399:null) Seq 1-1929052687: Processing: { Ans: , MgmtId: 6615759585382, via: 1, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.AttachAnswer":{"disk":{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"0d627eec-3824-4d35-8997-853472502454","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"c65a038a-750c-3b4f-bf26-7ce3b74e1c85","id":1,"poolType":"NetworkFilesystem","host":"10.147.28.7","path":"/export/home/sanjeev/pri_xen_os","port":2049}},"name":"cent62","size":10737418240,"path":"b2b96197-665a-40cd-a52b-de0506c45a8e","volumeId":10,"accountId":2,"format":"VHD","id":10}},"diskSeq":1,"vdiUuid":"b2b96197-665a-40cd-a52b-de0506c45a8e","type":"DATADISK"},"result":true,"wait":0}}] }
> 2013-07-23 08:52:40,870 DEBUG [agent.transport.Request] (Job-Executor-23:job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) Seq 1-1929052687: Received: { Ans: , MgmtId: 6615759585382, via: 1, Ver: v1, Flags: 10, { AttachAnswer } }
> 2013-07-23 08:52:40,915 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-23:job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) Complete async job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ], jobStatus: 1, resultCode: 0, result: org.apache.cloudstack.api.response.VolumeResponse@50be7f47
> 2013-07-23 08:52:40,922 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-23:job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]) Done executing org.apache.cloudstack.api.command.user.volume.AttachVolumeCmd for job-23 = [ 45a8259a-4c9f-4725-bb73-43fb4d0e786b ]
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira