You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@cloudstack.apache.org by "Abhinav Roy (JIRA)" <ji...@apache.org> on 2013/07/30 19:17:51 UTC
[jira] [Reopened] (CLOUDSTACK-2630) Object_Store_Refactor -
Snapshots - There is no delta snapshots being created for subsequent
snapshots when multiple snapshots are taken for root /data volumes.
[ https://issues.apache.org/jira/browse/CLOUDSTACK-2630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Abhinav Roy reopened CLOUDSTACK-2630:
-------------------------------------
Re-opening the bug as the delta snapshots are still not getting created :
----------------------------------------
Steps :
==========
1. Make the global configuration parameter snapshot.delta.max=3 and restart management server
2. Deploy a VM
3. Take snapshot of the ROOT volume of the VM
4. Create some files on the ROOT volume and take the snapshot again.
5. repeat step 5 few times.
----------------------------------------------------
So, after taking the 1st primary snapshot, 3 delta snapshots should be created having much smaller as it contains only the small changes (file additions) .
But it doesn't happen and all the snapshots created are full snapshots having the same size.
mysql> SELECT * FROM cloud.snapshots where volume_id=12;
+----+----------------+------------+-----------+-----------+------------------+----------+------+--------------------------------------+--------------------------------------+---------------+------------------+------------+---------------------+---------+----------------+----------+------------+--------------+-----------------+---------+-------+
| id | data_center_id | account_id | domain_id | volume_id | disk_offering_id | status | path | name | uuid | snapshot_type | type_description | size | created | removed | backup_snap_id | swift_id | sechost_id | prev_snap_id | hypervisor_type | version | s3_id |
+----+----------------+------------+-----------+-----------+------------------+----------+------+--------------------------------------+--------------------------------------+---------------+------------------+------------+---------------------+---------+----------------+----------+------------+--------------+-----------------+---------+-------+
| 3 | 1 | 2 | 1 | 12 | 1 | BackedUp | NULL | vm-delta-snap_ROOT-10_20130730131810 | bcb73cc6-9b6d-457a-bc2d-6ab1efc36175 | 0 | MANUAL | 2147483648 | 2013-07-30 13:18:10 | NULL | NULL | NULL | NULL | NULL | VMware | 2.2 | NULL |
| 4 | 1 | 2 | 1 | 12 | 1 | BackedUp | NULL | vm-delta-snap_ROOT-10_20130730132036 | 0ed707c0-691c-43af-a993-751c5bbbe790 | 0 | MANUAL | 2147483648 | 2013-07-30 13:20:36 | NULL | NULL | NULL | NULL | NULL | VMware | 2.2 | NULL |
| 5 | 1 | 2 | 1 | 12 | 1 | BackedUp | NULL | vm-delta-snap_ROOT-10_20130730132312 | f5d81156-3a60-4adb-bc58-a7b02b572562 | 0 | MANUAL | 2147483648 | 2013-07-30 13:23:12 | NULL | NULL | NULL | NULL | NULL | VMware | 2.2 | NULL |
| 6 | 1 | 2 | 1 | 12 | 1 | BackedUp | NULL | vm-delta-snap_ROOT-10_20130730132556 | e1321019-3d26-4635-ac90-2e68dc2e3ae3 | 0 | MANUAL | 2147483648 | 2013-07-30 13:25:56 | NULL | NULL | NULL | NULL | NULL | VMware | 2.2 | NULL |
| 7 | 1 | 2 | 1 | 12 | 1 | BackedUp | NULL | vm-delta-snap_ROOT-10_20130730132852 | d146bd18-a693-4b6f-b9ad-0afbb77b247c | 0 | MANUAL | 2147483648 | 2013-07-30 13:28:52 | NULL | NULL | NULL | NULL | NULL | VMware | 2.2 | NULL |
| 8 | 1 | 2 | 1 | 12 | 1 | BackedUp | NULL | vm-delta-snap_ROOT-10_20130730133133 | e6bb2438-f4da-4004-8b05-4e850fbcca5a | 0 | MANUAL | 2147483648 | 2013-07-30 13:31:33 | NULL | NULL | NULL | NULL | NULL | VMware | 2.2 | NULL |
+----+----------------+------------+-----------+-----------+------------------+----------+------+--------------------------------------+--------------------------------------+---------------+------------------+------------+---------------------+---------+----------------+----------+------------+--------------+-----------------+---------+-------+
6 rows in set (0.00 sec)
> Object_Store_Refactor - Snapshots - There is no delta snapshots being created for subsequent snapshots when multiple snapshots are taken for root /data volumes.
> -----------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: CLOUDSTACK-2630
> URL: https://issues.apache.org/jira/browse/CLOUDSTACK-2630
> Project: CloudStack
> Issue Type: Bug
> Security Level: Public(Anyone can view this level - this is the default.)
> Components: Management Server
> Affects Versions: 4.2.0
> Environment: Build from object store
> Reporter: Sangeetha Hariharan
> Assignee: edison su
> Priority: Blocker
> Fix For: 4.2.0
>
>
> Object_Store_Refactor - Snapshots - There is no delta syncs being created for subsequent snapshots when multiple snapshots are taken for root /data volumes
> Steps to reproduce the problem:
> Deploy a Vm with root and data disk.
> Take 1 snapshot of root volume.
> Do some changes to the root volume like create files.
> Take another snapshot of root volume.
> Notice that the 2nd snapshot taken is not a delta snapshot.
> [root@nfs2 3]# ls -ltr
> total 2607572
> -rw-r--r-- 1 root root 1863848448 May 22 15:28 aecfd50d-c5f7-4270-96af-ccef8d040854.vhd
> -rw-r--r-- 1 root root 1865949696 May 22 15:33 d9d89b01-a82c-41b0-a440-3bb807beac6e.vhd
> [root@nfs2 3]#
> Take 1 snapshot of data volume.
> Do some changes to the data volume like create files.
> Take another snapshot of data volume.
> Notice that the 2nd snapshot taken is not a delta snapshot.
> [root@nfs2 8]# ls -ltr
> total 13052
> -rw-r--r-- 1 root root 153403904 May 22 13:53 15f1706f-7a2a-45ba-96bc-d0dc520909f3.vhd
> -rw-r--r-- 1 root root 153403904 May 22 13:54 9047547a-a131-431a-b3f0-de1a3acb5117.vhd
> -rw-r--r-- 1 root root 153403904 May 22 15:47 6077e984-f7e3-4981-919d-25b0381fb563.vhd
> management server logs:
> 2013-05-22 14:46:17,881 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-21:null) submit async job-30, details: AsyncJobVO {id:30, userId: 2, accountId: 2, sessionKey: null, instanceType: Snapshot, instanceId: 7, cmd: org.apache.cloudstack.api.command.user.snapshot.CreateSnapshotCmd, cmdOriginator: null, cmdInfo: {"id":"7","response":"json","sessionkey":"5LuVTJbq8L9whPX/rBchZgFpeGs\u003d","ctxUserId":"2","httpmethod":"GET","_":"1369262605452","volumeid":"127eb892-e435-4a13-a29a-5b9d3185face","ctxAccountId":"2","ctxStartEventId":"95"}, cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0, processStatus: 0, resultCode: 0, result: null, initMsid: 206915885079359, completeMsid: null, lastUpdated: null, lastPolled: null, created: null}
> 2013-05-22 14:46:17,883 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-7:job-30) Executing org.apache.cloudstack.api.command.user.snapshot.CreateSnapshotCmd for job-30
> 2013-05-22 14:46:17,915 INFO [user.snapshot.CreateSnapshotCmd] (Job-Executor-7:job-30) VOLSS: createSnapshotCmd starts:1369259177915
> 2013-05-22 14:46:17,976 DEBUG [agent.transport.Request] (Job-Executor-7:job-30) Seq 1-375915079: Sending { Cmd , MgmtId: 206915885079359, via: 1, Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CreateObjectCommand":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"volume":{"uuid":"127eb892-e435-4a13-a29a-5b9d3185face","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"dbf7203e-d359-3179-a464-9900e126cdb0","id":3,"poolType":"NetworkFilesystem","host":"10.223.110.232","path":"/export/home/sangeetha/campo-systemp-1/primary2","port":2049}},"name":"DATA-8","size":5368709120,"path":"4cfaf81f-e11b-42ae-a290-65e2e36fb099","volumeId":8,"vmName":"i-2-8-VM","accountId":2,"id":8},"dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"dbf7203e-d359-3179-a464-9900e126cdb0","id":3,"poolType":"NetworkFilesystem","host":"10.223.110.232","path":"/export/home/sangeetha/campo-systemp-1/primary2","port":2049}},"vmName":"i-2-8-VM","name":"data-123_DATA-8_20130522214617","hypervisorType":"XenServer","id":7}},"wait":0}}] }
> 2013-05-22 14:46:17,976 DEBUG [agent.transport.Request] (Job-Executor-7:job-30) Seq 1-375915079: Executing: { Cmd , MgmtId: 206915885079359, via: 1, Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CreateObjectCommand":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"volume":{"uuid":"127eb892-e435-4a13-a29a-5b9d3185face","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"dbf7203e-d359-3179-a464-9900e126cdb0","id":3,"poolType":"NetworkFilesystem","host":"10.223.110.232","path":"/export/home/sangeetha/campo-systemp-1/primary2","port":2049}},"name":"DATA-8","size":5368709120,"path":"4cfaf81f-e11b-42ae-a290-65e2e36fb099","volumeId":8,"vmName":"i-2-8-VM","accountId":2,"id":8},"dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"dbf7203e-d359-3179-a464-9900e126cdb0","id":3,"poolType":"NetworkFilesystem","host":"10.223.110.232","path":"/export/home/sangeetha/campo-systemp-1/primary2","port":2049}},"vmName":"i-2-8-VM","name":"data-123_DATA-8_20130522214617","hypervisorType":"XenServer","id":7}},"wait":0}}] }
> 2013-05-22 14:46:19,526 DEBUG [agent.transport.Request] (Job-Executor-7:job-30) Seq 1-375915079: Received: { Ans: , MgmtId: 206915885079359, via: 1, Ver: v1, Flags: 10, { CreateObjectAnswer } }
> 2013-05-22 14:46:19,628 DEBUG [agent.transport.Request] (Job-Executor-7:job-30) Seq 1-375915080: Sending { Cmd , MgmtId: 206915885079359, via: 1, Ver: v1, Flags: 100111, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"3ceb618a-5bce-4076-a7c6-aff08af8bb6e","volume":{"uuid":"127eb892-e435-4a13-a29a-5b9d3185face","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"dbf7203e-d359-3179-a464-9900e126cdb0","id":3,"poolType":"NetworkFilesystem","host":"10.223.110.232","path":"/export/home/sangeetha/campo-systemp-1/primary2","port":2049}},"name":"DATA-8","size":5368709120,"path":"4cfaf81f-e11b-42ae-a290-65e2e36fb099","volumeId":8,"vmName":"i-2-8-VM","accountId":2,"id":8},"dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"dbf7203e-d359-3179-a464-9900e126cdb0","id":3,"poolType":"NetworkFilesystem","host":"10.223.110.232","path":"/export/home/sangeetha/campo-systemp-1/primary2","port":2049}},"vmName":"i-2-8-VM","name":"data-123_DATA-8_20130522214617","hypervisorType":"XenServer","id":7}},"destTO":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"snapshots/2/8","volume":{"uuid":"127eb892-e435-4a13-a29a-5b9d3185face","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"dbf7203e-d359-3179-a464-9900e126cdb0","id":3,"poolType":"NetworkFilesystem","host":"10.223.110.232","path":"/export/home/sangeetha/campo-systemp-1/primary2","port":2049}},"name":"DATA-8","size":5368709120,"path":"4cfaf81f-e11b-42ae-a290-65e2e36fb099","volumeId":8,"vmName":"i-2-8-VM","accountId":2,"id":8},"dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.223.110.232/export/home/sangeetha/campo-systemp-1/secondary","_role":"Image"}},"vmName":"i-2-8-VM","name":"data-123_DATA-8_20130522214617","hypervisorType":"XenServer","id":7}},"wait":21600}}] }
> 2013-05-22 14:46:19,629 DEBUG [agent.transport.Request] (Job-Executor-7:job-30) Seq 1-375915080: Executing: { Cmd , MgmtId: 206915885079359, via: 1, Ver: v1, Flags: 100111, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"3ceb618a-5bce-4076-a7c6-aff08af8bb6e","volume":{"uuid":"127eb892-e435-4a13-a29a-5b9d3185face","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"dbf7203e-d359-3179-a464-9900e126cdb0","id":3,"poolType":"NetworkFilesystem","host":"10.223.110.232","path":"/export/home/sangeetha/campo-systemp-1/primary2","port":2049}},"name":"DATA-8","size":5368709120,"path":"4cfaf81f-e11b-42ae-a290-65e2e36fb099","volumeId":8,"vmName":"i-2-8-VM","accountId":2,"id":8},"dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"dbf7203e-d359-3179-a464-9900e126cdb0","id":3,"poolType":"NetworkFilesystem","host":"10.223.110.232","path":"/export/home/sangeetha/campo-systemp-1/primary2","port":2049}},"vmName":"i-2-8-VM","name":"data-123_DATA-8_20130522214617","hypervisorType":"XenServer","id":7}},"destTO":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"snapshots/2/8","volume":{"uuid":"127eb892-e435-4a13-a29a-5b9d3185face","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"dbf7203e-d359-3179-a464-9900e126cdb0","id":3,"poolType":"NetworkFilesystem","host":"10.223.110.232","path":"/export/home/sangeetha/campo-systemp-1/primary2","port":2049}},"name":"DATA-8","size":5368709120,"path":"4cfaf81f-e11b-42ae-a290-65e2e36fb099","volumeId":8,"vmName":"i-2-8-VM","accountId":2,"id":8},"dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://10.223.110.232/export/home/sangeetha/campo-systemp-1/secondary","_role":"Image"}},"vmName":"i-2-8-VM","name":"data-123_DATA-8_20130522214617","hypervisorType":"XenServer","id":7}},"wait":21600}}] }
> 2013-05-22 14:46:47,906 DEBUG [agent.transport.Request] (Job-Executor-7:job-30) Seq 1-375915080: Received: { Ans: , MgmtId: 206915885079359, via: 1, Ver: v1, Flags: 110, { CopyCmdAnswer } }
> 2013-05-22 14:46:47,969 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-7:job-30) Complete async job-30, jobStatus: 1, resultCode: 0, result: org.apache.cloudstack.api.response.SnapshotResponse@3cc2f15
> 2013-05-22 14:46:47,980 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-7:job-30) Done executing org.apache.cloudstack.api.command.user.snapshot.CreateSnapshotCmd for job-30
> 2013-05-22 14:46:48,382 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-3:null) Async job-30 completed
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira