You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by Venkat Boggarapu <ve...@axiomio.com> on 2016/05/26 07:29:10 UTC

DAILY SNAPSHOT ISSUE FOR VOLUME SNAPSHOT

Hi Guys,

My environment is Cloudstack-4.2.0 and Xenserver is 6.2.0

I kept daily scheduled volume snapshots for all the vms in my environment.

But from last three weeks I am getting error "CREATED ON PRIMARY" for one volume snapshot on ROOT volume.

Please help me regarding if any one faced the same issue.

Thanks,
Venkat Boggarapu

Re: DAILY SNAPSHOT ISSUE FOR VOLUME SNAPSHOT

Posted by Prashant Mishra <pr...@accelerite.com>.
Can you provide full log, I don¹t see
org.apache.cloudstack.storage.command.CopyCommand  and create snapshot cmd
answer .

On 5/27/16, 5:20 PM, "Venkat Boggarapu" <ve...@axiomio.com> wrote:

>Hi Glenn/Prashant,
>
>I am forwarding the logs regarding the volumesnapshot error.
>I am using the local storage.
>
>Please check and let us know the solution
>
>2016-05-27 01:04:51,760 DEBUG [agent.transport.Request]
>(RouterStatusMonitor-1:null) Seq 39-2062270868: Received:  { Ans: ,
>MgmtId: 120860783173, via: 39, Ver: v1, Flags: 110, {
>CheckS2SVpnConnectionsAnswer } }
>2016-05-27 01:04:51,760 DEBUG [agent.manager.AgentManagerImpl]
>(RouterStatusMonitor-1:null) Details from executing class
>com.cloud.agent.api.CheckS2SVpnConnectionsCommand: success
>2016-05-27 01:04:51,764 DEBUG
>[network.router.VirtualNetworkApplianceManagerImpl]
>(RouterStatusMonitor-1:null) Found 0 networks to update RvR status.
>2016-05-27 01:04:53,383 DEBUG [agent.manager.DirectAgentAttache]
>(DirectAgent-220:null) Seq 39-2062270864: Response Received:
>2016-05-27 01:04:53,383 DEBUG [agent.transport.Request]
>(DirectAgent-220:null) Seq 39-2062270864: Processing:  { Ans: , MgmtId:
>120860783173, via: 39, Ver: v1, Flags: 10,
>[{"org.apache.cloudstack.storage.command.CreateObjectAnswer":{"data":{"org
>.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"a0185ce4-3e32-4a1
>0-941a-1bb0c2e6bc29","id":0}},"result":true,"wait":0}}] }
>2016-05-27 01:04:53,383 DEBUG [agent.transport.Request]
>(Job-Executor-133:job-31423 = [ 66ddcbce-bde3-4120-bdca-4c24aa3a7b0e ])
>Seq 39-2062270864: Received:  { Ans: , MgmtId: 120860783173, via: 39,
>Ver: v1, Flags: 10, { CreateObjectAnswer } }
>2016-05-27 01:04:53,411 DEBUG [agent.manager.AgentManagerImpl]
>(AgentManager-Handler-8:null) Ping from 17
>2016-05-27 01:04:53,544 DEBUG [storage.motion.AncientDataMotionStrategy]
>(Job-Executor-133:job-31423 = [ 66ddcbce-bde3-4120-bdca-4c24aa3a7b0e ])
>copyAsync inspecting src type SNAPSHOT copyAsync inspecting dest type
>SNAPSHOT
>2016-05-27 01:04:53,594 DEBUG [agent.transport.Request]
>(Job-Executor-133:job-31423 = [ 66ddcbce-bde3-4120-bdca-4c24aa3a7b0e ])
>Seq 39-2062270869: Sending  { Cmd , MgmtId: 120860783173, via: 39, Ver:
>v1, Flags: 100111,
>[{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apach
>e.cloudstack.storage.to.SnapshotObjectTO":{"path":"a0185ce4-3e32-4a10-941a
>-1bb0c2e6bc29","volume":{"uuid":"3a12d9c8-d746-4906-9de5-9bf16b646ecf","vo
>lumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDat
>aStoreTO":{"uuid":"48be6dd0-cb35-132e-2661-99842fadbaba","id":219,"poolTyp
>e":"LVM","host":"205.144.169.97","path":"lvm","port":0}},"name":"ROOT-746"
>,"size":64424509440,"path":"3d46fb28-b617-4179-a073-f4a148f393d7","volumeI
>d":1142,"vmName":"i-3-746-VM","accountId":3,"format":"VHD","id":1142,"hype
>rvisorType":"XenServer"},"parentSnapshotPath":"1828a168-b7ae-4b76-b1f8-c85
>378bc93cb","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStore
>TO":{"uuid":"48be6dd0-cb35-132e-2661-99842fadbaba","id":219,"poolType":"LV
>M","host":"205.144.169.97","path":"lvm","port":0}},"vmName":"i-3-746-VM","
>name":"BNI-EVC-Web1-Rep_ROOT-746_20160527080448","hypervisorType":"XenServ
>er","id":23350}},"destTO":{"org.apache.cloudstack.storage.to.SnapshotObjec
>tTO":{"path":"snapshots/3/1142","volume":{"uuid":"3a12d9c8-d746-4906-9de5-
>9bf16b646ecf","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.stor
>age.to.PrimaryDataStoreTO":{"uuid":"48be6dd0-cb35-132e-2661-99842fadbaba",
>"id":219,"poolType":"LVM","host":"205.144.169.97","path":"lvm","port":0}},
>"name":"ROOT-746","size":64424509440,"path":"3d46fb28-b617-4179-a073-f4a14
>8f393d7","volumeId":1142,"vmName":"i-3-746-VM","accountId":3,"format":"VHD
>","id":1142,"hypervisorType":"XenServer"},"parentSnapshotPath":"snapshots/
>3/1142/e20fdcd7-6d7e-41aa-8af7-c0605ca1b97b","dataStore":{"com.cloud.agent
>.api.to.NfsTO":{"_url":"nfs://205.144.169.99/export1/secondary","_role":"I
>mage"}},"vmName":"i-3-746-VM","name":"BNI-EVC-Web1-Rep_ROOT-746_2016052708
>0448","hypervisorType":"XenServer","id":23350}},"executeInSequence":true,"
>wait":21600}}] }
>2016-05-27 01:04:53,595 DEBUG [agent.transport.Request]
>(Job-Executor-133:job-31423 = [ 66ddcbce-bde3-4120-bdca-4c24aa3a7b0e ])
>Seq 39-2062270869: Executing:  { Cmd , MgmtId: 120860783173, via: 39,
>Ver: v1, Flags: 100111,
>[{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apach
>e.cloudstack.storage.to.SnapshotObjectTO":{"path":"a0185ce4-3e32-4a10-941a
>-1bb0c2e6bc29","volume":{"uuid":"3a12d9c8-d746-4906-9de5-9bf16b646ecf","vo
>lumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDat
>aStoreTO":{"uuid":"48be6dd0-cb35-132e-2661-99842fadbaba","id":219,"poolTyp
>e":"LVM","host":"205.144.169.97","path":"lvm","port":0}},"name":"ROOT-746"
>,"size":64424509440,"path":"3d46fb28-b617-4179-a073-f4a148f393d7","volumeI
>d":1142,"vmName":"i-3-746-VM","accountId":3,"format":"VHD","id":1142,"hype
>rvisorType":"XenServer"},"parentSnapshotPath":"1828a168-b7ae-4b76-b1f8-c85
>378bc93cb","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStore
>TO":{"uuid":"48be6dd0-cb35-132e-2661-99842fadbaba","id":219,"poolType":"LV
>M","host":"205.144.169.97","path":"lvm","port":0}},"vmName":"i-3-746-VM","
>name":"BNI-EVC-Web1-Rep_ROOT-746_20160527080448","hypervisorType":"XenServ
>er","id":23350}},"destTO":{"org.apache.cloudstack.storage.to.SnapshotObjec
>tTO":{"path":"snapshots/3/1142","volume":{"uuid":"3a12d9c8-d746-4906-9de5-
>9bf16b646ecf","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.stor
>age.to.PrimaryDataStoreTO":{"uuid":"48be6dd0-cb35-132e-2661-99842fadbaba",
>"id":219,"poolType":"LVM","host":"205.144.169.97","path":"lvm","port":0}},
>"name":"ROOT-746","size":64424509440,"path":"3d46fb28-b617-4179-a073-f4a14
>8f393d7","volumeId":1142,"vmName":"i-3-746-VM","accountId":3,"format":"VHD
>","id":1142,"hypervisorType":"XenServer"},"parentSnapshotPath":"snapshots/
>3/1142/e20fdcd7-6d7e-41aa-8af7-c0605ca1b97b","dataStore":{"com.cloud.agent
>.api.to.NfsTO":{"_url":"nfs://205.144.169.99/export1/secondary","_role":"I
>mage"}},"vmName":"i-3-746-VM","name":"BNI-EVC-Web1-Rep_ROOT-746_2016052708
>0448","hypervisorType":"XenServer","id":23350}},"executeInSequence":true,"
>wait":21600}}] }
>2016-05-27 01:04:53,595 DEBUG [agent.manager.DirectAgentAttache]
>(DirectAgent-335:null) Seq 39-2062270869: Executing request
>2016-05-27 01:04:55,421 DEBUG [agent.manager.AgentManagerImpl]
>(AgentManager-Handler-10:null) SeqA 17-2201881: Processing Seq
>17-2201881:  { Cmd , MgmtId: -1, via: 17, Ver: v1, Flags: 11,
>[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":299,"_
>loadInfo":"{\n  \"connections\": []\n}","wait":0}}] }
>2016-05-27 01:04:53,594 DEBUG [agent.transport.Request]
>(Job-Executor-133:job-31423 = [ 66ddcbce-bde3-4120-bdca-4c24aa3a7b0e ])
>Seq 39-2062270869: Sending  { Cmd , MgmtId: 120860783173, via: 39, Ver:
>v1, Flags: 100111,
>[{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apach
>e.cloudstack.storage.to.SnapshotObjectTO":{"path":"a0185ce4-3e32-4a10-941a
>-1bb0c2e6bc29","volume":{"uuid":"3a12d9c8-d746-4906-9de5-9bf16b646ecf","vo
>lumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDat
>aStoreTO":{"uuid":"48be6dd0-cb35-132e-2661-99842fadbaba","id":219,"poolTyp
>e":"LVM","host":"205.144.169.97","path":"lvm","port":0}},"name":"ROOT-746"
>,"size":64424509440,"path":"3d46fb28-b617-4179-a073-f4a148f393d7","volumeI
>d":1142,"vmName":"i-3-746-VM","accountId":3,"format":"VHD","id":1142,"hype
>rvisorType":"XenServer"},"parentSnapshotPath":"1828a168-b7ae-4b76-b1f8-c85
>378bc93cb","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStore
>TO":{"uuid":"48be6dd0-cb35-132e-2661-99842fadbaba","id":219,"poolType":"LV
>M","host":"205.144.169.97","path":"lvm","port":0}},"vmName":"i-3-746-VM","
>name":"BNI-EVC-Web1-Rep_ROOT-746_20160527080448","hypervisorType":"XenServ
>er","id":23350}},"destTO":{"org.apache.cloudstack.storage.to.SnapshotObjec
>tTO":{"path":"snapshots/3/1142","volume":{"uuid":"3a12d9c8-d746-4906-9de5-
>9bf16b646ecf","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.stor
>age.to.PrimaryDataStoreTO":{"uuid":"48be6dd0-cb35-132e-2661-99842fadbaba",
>"id":219,"poolType":"LVM","host":"205.144.169.97","path":"lvm","port":0}},
>"name":"ROOT-746","size":64424509440,"path":"3d46fb28-b617-4179-a073-f4a14
>8f393d7","volumeId":1142,"vmName":"i-3-746-VM","accountId":3,"format":"VHD
>","id":1142,"hypervisorType":"XenServer"},"parentSnapshotPath":"snapshots/
>3/1142/e20fdcd7-6d7e-41aa-8af7-c0605ca1b97b","dataStore":{"com.cloud.agent
>.api.to.NfsTO":{"_url":"nfs://205.144.169.99/export1/secondary","_role":"I
>mage"}},"vmName":"i-3-746-VM","name":"BNI-EVC-Web1-Rep_ROOT-746_2016052708
>0448","hypervisorType":"XenServer","id":23350}},"executeInSequence":true,"
>wait":21600}}] }
>2016-05-27 01:04:53,595 DEBUG [agent.transport.Request]
>(Job-Executor-133:job-31423 = [ 66ddcbce-bde3-4120-bdca-4c24aa3a7b0e ])
>Seq 39-2062270869: Executing:  { Cmd , MgmtId: 120860783173, via: 39,
>Ver: v1, Flags: 100111,
>[{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apach
>e.cloudstack.storage.to.SnapshotObjectTO":{"path":"a0185ce4-3e32-4a10-941a
>-1bb0c2e6bc29","volume":{"uuid":"3a12d9c8-d746-4906-9de5-9bf16b646ecf","vo
>lumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDat
>aStoreTO":{"uuid":"48be6dd0-cb35-132e-2661-99842fadbaba","id":219,"poolTyp
>e":"LVM","host":"205.144.169.97","path":"lvm","port":0}},"name":"ROOT-746"
>,"size":64424509440,"path":"3d46fb28-b617-4179-a073-f4a148f393d7","volumeI
>d":1142,"vmName":"i-3-746-VM","accountId":3,"format":"VHD","id":1142,"hype
>rvisorType":"XenServer"},"parentSnapshotPath":"1828a168-b7ae-4b76-b1f8-c85
>378bc93cb","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStore
>TO":{"uuid":"48be6dd0-cb35-132e-2661-99842fadbaba","id":219,"poolType":"LV
>M","host":"205.144.169.97","path":"lvm","port":0}},"vmName":"i-3-746-VM","
>name":"BNI-EVC-Web1-Rep_ROOT-746_20160527080448","hypervisorType":"XenServ
>er","id":23350}},"destTO":{"org.apache.cloudstack.storage.to.SnapshotObjec
>tTO":{"path":"snapshots/3/1142","volume":{"uuid":"3a12d9c8-d746-4906-9de5-
>9bf16b646ecf","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.stor
>age.to.PrimaryDataStoreTO":{"uuid":"48be6dd0-cb35-132e-2661-99842fadbaba",
>"id":219,"poolType":"LVM","host":"205.144.169.97","path":"lvm","port":0}},
>"name":"ROOT-746","size":64424509440,"path":"3d46fb28-b617-4179-a073-f4a14
>8f393d7","volumeId":1142,"vmName":"i-3-746-VM","accountId":3,"format":"VHD
>","id":1142,"hypervisorType":"XenServer"},"parentSnapshotPath":"snapshots/
>3/1142/e20fdcd7-6d7e-41aa-8af7-c0605ca1b97b","dataStore":{"com.cloud.agent
>.api.to.NfsTO":{"_url":"nfs://205.144.169.99/export1/secondary","_role":"I
>mage"}},"vmName":"i-3-746-VM","name":"BNI-EVC-Web1-Rep_ROOT-746_2016052708
>0448","hypervisorType":"XenServer","id":23350}},"executeInSequence":true,"
>wait":21600}}] }
>2016-05-27 01:04:53,595 DEBUG [agent.manager.DirectAgentAttache]
>(DirectAgent-335:null) Seq 39-2062270869: Executing request
>2016-05-27 01:04:55,421 DEBUG [agent.manager.AgentManagerImpl]
>(AgentManager-Handler-10:null) SeqA 17-2201881: Processing Seq
>17-2201881:  { Cmd , MgmtId: -1, via: 17, Ver: v1, Flags: 11,
>[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":299,"_
>loadInfo":"{\n  \"connections\": []\n}","wait":0}}] }
>2016-05-27 01:04:55,431 DEBUG [agent.manager.AgentManagerImpl]
>(AgentManager-Handler-10:null) SeqA 17-2201881: Sending Seq 17-2201881:
>{ Ans: , MgmtId: 120860783173, via: 17, Ver: v1, Flags: 100010,
>[{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
>2016-05-27 01:04:57,046 DEBUG [network.lb.LBHealthCheckManagerImpl]
>(LBHealthCheck-1:null) LB HealthCheck Manager is running and getting the
>updates from LB providers and updating service status
>2016-05-27 01:04:57,115 DEBUG [network.lb.LBHealthCheckManagerImpl]
>(LBHealthCheck-1:null) LB HealthCheck Manager is running and getting the
>updates from LB providers and updating service status
>2016-05-27 01:04:59,045 DEBUG [agent.manager.DirectAgentAttache]
>(DirectAgent-220:null) Ping from 38
>2016-05-27 01:04:59,667 DEBUG [agent.manager.AgentManagerImpl]
>(AgentManager-Handler-5:null) Ping from 32
>
>Thanks,
>Venkat Boggarapu
>
>-----Original Message-----
>From: Prashant Mishra [mailto:prashant.mishra@accelerite.com]
>Sent: Friday, May 27, 2016 10:06 AM
>To: users@cloudstack.apache.org
>Subject: Re: DAILY SNAPSHOT ISSUE FOR VOLUME SNAPSHOT
>
>As Glenn said   please provide MS log for further investigation , CREATED
>ON PRIMARY is the state of snapshot  ?
>On 5/27/16, 9:57 AM, "Venkat Boggarapu" <ve...@axiomio.com> wrote:
>
>>Hi Glenn,
>>
>>I tried to remove the error and taken manual snapshot for the volume,
>>manual snapshot is done, after that for two days daily snapshots is
>>working good for that volume.
>>
>>After two days the error comes again  as "CREATED ON PRIMARY". This is
>>happening from last three to four weeks.
>>
>>Thanks,
>>Venkat Boggarapu
>>
>>-----Original Message-----
>>From: Glenn Wagner [mailto:glenn.wagner@shapeblue.com]
>>Sent: Thursday, May 26, 2016 1:04 PM
>>To: users@cloudstack.apache.org
>>Subject: RE: DAILY SNAPSHOT ISSUE FOR VOLUME SNAPSHOT
>>
>>Hi,
>>
>>Can you upload (pastebin) your management server logs for us to see the
>>error,
>>
>>Regards
>>Glenn
>>
>>glenn.wagner@shapeblue.com
>>www.shapeblue.com
>>2nd Floor, Oudehuis Centre, 122 Main Rd, Somerset West, Cape Town
>>7130South Africa @shapeblue
>>
>>
>>
>>-----Original Message-----
>>From: Venkat Boggarapu [mailto:venkat.b@axiomio.com]
>>Sent: Thursday, 26 May 2016 9:29 AM
>>To: users@cloudstack.apache.org
>>Subject: DAILY SNAPSHOT ISSUE FOR VOLUME SNAPSHOT
>>
>>Hi Guys,
>>
>>My environment is Cloudstack-4.2.0 and Xenserver is 6.2.0
>>
>>I kept daily scheduled volume snapshots for all the vms in my
>>environment.
>>
>>But from last three weeks I am getting error "CREATED ON PRIMARY" for
>>one volume snapshot on ROOT volume.
>>
>>Please help me regarding if any one faced the same issue.
>>
>>Thanks,
>>Venkat Boggarapu
>
>
>
>
>DISCLAIMER
>==========
>This e-mail may contain privileged and confidential information which is
>the property of Accelerite, a Persistent Systems business. It is intended
>only for the use of the individual or entity to which it is addressed. If
>you are not the intended recipient, you are not authorized to read,
>retain, copy, print, distribute or use this message. If you have received
>this communication in error, please notify the sender and delete all
>copies of this message. Accelerite, a Persistent Systems business does
>not accept any liability for virus infected mails.




DISCLAIMER
==========
This e-mail may contain privileged and confidential information which is the property of Accelerite, a Persistent Systems business. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Accelerite, a Persistent Systems business does not accept any liability for virus infected mails.

RE: DAILY SNAPSHOT ISSUE FOR VOLUME SNAPSHOT

Posted by Venkat Boggarapu <ve...@axiomio.com>.
Hi Glenn/Prashant,

I am forwarding the logs regarding the volumesnapshot error.
I am using the local storage.

Please check and let us know the solution

2016-05-27 01:04:51,760 DEBUG [agent.transport.Request] (RouterStatusMonitor-1:null) Seq 39-2062270868: Received:  { Ans: , MgmtId: 120860783173, via: 39, Ver: v1, Flags: 110, { CheckS2SVpnConnectionsAnswer } }
2016-05-27 01:04:51,760 DEBUG [agent.manager.AgentManagerImpl] (RouterStatusMonitor-1:null) Details from executing class com.cloud.agent.api.CheckS2SVpnConnectionsCommand: success
2016-05-27 01:04:51,764 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 0 networks to update RvR status.
2016-05-27 01:04:53,383 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-220:null) Seq 39-2062270864: Response Received:
2016-05-27 01:04:53,383 DEBUG [agent.transport.Request] (DirectAgent-220:null) Seq 39-2062270864: Processing:  { Ans: , MgmtId: 120860783173, via: 39, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CreateObjectAnswer":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"a0185ce4-3e32-4a10-941a-1bb0c2e6bc29","id":0}},"result":true,"wait":0}}] }
2016-05-27 01:04:53,383 DEBUG [agent.transport.Request] (Job-Executor-133:job-31423 = [ 66ddcbce-bde3-4120-bdca-4c24aa3a7b0e ]) Seq 39-2062270864: Received:  { Ans: , MgmtId: 120860783173, via: 39, Ver: v1, Flags: 10, { CreateObjectAnswer } }
2016-05-27 01:04:53,411 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-8:null) Ping from 17
2016-05-27 01:04:53,544 DEBUG [storage.motion.AncientDataMotionStrategy] (Job-Executor-133:job-31423 = [ 66ddcbce-bde3-4120-bdca-4c24aa3a7b0e ]) copyAsync inspecting src type SNAPSHOT copyAsync inspecting dest type SNAPSHOT
2016-05-27 01:04:53,594 DEBUG [agent.transport.Request] (Job-Executor-133:job-31423 = [ 66ddcbce-bde3-4120-bdca-4c24aa3a7b0e ]) Seq 39-2062270869: Sending  { Cmd , MgmtId: 120860783173, via: 39, Ver: v1, Flags: 100111, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"a0185ce4-3e32-4a10-941a-1bb0c2e6bc29","volume":{"uuid":"3a12d9c8-d746-4906-9de5-9bf16b646ecf","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"48be6dd0-cb35-132e-2661-99842fadbaba","id":219,"poolType":"LVM","host":"205.144.169.97","path":"lvm","port":0}},"name":"ROOT-746","size":64424509440,"path":"3d46fb28-b617-4179-a073-f4a148f393d7","volumeId":1142,"vmName":"i-3-746-VM","accountId":3,"format":"VHD","id":1142,"hypervisorType":"XenServer"},"parentSnapshotPath":"1828a168-b7ae-4b76-b1f8-c85378bc93cb","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"48be6dd0-cb35-132e-2661-99842fadbaba","id":219,"poolType":"LVM","host":"205.144.169.97","path":"lvm","port":0}},"vmName":"i-3-746-VM","name":"BNI-EVC-Web1-Rep_ROOT-746_20160527080448","hypervisorType":"XenServer","id":23350}},"destTO":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"snapshots/3/1142","volume":{"uuid":"3a12d9c8-d746-4906-9de5-9bf16b646ecf","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"48be6dd0-cb35-132e-2661-99842fadbaba","id":219,"poolType":"LVM","host":"205.144.169.97","path":"lvm","port":0}},"name":"ROOT-746","size":64424509440,"path":"3d46fb28-b617-4179-a073-f4a148f393d7","volumeId":1142,"vmName":"i-3-746-VM","accountId":3,"format":"VHD","id":1142,"hypervisorType":"XenServer"},"parentSnapshotPath":"snapshots/3/1142/e20fdcd7-6d7e-41aa-8af7-c0605ca1b97b","dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://205.144.169.99/export1/secondary","_role":"Image"}},"vmName":"i-3-746-VM","name":"BNI-EVC-Web1-Rep_ROOT-746_20160527080448","hypervisorType":"XenServer","id":23350}},"executeInSequence":true,"wait":21600}}] }
2016-05-27 01:04:53,595 DEBUG [agent.transport.Request] (Job-Executor-133:job-31423 = [ 66ddcbce-bde3-4120-bdca-4c24aa3a7b0e ]) Seq 39-2062270869: Executing:  { Cmd , MgmtId: 120860783173, via: 39, Ver: v1, Flags: 100111, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"a0185ce4-3e32-4a10-941a-1bb0c2e6bc29","volume":{"uuid":"3a12d9c8-d746-4906-9de5-9bf16b646ecf","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"48be6dd0-cb35-132e-2661-99842fadbaba","id":219,"poolType":"LVM","host":"205.144.169.97","path":"lvm","port":0}},"name":"ROOT-746","size":64424509440,"path":"3d46fb28-b617-4179-a073-f4a148f393d7","volumeId":1142,"vmName":"i-3-746-VM","accountId":3,"format":"VHD","id":1142,"hypervisorType":"XenServer"},"parentSnapshotPath":"1828a168-b7ae-4b76-b1f8-c85378bc93cb","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"48be6dd0-cb35-132e-2661-99842fadbaba","id":219,"poolType":"LVM","host":"205.144.169.97","path":"lvm","port":0}},"vmName":"i-3-746-VM","name":"BNI-EVC-Web1-Rep_ROOT-746_20160527080448","hypervisorType":"XenServer","id":23350}},"destTO":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"snapshots/3/1142","volume":{"uuid":"3a12d9c8-d746-4906-9de5-9bf16b646ecf","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"48be6dd0-cb35-132e-2661-99842fadbaba","id":219,"poolType":"LVM","host":"205.144.169.97","path":"lvm","port":0}},"name":"ROOT-746","size":64424509440,"path":"3d46fb28-b617-4179-a073-f4a148f393d7","volumeId":1142,"vmName":"i-3-746-VM","accountId":3,"format":"VHD","id":1142,"hypervisorType":"XenServer"},"parentSnapshotPath":"snapshots/3/1142/e20fdcd7-6d7e-41aa-8af7-c0605ca1b97b","dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://205.144.169.99/export1/secondary","_role":"Image"}},"vmName":"i-3-746-VM","name":"BNI-EVC-Web1-Rep_ROOT-746_20160527080448","hypervisorType":"XenServer","id":23350}},"executeInSequence":true,"wait":21600}}] }
2016-05-27 01:04:53,595 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-335:null) Seq 39-2062270869: Executing request
2016-05-27 01:04:55,421 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-10:null) SeqA 17-2201881: Processing Seq 17-2201881:  { Cmd , MgmtId: -1, via: 17, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":299,"_loadInfo":"{\n  \"connections\": []\n}","wait":0}}] }
2016-05-27 01:04:53,594 DEBUG [agent.transport.Request] (Job-Executor-133:job-31423 = [ 66ddcbce-bde3-4120-bdca-4c24aa3a7b0e ]) Seq 39-2062270869: Sending  { Cmd , MgmtId: 120860783173, via: 39, Ver: v1, Flags: 100111, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"a0185ce4-3e32-4a10-941a-1bb0c2e6bc29","volume":{"uuid":"3a12d9c8-d746-4906-9de5-9bf16b646ecf","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"48be6dd0-cb35-132e-2661-99842fadbaba","id":219,"poolType":"LVM","host":"205.144.169.97","path":"lvm","port":0}},"name":"ROOT-746","size":64424509440,"path":"3d46fb28-b617-4179-a073-f4a148f393d7","volumeId":1142,"vmName":"i-3-746-VM","accountId":3,"format":"VHD","id":1142,"hypervisorType":"XenServer"},"parentSnapshotPath":"1828a168-b7ae-4b76-b1f8-c85378bc93cb","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"48be6dd0-cb35-132e-2661-99842fadbaba","id":219,"poolType":"LVM","host":"205.144.169.97","path":"lvm","port":0}},"vmName":"i-3-746-VM","name":"BNI-EVC-Web1-Rep_ROOT-746_20160527080448","hypervisorType":"XenServer","id":23350}},"destTO":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"snapshots/3/1142","volume":{"uuid":"3a12d9c8-d746-4906-9de5-9bf16b646ecf","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"48be6dd0-cb35-132e-2661-99842fadbaba","id":219,"poolType":"LVM","host":"205.144.169.97","path":"lvm","port":0}},"name":"ROOT-746","size":64424509440,"path":"3d46fb28-b617-4179-a073-f4a148f393d7","volumeId":1142,"vmName":"i-3-746-VM","accountId":3,"format":"VHD","id":1142,"hypervisorType":"XenServer"},"parentSnapshotPath":"snapshots/3/1142/e20fdcd7-6d7e-41aa-8af7-c0605ca1b97b","dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://205.144.169.99/export1/secondary","_role":"Image"}},"vmName":"i-3-746-VM","name":"BNI-EVC-Web1-Rep_ROOT-746_20160527080448","hypervisorType":"XenServer","id":23350}},"executeInSequence":true,"wait":21600}}] }
2016-05-27 01:04:53,595 DEBUG [agent.transport.Request] (Job-Executor-133:job-31423 = [ 66ddcbce-bde3-4120-bdca-4c24aa3a7b0e ]) Seq 39-2062270869: Executing:  { Cmd , MgmtId: 120860783173, via: 39, Ver: v1, Flags: 100111, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"a0185ce4-3e32-4a10-941a-1bb0c2e6bc29","volume":{"uuid":"3a12d9c8-d746-4906-9de5-9bf16b646ecf","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"48be6dd0-cb35-132e-2661-99842fadbaba","id":219,"poolType":"LVM","host":"205.144.169.97","path":"lvm","port":0}},"name":"ROOT-746","size":64424509440,"path":"3d46fb28-b617-4179-a073-f4a148f393d7","volumeId":1142,"vmName":"i-3-746-VM","accountId":3,"format":"VHD","id":1142,"hypervisorType":"XenServer"},"parentSnapshotPath":"1828a168-b7ae-4b76-b1f8-c85378bc93cb","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"48be6dd0-cb35-132e-2661-99842fadbaba","id":219,"poolType":"LVM","host":"205.144.169.97","path":"lvm","port":0}},"vmName":"i-3-746-VM","name":"BNI-EVC-Web1-Rep_ROOT-746_20160527080448","hypervisorType":"XenServer","id":23350}},"destTO":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"snapshots/3/1142","volume":{"uuid":"3a12d9c8-d746-4906-9de5-9bf16b646ecf","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"48be6dd0-cb35-132e-2661-99842fadbaba","id":219,"poolType":"LVM","host":"205.144.169.97","path":"lvm","port":0}},"name":"ROOT-746","size":64424509440,"path":"3d46fb28-b617-4179-a073-f4a148f393d7","volumeId":1142,"vmName":"i-3-746-VM","accountId":3,"format":"VHD","id":1142,"hypervisorType":"XenServer"},"parentSnapshotPath":"snapshots/3/1142/e20fdcd7-6d7e-41aa-8af7-c0605ca1b97b","dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://205.144.169.99/export1/secondary","_role":"Image"}},"vmName":"i-3-746-VM","name":"BNI-EVC-Web1-Rep_ROOT-746_20160527080448","hypervisorType":"XenServer","id":23350}},"executeInSequence":true,"wait":21600}}] }
2016-05-27 01:04:53,595 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-335:null) Seq 39-2062270869: Executing request
2016-05-27 01:04:55,421 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-10:null) SeqA 17-2201881: Processing Seq 17-2201881:  { Cmd , MgmtId: -1, via: 17, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":299,"_loadInfo":"{\n  \"connections\": []\n}","wait":0}}] }
2016-05-27 01:04:55,431 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-10:null) SeqA 17-2201881: Sending Seq 17-2201881:  { Ans: , MgmtId: 120860783173, via: 17, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2016-05-27 01:04:57,046 DEBUG [network.lb.LBHealthCheckManagerImpl] (LBHealthCheck-1:null) LB HealthCheck Manager is running and getting the updates from LB providers and updating service status
2016-05-27 01:04:57,115 DEBUG [network.lb.LBHealthCheckManagerImpl] (LBHealthCheck-1:null) LB HealthCheck Manager is running and getting the updates from LB providers and updating service status
2016-05-27 01:04:59,045 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-220:null) Ping from 38
2016-05-27 01:04:59,667 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-5:null) Ping from 32

Thanks,
Venkat Boggarapu

-----Original Message-----
From: Prashant Mishra [mailto:prashant.mishra@accelerite.com] 
Sent: Friday, May 27, 2016 10:06 AM
To: users@cloudstack.apache.org
Subject: Re: DAILY SNAPSHOT ISSUE FOR VOLUME SNAPSHOT

As Glenn said   please provide MS log for further investigation , CREATED
ON PRIMARY is the state of snapshot  ?
On 5/27/16, 9:57 AM, "Venkat Boggarapu" <ve...@axiomio.com> wrote:

>Hi Glenn,
>
>I tried to remove the error and taken manual snapshot for the volume, 
>manual snapshot is done, after that for two days daily snapshots is 
>working good for that volume.
>
>After two days the error comes again  as "CREATED ON PRIMARY". This is 
>happening from last three to four weeks.
>
>Thanks,
>Venkat Boggarapu
>
>-----Original Message-----
>From: Glenn Wagner [mailto:glenn.wagner@shapeblue.com]
>Sent: Thursday, May 26, 2016 1:04 PM
>To: users@cloudstack.apache.org
>Subject: RE: DAILY SNAPSHOT ISSUE FOR VOLUME SNAPSHOT
>
>Hi,
>
>Can you upload (pastebin) your management server logs for us to see the 
>error,
>
>Regards
>Glenn
>
>glenn.wagner@shapeblue.com
>www.shapeblue.com
>2nd Floor, Oudehuis Centre, 122 Main Rd, Somerset West, Cape Town 
>7130South Africa @shapeblue
>
>
>
>-----Original Message-----
>From: Venkat Boggarapu [mailto:venkat.b@axiomio.com]
>Sent: Thursday, 26 May 2016 9:29 AM
>To: users@cloudstack.apache.org
>Subject: DAILY SNAPSHOT ISSUE FOR VOLUME SNAPSHOT
>
>Hi Guys,
>
>My environment is Cloudstack-4.2.0 and Xenserver is 6.2.0
>
>I kept daily scheduled volume snapshots for all the vms in my environment.
>
>But from last three weeks I am getting error "CREATED ON PRIMARY" for 
>one volume snapshot on ROOT volume.
>
>Please help me regarding if any one faced the same issue.
>
>Thanks,
>Venkat Boggarapu




DISCLAIMER
==========
This e-mail may contain privileged and confidential information which is the property of Accelerite, a Persistent Systems business. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Accelerite, a Persistent Systems business does not accept any liability for virus infected mails.

Re: DAILY SNAPSHOT ISSUE FOR VOLUME SNAPSHOT

Posted by Prashant Mishra <pr...@accelerite.com>.
With this log snippet what I could figure out is it issue with host (error
msg :callHostPlugin failed).clear host tag and try to force-reconnect it
should copy required packages .

On 5/30/16, 11:36 AM, "Venkat Boggarapu" <ve...@axiomio.com> wrote:

>Hi Glenn/Prashant,
>
>I am forwarding the exact log for the voloume snapshot
>Please check and let us know the error
>
>2016-05-29 01:07:10,021 WARN  [xen.resource.CitrixResourceBase]
>(DirectAgent-250:null) Task failed! Task record:                 uuid:
>8f8e8e52-de8d-7310-22c5-030719540292
>           nameLabel: Async.host.call_plugin
>     nameDescription:
>   allowedOperations: []
>   currentOperations: {}
>             created: Sun May 29 01:04:54 PDT 2016
>            finished: Sun May 29 01:07:09 PDT 2016
>              status: failure
>          residentOn: com.xensource.xenapi.Host@2115a7db
>            progress: 1.0
>                type: <none/>
>              result:
>           errorInfo: [XENAPI_PLUGIN_FAILURE, backupSnapshot,
>CommandException, 32]
>         otherConfig: {}
>           subtaskOf: com.xensource.xenapi.Task@aaf13f6f
>            subtasks: []
>
>2016-05-29 01:07:10,023 WARN  [xen.resource.CitrixResourceBase]
>(DirectAgent-250:null) callHostPlugin failed for cmd: backupSnapshot with
>args secondaryStorageMountPath: 205.144.169.99:/export1/secondary,
>localMountPoint: 
>/var/run/cloud_mount/60ef4a9f-de15-3c55-a95e-7c471608332c, backupUuid:
>6278b10c-3288-4e20-84b5-ada34b710e23, path: snapshots/3/1142,
>prevBackupUuid: snapshots/3/1142/a3585a4c-c2a1-4fe6-8fff-1ec799ecb7d6,
>snapshotUuid: 66e1b2cf-68bb-4245-ae0d-8a1fc6df18e3, isISCSI: true,
>primaryStorageSRUuid: 48be6dd0-cb35-132e-2661-99842fadbaba,  due to Task
>failed! Task record:                 uuid:
>8f8e8e52-de8d-7310-22c5-030719540292
>           nameLabel: Async.host.call_plugin
>     nameDescription:
>   allowedOperations: []
>   currentOperations: {}
>             created: Sun May 29 01:04:54 PDT 2016
>            finished: Sun May 29 01:07:09 PDT 2016
>              status: failure
>          residentOn: com.xensource.xenapi.Host@2115a7db
>            progress: 1.0
>                type: <none/>
>              result:
>           errorInfo: [XENAPI_PLUGIN_FAILURE, backupSnapshot,
>CommandException, 32]
>         otherConfig: {}
>           subtaskOf: com.xensource.xenapi.Task@aaf13f6f
>            subtasks: []
>
>Task failed! Task record:                 uuid:
>8f8e8e52-de8d-7310-22c5-030719540292
>           nameLabel: Async.host.call_plugin
>     nameDescription:
>   allowedOperations: []
>    currentOperations: {}
>             created: Sun May 29 01:04:54 PDT 2016
>            finished: Sun May 29 01:07:09 PDT 2016
>              status: failure
>          residentOn: com.xensource.xenapi.Host@2115a7db
>            progress: 1.0
>                type: <none/>
>              result:
>           errorInfo: [XENAPI_PLUGIN_FAILURE, backupSnapshot,
>CommandException, 32]
>         otherConfig: {}
>           subtaskOf: com.xensource.xenapi.Task@aaf13f6f
>            subtasks: []
>
>        at 
>com.cloud.hypervisor.xen.resource.CitrixResourceBase.checkForSuccess(Citri
>xResourceBase.java:3605)
>        at 
>com.cloud.hypervisor.xen.resource.CitrixResourceBase.callHostPluginAsync(C
>itrixResourceBase.java:3919)
>        at 
>com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.backupSnapshot
>(XenServerStorageProcessor.java:1117)
>        at 
>com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.backupSnapshot
>(XenServerStorageProcessor.java:1307)
>        at 
>com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(Stor
>ageSubsystemCommandHandlerBase.java:84)
>        at 
>com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorag
>eCommands(StorageSubsystemCommandHandlerBase.java:49)
>        at 
>com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(Citrix
>ResourceBase.java:621)
>        at 
>com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenSe
>rver56Resource.java:73)
>        at 
>com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenS
>erver610Resource.java:104)
>        at 
>com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.jav
>a:186)
>        at 
>java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>        at 
>java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>        at 
>java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.acces
>s$101(ScheduledThreadPoolExecutor.java:165)
>        at 
>java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(S
>cheduledThreadPoolExecutor.java:266)
>        at 
>java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
>1146)
>        at 
>java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java
>:615)
>        at java.lang.Thread.run(Thread.java:679)
>2016-05-29 01:07:11,040 WARN  [xen.resource.XenServerStorageProcessor]
>(DirectAgent-250:null) Could not copy backupUuid: null from primary
>storage 48be6dd0-cb35-132e-2661-99842fadbaba to secondary storage
>205.144.169.99:/export1/secondary due to null
>2016-05-29 01:07:11,040 WARN  [xen.resource.XenServerStorageProcessor]
>(DirectAgent-250:null) BackupSnapshot Failed due to Could not copy
>backupUuid: null from primary storage
>48be6dd0-cb35-132e-2661-99842fadbaba to secondary storage
>205.144.169.99:/export1/secondary due to null
>com.cloud.utils.exception.CloudRuntimeException: Could not copy
>backupUuid: null from primary storage
>48be6dd0-cb35-132e-2661-99842fadbaba to secondary storage
>205.144.169.99:/export1/secondary due to null
>        at 
>com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.backupSnapshot
>(XenServerStorageProcessor.java:1146)
>        at 
>com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.backupSnapshot
>(XenServerStorageProcessor.java:1307)
>        at 
>com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(Stor
>ageSubsystemCommandHandlerBase.java:84)
>        at 
>com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorag
>eCommands(StorageSubsystemCommandHandlerBase.java:49)
>        at 
>com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(Citrix
>ResourceBase.java:621)
>        at 
>com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenSe
>rver56Resource.java:73)
> at 
>com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenSe
>rver56Resource.java:73)
>        at 
>com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenS
>erver610Resource.java:104)
>        at 
>com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.jav
>a:186)
>        at 
>java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>        at 
>java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>        at 
>java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.acces
>s$101(ScheduledThreadPoolExecutor.java:165)
>        at 
>java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(S
>cheduledThreadPoolExecutor.java:266)
>        at 
>java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
>1146)
>        at 
>java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java
>:615)
>        at java.lang.Thread.run(Thread.java:679)
>2016-05-29 01:07:11,041 DEBUG [agent.manager.DirectAgentAttache]
>(DirectAgent-250:null) Seq 39-2062304528: Response Received:
>2016-05-29 01:07:11,041 DEBUG [agent.transport.Request]
>(DirectAgent-250:null) Seq 39-2062304528: Processing:  { Ans: , MgmtId:
>120860783173, via: 39, Ver: v1, Flags: 110,
>[{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"d
>etails":"BackupSnapshot Failed due to Could not copy backupUuid: null
>from primary storage 48be6dd0-cb35-132e-2661-99842fadbaba to secondary
>storage 205.144.169.99:/export1/secondary due to null","wait":0}}] }
>2016-05-29 01:07:11,042 DEBUG [agent.manager.AgentAttache]
>(DirectAgent-250:null) Seq 39-2062304541: Sending now.  is current
>sequence.
>2016-05-29 01:07:11,042 DEBUG [agent.transport.Request]
>(Job-Executor-10:job-31466 = [ f3aca400-b871-41b9-927d-18b1bd8b0635 ])
>Seq 39-2062304528: Received:  { Ans: , MgmtId: 120860783173, via: 39,
>Ver: v1, Flags: 110, { CopyCmdAnswer } }
>2016-05-29 01:07:11,042 DEBUG [agent.transport.Request]
>(DirectAgent-250:null) Seq 39-2062304541: Executing:  { Cmd , MgmtId:
>120860783173, via: 39, Ver: v1, Flags: 100111,
>[{"com.cloud.agent.api.CheckS2SVpnConnectionsCommand":{"vpnIps":[],"access
>Details":{"router.ip":"169.254.1.111","router.name":"r-781-VM"},"wait":30}
>}] }
>2016-05-29 01:07:11,042 DEBUG [agent.manager.DirectAgentAttache]
>(DirectAgent-250:null) Seq 39-2062304541: Executing request
>2016-05-29 01:07:11,056 DEBUG [storage.snapshot.SnapshotManagerImpl]
>(Job-Executor-10:job-31466 = [ f3aca400-b871-41b9-927d-18b1bd8b0635 ])
>Failed to create snapshot
>com.cloud.utils.exception.CloudRuntimeException: BackupSnapshot Failed
>due to Could not copy backupUuid: null from primary storage
>48be6dd0-cb35-132e-2661-99842fadbaba to secondary storage
>205.144.169.99:/export1/secondary due to null
>        at 
>org.apache.cloudstack.storage.snapshot.SnapshotServiceImpl.backupSnapshot(
>SnapshotServiceImpl.java:280)
>        at 
>org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.backupSna
>pshot(XenserverSnapshotStrategy.java:138)
>        at 
>org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.takeSnaps
>hot(XenserverSnapshotStrategy.java:264)
>        at 
>com.cloud.storage.snapshot.SnapshotManagerImpl.takeSnapshot(SnapshotManage
>rImpl.java:1013)
>        at 
>com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorD
>ispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
>        at 
>org.apache.cloudstack.storage.volume.VolumeServiceImpl.takeSnapshot(Volume
>ServiceImpl.java:1307)
>        at 
>com.cloud.storage.VolumeManagerImpl.takeSnapshot(VolumeManagerImpl.java:27
>19)
>        at 
>org.apache.cloudstack.api.command.user.snapshot.CreateSnapshotCmd.execute(
>CreateSnapshotCmd.java:170)
>        at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
>        at 
>com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
>        at 
>java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>        at 
>java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>        at 
>java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
>1146)
>        at 
>java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java
>:615)
>        at java.lang.Thread.run(Thread.java:679)
>2016-05-29 01:07:11,063 DEBUG [storage.volume.VolumeServiceImpl]
>(Job-Executor-10:job-31466 = [ f3aca400-b871-41b9-927d-18b1bd8b0635 ])
>Take snapshot: 1142 failed
>com.cloud.utils.exception.CloudRuntimeException: Failed to create snapshot
>        at 
>com.cloud.storage.snapshot.SnapshotManagerImpl.takeSnapshot(SnapshotManage
>rImpl.java:1040)
> at 
>com.cloud.storage.VolumeManagerImpl.takeSnapshot(VolumeManagerImpl.java:27
>19)
>        at 
>org.apache.cloudstack.api.command.user.snapshot.CreateSnapshotCmd.execute(
>CreateSnapshotCmd.java:170)
>        at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
>        at 
>com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
>        at 
>java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>        at 
>java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>        at 
>java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:
>1146)
>        at 
>java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java
>:615)
>        at java.lang.Thread.run(Thread.java:679)
>Caused by: com.cloud.utils.exception.CloudRuntimeException:
>BackupSnapshot Failed due to Could not copy backupUuid: null from primary
>storage 48be6dd0-cb35-132e-2661-99842fadbaba to secondary storage
>205.144.169.99:/export1/secondary due to null
>        at 
>org.apache.cloudstack.storage.snapshot.SnapshotServiceImpl.backupSnapshot(
>SnapshotServiceImpl.java:280)
>        at 
>org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.backupSna
>pshot(XenserverSnapshotStrategy.java:138)
>        at 
>org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.takeSnaps
>hot(XenserverSnapshotStrategy.java:264)
>        at 
>com.cloud.storage.snapshot.SnapshotManagerImpl.takeSnapshot(SnapshotManage
>rImpl.java:1013)
>        ... 16 more
>2016-05-29 01:07:11,070 DEBUG [cloud.async.AsyncJobManagerImpl]
>(Job-Executor-10:job-31466 = [ f3aca400-b871-41b9-927d-18b1bd8b0635 ])
>Complete async job-31466 = [ f3aca400-b871-41b9-927d-18b1bd8b0635 ],
>jobStatus: 2, resultCode: 530, result: Error Code: 530 Error text: Failed
>to create snapshot due to an internal error creating snapshot for volume
>1142
>
>-----Original Message-----
>From: Prashant Mishra [mailto:prashant.mishra@accelerite.com]
>Sent: Friday, May 27, 2016 10:06 AM
>To: users@cloudstack.apache.org
>Subject: Re: DAILY SNAPSHOT ISSUE FOR VOLUME SNAPSHOT
>
>As Glenn said   please provide MS log for further investigation , CREATED
>ON PRIMARY is the state of snapshot  ?
>On 5/27/16, 9:57 AM, "Venkat Boggarapu" <ve...@axiomio.com> wrote:
>
>>Hi Glenn,
>>
>>I tried to remove the error and taken manual snapshot for the volume,
>>manual snapshot is done, after that for two days daily snapshots is
>>working good for that volume.
>>
>>After two days the error comes again  as "CREATED ON PRIMARY". This is
>>happening from last three to four weeks.
>>
>>Thanks,
>>Venkat Boggarapu
>>
>>-----Original Message-----
>>From: Glenn Wagner [mailto:glenn.wagner@shapeblue.com]
>>Sent: Thursday, May 26, 2016 1:04 PM
>>To: users@cloudstack.apache.org
>>Subject: RE: DAILY SNAPSHOT ISSUE FOR VOLUME SNAPSHOT
>>
>>Hi,
>>
>>Can you upload (pastebin) your management server logs for us to see the
>>error,
>>
>>Regards
>>Glenn
>>
>>glenn.wagner@shapeblue.com
>>www.shapeblue.com
>>2nd Floor, Oudehuis Centre, 122 Main Rd, Somerset West, Cape Town
>>7130South Africa @shapeblue
>>
>>
>>
>>-----Original Message-----
>>From: Venkat Boggarapu [mailto:venkat.b@axiomio.com]
>>Sent: Thursday, 26 May 2016 9:29 AM
>>To: users@cloudstack.apache.org
>>Subject: DAILY SNAPSHOT ISSUE FOR VOLUME SNAPSHOT
>>
>>Hi Guys,
>>
>>My environment is Cloudstack-4.2.0 and Xenserver is 6.2.0
>>
>>I kept daily scheduled volume snapshots for all the vms in my
>>environment.
>>
>>But from last three weeks I am getting error "CREATED ON PRIMARY" for
>>one volume snapshot on ROOT volume.
>>
>>Please help me regarding if any one faced the same issue.
>>
>>Thanks,
>>Venkat Boggarapu
>
>
>
>
>DISCLAIMER
>==========
>This e-mail may contain privileged and confidential information which is
>the property of Accelerite, a Persistent Systems business. It is intended
>only for the use of the individual or entity to which it is addressed. If
>you are not the intended recipient, you are not authorized to read,
>retain, copy, print, distribute or use this message. If you have received
>this communication in error, please notify the sender and delete all
>copies of this message. Accelerite, a Persistent Systems business does
>not accept any liability for virus infected mails.




DISCLAIMER
==========
This e-mail may contain privileged and confidential information which is the property of Accelerite, a Persistent Systems business. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Accelerite, a Persistent Systems business does not accept any liability for virus infected mails.

RE: DAILY SNAPSHOT ISSUE FOR VOLUME SNAPSHOT

Posted by Venkat Boggarapu <ve...@axiomio.com>.
Hi Glenn/Prashant,

I am forwarding the exact log for the voloume snapshot
Please check and let us know the error

2016-05-29 01:07:10,021 WARN  [xen.resource.CitrixResourceBase] (DirectAgent-250:null) Task failed! Task record:                 uuid: 8f8e8e52-de8d-7310-22c5-030719540292
           nameLabel: Async.host.call_plugin
     nameDescription:
   allowedOperations: []
   currentOperations: {}
             created: Sun May 29 01:04:54 PDT 2016
            finished: Sun May 29 01:07:09 PDT 2016
              status: failure
          residentOn: com.xensource.xenapi.Host@2115a7db
            progress: 1.0
                type: <none/>
              result:
           errorInfo: [XENAPI_PLUGIN_FAILURE, backupSnapshot, CommandException, 32]
         otherConfig: {}
           subtaskOf: com.xensource.xenapi.Task@aaf13f6f
            subtasks: []

2016-05-29 01:07:10,023 WARN  [xen.resource.CitrixResourceBase] (DirectAgent-250:null) callHostPlugin failed for cmd: backupSnapshot with args secondaryStorageMountPath: 205.144.169.99:/export1/secondary, localMountPoint: /var/run/cloud_mount/60ef4a9f-de15-3c55-a95e-7c471608332c, backupUuid: 6278b10c-3288-4e20-84b5-ada34b710e23, path: snapshots/3/1142, prevBackupUuid: snapshots/3/1142/a3585a4c-c2a1-4fe6-8fff-1ec799ecb7d6, snapshotUuid: 66e1b2cf-68bb-4245-ae0d-8a1fc6df18e3, isISCSI: true, primaryStorageSRUuid: 48be6dd0-cb35-132e-2661-99842fadbaba,  due to Task failed! Task record:                 uuid: 8f8e8e52-de8d-7310-22c5-030719540292
           nameLabel: Async.host.call_plugin
     nameDescription:
   allowedOperations: []
   currentOperations: {}
             created: Sun May 29 01:04:54 PDT 2016
            finished: Sun May 29 01:07:09 PDT 2016
              status: failure
          residentOn: com.xensource.xenapi.Host@2115a7db
            progress: 1.0
                type: <none/>
              result:
           errorInfo: [XENAPI_PLUGIN_FAILURE, backupSnapshot, CommandException, 32]
         otherConfig: {}
           subtaskOf: com.xensource.xenapi.Task@aaf13f6f
            subtasks: []

Task failed! Task record:                 uuid: 8f8e8e52-de8d-7310-22c5-030719540292
           nameLabel: Async.host.call_plugin
     nameDescription:
   allowedOperations: []
    currentOperations: {}
             created: Sun May 29 01:04:54 PDT 2016
            finished: Sun May 29 01:07:09 PDT 2016
              status: failure
          residentOn: com.xensource.xenapi.Host@2115a7db
            progress: 1.0
                type: <none/>
              result:
           errorInfo: [XENAPI_PLUGIN_FAILURE, backupSnapshot, CommandException, 32]
         otherConfig: {}
           subtaskOf: com.xensource.xenapi.Task@aaf13f6f
            subtasks: []

        at com.cloud.hypervisor.xen.resource.CitrixResourceBase.checkForSuccess(CitrixResourceBase.java:3605)
        at com.cloud.hypervisor.xen.resource.CitrixResourceBase.callHostPluginAsync(CitrixResourceBase.java:3919)
        at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.backupSnapshot(XenServerStorageProcessor.java:1117)
        at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.backupSnapshot(XenServerStorageProcessor.java:1307)
        at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:84)
        at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:49)
        at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:621)
        at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:73)
        at com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:104)
        at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:679)
2016-05-29 01:07:11,040 WARN  [xen.resource.XenServerStorageProcessor] (DirectAgent-250:null) Could not copy backupUuid: null from primary storage 48be6dd0-cb35-132e-2661-99842fadbaba to secondary storage 205.144.169.99:/export1/secondary due to null
2016-05-29 01:07:11,040 WARN  [xen.resource.XenServerStorageProcessor] (DirectAgent-250:null) BackupSnapshot Failed due to Could not copy backupUuid: null from primary storage 48be6dd0-cb35-132e-2661-99842fadbaba to secondary storage 205.144.169.99:/export1/secondary due to null
com.cloud.utils.exception.CloudRuntimeException: Could not copy backupUuid: null from primary storage 48be6dd0-cb35-132e-2661-99842fadbaba to secondary storage 205.144.169.99:/export1/secondary due to null
        at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.backupSnapshot(XenServerStorageProcessor.java:1146)
        at com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.backupSnapshot(XenServerStorageProcessor.java:1307)
        at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:84)
        at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:49)
        at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:621)
        at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:73)
 at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:73)
        at com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:104)
        at com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:679)
2016-05-29 01:07:11,041 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-250:null) Seq 39-2062304528: Response Received:
2016-05-29 01:07:11,041 DEBUG [agent.transport.Request] (DirectAgent-250:null) Seq 39-2062304528: Processing:  { Ans: , MgmtId: 120860783173, via: 39, Ver: v1, Flags: 110, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"BackupSnapshot Failed due to Could not copy backupUuid: null from primary storage 48be6dd0-cb35-132e-2661-99842fadbaba to secondary storage 205.144.169.99:/export1/secondary due to null","wait":0}}] }
2016-05-29 01:07:11,042 DEBUG [agent.manager.AgentAttache] (DirectAgent-250:null) Seq 39-2062304541: Sending now.  is current sequence.
2016-05-29 01:07:11,042 DEBUG [agent.transport.Request] (Job-Executor-10:job-31466 = [ f3aca400-b871-41b9-927d-18b1bd8b0635 ]) Seq 39-2062304528: Received:  { Ans: , MgmtId: 120860783173, via: 39, Ver: v1, Flags: 110, { CopyCmdAnswer } }
2016-05-29 01:07:11,042 DEBUG [agent.transport.Request] (DirectAgent-250:null) Seq 39-2062304541: Executing:  { Cmd , MgmtId: 120860783173, via: 39, Ver: v1, Flags: 100111, [{"com.cloud.agent.api.CheckS2SVpnConnectionsCommand":{"vpnIps":[],"accessDetails":{"router.ip":"169.254.1.111","router.name":"r-781-VM"},"wait":30}}] }
2016-05-29 01:07:11,042 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-250:null) Seq 39-2062304541: Executing request
2016-05-29 01:07:11,056 DEBUG [storage.snapshot.SnapshotManagerImpl] (Job-Executor-10:job-31466 = [ f3aca400-b871-41b9-927d-18b1bd8b0635 ]) Failed to create snapshot
com.cloud.utils.exception.CloudRuntimeException: BackupSnapshot Failed due to Could not copy backupUuid: null from primary storage 48be6dd0-cb35-132e-2661-99842fadbaba to secondary storage 205.144.169.99:/export1/secondary due to null
        at org.apache.cloudstack.storage.snapshot.SnapshotServiceImpl.backupSnapshot(SnapshotServiceImpl.java:280)
        at org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.backupSnapshot(XenserverSnapshotStrategy.java:138)
        at org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.takeSnapshot(XenserverSnapshotStrategy.java:264)
        at com.cloud.storage.snapshot.SnapshotManagerImpl.takeSnapshot(SnapshotManagerImpl.java:1013)
        at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
        at org.apache.cloudstack.storage.volume.VolumeServiceImpl.takeSnapshot(VolumeServiceImpl.java:1307)
        at com.cloud.storage.VolumeManagerImpl.takeSnapshot(VolumeManagerImpl.java:2719)
        at org.apache.cloudstack.api.command.user.snapshot.CreateSnapshotCmd.execute(CreateSnapshotCmd.java:170)
        at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
        at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:679)
2016-05-29 01:07:11,063 DEBUG [storage.volume.VolumeServiceImpl] (Job-Executor-10:job-31466 = [ f3aca400-b871-41b9-927d-18b1bd8b0635 ]) Take snapshot: 1142 failed
com.cloud.utils.exception.CloudRuntimeException: Failed to create snapshot
        at com.cloud.storage.snapshot.SnapshotManagerImpl.takeSnapshot(SnapshotManagerImpl.java:1040)
 at com.cloud.storage.VolumeManagerImpl.takeSnapshot(VolumeManagerImpl.java:2719)
        at org.apache.cloudstack.api.command.user.snapshot.CreateSnapshotCmd.execute(CreateSnapshotCmd.java:170)
        at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
        at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:679)
Caused by: com.cloud.utils.exception.CloudRuntimeException: BackupSnapshot Failed due to Could not copy backupUuid: null from primary storage 48be6dd0-cb35-132e-2661-99842fadbaba to secondary storage 205.144.169.99:/export1/secondary due to null
        at org.apache.cloudstack.storage.snapshot.SnapshotServiceImpl.backupSnapshot(SnapshotServiceImpl.java:280)
        at org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.backupSnapshot(XenserverSnapshotStrategy.java:138)
        at org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.takeSnapshot(XenserverSnapshotStrategy.java:264)
        at com.cloud.storage.snapshot.SnapshotManagerImpl.takeSnapshot(SnapshotManagerImpl.java:1013)
        ... 16 more
2016-05-29 01:07:11,070 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-10:job-31466 = [ f3aca400-b871-41b9-927d-18b1bd8b0635 ]) Complete async job-31466 = [ f3aca400-b871-41b9-927d-18b1bd8b0635 ], jobStatus: 2, resultCode: 530, result: Error Code: 530 Error text: Failed to create snapshot due to an internal error creating snapshot for volume 1142

-----Original Message-----
From: Prashant Mishra [mailto:prashant.mishra@accelerite.com] 
Sent: Friday, May 27, 2016 10:06 AM
To: users@cloudstack.apache.org
Subject: Re: DAILY SNAPSHOT ISSUE FOR VOLUME SNAPSHOT

As Glenn said   please provide MS log for further investigation , CREATED
ON PRIMARY is the state of snapshot  ?
On 5/27/16, 9:57 AM, "Venkat Boggarapu" <ve...@axiomio.com> wrote:

>Hi Glenn,
>
>I tried to remove the error and taken manual snapshot for the volume, 
>manual snapshot is done, after that for two days daily snapshots is 
>working good for that volume.
>
>After two days the error comes again  as "CREATED ON PRIMARY". This is 
>happening from last three to four weeks.
>
>Thanks,
>Venkat Boggarapu
>
>-----Original Message-----
>From: Glenn Wagner [mailto:glenn.wagner@shapeblue.com]
>Sent: Thursday, May 26, 2016 1:04 PM
>To: users@cloudstack.apache.org
>Subject: RE: DAILY SNAPSHOT ISSUE FOR VOLUME SNAPSHOT
>
>Hi,
>
>Can you upload (pastebin) your management server logs for us to see the 
>error,
>
>Regards
>Glenn
>
>glenn.wagner@shapeblue.com
>www.shapeblue.com
>2nd Floor, Oudehuis Centre, 122 Main Rd, Somerset West, Cape Town 
>7130South Africa @shapeblue
>
>
>
>-----Original Message-----
>From: Venkat Boggarapu [mailto:venkat.b@axiomio.com]
>Sent: Thursday, 26 May 2016 9:29 AM
>To: users@cloudstack.apache.org
>Subject: DAILY SNAPSHOT ISSUE FOR VOLUME SNAPSHOT
>
>Hi Guys,
>
>My environment is Cloudstack-4.2.0 and Xenserver is 6.2.0
>
>I kept daily scheduled volume snapshots for all the vms in my environment.
>
>But from last three weeks I am getting error "CREATED ON PRIMARY" for 
>one volume snapshot on ROOT volume.
>
>Please help me regarding if any one faced the same issue.
>
>Thanks,
>Venkat Boggarapu




DISCLAIMER
==========
This e-mail may contain privileged and confidential information which is the property of Accelerite, a Persistent Systems business. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Accelerite, a Persistent Systems business does not accept any liability for virus infected mails.

Re: DAILY SNAPSHOT ISSUE FOR VOLUME SNAPSHOT

Posted by Prashant Mishra <pr...@accelerite.com>.
As Glenn said   please provide MS log for further investigation , CREATED
ON PRIMARY is the state of snapshot  ?
On 5/27/16, 9:57 AM, "Venkat Boggarapu" <ve...@axiomio.com> wrote:

>Hi Glenn,
>
>I tried to remove the error and taken manual snapshot for the volume,
>manual snapshot is done, after that for two days daily snapshots is
>working good for that volume.
>
>After two days the error comes again  as "CREATED ON PRIMARY". This is
>happening from last three to four weeks.
>
>Thanks,
>Venkat Boggarapu
>
>-----Original Message-----
>From: Glenn Wagner [mailto:glenn.wagner@shapeblue.com]
>Sent: Thursday, May 26, 2016 1:04 PM
>To: users@cloudstack.apache.org
>Subject: RE: DAILY SNAPSHOT ISSUE FOR VOLUME SNAPSHOT
>
>Hi,
>
>Can you upload (pastebin) your management server logs for us to see the
>error, 
>
>Regards
>Glenn 
>
>glenn.wagner@shapeblue.com
>www.shapeblue.com
>2nd Floor, Oudehuis Centre, 122 Main Rd, Somerset West, Cape Town
>7130South Africa @shapeblue
>
>
>
>-----Original Message-----
>From: Venkat Boggarapu [mailto:venkat.b@axiomio.com]
>Sent: Thursday, 26 May 2016 9:29 AM
>To: users@cloudstack.apache.org
>Subject: DAILY SNAPSHOT ISSUE FOR VOLUME SNAPSHOT
>
>Hi Guys,
>
>My environment is Cloudstack-4.2.0 and Xenserver is 6.2.0
>
>I kept daily scheduled volume snapshots for all the vms in my environment.
>
>But from last three weeks I am getting error "CREATED ON PRIMARY" for one
>volume snapshot on ROOT volume.
>
>Please help me regarding if any one faced the same issue.
>
>Thanks,
>Venkat Boggarapu




DISCLAIMER
==========
This e-mail may contain privileged and confidential information which is the property of Accelerite, a Persistent Systems business. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Accelerite, a Persistent Systems business does not accept any liability for virus infected mails.

RE: DAILY SNAPSHOT ISSUE FOR VOLUME SNAPSHOT

Posted by Venkat Boggarapu <ve...@axiomio.com>.
Hi Glenn,

I tried to remove the error and taken manual snapshot for the volume, manual snapshot is done, after that for two days daily snapshots is working good for that volume.

After two days the error comes again  as "CREATED ON PRIMARY". This is happening from last three to four weeks.

Thanks,
Venkat Boggarapu

-----Original Message-----
From: Glenn Wagner [mailto:glenn.wagner@shapeblue.com] 
Sent: Thursday, May 26, 2016 1:04 PM
To: users@cloudstack.apache.org
Subject: RE: DAILY SNAPSHOT ISSUE FOR VOLUME SNAPSHOT

Hi,

Can you upload (pastebin) your management server logs for us to see the error, 

Regards
Glenn 

glenn.wagner@shapeblue.com
www.shapeblue.com
2nd Floor, Oudehuis Centre, 122 Main Rd, Somerset West, Cape Town  7130South Africa @shapeblue



-----Original Message-----
From: Venkat Boggarapu [mailto:venkat.b@axiomio.com] 
Sent: Thursday, 26 May 2016 9:29 AM
To: users@cloudstack.apache.org
Subject: DAILY SNAPSHOT ISSUE FOR VOLUME SNAPSHOT

Hi Guys,

My environment is Cloudstack-4.2.0 and Xenserver is 6.2.0

I kept daily scheduled volume snapshots for all the vms in my environment.

But from last three weeks I am getting error "CREATED ON PRIMARY" for one volume snapshot on ROOT volume.

Please help me regarding if any one faced the same issue.

Thanks,
Venkat Boggarapu

RE: DAILY SNAPSHOT ISSUE FOR VOLUME SNAPSHOT

Posted by Glenn Wagner <gl...@shapeblue.com>.
Hi,

Can you upload (pastebin) your management server logs for us to see the error, 

Regards
Glenn 

glenn.wagner@shapeblue.com 
www.shapeblue.com
2nd Floor, Oudehuis Centre, 122 Main Rd, Somerset West, Cape Town  7130South Africa
@shapeblue



-----Original Message-----
From: Venkat Boggarapu [mailto:venkat.b@axiomio.com] 
Sent: Thursday, 26 May 2016 9:29 AM
To: users@cloudstack.apache.org
Subject: DAILY SNAPSHOT ISSUE FOR VOLUME SNAPSHOT

Hi Guys,

My environment is Cloudstack-4.2.0 and Xenserver is 6.2.0

I kept daily scheduled volume snapshots for all the vms in my environment.

But from last three weeks I am getting error "CREATED ON PRIMARY" for one volume snapshot on ROOT volume.

Please help me regarding if any one faced the same issue.

Thanks,
Venkat Boggarapu