You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by raja sekhar <ra...@gmail.com> on 2015/09/14 11:45:59 UTC

Recurring snapshot taking full every time

Hi All,

I am using CS 4.3.1 and xenserver 6.2
I have configured daily recurring snapshot policy for all the root volumes.
but recent three days onwards it is taking full snapshots and not taking
any child snapshots.
I have configured snapshot.delta.max to 16.
please help me my secondary storage is becoming full.

The log file details shows:

2015-09-14 01:03:29,973 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-24:ctx-d68622c5) Seq 4-482873005: Response Received:
2015-09-14 01:03:29,973 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
(DirectAgent-24:ctx-d68622c5) Seq 4-482873005: MgmtId 195780927071877:
Resp: Routing to peer
2015-09-14 01:03:32,233 DEBUG [c.c.c.ConsoleProxyManagerImpl]
(consoleproxy-1:ctx-b1db30de) Zone 1 is ready to launch console proxy
2015-09-14 01:03:32,334 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
(secstorage-1:ctx-e024d41b) Zone 1 is ready to launch secondary storage VM
2015-09-14 01:03:33,934 WARN  [c.c.u.n.Link] (AgentManager-Selector:null)
SSL: Fail to find the generated keystore. Loading fail-safe one to continue.
2015-09-14 01:03:34,044 DEBUG [c.c.a.t.Request]
(AgentManager-Handler-10:null) Seq 1-457572529: Executing:  { Cmd , MgmtId:
108371418365724, via: 1, Ver: v1, Flags: 100011,
[{"org.apache.cloudstack.storage.command.CreateObjectCommand":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"volume":{"uuid":"bcf7653a-33db-461a-9355-e5d518012679","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f9486b
"}},"name":"ROOT-189","size":85899345920,"path":"9deefbf6-86e6-4359-acb3-99e1aebcb359","volumeId":696,"vmName":"i-11-189-VM","accountId":11,"format":"VHD","id":696,"deviceId":0,"hypervisorType":"XenServer"},"parentSnapshotPath":"3a6e9e1a-fd95-4530-ae67-03a368b3e2fd","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f9486b"}},"vmName":"i-11-189-VM","name":"SAGXD02_ROOT-189_20150914090333","hypervisorType":"XenServer","id":6732,"quiescevm":false,"parents":["3a6e9e1a-fd95-4530-ae67-03a368b3e2fd"],"physicalSize":0}},"wait":0}}]
}
2015-09-14 01:03:34,045 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: Executing request
2015-09-14 01:03:35,421 WARN  [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-333:ctx-c3e7c331) callHostPlugin failed for cmd: getVhdParent
with args snapshotUuid: 3a6e9e1a-fd95-4530-ae67-03a368b3e2fd, isISCSI:
false, primaryStorageSRUuid: a6a7f65a-a1d2-83e3-d3b0-f38792863fb6,  due to
There was a failure communicating with the plugin.
2015-09-14 01:03:35,421 DEBUG [c.c.h.x.r.XenServerStorageProcessor]
(DirectAgent-333:ctx-c3e7c331) Failed to get parent snapshot
com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed for
cmd: getVhdParent with args snapshotUuid:
3a6e9e1a-fd95-4530-ae67-03a368b3e2fd, isISCSI: false, primaryStorageSRUuid:
a6a7f65a-a1d2-83e3-d3b0-f38792863fb6,  due to There was a failure
communicating with the plugin.
        at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.callHostPlugin(CitrixResourceBase.java:4239)
        at
com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.getVhdParent(XenServerStorageProcessor.java:879)
        at
com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.createSnapshot(XenServerStorageProcessor.java:478)
        at
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:107)
        at
com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:52)
        at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
 at
com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
        at
com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
        at
com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
        at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
        at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
        at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
        at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
        at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
        at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:701)
2015-09-14 01:03:35,421 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: Response Received:
2015-09-14 01:03:35,423 INFO  [c.c.a.m.ClusteredAgentManagerImpl]
(DirectAgent-333:ctx-c3e7c331) Unable to find peer: 108371418365724
2015-09-14 01:03:35,424 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
(DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: MgmtId 108371418365724:
Resp: Unable to route to peer: Seq 1-457572529:  { Ans: , MgmtId:
108371418365724, via: 1, Ver: v1, Flags: 10,
[{"org.apache.cloudstack.storage.command.CreateObjectAnswer":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"c377e041-7ea9-40a2-9721-208b9a33b0c2","id":0,"quiescevm":false,"physicalSize":0}},"result":true,"wait":0}}]
}
2015-09-14 01:03:38,934 WARN  [c.c.u.n.Link] (AgentManager-Selector:null)
SSL: Fail to find the generated keystore. Loading fail-safe one to continue.
2015-09-14 01:03:39,458 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-1:null) SeqA 2-3043178: Processing Seq 2-3043178:  {
Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":43,"_loadInfo":"{\n
 \"connections\": []\n}","wait":0}}] }


Regards,
rajasekhar.

Re: Recurring snapshot taking full every time

Posted by Abhinandan Prateek <ab...@shapeblue.com>.
Looking at the code the plugin that is failing is “vmopsSnapshot”. That will mean the snapshot operation is falling possibly due to lack of space.
You have mentioned that you are running out of space. Did you try freeing up some space ?


> On 18-Sep-2015, at 12:14 pm, raja sekhar <ra...@gmail.com> wrote:
>
> Hi Abhinandan,
>
> I have force reconnect the hosts but no use and i didn't find any error in
> SMlog. please suggest me the error is still
> generating.
>
> Regards,
> Rajasekhar.
>
> On Wed, Sep 16, 2015 at 8:58 AM, Abhinandan Prateek <
> abhinandan.prateek@shapeblue.com> wrote:
>
>> Can you check in the SMlog on the concerned host if you see any error when
>> the plugin is being invoked ?
>>
>>> On 14-Sep-2015, at 5:01 pm, raja sekhar <ra...@gmail.com> wrote:
>>>
>>> Hi abhinandan,
>>>
>>> Thanks for your reply.
>>> We are facing the issue only for root volumes in that host. The snapshot
>>> recurring policy for data disks in same host is working fine.
>>> if the host configuration is not properly instrumented the policy for
>> data
>>> disks also fails, but it is working fine.
>>> please suggest us.
>>>
>>> Note: The manual snapshots for root disk is working fine,and it is taking
>>> child when second manual is configured , problem only with root daily
>>> snapshots every day it is taking full instead of taking child snapshots
>>> throwing error "*Failed to get parent snapshot**, due to There was a
>>> failure communicating with the plugin*".
>>>
>>> Regards,
>>> rajasekhar.
>>>
>>> On Mon, Sep 14, 2015 at 4:00 PM, Abhinandan Prateek <
>>> abhinandan.prateek@shapeblue.com> wrote:
>>>
>>>> Looks like the host is not instrumented properly and management server
>> is
>>>> unable to invoke plugin on the host.
>>>> Can you force-reconnect the host that is throwing this error ? That
>> should
>>>> recopy the plugins on to the host.
>>>>
>>>>> On 14-Sep-2015, at 3:15 pm, raja sekhar <ra...@gmail.com>
>> wrote:
>>>>>
>>>>> Hi All,
>>>>>
>>>>> I am using CS 4.3.1 and xenserver 6.2
>>>>> I have configured daily recurring snapshot policy for all the root
>>>> volumes.
>>>>> but recent three days onwards it is taking full snapshots and not
>> taking
>>>>> any child snapshots.
>>>>> I have configured snapshot.delta.max to 16.
>>>>> please help me my secondary storage is becoming full.
>>>>>
>>>>> The log file details shows:
>>>>>
>>>>> 2015-09-14 01:03:29,973 DEBUG [c.c.a.m.DirectAgentAttache]
>>>>> (DirectAgent-24:ctx-d68622c5) Seq 4-482873005: Response Received:
>>>>> 2015-09-14 01:03:29,973 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
>>>>> (DirectAgent-24:ctx-d68622c5) Seq 4-482873005: MgmtId 195780927071877:
>>>>> Resp: Routing to peer
>>>>> 2015-09-14 01:03:32,233 DEBUG [c.c.c.ConsoleProxyManagerImpl]
>>>>> (consoleproxy-1:ctx-b1db30de) Zone 1 is ready to launch console proxy
>>>>> 2015-09-14 01:03:32,334 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
>>>>> (secstorage-1:ctx-e024d41b) Zone 1 is ready to launch secondary storage
>>>> VM
>>>>> 2015-09-14 01:03:33,934 WARN  [c.c.u.n.Link]
>> (AgentManager-Selector:null)
>>>>> SSL: Fail to find the generated keystore. Loading fail-safe one to
>>>> continue.
>>>>> 2015-09-14 01:03:34,044 DEBUG [c.c.a.t.Request]
>>>>> (AgentManager-Handler-10:null) Seq 1-457572529: Executing:  { Cmd ,
>>>> MgmtId:
>>>>> 108371418365724, via: 1, Ver: v1, Flags: 100011,
>>>>>
>>>>
>> [{"org.apache.cloudstack.storage.command.CreateObjectCommand":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"volume":{"uuid":"bcf7653a-33db-461a-9355-e5d518012679","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
>>>>>
>>>>
>> 172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f9486b
>>>>>
>>>>
>> "}},"name":"ROOT-189","size":85899345920,"path":"9deefbf6-86e6-4359-acb3-99e1aebcb359","volumeId":696,"vmName":"i-11-189-VM","accountId":11,"format":"VHD","id":696,"deviceId":0,"hypervisorType":"XenServer"},"parentSnapshotPath":"3a6e9e1a-fd95-4530-ae67-03a368b3e2fd","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
>>>>>
>>>>
>> 172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f9486b
>>>>
>> "}},"vmName":"i-11-189-VM","name":"SAGXD02_ROOT-189_20150914090333","hypervisorType":"XenServer","id":6732,"quiescevm":false,"parents":["3a6e9e1a-fd95-4530-ae67-03a368b3e2fd"],"physicalSize":0}},"wait":0}}]
>>>>> }
>>>>> 2015-09-14 01:03:34,045 DEBUG [c.c.a.m.DirectAgentAttache]
>>>>> (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: Executing request
>>>>> 2015-09-14 01:03:35,421 WARN  [c.c.h.x.r.CitrixResourceBase]
>>>>> (DirectAgent-333:ctx-c3e7c331) callHostPlugin failed for cmd:
>>>> getVhdParent
>>>>> with args snapshotUuid: 3a6e9e1a-fd95-4530-ae67-03a368b3e2fd, isISCSI:
>>>>> false, primaryStorageSRUuid: a6a7f65a-a1d2-83e3-d3b0-f38792863fb6,  due
>>>> to
>>>>> There was a failure communicating with the plugin.
>>>>> 2015-09-14 01:03:35,421 DEBUG [c.c.h.x.r.XenServerStorageProcessor]
>>>>> (DirectAgent-333:ctx-c3e7c331) Failed to get parent snapshot
>>>>> com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed
>>>> for
>>>>> cmd: getVhdParent with args snapshotUuid:
>>>>> 3a6e9e1a-fd95-4530-ae67-03a368b3e2fd, isISCSI: false,
>>>> primaryStorageSRUuid:
>>>>> a6a7f65a-a1d2-83e3-d3b0-f38792863fb6,  due to There was a failure
>>>>> communicating with the plugin.
>>>>>      at
>>>>>
>>>>
>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.callHostPlugin(CitrixResourceBase.java:4239)
>>>>>      at
>>>>>
>>>>
>> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.getVhdParent(XenServerStorageProcessor.java:879)
>>>>>      at
>>>>>
>>>>
>> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.createSnapshot(XenServerStorageProcessor.java:478)
>>>>>      at
>>>>>
>>>>
>> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:107)
>>>>>      at
>>>>>
>>>>
>> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:52)
>>>>>      at
>>>>>
>>>>
>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
>>>>> at
>>>>>
>>>>
>> com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
>>>>>      at
>>>>>
>>>>
>> com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
>>>>>      at
>>>>>
>>>>
>> com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
>>>>>      at
>>>>>
>>>>
>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>>>>>      at
>>>>>
>>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>>>>>      at
>>>>>
>>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>>>>>      at
>>>>>
>>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>>>>>      at
>>>>>
>>>>
>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>>>>>      at
>>>>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>>>>      at
>>>>> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>>>>>      at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>>>>>      at
>>>>>
>>>>
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
>>>>>      at
>>>>>
>>>>
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
>>>>>      at
>>>>>
>>>>
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
>>>>>      at
>>>>>
>>>>
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>>>>      at java.lang.Thread.run(Thread.java:701)
>>>>> 2015-09-14 01:03:35,421 DEBUG [c.c.a.m.DirectAgentAttache]
>>>>> (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: Response Received:
>>>>> 2015-09-14 01:03:35,423 INFO  [c.c.a.m.ClusteredAgentManagerImpl]
>>>>> (DirectAgent-333:ctx-c3e7c331) Unable to find peer: 108371418365724
>>>>> 2015-09-14 01:03:35,424 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
>>>>> (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: MgmtId 108371418365724:
>>>>> Resp: Unable to route to peer: Seq 1-457572529:  { Ans: , MgmtId:
>>>>> 108371418365724, via: 1, Ver: v1, Flags: 10,
>>>>>
>>>>
>> [{"org.apache.cloudstack.storage.command.CreateObjectAnswer":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"c377e041-7ea9-40a2-9721-208b9a33b0c2","id":0,"quiescevm":false,"physicalSize":0}},"result":true,"wait":0}}]
>>>>> }
>>>>> 2015-09-14 01:03:38,934 WARN  [c.c.u.n.Link]
>> (AgentManager-Selector:null)
>>>>> SSL: Fail to find the generated keystore. Loading fail-safe one to
>>>> continue.
>>>>> 2015-09-14 01:03:39,458 DEBUG [c.c.a.m.AgentManagerImpl]
>>>>> (AgentManager-Handler-1:null) SeqA 2-3043178: Processing Seq 2-3043178:
>>>> {
>>>>> Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11,
>>>>>
>>>>
>> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":43,"_loadInfo":"{\n
>>>>> \"connections\": []\n}","wait":0}}] }
>>>>>
>>>>>
>>>>> Regards,
>>>>> rajasekhar.
>>>>
>>>> Find out more about ShapeBlue and our range of CloudStack related
>> services
>>>>
>>>> IaaS Cloud Design & Build<
>>>> http://shapeblue.com/iaas-cloud-design-and-build//>
>>>> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/
>>>
>>>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>>>> CloudStack Software Engineering<
>>>> http://shapeblue.com/cloudstack-software-engineering/>
>>>> CloudStack Infrastructure Support<
>>>> http://shapeblue.com/cloudstack-infrastructure-support/>
>>>> CloudStack Bootcamp Training Courses<
>>>> http://shapeblue.com/cloudstack-training/>
>>>>
>>>> This email and any attachments to it may be confidential and are
>> intended
>>>> solely for the use of the individual to whom it is addressed. Any views
>> or
>>>> opinions expressed are solely those of the author and do not necessarily
>>>> represent those of Shape Blue Ltd or related companies. If you are not
>> the
>>>> intended recipient of this email, you must neither take any action based
>>>> upon its contents, nor copy or show it to anyone. Please contact the
>> sender
>>>> if you believe you have received this email in error. Shape Blue Ltd is
>> a
>>>> company incorporated in England & Wales. ShapeBlue Services India LLP
>> is a
>>>> company incorporated in India and is operated under license from Shape
>> Blue
>>>> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in
>> Brasil
>>>> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd
>> is
>>>> a company registered by The Republic of South Africa and is traded under
>>>> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>>>
>>
>> Find out more about ShapeBlue and our range of CloudStack related services
>>
>> IaaS Cloud Design & Build<
>> http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Software Engineering<
>> http://shapeblue.com/cloudstack-software-engineering/>
>> CloudStack Infrastructure Support<
>> http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training Courses<
>> http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are intended
>> solely for the use of the individual to whom it is addressed. Any views or
>> opinions expressed are solely those of the author and do not necessarily
>> represent those of Shape Blue Ltd or related companies. If you are not the
>> intended recipient of this email, you must neither take any action based
>> upon its contents, nor copy or show it to anyone. Please contact the sender
>> if you believe you have received this email in error. Shape Blue Ltd is a
>> company incorporated in England & Wales. ShapeBlue Services India LLP is a
>> company incorporated in India and is operated under license from Shape Blue
>> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
>> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is
>> a company registered by The Republic of South Africa and is traded under
>> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: Recurring snapshot taking full every time

Posted by Abhinandan Prateek <ab...@shapeblue.com>.
Looking at the code the plugin that is failing is “vmopsSnapshot”. That will mean the snapshot operation is falling possibly due to lack of space.
You have mentioned that you are running out of space. Did you try freeing up some space ?


> On 18-Sep-2015, at 12:14 pm, raja sekhar <ra...@gmail.com> wrote:
>
> Hi Abhinandan,
>
> I have force reconnect the hosts but no use and i didn't find any error in
> SMlog. please suggest me the error is still
> generating.
>
> Regards,
> Rajasekhar.
>
> On Wed, Sep 16, 2015 at 8:58 AM, Abhinandan Prateek <
> abhinandan.prateek@shapeblue.com> wrote:
>
>> Can you check in the SMlog on the concerned host if you see any error when
>> the plugin is being invoked ?
>>
>>> On 14-Sep-2015, at 5:01 pm, raja sekhar <ra...@gmail.com> wrote:
>>>
>>> Hi abhinandan,
>>>
>>> Thanks for your reply.
>>> We are facing the issue only for root volumes in that host. The snapshot
>>> recurring policy for data disks in same host is working fine.
>>> if the host configuration is not properly instrumented the policy for
>> data
>>> disks also fails, but it is working fine.
>>> please suggest us.
>>>
>>> Note: The manual snapshots for root disk is working fine,and it is taking
>>> child when second manual is configured , problem only with root daily
>>> snapshots every day it is taking full instead of taking child snapshots
>>> throwing error "*Failed to get parent snapshot**, due to There was a
>>> failure communicating with the plugin*".
>>>
>>> Regards,
>>> rajasekhar.
>>>
>>> On Mon, Sep 14, 2015 at 4:00 PM, Abhinandan Prateek <
>>> abhinandan.prateek@shapeblue.com> wrote:
>>>
>>>> Looks like the host is not instrumented properly and management server
>> is
>>>> unable to invoke plugin on the host.
>>>> Can you force-reconnect the host that is throwing this error ? That
>> should
>>>> recopy the plugins on to the host.
>>>>
>>>>> On 14-Sep-2015, at 3:15 pm, raja sekhar <ra...@gmail.com>
>> wrote:
>>>>>
>>>>> Hi All,
>>>>>
>>>>> I am using CS 4.3.1 and xenserver 6.2
>>>>> I have configured daily recurring snapshot policy for all the root
>>>> volumes.
>>>>> but recent three days onwards it is taking full snapshots and not
>> taking
>>>>> any child snapshots.
>>>>> I have configured snapshot.delta.max to 16.
>>>>> please help me my secondary storage is becoming full.
>>>>>
>>>>> The log file details shows:
>>>>>
>>>>> 2015-09-14 01:03:29,973 DEBUG [c.c.a.m.DirectAgentAttache]
>>>>> (DirectAgent-24:ctx-d68622c5) Seq 4-482873005: Response Received:
>>>>> 2015-09-14 01:03:29,973 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
>>>>> (DirectAgent-24:ctx-d68622c5) Seq 4-482873005: MgmtId 195780927071877:
>>>>> Resp: Routing to peer
>>>>> 2015-09-14 01:03:32,233 DEBUG [c.c.c.ConsoleProxyManagerImpl]
>>>>> (consoleproxy-1:ctx-b1db30de) Zone 1 is ready to launch console proxy
>>>>> 2015-09-14 01:03:32,334 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
>>>>> (secstorage-1:ctx-e024d41b) Zone 1 is ready to launch secondary storage
>>>> VM
>>>>> 2015-09-14 01:03:33,934 WARN  [c.c.u.n.Link]
>> (AgentManager-Selector:null)
>>>>> SSL: Fail to find the generated keystore. Loading fail-safe one to
>>>> continue.
>>>>> 2015-09-14 01:03:34,044 DEBUG [c.c.a.t.Request]
>>>>> (AgentManager-Handler-10:null) Seq 1-457572529: Executing:  { Cmd ,
>>>> MgmtId:
>>>>> 108371418365724, via: 1, Ver: v1, Flags: 100011,
>>>>>
>>>>
>> [{"org.apache.cloudstack.storage.command.CreateObjectCommand":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"volume":{"uuid":"bcf7653a-33db-461a-9355-e5d518012679","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
>>>>>
>>>>
>> 172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f9486b
>>>>>
>>>>
>> "}},"name":"ROOT-189","size":85899345920,"path":"9deefbf6-86e6-4359-acb3-99e1aebcb359","volumeId":696,"vmName":"i-11-189-VM","accountId":11,"format":"VHD","id":696,"deviceId":0,"hypervisorType":"XenServer"},"parentSnapshotPath":"3a6e9e1a-fd95-4530-ae67-03a368b3e2fd","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
>>>>>
>>>>
>> 172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f9486b
>>>>
>> "}},"vmName":"i-11-189-VM","name":"SAGXD02_ROOT-189_20150914090333","hypervisorType":"XenServer","id":6732,"quiescevm":false,"parents":["3a6e9e1a-fd95-4530-ae67-03a368b3e2fd"],"physicalSize":0}},"wait":0}}]
>>>>> }
>>>>> 2015-09-14 01:03:34,045 DEBUG [c.c.a.m.DirectAgentAttache]
>>>>> (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: Executing request
>>>>> 2015-09-14 01:03:35,421 WARN  [c.c.h.x.r.CitrixResourceBase]
>>>>> (DirectAgent-333:ctx-c3e7c331) callHostPlugin failed for cmd:
>>>> getVhdParent
>>>>> with args snapshotUuid: 3a6e9e1a-fd95-4530-ae67-03a368b3e2fd, isISCSI:
>>>>> false, primaryStorageSRUuid: a6a7f65a-a1d2-83e3-d3b0-f38792863fb6,  due
>>>> to
>>>>> There was a failure communicating with the plugin.
>>>>> 2015-09-14 01:03:35,421 DEBUG [c.c.h.x.r.XenServerStorageProcessor]
>>>>> (DirectAgent-333:ctx-c3e7c331) Failed to get parent snapshot
>>>>> com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed
>>>> for
>>>>> cmd: getVhdParent with args snapshotUuid:
>>>>> 3a6e9e1a-fd95-4530-ae67-03a368b3e2fd, isISCSI: false,
>>>> primaryStorageSRUuid:
>>>>> a6a7f65a-a1d2-83e3-d3b0-f38792863fb6,  due to There was a failure
>>>>> communicating with the plugin.
>>>>>      at
>>>>>
>>>>
>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.callHostPlugin(CitrixResourceBase.java:4239)
>>>>>      at
>>>>>
>>>>
>> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.getVhdParent(XenServerStorageProcessor.java:879)
>>>>>      at
>>>>>
>>>>
>> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.createSnapshot(XenServerStorageProcessor.java:478)
>>>>>      at
>>>>>
>>>>
>> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:107)
>>>>>      at
>>>>>
>>>>
>> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:52)
>>>>>      at
>>>>>
>>>>
>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
>>>>> at
>>>>>
>>>>
>> com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
>>>>>      at
>>>>>
>>>>
>> com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
>>>>>      at
>>>>>
>>>>
>> com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
>>>>>      at
>>>>>
>>>>
>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>>>>>      at
>>>>>
>>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>>>>>      at
>>>>>
>>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>>>>>      at
>>>>>
>>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>>>>>      at
>>>>>
>>>>
>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>>>>>      at
>>>>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>>>>      at
>>>>> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>>>>>      at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>>>>>      at
>>>>>
>>>>
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
>>>>>      at
>>>>>
>>>>
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
>>>>>      at
>>>>>
>>>>
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
>>>>>      at
>>>>>
>>>>
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>>>>      at java.lang.Thread.run(Thread.java:701)
>>>>> 2015-09-14 01:03:35,421 DEBUG [c.c.a.m.DirectAgentAttache]
>>>>> (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: Response Received:
>>>>> 2015-09-14 01:03:35,423 INFO  [c.c.a.m.ClusteredAgentManagerImpl]
>>>>> (DirectAgent-333:ctx-c3e7c331) Unable to find peer: 108371418365724
>>>>> 2015-09-14 01:03:35,424 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
>>>>> (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: MgmtId 108371418365724:
>>>>> Resp: Unable to route to peer: Seq 1-457572529:  { Ans: , MgmtId:
>>>>> 108371418365724, via: 1, Ver: v1, Flags: 10,
>>>>>
>>>>
>> [{"org.apache.cloudstack.storage.command.CreateObjectAnswer":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"c377e041-7ea9-40a2-9721-208b9a33b0c2","id":0,"quiescevm":false,"physicalSize":0}},"result":true,"wait":0}}]
>>>>> }
>>>>> 2015-09-14 01:03:38,934 WARN  [c.c.u.n.Link]
>> (AgentManager-Selector:null)
>>>>> SSL: Fail to find the generated keystore. Loading fail-safe one to
>>>> continue.
>>>>> 2015-09-14 01:03:39,458 DEBUG [c.c.a.m.AgentManagerImpl]
>>>>> (AgentManager-Handler-1:null) SeqA 2-3043178: Processing Seq 2-3043178:
>>>> {
>>>>> Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11,
>>>>>
>>>>
>> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":43,"_loadInfo":"{\n
>>>>> \"connections\": []\n}","wait":0}}] }
>>>>>
>>>>>
>>>>> Regards,
>>>>> rajasekhar.
>>>>
>>>> Find out more about ShapeBlue and our range of CloudStack related
>> services
>>>>
>>>> IaaS Cloud Design & Build<
>>>> http://shapeblue.com/iaas-cloud-design-and-build//>
>>>> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/
>>>
>>>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>>>> CloudStack Software Engineering<
>>>> http://shapeblue.com/cloudstack-software-engineering/>
>>>> CloudStack Infrastructure Support<
>>>> http://shapeblue.com/cloudstack-infrastructure-support/>
>>>> CloudStack Bootcamp Training Courses<
>>>> http://shapeblue.com/cloudstack-training/>
>>>>
>>>> This email and any attachments to it may be confidential and are
>> intended
>>>> solely for the use of the individual to whom it is addressed. Any views
>> or
>>>> opinions expressed are solely those of the author and do not necessarily
>>>> represent those of Shape Blue Ltd or related companies. If you are not
>> the
>>>> intended recipient of this email, you must neither take any action based
>>>> upon its contents, nor copy or show it to anyone. Please contact the
>> sender
>>>> if you believe you have received this email in error. Shape Blue Ltd is
>> a
>>>> company incorporated in England & Wales. ShapeBlue Services India LLP
>> is a
>>>> company incorporated in India and is operated under license from Shape
>> Blue
>>>> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in
>> Brasil
>>>> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd
>> is
>>>> a company registered by The Republic of South Africa and is traded under
>>>> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>>>
>>
>> Find out more about ShapeBlue and our range of CloudStack related services
>>
>> IaaS Cloud Design & Build<
>> http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Software Engineering<
>> http://shapeblue.com/cloudstack-software-engineering/>
>> CloudStack Infrastructure Support<
>> http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training Courses<
>> http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are intended
>> solely for the use of the individual to whom it is addressed. Any views or
>> opinions expressed are solely those of the author and do not necessarily
>> represent those of Shape Blue Ltd or related companies. If you are not the
>> intended recipient of this email, you must neither take any action based
>> upon its contents, nor copy or show it to anyone. Please contact the sender
>> if you believe you have received this email in error. Shape Blue Ltd is a
>> company incorporated in England & Wales. ShapeBlue Services India LLP is a
>> company incorporated in India and is operated under license from Shape Blue
>> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
>> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is
>> a company registered by The Republic of South Africa and is traded under
>> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: Recurring snapshot taking full every time

Posted by raja sekhar <ra...@gmail.com>.
Hi Abhinandan,

I have force reconnect the hosts but no use and i didn't find any error in
SMlog. please suggest me the error is still
generating.

Regards,
Rajasekhar.

On Wed, Sep 16, 2015 at 8:58 AM, Abhinandan Prateek <
abhinandan.prateek@shapeblue.com> wrote:

> Can you check in the SMlog on the concerned host if you see any error when
> the plugin is being invoked ?
>
> > On 14-Sep-2015, at 5:01 pm, raja sekhar <ra...@gmail.com> wrote:
> >
> > Hi abhinandan,
> >
> > Thanks for your reply.
> > We are facing the issue only for root volumes in that host. The snapshot
> > recurring policy for data disks in same host is working fine.
> > if the host configuration is not properly instrumented the policy for
> data
> > disks also fails, but it is working fine.
> > please suggest us.
> >
> > Note: The manual snapshots for root disk is working fine,and it is taking
> > child when second manual is configured , problem only with root daily
> > snapshots every day it is taking full instead of taking child snapshots
> > throwing error "*Failed to get parent snapshot**, due to There was a
> > failure communicating with the plugin*".
> >
> > Regards,
> > rajasekhar.
> >
> > On Mon, Sep 14, 2015 at 4:00 PM, Abhinandan Prateek <
> > abhinandan.prateek@shapeblue.com> wrote:
> >
> >> Looks like the host is not instrumented properly and management server
> is
> >> unable to invoke plugin on the host.
> >> Can you force-reconnect the host that is throwing this error ? That
> should
> >> recopy the plugins on to the host.
> >>
> >>> On 14-Sep-2015, at 3:15 pm, raja sekhar <ra...@gmail.com>
> wrote:
> >>>
> >>> Hi All,
> >>>
> >>> I am using CS 4.3.1 and xenserver 6.2
> >>> I have configured daily recurring snapshot policy for all the root
> >> volumes.
> >>> but recent three days onwards it is taking full snapshots and not
> taking
> >>> any child snapshots.
> >>> I have configured snapshot.delta.max to 16.
> >>> please help me my secondary storage is becoming full.
> >>>
> >>> The log file details shows:
> >>>
> >>> 2015-09-14 01:03:29,973 DEBUG [c.c.a.m.DirectAgentAttache]
> >>> (DirectAgent-24:ctx-d68622c5) Seq 4-482873005: Response Received:
> >>> 2015-09-14 01:03:29,973 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
> >>> (DirectAgent-24:ctx-d68622c5) Seq 4-482873005: MgmtId 195780927071877:
> >>> Resp: Routing to peer
> >>> 2015-09-14 01:03:32,233 DEBUG [c.c.c.ConsoleProxyManagerImpl]
> >>> (consoleproxy-1:ctx-b1db30de) Zone 1 is ready to launch console proxy
> >>> 2015-09-14 01:03:32,334 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
> >>> (secstorage-1:ctx-e024d41b) Zone 1 is ready to launch secondary storage
> >> VM
> >>> 2015-09-14 01:03:33,934 WARN  [c.c.u.n.Link]
> (AgentManager-Selector:null)
> >>> SSL: Fail to find the generated keystore. Loading fail-safe one to
> >> continue.
> >>> 2015-09-14 01:03:34,044 DEBUG [c.c.a.t.Request]
> >>> (AgentManager-Handler-10:null) Seq 1-457572529: Executing:  { Cmd ,
> >> MgmtId:
> >>> 108371418365724, via: 1, Ver: v1, Flags: 100011,
> >>>
> >>
> [{"org.apache.cloudstack.storage.command.CreateObjectCommand":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"volume":{"uuid":"bcf7653a-33db-461a-9355-e5d518012679","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
> >>>
> >>
> 172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f9486b
> >>>
> >>
> "}},"name":"ROOT-189","size":85899345920,"path":"9deefbf6-86e6-4359-acb3-99e1aebcb359","volumeId":696,"vmName":"i-11-189-VM","accountId":11,"format":"VHD","id":696,"deviceId":0,"hypervisorType":"XenServer"},"parentSnapshotPath":"3a6e9e1a-fd95-4530-ae67-03a368b3e2fd","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
> >>>
> >>
> 172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f9486b
> >>
> "}},"vmName":"i-11-189-VM","name":"SAGXD02_ROOT-189_20150914090333","hypervisorType":"XenServer","id":6732,"quiescevm":false,"parents":["3a6e9e1a-fd95-4530-ae67-03a368b3e2fd"],"physicalSize":0}},"wait":0}}]
> >>> }
> >>> 2015-09-14 01:03:34,045 DEBUG [c.c.a.m.DirectAgentAttache]
> >>> (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: Executing request
> >>> 2015-09-14 01:03:35,421 WARN  [c.c.h.x.r.CitrixResourceBase]
> >>> (DirectAgent-333:ctx-c3e7c331) callHostPlugin failed for cmd:
> >> getVhdParent
> >>> with args snapshotUuid: 3a6e9e1a-fd95-4530-ae67-03a368b3e2fd, isISCSI:
> >>> false, primaryStorageSRUuid: a6a7f65a-a1d2-83e3-d3b0-f38792863fb6,  due
> >> to
> >>> There was a failure communicating with the plugin.
> >>> 2015-09-14 01:03:35,421 DEBUG [c.c.h.x.r.XenServerStorageProcessor]
> >>> (DirectAgent-333:ctx-c3e7c331) Failed to get parent snapshot
> >>> com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed
> >> for
> >>> cmd: getVhdParent with args snapshotUuid:
> >>> 3a6e9e1a-fd95-4530-ae67-03a368b3e2fd, isISCSI: false,
> >> primaryStorageSRUuid:
> >>> a6a7f65a-a1d2-83e3-d3b0-f38792863fb6,  due to There was a failure
> >>> communicating with the plugin.
> >>>       at
> >>>
> >>
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.callHostPlugin(CitrixResourceBase.java:4239)
> >>>       at
> >>>
> >>
> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.getVhdParent(XenServerStorageProcessor.java:879)
> >>>       at
> >>>
> >>
> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.createSnapshot(XenServerStorageProcessor.java:478)
> >>>       at
> >>>
> >>
> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:107)
> >>>       at
> >>>
> >>
> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:52)
> >>>       at
> >>>
> >>
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
> >>> at
> >>>
> >>
> com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
> >>>       at
> >>>
> >>
> com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
> >>>       at
> >>>
> >>
> com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
> >>>       at
> >>>
> >>
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
> >>>       at
> >>>
> >>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
> >>>       at
> >>>
> >>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
> >>>       at
> >>>
> >>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
> >>>       at
> >>>
> >>
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
> >>>       at
> >>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> >>>       at
> >>> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> >>>       at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> >>>       at
> >>>
> >>
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
> >>>       at
> >>>
> >>
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
> >>>       at
> >>>
> >>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
> >>>       at
> >>>
> >>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> >>>       at java.lang.Thread.run(Thread.java:701)
> >>> 2015-09-14 01:03:35,421 DEBUG [c.c.a.m.DirectAgentAttache]
> >>> (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: Response Received:
> >>> 2015-09-14 01:03:35,423 INFO  [c.c.a.m.ClusteredAgentManagerImpl]
> >>> (DirectAgent-333:ctx-c3e7c331) Unable to find peer: 108371418365724
> >>> 2015-09-14 01:03:35,424 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
> >>> (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: MgmtId 108371418365724:
> >>> Resp: Unable to route to peer: Seq 1-457572529:  { Ans: , MgmtId:
> >>> 108371418365724, via: 1, Ver: v1, Flags: 10,
> >>>
> >>
> [{"org.apache.cloudstack.storage.command.CreateObjectAnswer":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"c377e041-7ea9-40a2-9721-208b9a33b0c2","id":0,"quiescevm":false,"physicalSize":0}},"result":true,"wait":0}}]
> >>> }
> >>> 2015-09-14 01:03:38,934 WARN  [c.c.u.n.Link]
> (AgentManager-Selector:null)
> >>> SSL: Fail to find the generated keystore. Loading fail-safe one to
> >> continue.
> >>> 2015-09-14 01:03:39,458 DEBUG [c.c.a.m.AgentManagerImpl]
> >>> (AgentManager-Handler-1:null) SeqA 2-3043178: Processing Seq 2-3043178:
> >> {
> >>> Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11,
> >>>
> >>
> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":43,"_loadInfo":"{\n
> >>> \"connections\": []\n}","wait":0}}] }
> >>>
> >>>
> >>> Regards,
> >>> rajasekhar.
> >>
> >> Find out more about ShapeBlue and our range of CloudStack related
> services
> >>
> >> IaaS Cloud Design & Build<
> >> http://shapeblue.com/iaas-cloud-design-and-build//>
> >> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/
> >
> >> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> >> CloudStack Software Engineering<
> >> http://shapeblue.com/cloudstack-software-engineering/>
> >> CloudStack Infrastructure Support<
> >> http://shapeblue.com/cloudstack-infrastructure-support/>
> >> CloudStack Bootcamp Training Courses<
> >> http://shapeblue.com/cloudstack-training/>
> >>
> >> This email and any attachments to it may be confidential and are
> intended
> >> solely for the use of the individual to whom it is addressed. Any views
> or
> >> opinions expressed are solely those of the author and do not necessarily
> >> represent those of Shape Blue Ltd or related companies. If you are not
> the
> >> intended recipient of this email, you must neither take any action based
> >> upon its contents, nor copy or show it to anyone. Please contact the
> sender
> >> if you believe you have received this email in error. Shape Blue Ltd is
> a
> >> company incorporated in England & Wales. ShapeBlue Services India LLP
> is a
> >> company incorporated in India and is operated under license from Shape
> Blue
> >> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in
> Brasil
> >> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd
> is
> >> a company registered by The Republic of South Africa and is traded under
> >> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
> >>
>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build<
> http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Software Engineering<
> http://shapeblue.com/cloudstack-software-engineering/>
> CloudStack Infrastructure Support<
> http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training Courses<
> http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended
> solely for the use of the individual to whom it is addressed. Any views or
> opinions expressed are solely those of the author and do not necessarily
> represent those of Shape Blue Ltd or related companies. If you are not the
> intended recipient of this email, you must neither take any action based
> upon its contents, nor copy or show it to anyone. Please contact the sender
> if you believe you have received this email in error. Shape Blue Ltd is a
> company incorporated in England & Wales. ShapeBlue Services India LLP is a
> company incorporated in India and is operated under license from Shape Blue
> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is
> a company registered by The Republic of South Africa and is traded under
> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>

Re: Recurring snapshot taking full every time

Posted by raja sekhar <ra...@gmail.com>.
Hi Abhinandan,

I have force reconnect the hosts but no use and i didn't find any error in
SMlog. please suggest me the error is still
generating.

Regards,
Rajasekhar.

On Wed, Sep 16, 2015 at 8:58 AM, Abhinandan Prateek <
abhinandan.prateek@shapeblue.com> wrote:

> Can you check in the SMlog on the concerned host if you see any error when
> the plugin is being invoked ?
>
> > On 14-Sep-2015, at 5:01 pm, raja sekhar <ra...@gmail.com> wrote:
> >
> > Hi abhinandan,
> >
> > Thanks for your reply.
> > We are facing the issue only for root volumes in that host. The snapshot
> > recurring policy for data disks in same host is working fine.
> > if the host configuration is not properly instrumented the policy for
> data
> > disks also fails, but it is working fine.
> > please suggest us.
> >
> > Note: The manual snapshots for root disk is working fine,and it is taking
> > child when second manual is configured , problem only with root daily
> > snapshots every day it is taking full instead of taking child snapshots
> > throwing error "*Failed to get parent snapshot**, due to There was a
> > failure communicating with the plugin*".
> >
> > Regards,
> > rajasekhar.
> >
> > On Mon, Sep 14, 2015 at 4:00 PM, Abhinandan Prateek <
> > abhinandan.prateek@shapeblue.com> wrote:
> >
> >> Looks like the host is not instrumented properly and management server
> is
> >> unable to invoke plugin on the host.
> >> Can you force-reconnect the host that is throwing this error ? That
> should
> >> recopy the plugins on to the host.
> >>
> >>> On 14-Sep-2015, at 3:15 pm, raja sekhar <ra...@gmail.com>
> wrote:
> >>>
> >>> Hi All,
> >>>
> >>> I am using CS 4.3.1 and xenserver 6.2
> >>> I have configured daily recurring snapshot policy for all the root
> >> volumes.
> >>> but recent three days onwards it is taking full snapshots and not
> taking
> >>> any child snapshots.
> >>> I have configured snapshot.delta.max to 16.
> >>> please help me my secondary storage is becoming full.
> >>>
> >>> The log file details shows:
> >>>
> >>> 2015-09-14 01:03:29,973 DEBUG [c.c.a.m.DirectAgentAttache]
> >>> (DirectAgent-24:ctx-d68622c5) Seq 4-482873005: Response Received:
> >>> 2015-09-14 01:03:29,973 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
> >>> (DirectAgent-24:ctx-d68622c5) Seq 4-482873005: MgmtId 195780927071877:
> >>> Resp: Routing to peer
> >>> 2015-09-14 01:03:32,233 DEBUG [c.c.c.ConsoleProxyManagerImpl]
> >>> (consoleproxy-1:ctx-b1db30de) Zone 1 is ready to launch console proxy
> >>> 2015-09-14 01:03:32,334 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
> >>> (secstorage-1:ctx-e024d41b) Zone 1 is ready to launch secondary storage
> >> VM
> >>> 2015-09-14 01:03:33,934 WARN  [c.c.u.n.Link]
> (AgentManager-Selector:null)
> >>> SSL: Fail to find the generated keystore. Loading fail-safe one to
> >> continue.
> >>> 2015-09-14 01:03:34,044 DEBUG [c.c.a.t.Request]
> >>> (AgentManager-Handler-10:null) Seq 1-457572529: Executing:  { Cmd ,
> >> MgmtId:
> >>> 108371418365724, via: 1, Ver: v1, Flags: 100011,
> >>>
> >>
> [{"org.apache.cloudstack.storage.command.CreateObjectCommand":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"volume":{"uuid":"bcf7653a-33db-461a-9355-e5d518012679","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
> >>>
> >>
> 172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f9486b
> >>>
> >>
> "}},"name":"ROOT-189","size":85899345920,"path":"9deefbf6-86e6-4359-acb3-99e1aebcb359","volumeId":696,"vmName":"i-11-189-VM","accountId":11,"format":"VHD","id":696,"deviceId":0,"hypervisorType":"XenServer"},"parentSnapshotPath":"3a6e9e1a-fd95-4530-ae67-03a368b3e2fd","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
> >>>
> >>
> 172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f9486b
> >>
> "}},"vmName":"i-11-189-VM","name":"SAGXD02_ROOT-189_20150914090333","hypervisorType":"XenServer","id":6732,"quiescevm":false,"parents":["3a6e9e1a-fd95-4530-ae67-03a368b3e2fd"],"physicalSize":0}},"wait":0}}]
> >>> }
> >>> 2015-09-14 01:03:34,045 DEBUG [c.c.a.m.DirectAgentAttache]
> >>> (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: Executing request
> >>> 2015-09-14 01:03:35,421 WARN  [c.c.h.x.r.CitrixResourceBase]
> >>> (DirectAgent-333:ctx-c3e7c331) callHostPlugin failed for cmd:
> >> getVhdParent
> >>> with args snapshotUuid: 3a6e9e1a-fd95-4530-ae67-03a368b3e2fd, isISCSI:
> >>> false, primaryStorageSRUuid: a6a7f65a-a1d2-83e3-d3b0-f38792863fb6,  due
> >> to
> >>> There was a failure communicating with the plugin.
> >>> 2015-09-14 01:03:35,421 DEBUG [c.c.h.x.r.XenServerStorageProcessor]
> >>> (DirectAgent-333:ctx-c3e7c331) Failed to get parent snapshot
> >>> com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed
> >> for
> >>> cmd: getVhdParent with args snapshotUuid:
> >>> 3a6e9e1a-fd95-4530-ae67-03a368b3e2fd, isISCSI: false,
> >> primaryStorageSRUuid:
> >>> a6a7f65a-a1d2-83e3-d3b0-f38792863fb6,  due to There was a failure
> >>> communicating with the plugin.
> >>>       at
> >>>
> >>
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.callHostPlugin(CitrixResourceBase.java:4239)
> >>>       at
> >>>
> >>
> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.getVhdParent(XenServerStorageProcessor.java:879)
> >>>       at
> >>>
> >>
> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.createSnapshot(XenServerStorageProcessor.java:478)
> >>>       at
> >>>
> >>
> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:107)
> >>>       at
> >>>
> >>
> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:52)
> >>>       at
> >>>
> >>
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
> >>> at
> >>>
> >>
> com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
> >>>       at
> >>>
> >>
> com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
> >>>       at
> >>>
> >>
> com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
> >>>       at
> >>>
> >>
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
> >>>       at
> >>>
> >>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
> >>>       at
> >>>
> >>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
> >>>       at
> >>>
> >>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
> >>>       at
> >>>
> >>
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
> >>>       at
> >>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> >>>       at
> >>> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> >>>       at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> >>>       at
> >>>
> >>
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
> >>>       at
> >>>
> >>
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
> >>>       at
> >>>
> >>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
> >>>       at
> >>>
> >>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> >>>       at java.lang.Thread.run(Thread.java:701)
> >>> 2015-09-14 01:03:35,421 DEBUG [c.c.a.m.DirectAgentAttache]
> >>> (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: Response Received:
> >>> 2015-09-14 01:03:35,423 INFO  [c.c.a.m.ClusteredAgentManagerImpl]
> >>> (DirectAgent-333:ctx-c3e7c331) Unable to find peer: 108371418365724
> >>> 2015-09-14 01:03:35,424 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
> >>> (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: MgmtId 108371418365724:
> >>> Resp: Unable to route to peer: Seq 1-457572529:  { Ans: , MgmtId:
> >>> 108371418365724, via: 1, Ver: v1, Flags: 10,
> >>>
> >>
> [{"org.apache.cloudstack.storage.command.CreateObjectAnswer":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"c377e041-7ea9-40a2-9721-208b9a33b0c2","id":0,"quiescevm":false,"physicalSize":0}},"result":true,"wait":0}}]
> >>> }
> >>> 2015-09-14 01:03:38,934 WARN  [c.c.u.n.Link]
> (AgentManager-Selector:null)
> >>> SSL: Fail to find the generated keystore. Loading fail-safe one to
> >> continue.
> >>> 2015-09-14 01:03:39,458 DEBUG [c.c.a.m.AgentManagerImpl]
> >>> (AgentManager-Handler-1:null) SeqA 2-3043178: Processing Seq 2-3043178:
> >> {
> >>> Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11,
> >>>
> >>
> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":43,"_loadInfo":"{\n
> >>> \"connections\": []\n}","wait":0}}] }
> >>>
> >>>
> >>> Regards,
> >>> rajasekhar.
> >>
> >> Find out more about ShapeBlue and our range of CloudStack related
> services
> >>
> >> IaaS Cloud Design & Build<
> >> http://shapeblue.com/iaas-cloud-design-and-build//>
> >> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/
> >
> >> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> >> CloudStack Software Engineering<
> >> http://shapeblue.com/cloudstack-software-engineering/>
> >> CloudStack Infrastructure Support<
> >> http://shapeblue.com/cloudstack-infrastructure-support/>
> >> CloudStack Bootcamp Training Courses<
> >> http://shapeblue.com/cloudstack-training/>
> >>
> >> This email and any attachments to it may be confidential and are
> intended
> >> solely for the use of the individual to whom it is addressed. Any views
> or
> >> opinions expressed are solely those of the author and do not necessarily
> >> represent those of Shape Blue Ltd or related companies. If you are not
> the
> >> intended recipient of this email, you must neither take any action based
> >> upon its contents, nor copy or show it to anyone. Please contact the
> sender
> >> if you believe you have received this email in error. Shape Blue Ltd is
> a
> >> company incorporated in England & Wales. ShapeBlue Services India LLP
> is a
> >> company incorporated in India and is operated under license from Shape
> Blue
> >> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in
> Brasil
> >> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd
> is
> >> a company registered by The Republic of South Africa and is traded under
> >> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
> >>
>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build<
> http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Software Engineering<
> http://shapeblue.com/cloudstack-software-engineering/>
> CloudStack Infrastructure Support<
> http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training Courses<
> http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended
> solely for the use of the individual to whom it is addressed. Any views or
> opinions expressed are solely those of the author and do not necessarily
> represent those of Shape Blue Ltd or related companies. If you are not the
> intended recipient of this email, you must neither take any action based
> upon its contents, nor copy or show it to anyone. Please contact the sender
> if you believe you have received this email in error. Shape Blue Ltd is a
> company incorporated in England & Wales. ShapeBlue Services India LLP is a
> company incorporated in India and is operated under license from Shape Blue
> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is
> a company registered by The Republic of South Africa and is traded under
> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>

Re: Recurring snapshot taking full every time

Posted by Abhinandan Prateek <ab...@shapeblue.com>.
Can you check in the SMlog on the concerned host if you see any error when the plugin is being invoked ?

> On 14-Sep-2015, at 5:01 pm, raja sekhar <ra...@gmail.com> wrote:
>
> Hi abhinandan,
>
> Thanks for your reply.
> We are facing the issue only for root volumes in that host. The snapshot
> recurring policy for data disks in same host is working fine.
> if the host configuration is not properly instrumented the policy for data
> disks also fails, but it is working fine.
> please suggest us.
>
> Note: The manual snapshots for root disk is working fine,and it is taking
> child when second manual is configured , problem only with root daily
> snapshots every day it is taking full instead of taking child snapshots
> throwing error "*Failed to get parent snapshot**, due to There was a
> failure communicating with the plugin*".
>
> Regards,
> rajasekhar.
>
> On Mon, Sep 14, 2015 at 4:00 PM, Abhinandan Prateek <
> abhinandan.prateek@shapeblue.com> wrote:
>
>> Looks like the host is not instrumented properly and management server is
>> unable to invoke plugin on the host.
>> Can you force-reconnect the host that is throwing this error ? That should
>> recopy the plugins on to the host.
>>
>>> On 14-Sep-2015, at 3:15 pm, raja sekhar <ra...@gmail.com> wrote:
>>>
>>> Hi All,
>>>
>>> I am using CS 4.3.1 and xenserver 6.2
>>> I have configured daily recurring snapshot policy for all the root
>> volumes.
>>> but recent three days onwards it is taking full snapshots and not taking
>>> any child snapshots.
>>> I have configured snapshot.delta.max to 16.
>>> please help me my secondary storage is becoming full.
>>>
>>> The log file details shows:
>>>
>>> 2015-09-14 01:03:29,973 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-24:ctx-d68622c5) Seq 4-482873005: Response Received:
>>> 2015-09-14 01:03:29,973 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
>>> (DirectAgent-24:ctx-d68622c5) Seq 4-482873005: MgmtId 195780927071877:
>>> Resp: Routing to peer
>>> 2015-09-14 01:03:32,233 DEBUG [c.c.c.ConsoleProxyManagerImpl]
>>> (consoleproxy-1:ctx-b1db30de) Zone 1 is ready to launch console proxy
>>> 2015-09-14 01:03:32,334 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
>>> (secstorage-1:ctx-e024d41b) Zone 1 is ready to launch secondary storage
>> VM
>>> 2015-09-14 01:03:33,934 WARN  [c.c.u.n.Link] (AgentManager-Selector:null)
>>> SSL: Fail to find the generated keystore. Loading fail-safe one to
>> continue.
>>> 2015-09-14 01:03:34,044 DEBUG [c.c.a.t.Request]
>>> (AgentManager-Handler-10:null) Seq 1-457572529: Executing:  { Cmd ,
>> MgmtId:
>>> 108371418365724, via: 1, Ver: v1, Flags: 100011,
>>>
>> [{"org.apache.cloudstack.storage.command.CreateObjectCommand":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"volume":{"uuid":"bcf7653a-33db-461a-9355-e5d518012679","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
>>>
>> 172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f9486b
>>>
>> "}},"name":"ROOT-189","size":85899345920,"path":"9deefbf6-86e6-4359-acb3-99e1aebcb359","volumeId":696,"vmName":"i-11-189-VM","accountId":11,"format":"VHD","id":696,"deviceId":0,"hypervisorType":"XenServer"},"parentSnapshotPath":"3a6e9e1a-fd95-4530-ae67-03a368b3e2fd","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
>>>
>> 172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f9486b
>> "}},"vmName":"i-11-189-VM","name":"SAGXD02_ROOT-189_20150914090333","hypervisorType":"XenServer","id":6732,"quiescevm":false,"parents":["3a6e9e1a-fd95-4530-ae67-03a368b3e2fd"],"physicalSize":0}},"wait":0}}]
>>> }
>>> 2015-09-14 01:03:34,045 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: Executing request
>>> 2015-09-14 01:03:35,421 WARN  [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-333:ctx-c3e7c331) callHostPlugin failed for cmd:
>> getVhdParent
>>> with args snapshotUuid: 3a6e9e1a-fd95-4530-ae67-03a368b3e2fd, isISCSI:
>>> false, primaryStorageSRUuid: a6a7f65a-a1d2-83e3-d3b0-f38792863fb6,  due
>> to
>>> There was a failure communicating with the plugin.
>>> 2015-09-14 01:03:35,421 DEBUG [c.c.h.x.r.XenServerStorageProcessor]
>>> (DirectAgent-333:ctx-c3e7c331) Failed to get parent snapshot
>>> com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed
>> for
>>> cmd: getVhdParent with args snapshotUuid:
>>> 3a6e9e1a-fd95-4530-ae67-03a368b3e2fd, isISCSI: false,
>> primaryStorageSRUuid:
>>> a6a7f65a-a1d2-83e3-d3b0-f38792863fb6,  due to There was a failure
>>> communicating with the plugin.
>>>       at
>>>
>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.callHostPlugin(CitrixResourceBase.java:4239)
>>>       at
>>>
>> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.getVhdParent(XenServerStorageProcessor.java:879)
>>>       at
>>>
>> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.createSnapshot(XenServerStorageProcessor.java:478)
>>>       at
>>>
>> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:107)
>>>       at
>>>
>> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:52)
>>>       at
>>>
>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
>>> at
>>>
>> com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
>>>       at
>>>
>> com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
>>>       at
>>>
>> com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
>>>       at
>>>
>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>>>       at
>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>>>       at
>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>>>       at
>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>>>       at
>>>
>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>>>       at
>>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>>       at
>>> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>>>       at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>>>       at
>>>
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
>>>       at
>>>
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
>>>       at
>>>
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
>>>       at
>>>
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>>       at java.lang.Thread.run(Thread.java:701)
>>> 2015-09-14 01:03:35,421 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: Response Received:
>>> 2015-09-14 01:03:35,423 INFO  [c.c.a.m.ClusteredAgentManagerImpl]
>>> (DirectAgent-333:ctx-c3e7c331) Unable to find peer: 108371418365724
>>> 2015-09-14 01:03:35,424 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
>>> (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: MgmtId 108371418365724:
>>> Resp: Unable to route to peer: Seq 1-457572529:  { Ans: , MgmtId:
>>> 108371418365724, via: 1, Ver: v1, Flags: 10,
>>>
>> [{"org.apache.cloudstack.storage.command.CreateObjectAnswer":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"c377e041-7ea9-40a2-9721-208b9a33b0c2","id":0,"quiescevm":false,"physicalSize":0}},"result":true,"wait":0}}]
>>> }
>>> 2015-09-14 01:03:38,934 WARN  [c.c.u.n.Link] (AgentManager-Selector:null)
>>> SSL: Fail to find the generated keystore. Loading fail-safe one to
>> continue.
>>> 2015-09-14 01:03:39,458 DEBUG [c.c.a.m.AgentManagerImpl]
>>> (AgentManager-Handler-1:null) SeqA 2-3043178: Processing Seq 2-3043178:
>> {
>>> Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11,
>>>
>> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":43,"_loadInfo":"{\n
>>> \"connections\": []\n}","wait":0}}] }
>>>
>>>
>>> Regards,
>>> rajasekhar.
>>
>> Find out more about ShapeBlue and our range of CloudStack related services
>>
>> IaaS Cloud Design & Build<
>> http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Software Engineering<
>> http://shapeblue.com/cloudstack-software-engineering/>
>> CloudStack Infrastructure Support<
>> http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training Courses<
>> http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are intended
>> solely for the use of the individual to whom it is addressed. Any views or
>> opinions expressed are solely those of the author and do not necessarily
>> represent those of Shape Blue Ltd or related companies. If you are not the
>> intended recipient of this email, you must neither take any action based
>> upon its contents, nor copy or show it to anyone. Please contact the sender
>> if you believe you have received this email in error. Shape Blue Ltd is a
>> company incorporated in England & Wales. ShapeBlue Services India LLP is a
>> company incorporated in India and is operated under license from Shape Blue
>> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
>> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is
>> a company registered by The Republic of South Africa and is traded under
>> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: Recurring snapshot taking full every time

Posted by Abhinandan Prateek <ab...@shapeblue.com>.
Can you check in the SMlog on the concerned host if you see any error when the plugin is being invoked ?

> On 14-Sep-2015, at 5:01 pm, raja sekhar <ra...@gmail.com> wrote:
>
> Hi abhinandan,
>
> Thanks for your reply.
> We are facing the issue only for root volumes in that host. The snapshot
> recurring policy for data disks in same host is working fine.
> if the host configuration is not properly instrumented the policy for data
> disks also fails, but it is working fine.
> please suggest us.
>
> Note: The manual snapshots for root disk is working fine,and it is taking
> child when second manual is configured , problem only with root daily
> snapshots every day it is taking full instead of taking child snapshots
> throwing error "*Failed to get parent snapshot**, due to There was a
> failure communicating with the plugin*".
>
> Regards,
> rajasekhar.
>
> On Mon, Sep 14, 2015 at 4:00 PM, Abhinandan Prateek <
> abhinandan.prateek@shapeblue.com> wrote:
>
>> Looks like the host is not instrumented properly and management server is
>> unable to invoke plugin on the host.
>> Can you force-reconnect the host that is throwing this error ? That should
>> recopy the plugins on to the host.
>>
>>> On 14-Sep-2015, at 3:15 pm, raja sekhar <ra...@gmail.com> wrote:
>>>
>>> Hi All,
>>>
>>> I am using CS 4.3.1 and xenserver 6.2
>>> I have configured daily recurring snapshot policy for all the root
>> volumes.
>>> but recent three days onwards it is taking full snapshots and not taking
>>> any child snapshots.
>>> I have configured snapshot.delta.max to 16.
>>> please help me my secondary storage is becoming full.
>>>
>>> The log file details shows:
>>>
>>> 2015-09-14 01:03:29,973 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-24:ctx-d68622c5) Seq 4-482873005: Response Received:
>>> 2015-09-14 01:03:29,973 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
>>> (DirectAgent-24:ctx-d68622c5) Seq 4-482873005: MgmtId 195780927071877:
>>> Resp: Routing to peer
>>> 2015-09-14 01:03:32,233 DEBUG [c.c.c.ConsoleProxyManagerImpl]
>>> (consoleproxy-1:ctx-b1db30de) Zone 1 is ready to launch console proxy
>>> 2015-09-14 01:03:32,334 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
>>> (secstorage-1:ctx-e024d41b) Zone 1 is ready to launch secondary storage
>> VM
>>> 2015-09-14 01:03:33,934 WARN  [c.c.u.n.Link] (AgentManager-Selector:null)
>>> SSL: Fail to find the generated keystore. Loading fail-safe one to
>> continue.
>>> 2015-09-14 01:03:34,044 DEBUG [c.c.a.t.Request]
>>> (AgentManager-Handler-10:null) Seq 1-457572529: Executing:  { Cmd ,
>> MgmtId:
>>> 108371418365724, via: 1, Ver: v1, Flags: 100011,
>>>
>> [{"org.apache.cloudstack.storage.command.CreateObjectCommand":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"volume":{"uuid":"bcf7653a-33db-461a-9355-e5d518012679","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
>>>
>> 172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f9486b
>>>
>> "}},"name":"ROOT-189","size":85899345920,"path":"9deefbf6-86e6-4359-acb3-99e1aebcb359","volumeId":696,"vmName":"i-11-189-VM","accountId":11,"format":"VHD","id":696,"deviceId":0,"hypervisorType":"XenServer"},"parentSnapshotPath":"3a6e9e1a-fd95-4530-ae67-03a368b3e2fd","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
>>>
>> 172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f9486b
>> "}},"vmName":"i-11-189-VM","name":"SAGXD02_ROOT-189_20150914090333","hypervisorType":"XenServer","id":6732,"quiescevm":false,"parents":["3a6e9e1a-fd95-4530-ae67-03a368b3e2fd"],"physicalSize":0}},"wait":0}}]
>>> }
>>> 2015-09-14 01:03:34,045 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: Executing request
>>> 2015-09-14 01:03:35,421 WARN  [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-333:ctx-c3e7c331) callHostPlugin failed for cmd:
>> getVhdParent
>>> with args snapshotUuid: 3a6e9e1a-fd95-4530-ae67-03a368b3e2fd, isISCSI:
>>> false, primaryStorageSRUuid: a6a7f65a-a1d2-83e3-d3b0-f38792863fb6,  due
>> to
>>> There was a failure communicating with the plugin.
>>> 2015-09-14 01:03:35,421 DEBUG [c.c.h.x.r.XenServerStorageProcessor]
>>> (DirectAgent-333:ctx-c3e7c331) Failed to get parent snapshot
>>> com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed
>> for
>>> cmd: getVhdParent with args snapshotUuid:
>>> 3a6e9e1a-fd95-4530-ae67-03a368b3e2fd, isISCSI: false,
>> primaryStorageSRUuid:
>>> a6a7f65a-a1d2-83e3-d3b0-f38792863fb6,  due to There was a failure
>>> communicating with the plugin.
>>>       at
>>>
>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.callHostPlugin(CitrixResourceBase.java:4239)
>>>       at
>>>
>> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.getVhdParent(XenServerStorageProcessor.java:879)
>>>       at
>>>
>> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.createSnapshot(XenServerStorageProcessor.java:478)
>>>       at
>>>
>> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:107)
>>>       at
>>>
>> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:52)
>>>       at
>>>
>> com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
>>> at
>>>
>> com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
>>>       at
>>>
>> com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
>>>       at
>>>
>> com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
>>>       at
>>>
>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>>>       at
>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>>>       at
>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>>>       at
>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>>>       at
>>>
>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>>>       at
>>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>>       at
>>> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>>>       at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>>>       at
>>>
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
>>>       at
>>>
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
>>>       at
>>>
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
>>>       at
>>>
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>>       at java.lang.Thread.run(Thread.java:701)
>>> 2015-09-14 01:03:35,421 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: Response Received:
>>> 2015-09-14 01:03:35,423 INFO  [c.c.a.m.ClusteredAgentManagerImpl]
>>> (DirectAgent-333:ctx-c3e7c331) Unable to find peer: 108371418365724
>>> 2015-09-14 01:03:35,424 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
>>> (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: MgmtId 108371418365724:
>>> Resp: Unable to route to peer: Seq 1-457572529:  { Ans: , MgmtId:
>>> 108371418365724, via: 1, Ver: v1, Flags: 10,
>>>
>> [{"org.apache.cloudstack.storage.command.CreateObjectAnswer":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"c377e041-7ea9-40a2-9721-208b9a33b0c2","id":0,"quiescevm":false,"physicalSize":0}},"result":true,"wait":0}}]
>>> }
>>> 2015-09-14 01:03:38,934 WARN  [c.c.u.n.Link] (AgentManager-Selector:null)
>>> SSL: Fail to find the generated keystore. Loading fail-safe one to
>> continue.
>>> 2015-09-14 01:03:39,458 DEBUG [c.c.a.m.AgentManagerImpl]
>>> (AgentManager-Handler-1:null) SeqA 2-3043178: Processing Seq 2-3043178:
>> {
>>> Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11,
>>>
>> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":43,"_loadInfo":"{\n
>>> \"connections\": []\n}","wait":0}}] }
>>>
>>>
>>> Regards,
>>> rajasekhar.
>>
>> Find out more about ShapeBlue and our range of CloudStack related services
>>
>> IaaS Cloud Design & Build<
>> http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Software Engineering<
>> http://shapeblue.com/cloudstack-software-engineering/>
>> CloudStack Infrastructure Support<
>> http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training Courses<
>> http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are intended
>> solely for the use of the individual to whom it is addressed. Any views or
>> opinions expressed are solely those of the author and do not necessarily
>> represent those of Shape Blue Ltd or related companies. If you are not the
>> intended recipient of this email, you must neither take any action based
>> upon its contents, nor copy or show it to anyone. Please contact the sender
>> if you believe you have received this email in error. Shape Blue Ltd is a
>> company incorporated in England & Wales. ShapeBlue Services India LLP is a
>> company incorporated in India and is operated under license from Shape Blue
>> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
>> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is
>> a company registered by The Republic of South Africa and is traded under
>> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: Recurring snapshot taking full every time

Posted by raja sekhar <ra...@gmail.com>.
Hi abhinandan,

Thanks for your reply.
We are facing the issue only for root volumes in that host. The snapshot
recurring policy for data disks in same host is working fine.
if the host configuration is not properly instrumented the policy for data
disks also fails, but it is working fine.
please suggest us.

Note: The manual snapshots for root disk is working fine,and it is taking
child when second manual is configured , problem only with root daily
snapshots every day it is taking full instead of taking child snapshots
throwing error "*Failed to get parent snapshot**, due to There was a
failure communicating with the plugin*".

Regards,
rajasekhar.

On Mon, Sep 14, 2015 at 4:00 PM, Abhinandan Prateek <
abhinandan.prateek@shapeblue.com> wrote:

> Looks like the host is not instrumented properly and management server is
> unable to invoke plugin on the host.
> Can you force-reconnect the host that is throwing this error ? That should
> recopy the plugins on to the host.
>
> > On 14-Sep-2015, at 3:15 pm, raja sekhar <ra...@gmail.com> wrote:
> >
> > Hi All,
> >
> > I am using CS 4.3.1 and xenserver 6.2
> > I have configured daily recurring snapshot policy for all the root
> volumes.
> > but recent three days onwards it is taking full snapshots and not taking
> > any child snapshots.
> > I have configured snapshot.delta.max to 16.
> > please help me my secondary storage is becoming full.
> >
> > The log file details shows:
> >
> > 2015-09-14 01:03:29,973 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-24:ctx-d68622c5) Seq 4-482873005: Response Received:
> > 2015-09-14 01:03:29,973 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
> > (DirectAgent-24:ctx-d68622c5) Seq 4-482873005: MgmtId 195780927071877:
> > Resp: Routing to peer
> > 2015-09-14 01:03:32,233 DEBUG [c.c.c.ConsoleProxyManagerImpl]
> > (consoleproxy-1:ctx-b1db30de) Zone 1 is ready to launch console proxy
> > 2015-09-14 01:03:32,334 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
> > (secstorage-1:ctx-e024d41b) Zone 1 is ready to launch secondary storage
> VM
> > 2015-09-14 01:03:33,934 WARN  [c.c.u.n.Link] (AgentManager-Selector:null)
> > SSL: Fail to find the generated keystore. Loading fail-safe one to
> continue.
> > 2015-09-14 01:03:34,044 DEBUG [c.c.a.t.Request]
> > (AgentManager-Handler-10:null) Seq 1-457572529: Executing:  { Cmd ,
> MgmtId:
> > 108371418365724, via: 1, Ver: v1, Flags: 100011,
> >
> [{"org.apache.cloudstack.storage.command.CreateObjectCommand":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"volume":{"uuid":"bcf7653a-33db-461a-9355-e5d518012679","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
> >
> 172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f9486b
> >
> "}},"name":"ROOT-189","size":85899345920,"path":"9deefbf6-86e6-4359-acb3-99e1aebcb359","volumeId":696,"vmName":"i-11-189-VM","accountId":11,"format":"VHD","id":696,"deviceId":0,"hypervisorType":"XenServer"},"parentSnapshotPath":"3a6e9e1a-fd95-4530-ae67-03a368b3e2fd","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
> >
> 172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f9486b
> "}},"vmName":"i-11-189-VM","name":"SAGXD02_ROOT-189_20150914090333","hypervisorType":"XenServer","id":6732,"quiescevm":false,"parents":["3a6e9e1a-fd95-4530-ae67-03a368b3e2fd"],"physicalSize":0}},"wait":0}}]
> > }
> > 2015-09-14 01:03:34,045 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: Executing request
> > 2015-09-14 01:03:35,421 WARN  [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-333:ctx-c3e7c331) callHostPlugin failed for cmd:
> getVhdParent
> > with args snapshotUuid: 3a6e9e1a-fd95-4530-ae67-03a368b3e2fd, isISCSI:
> > false, primaryStorageSRUuid: a6a7f65a-a1d2-83e3-d3b0-f38792863fb6,  due
> to
> > There was a failure communicating with the plugin.
> > 2015-09-14 01:03:35,421 DEBUG [c.c.h.x.r.XenServerStorageProcessor]
> > (DirectAgent-333:ctx-c3e7c331) Failed to get parent snapshot
> > com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed
> for
> > cmd: getVhdParent with args snapshotUuid:
> > 3a6e9e1a-fd95-4530-ae67-03a368b3e2fd, isISCSI: false,
> primaryStorageSRUuid:
> > a6a7f65a-a1d2-83e3-d3b0-f38792863fb6,  due to There was a failure
> > communicating with the plugin.
> >        at
> >
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.callHostPlugin(CitrixResourceBase.java:4239)
> >        at
> >
> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.getVhdParent(XenServerStorageProcessor.java:879)
> >        at
> >
> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.createSnapshot(XenServerStorageProcessor.java:478)
> >        at
> >
> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:107)
> >        at
> >
> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:52)
> >        at
> >
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
> > at
> >
> com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
> >        at
> >
> com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
> >        at
> >
> com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
> >        at
> >
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
> >        at
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
> >        at
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
> >        at
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
> >        at
> >
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
> >        at
> > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> >        at
> > java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> >        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> >        at
> >
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
> >        at
> >
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
> >        at
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
> >        at
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> >        at java.lang.Thread.run(Thread.java:701)
> > 2015-09-14 01:03:35,421 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: Response Received:
> > 2015-09-14 01:03:35,423 INFO  [c.c.a.m.ClusteredAgentManagerImpl]
> > (DirectAgent-333:ctx-c3e7c331) Unable to find peer: 108371418365724
> > 2015-09-14 01:03:35,424 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
> > (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: MgmtId 108371418365724:
> > Resp: Unable to route to peer: Seq 1-457572529:  { Ans: , MgmtId:
> > 108371418365724, via: 1, Ver: v1, Flags: 10,
> >
> [{"org.apache.cloudstack.storage.command.CreateObjectAnswer":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"c377e041-7ea9-40a2-9721-208b9a33b0c2","id":0,"quiescevm":false,"physicalSize":0}},"result":true,"wait":0}}]
> > }
> > 2015-09-14 01:03:38,934 WARN  [c.c.u.n.Link] (AgentManager-Selector:null)
> > SSL: Fail to find the generated keystore. Loading fail-safe one to
> continue.
> > 2015-09-14 01:03:39,458 DEBUG [c.c.a.m.AgentManagerImpl]
> > (AgentManager-Handler-1:null) SeqA 2-3043178: Processing Seq 2-3043178:
> {
> > Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11,
> >
> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":43,"_loadInfo":"{\n
> > \"connections\": []\n}","wait":0}}] }
> >
> >
> > Regards,
> > rajasekhar.
>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build<
> http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Software Engineering<
> http://shapeblue.com/cloudstack-software-engineering/>
> CloudStack Infrastructure Support<
> http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training Courses<
> http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended
> solely for the use of the individual to whom it is addressed. Any views or
> opinions expressed are solely those of the author and do not necessarily
> represent those of Shape Blue Ltd or related companies. If you are not the
> intended recipient of this email, you must neither take any action based
> upon its contents, nor copy or show it to anyone. Please contact the sender
> if you believe you have received this email in error. Shape Blue Ltd is a
> company incorporated in England & Wales. ShapeBlue Services India LLP is a
> company incorporated in India and is operated under license from Shape Blue
> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is
> a company registered by The Republic of South Africa and is traded under
> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>

Re: Recurring snapshot taking full every time

Posted by raja sekhar <ra...@gmail.com>.
Hi abhinandan,

Thanks for your reply.
We are facing the issue only for root volumes in that host. The snapshot
recurring policy for data disks in same host is working fine.
if the host configuration is not properly instrumented the policy for data
disks also fails, but it is working fine.
please suggest us.

Note: The manual snapshots for root disk is working fine,and it is taking
child when second manual is configured , problem only with root daily
snapshots every day it is taking full instead of taking child snapshots
throwing error "*Failed to get parent snapshot**, due to There was a
failure communicating with the plugin*".

Regards,
rajasekhar.

On Mon, Sep 14, 2015 at 4:00 PM, Abhinandan Prateek <
abhinandan.prateek@shapeblue.com> wrote:

> Looks like the host is not instrumented properly and management server is
> unable to invoke plugin on the host.
> Can you force-reconnect the host that is throwing this error ? That should
> recopy the plugins on to the host.
>
> > On 14-Sep-2015, at 3:15 pm, raja sekhar <ra...@gmail.com> wrote:
> >
> > Hi All,
> >
> > I am using CS 4.3.1 and xenserver 6.2
> > I have configured daily recurring snapshot policy for all the root
> volumes.
> > but recent three days onwards it is taking full snapshots and not taking
> > any child snapshots.
> > I have configured snapshot.delta.max to 16.
> > please help me my secondary storage is becoming full.
> >
> > The log file details shows:
> >
> > 2015-09-14 01:03:29,973 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-24:ctx-d68622c5) Seq 4-482873005: Response Received:
> > 2015-09-14 01:03:29,973 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
> > (DirectAgent-24:ctx-d68622c5) Seq 4-482873005: MgmtId 195780927071877:
> > Resp: Routing to peer
> > 2015-09-14 01:03:32,233 DEBUG [c.c.c.ConsoleProxyManagerImpl]
> > (consoleproxy-1:ctx-b1db30de) Zone 1 is ready to launch console proxy
> > 2015-09-14 01:03:32,334 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
> > (secstorage-1:ctx-e024d41b) Zone 1 is ready to launch secondary storage
> VM
> > 2015-09-14 01:03:33,934 WARN  [c.c.u.n.Link] (AgentManager-Selector:null)
> > SSL: Fail to find the generated keystore. Loading fail-safe one to
> continue.
> > 2015-09-14 01:03:34,044 DEBUG [c.c.a.t.Request]
> > (AgentManager-Handler-10:null) Seq 1-457572529: Executing:  { Cmd ,
> MgmtId:
> > 108371418365724, via: 1, Ver: v1, Flags: 100011,
> >
> [{"org.apache.cloudstack.storage.command.CreateObjectCommand":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"volume":{"uuid":"bcf7653a-33db-461a-9355-e5d518012679","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
> >
> 172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f9486b
> >
> "}},"name":"ROOT-189","size":85899345920,"path":"9deefbf6-86e6-4359-acb3-99e1aebcb359","volumeId":696,"vmName":"i-11-189-VM","accountId":11,"format":"VHD","id":696,"deviceId":0,"hypervisorType":"XenServer"},"parentSnapshotPath":"3a6e9e1a-fd95-4530-ae67-03a368b3e2fd","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
> >
> 172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f9486b
> "}},"vmName":"i-11-189-VM","name":"SAGXD02_ROOT-189_20150914090333","hypervisorType":"XenServer","id":6732,"quiescevm":false,"parents":["3a6e9e1a-fd95-4530-ae67-03a368b3e2fd"],"physicalSize":0}},"wait":0}}]
> > }
> > 2015-09-14 01:03:34,045 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: Executing request
> > 2015-09-14 01:03:35,421 WARN  [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-333:ctx-c3e7c331) callHostPlugin failed for cmd:
> getVhdParent
> > with args snapshotUuid: 3a6e9e1a-fd95-4530-ae67-03a368b3e2fd, isISCSI:
> > false, primaryStorageSRUuid: a6a7f65a-a1d2-83e3-d3b0-f38792863fb6,  due
> to
> > There was a failure communicating with the plugin.
> > 2015-09-14 01:03:35,421 DEBUG [c.c.h.x.r.XenServerStorageProcessor]
> > (DirectAgent-333:ctx-c3e7c331) Failed to get parent snapshot
> > com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed
> for
> > cmd: getVhdParent with args snapshotUuid:
> > 3a6e9e1a-fd95-4530-ae67-03a368b3e2fd, isISCSI: false,
> primaryStorageSRUuid:
> > a6a7f65a-a1d2-83e3-d3b0-f38792863fb6,  due to There was a failure
> > communicating with the plugin.
> >        at
> >
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.callHostPlugin(CitrixResourceBase.java:4239)
> >        at
> >
> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.getVhdParent(XenServerStorageProcessor.java:879)
> >        at
> >
> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.createSnapshot(XenServerStorageProcessor.java:478)
> >        at
> >
> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:107)
> >        at
> >
> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:52)
> >        at
> >
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
> > at
> >
> com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
> >        at
> >
> com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
> >        at
> >
> com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
> >        at
> >
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
> >        at
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
> >        at
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
> >        at
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
> >        at
> >
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
> >        at
> > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> >        at
> > java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> >        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> >        at
> >
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
> >        at
> >
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
> >        at
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
> >        at
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> >        at java.lang.Thread.run(Thread.java:701)
> > 2015-09-14 01:03:35,421 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: Response Received:
> > 2015-09-14 01:03:35,423 INFO  [c.c.a.m.ClusteredAgentManagerImpl]
> > (DirectAgent-333:ctx-c3e7c331) Unable to find peer: 108371418365724
> > 2015-09-14 01:03:35,424 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
> > (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: MgmtId 108371418365724:
> > Resp: Unable to route to peer: Seq 1-457572529:  { Ans: , MgmtId:
> > 108371418365724, via: 1, Ver: v1, Flags: 10,
> >
> [{"org.apache.cloudstack.storage.command.CreateObjectAnswer":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"c377e041-7ea9-40a2-9721-208b9a33b0c2","id":0,"quiescevm":false,"physicalSize":0}},"result":true,"wait":0}}]
> > }
> > 2015-09-14 01:03:38,934 WARN  [c.c.u.n.Link] (AgentManager-Selector:null)
> > SSL: Fail to find the generated keystore. Loading fail-safe one to
> continue.
> > 2015-09-14 01:03:39,458 DEBUG [c.c.a.m.AgentManagerImpl]
> > (AgentManager-Handler-1:null) SeqA 2-3043178: Processing Seq 2-3043178:
> {
> > Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11,
> >
> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":43,"_loadInfo":"{\n
> > \"connections\": []\n}","wait":0}}] }
> >
> >
> > Regards,
> > rajasekhar.
>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build<
> http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Software Engineering<
> http://shapeblue.com/cloudstack-software-engineering/>
> CloudStack Infrastructure Support<
> http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training Courses<
> http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended
> solely for the use of the individual to whom it is addressed. Any views or
> opinions expressed are solely those of the author and do not necessarily
> represent those of Shape Blue Ltd or related companies. If you are not the
> intended recipient of this email, you must neither take any action based
> upon its contents, nor copy or show it to anyone. Please contact the sender
> if you believe you have received this email in error. Shape Blue Ltd is a
> company incorporated in England & Wales. ShapeBlue Services India LLP is a
> company incorporated in India and is operated under license from Shape Blue
> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is
> a company registered by The Republic of South Africa and is traded under
> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>

Re: Recurring snapshot taking full every time

Posted by Abhinandan Prateek <ab...@shapeblue.com>.
Looks like the host is not instrumented properly and management server is unable to invoke plugin on the host.
Can you force-reconnect the host that is throwing this error ? That should recopy the plugins on to the host.

> On 14-Sep-2015, at 3:15 pm, raja sekhar <ra...@gmail.com> wrote:
>
> Hi All,
>
> I am using CS 4.3.1 and xenserver 6.2
> I have configured daily recurring snapshot policy for all the root volumes.
> but recent three days onwards it is taking full snapshots and not taking
> any child snapshots.
> I have configured snapshot.delta.max to 16.
> please help me my secondary storage is becoming full.
>
> The log file details shows:
>
> 2015-09-14 01:03:29,973 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-24:ctx-d68622c5) Seq 4-482873005: Response Received:
> 2015-09-14 01:03:29,973 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
> (DirectAgent-24:ctx-d68622c5) Seq 4-482873005: MgmtId 195780927071877:
> Resp: Routing to peer
> 2015-09-14 01:03:32,233 DEBUG [c.c.c.ConsoleProxyManagerImpl]
> (consoleproxy-1:ctx-b1db30de) Zone 1 is ready to launch console proxy
> 2015-09-14 01:03:32,334 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
> (secstorage-1:ctx-e024d41b) Zone 1 is ready to launch secondary storage VM
> 2015-09-14 01:03:33,934 WARN  [c.c.u.n.Link] (AgentManager-Selector:null)
> SSL: Fail to find the generated keystore. Loading fail-safe one to continue.
> 2015-09-14 01:03:34,044 DEBUG [c.c.a.t.Request]
> (AgentManager-Handler-10:null) Seq 1-457572529: Executing:  { Cmd , MgmtId:
> 108371418365724, via: 1, Ver: v1, Flags: 100011,
> [{"org.apache.cloudstack.storage.command.CreateObjectCommand":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"volume":{"uuid":"bcf7653a-33db-461a-9355-e5d518012679","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
> 172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f9486b
> "}},"name":"ROOT-189","size":85899345920,"path":"9deefbf6-86e6-4359-acb3-99e1aebcb359","volumeId":696,"vmName":"i-11-189-VM","accountId":11,"format":"VHD","id":696,"deviceId":0,"hypervisorType":"XenServer"},"parentSnapshotPath":"3a6e9e1a-fd95-4530-ae67-03a368b3e2fd","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
> 172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f9486b"}},"vmName":"i-11-189-VM","name":"SAGXD02_ROOT-189_20150914090333","hypervisorType":"XenServer","id":6732,"quiescevm":false,"parents":["3a6e9e1a-fd95-4530-ae67-03a368b3e2fd"],"physicalSize":0}},"wait":0}}]
> }
> 2015-09-14 01:03:34,045 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: Executing request
> 2015-09-14 01:03:35,421 WARN  [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-333:ctx-c3e7c331) callHostPlugin failed for cmd: getVhdParent
> with args snapshotUuid: 3a6e9e1a-fd95-4530-ae67-03a368b3e2fd, isISCSI:
> false, primaryStorageSRUuid: a6a7f65a-a1d2-83e3-d3b0-f38792863fb6,  due to
> There was a failure communicating with the plugin.
> 2015-09-14 01:03:35,421 DEBUG [c.c.h.x.r.XenServerStorageProcessor]
> (DirectAgent-333:ctx-c3e7c331) Failed to get parent snapshot
> com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed for
> cmd: getVhdParent with args snapshotUuid:
> 3a6e9e1a-fd95-4530-ae67-03a368b3e2fd, isISCSI: false, primaryStorageSRUuid:
> a6a7f65a-a1d2-83e3-d3b0-f38792863fb6,  due to There was a failure
> communicating with the plugin.
>        at
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.callHostPlugin(CitrixResourceBase.java:4239)
>        at
> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.getVhdParent(XenServerStorageProcessor.java:879)
>        at
> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.createSnapshot(XenServerStorageProcessor.java:478)
>        at
> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:107)
>        at
> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:52)
>        at
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
> at
> com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
>        at
> com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
>        at
> com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
>        at
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>        at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>        at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>        at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>        at
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>        at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>        at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>        at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
>        at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
>        at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
>        at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>        at java.lang.Thread.run(Thread.java:701)
> 2015-09-14 01:03:35,421 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: Response Received:
> 2015-09-14 01:03:35,423 INFO  [c.c.a.m.ClusteredAgentManagerImpl]
> (DirectAgent-333:ctx-c3e7c331) Unable to find peer: 108371418365724
> 2015-09-14 01:03:35,424 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
> (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: MgmtId 108371418365724:
> Resp: Unable to route to peer: Seq 1-457572529:  { Ans: , MgmtId:
> 108371418365724, via: 1, Ver: v1, Flags: 10,
> [{"org.apache.cloudstack.storage.command.CreateObjectAnswer":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"c377e041-7ea9-40a2-9721-208b9a33b0c2","id":0,"quiescevm":false,"physicalSize":0}},"result":true,"wait":0}}]
> }
> 2015-09-14 01:03:38,934 WARN  [c.c.u.n.Link] (AgentManager-Selector:null)
> SSL: Fail to find the generated keystore. Loading fail-safe one to continue.
> 2015-09-14 01:03:39,458 DEBUG [c.c.a.m.AgentManagerImpl]
> (AgentManager-Handler-1:null) SeqA 2-3043178: Processing Seq 2-3043178:  {
> Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11,
> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":43,"_loadInfo":"{\n
> \"connections\": []\n}","wait":0}}] }
>
>
> Regards,
> rajasekhar.

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.

Re: Recurring snapshot taking full every time

Posted by Abhinandan Prateek <ab...@shapeblue.com>.
Looks like the host is not instrumented properly and management server is unable to invoke plugin on the host.
Can you force-reconnect the host that is throwing this error ? That should recopy the plugins on to the host.

> On 14-Sep-2015, at 3:15 pm, raja sekhar <ra...@gmail.com> wrote:
>
> Hi All,
>
> I am using CS 4.3.1 and xenserver 6.2
> I have configured daily recurring snapshot policy for all the root volumes.
> but recent three days onwards it is taking full snapshots and not taking
> any child snapshots.
> I have configured snapshot.delta.max to 16.
> please help me my secondary storage is becoming full.
>
> The log file details shows:
>
> 2015-09-14 01:03:29,973 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-24:ctx-d68622c5) Seq 4-482873005: Response Received:
> 2015-09-14 01:03:29,973 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
> (DirectAgent-24:ctx-d68622c5) Seq 4-482873005: MgmtId 195780927071877:
> Resp: Routing to peer
> 2015-09-14 01:03:32,233 DEBUG [c.c.c.ConsoleProxyManagerImpl]
> (consoleproxy-1:ctx-b1db30de) Zone 1 is ready to launch console proxy
> 2015-09-14 01:03:32,334 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
> (secstorage-1:ctx-e024d41b) Zone 1 is ready to launch secondary storage VM
> 2015-09-14 01:03:33,934 WARN  [c.c.u.n.Link] (AgentManager-Selector:null)
> SSL: Fail to find the generated keystore. Loading fail-safe one to continue.
> 2015-09-14 01:03:34,044 DEBUG [c.c.a.t.Request]
> (AgentManager-Handler-10:null) Seq 1-457572529: Executing:  { Cmd , MgmtId:
> 108371418365724, via: 1, Ver: v1, Flags: 100011,
> [{"org.apache.cloudstack.storage.command.CreateObjectCommand":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"volume":{"uuid":"bcf7653a-33db-461a-9355-e5d518012679","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
> 172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f9486b
> "}},"name":"ROOT-189","size":85899345920,"path":"9deefbf6-86e6-4359-acb3-99e1aebcb359","volumeId":696,"vmName":"i-11-189-VM","accountId":11,"format":"VHD","id":696,"deviceId":0,"hypervisorType":"XenServer"},"parentSnapshotPath":"3a6e9e1a-fd95-4530-ae67-03a368b3e2fd","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"165fb777-4225-326a-bc48-f5b465f9486b","id":1,"poolType":"NetworkFilesystem","host":"172.30.36.51","path":"/vS02304090GCSP_NAS05","port":2049,"url":"NetworkFilesystem://
> 172.30.36.51//vS02304090GCSP_NAS05/?ROLE=Primary&STOREUUID=165fb777-4225-326a-bc48-f5b465f9486b"}},"vmName":"i-11-189-VM","name":"SAGXD02_ROOT-189_20150914090333","hypervisorType":"XenServer","id":6732,"quiescevm":false,"parents":["3a6e9e1a-fd95-4530-ae67-03a368b3e2fd"],"physicalSize":0}},"wait":0}}]
> }
> 2015-09-14 01:03:34,045 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: Executing request
> 2015-09-14 01:03:35,421 WARN  [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-333:ctx-c3e7c331) callHostPlugin failed for cmd: getVhdParent
> with args snapshotUuid: 3a6e9e1a-fd95-4530-ae67-03a368b3e2fd, isISCSI:
> false, primaryStorageSRUuid: a6a7f65a-a1d2-83e3-d3b0-f38792863fb6,  due to
> There was a failure communicating with the plugin.
> 2015-09-14 01:03:35,421 DEBUG [c.c.h.x.r.XenServerStorageProcessor]
> (DirectAgent-333:ctx-c3e7c331) Failed to get parent snapshot
> com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed for
> cmd: getVhdParent with args snapshotUuid:
> 3a6e9e1a-fd95-4530-ae67-03a368b3e2fd, isISCSI: false, primaryStorageSRUuid:
> a6a7f65a-a1d2-83e3-d3b0-f38792863fb6,  due to There was a failure
> communicating with the plugin.
>        at
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.callHostPlugin(CitrixResourceBase.java:4239)
>        at
> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.getVhdParent(XenServerStorageProcessor.java:879)
>        at
> com.cloud.hypervisor.xen.resource.XenServerStorageProcessor.createSnapshot(XenServerStorageProcessor.java:478)
>        at
> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:107)
>        at
> com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:52)
>        at
> com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:609)
> at
> com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
>        at
> com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
>        at
> com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
>        at
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>        at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>        at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>        at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>        at
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>        at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>        at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>        at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>        at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
>        at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
>        at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
>        at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>        at java.lang.Thread.run(Thread.java:701)
> 2015-09-14 01:03:35,421 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: Response Received:
> 2015-09-14 01:03:35,423 INFO  [c.c.a.m.ClusteredAgentManagerImpl]
> (DirectAgent-333:ctx-c3e7c331) Unable to find peer: 108371418365724
> 2015-09-14 01:03:35,424 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
> (DirectAgent-333:ctx-c3e7c331) Seq 1-457572529: MgmtId 108371418365724:
> Resp: Unable to route to peer: Seq 1-457572529:  { Ans: , MgmtId:
> 108371418365724, via: 1, Ver: v1, Flags: 10,
> [{"org.apache.cloudstack.storage.command.CreateObjectAnswer":{"data":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"c377e041-7ea9-40a2-9721-208b9a33b0c2","id":0,"quiescevm":false,"physicalSize":0}},"result":true,"wait":0}}]
> }
> 2015-09-14 01:03:38,934 WARN  [c.c.u.n.Link] (AgentManager-Selector:null)
> SSL: Fail to find the generated keystore. Loading fail-safe one to continue.
> 2015-09-14 01:03:39,458 DEBUG [c.c.a.m.AgentManagerImpl]
> (AgentManager-Handler-1:null) SeqA 2-3043178: Processing Seq 2-3043178:  {
> Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11,
> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":43,"_loadInfo":"{\n
> \"connections\": []\n}","wait":0}}] }
>
>
> Regards,
> rajasekhar.

Find out more about ShapeBlue and our range of CloudStack related services

IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>

This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.