You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users-cn@cloudstack.apache.org by 赵涛 <zh...@qq.com> on 2015/01/16 06:43:38 UTC

回复:cloudstack+kvm创建快照遇到问题,求助,谢谢!

cs什么版本




------------------ 原始邮件 ------------------
发件人: "廖延安";<li...@126.com>;
发送时间: 2015年1月16日(星期五) 中午11:45
收件人: "users-cn"<us...@cloudstack.apache.org>; 

主题: cloudstack+kvm创建快照遇到问题,求助,谢谢!



在cloudstack的web操作页面上为虚机的卷创建快照,出现报错,大牛们帮我看看,小弟不胜感激。


报错信息:
Failed to create snapshot due to an internal error creating snapshot for volume 3


查看/var/log/messages的信息有如下信息:
Jan 16 11:10:43 mgmt automount[2350]: lookup_read_master: lookup(nisplus): couldn't locate nis+ table auto.master
Jan 16 11:10:43 mgmt kernel: Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
Jan 16 11:10:43 mgmt rpc.mountd[2396]: Version 1.2.3 starting
Jan 16 11:10:43 mgmt kernel: NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
Jan 16 11:10:43 mgmt kernel: NFSD: starting 90-second grace period
Jan 16 11:10:44 mgmt mcelog: failed to prefill DIMM database from DMI data
Jan 16 11:10:48 mgmt abrtd: Init complete, entering main loop
Jan 16 11:11:34 mgmt kernel: IPMI message handler: BMC returned incorrect response, expected netfn 7 cmd 33, got netfn 7 cmd 34


查看/var/log/cloudstack/management/management-server.log的信息有如下错误:
2015-01-16 10:28:48,500 DEBUG [c.c.a.t.Request] (AgentManager-Handler-5:null) Seq 1-456589455: Processing:  { Ans: , MgmtId: 40376232520518, via: 1, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Failed to backup a7e5366c-95ef-4a67-ae81-9ec0618a04dc for disk /mnt/d264fc96-fff7-3ce1-95c4-84a87af65f31/91e9d97b-ba5b-41a1-9353-797067744db7 to /mnt/9043d5c8-71f2-3772-8b0f-ba217122cb46/snapshots/2/3","wait":0}}] }
2015-01-16 10:28:48,500 DEBUG [c.c.a.t.Request] (Job-Executor-10:ctx-a18662a1 ctx-e67f51df) Seq 1-456589455: Received:  { Ans: , MgmtId: 40376232520518, via: 1, Ver: v1, Flags: 10, { CopyCmdAnswer } }
2015-01-16 10:28:48,902 DEBUG [c.c.s.s.SnapshotManagerImpl] (Job-Executor-10:ctx-a18662a1 ctx-e67f51df) Failed to create snapshot
com.cloud.utils.exception.CloudRuntimeException: Failed to backup a7e5366c-95ef-4a67-ae81-9ec0618a04dc for disk /mnt/d264fc96-fff7-3ce1-95c4-84a87af65f31/91e9d97b-ba5b-41a1-9353-797067744db7 to /mnt/9043d5c8-71f2-3772-8b0f-ba217122cb46/snapshots/2/3
        at org.apache.cloudstack.storage.snapshot.SnapshotServiceImpl.backupSnapshot(SnapshotServiceImpl.java:292)
        at org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.backupSnapshot(XenserverSnapshotStrategy.java:142)
        at org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.takeSnapshot(XenserverSnapshotStrategy.java:301)
        at com.cloud.storage.snapshot.SnapshotManagerImpl.takeSnapshot(SnapshotManagerImpl.java:945)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
        at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
        at com.sun.proxy.$Proxy160.takeSnapshot(Unknown Source)
        at org.apache.cloudstack.storage.volume.VolumeServiceImpl.takeSnapshot(VolumeServiceImpl.java:1381)
        at com.cloud.storage.VolumeApiServiceImpl.orchestrateTakeVolumeSnapshot(VolumeApiServiceImpl.java:1783)
        at com.cloud.storage.VolumeApiServiceImpl.takeSnapshot(VolumeApiServiceImpl.java:1724)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
        at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
        at com.sun.proxy.$Proxy196.takeSnapshot(Unknown Source)
        at org.apache.cloudstack.api.command.user.snapshot.CreateSnapshotCmd.execute(CreateSnapshotCmd.java:181)
        at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161)
        at com.cloud.api.ApiAsyncJobDispatcher.runJobInContext(ApiAsyncJobDispatcher.java:109)
        at com.cloud.api.ApiAsyncJobDispatcher$1.run(ApiAsyncJobDispatcher.java:66)
        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
        at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:63)
        at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:509)
        at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
        at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:744)
2015-01-16 10:28:49,044 DEBUG [o.a.c.s.v.VolumeServiceImpl] (Job-Executor-10:ctx-a18662a1 ctx-e67f51df) Take snapshot: 3 failed
com.cloud.utils.exception.CloudRuntimeException: Failed to create snapshot
        at com.cloud.storage.snapshot.SnapshotManagerImpl.takeSnapshot(SnapshotManagerImpl.java:963)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
        at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
        at com.sun.proxy.$Proxy160.takeSnapshot(Unknown Source)
        at org.apache.cloudstack.storage.volume.VolumeServiceImpl.takeSnapshot(VolumeServiceImpl.java:1381)
        at com.cloud.storage.VolumeApiServiceImpl.orchestrateTakeVolumeSnapshot(VolumeApiServiceImpl.java:1783)
        at com.cloud.storage.VolumeApiServiceImpl.takeSnapshot(VolumeApiServiceImpl.java:1724)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
        at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
        at com.sun.proxy.$Proxy196.takeSnapshot(Unknown Source)
        at org.apache.cloudstack.api.command.user.snapshot.CreateSnapshotCmd.execute(CreateSnapshotCmd.java:181)
        at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161)
        at com.cloud.api.ApiAsyncJobDispatcher.runJobInContext(ApiAsyncJobDispatcher.java:109)
        at com.cloud.api.ApiAsyncJobDispatcher$1.run(ApiAsyncJobDispatcher.java:66)
        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
        at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:63)
        at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:509)
        at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
        at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:744)
Caused by: com.cloud.utils.exception.CloudRuntimeException: Failed to backup a7e5366c-95ef-4a67-ae81-9ec0618a04dc for disk /mnt/d264fc96-fff7-3ce1-95c4-84a87af65f31/91e9d97b-ba5b-41a1-9353-797067744db7 to /mnt/9043d5c8-71f2-3772-8b0f-ba217122cb46/snapshots/2/3
        at org.apache.cloudstack.storage.snapshot.SnapshotServiceImpl.backupSnapshot(SnapshotServiceImpl.java:292)
        at org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.backupSnapshot(XenserverSnapshotStrategy.java:142)
        at org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.takeSnapshot(XenserverSnapshotStrategy.java:301)
        at com.cloud.storage.snapshot.SnapshotManagerImpl.takeSnapshot(SnapshotManagerImpl.java:945)
        ... 44 more
2015-01-16 10:28:49,045 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Job-Executor-10:ctx-a18662a1) Complete async job-14, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Failed to create snapshot due to an internal error creating snapshot for volume 3"}
2015-01-16 10:28:49,119 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Job-Executor-10:ctx-a18662a1) Done executing org.apache.cloudstack.api.command.user.snapshot.CreateSnapshotCmd for job-14
2015-01-16 10:28:49,153 INFO  [o.a.c.f.j.i.AsyncJobMonitor] (Job-Executor-10:ctx-a18662a1) Remove job-14 from job monitoring
2015-01-16 10:28:49,565 DEBUG [c.c.a.ApiServlet] (catalina-exec-16:ctx-508b1417) ===START===  192.168.220.37 -- GET  command=queryAsyncJobResult&jobId=7461e7ef-93c0-47a6-83fe-b142593d42b6&response=json&sessionkey=lwh%2Ba7QV3jvDiEdPg2i44spsMUM%3D&_=1421375410127
2015-01-16 10:28:49,665 DEBUG [c.c.a.ApiServlet] (catalina-exec-16:ctx-508b1417 ctx-b091b789) ===END===  192.168.220.37 -- GET  command=queryAsyncJobResult&jobId=7461e7ef-93c0-47a6-83fe-b142593d42b6&response=json&sessionkey=lwh%2Ba7QV3jvDiEdPg2i44spsMUM%3D&_=1421375410127
2015-01-16 10:28:50,348 DEBUG [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-293af423) Zone 1 is ready to launch secondary storage VM
2015-01-16 10:28:50,391 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-2fb16202) Zone 1 is ready to launch console proxy
2015-01-16 10:28:52,496 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-6:null) SeqA 2-520: Processing Seq 2-520:  { Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n  \"connections\": []\n}","wait":0}}] }
2015-01-16 10:28:52,570 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-6:null) SeqA 2-520: Sending Seq 2-520:  { Ans: , MgmtId: 40376232520518, via: 2, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2015-01-16 10:28:53,410 DEBUG [c.c.s.StatsCollector] (StatsCollector-3:ctx-cd96849a) StorageCollector is running...
2015-01-16 10:28:53,475 DEBUG [c.c.a.t.Request] (StatsCollector-3:ctx-cd96849a) Seq 3-1162870869: Received:  { Ans: , MgmtId: 40376232520518, via: 3, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
2015-01-16 10:28:53,519 DEBUG [c.c.a.t.Request] (StatsCollector-3:ctx-cd96849a) Seq 1-456589456: Received:  { Ans: , MgmtId: 40376232520518, via: 1, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
2015-01-16 10:28:57,504 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-9:null) SeqA 2-521: Processing Seq 2-521:  { Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n  \"connections\": []\n}","wait":0}}] }

Re:回复:cloudstack+kvm创建快照遇到问题,求助,谢谢!

Posted by 廖延安 <li...@126.com>.
问题解决,非常感谢








At 2015-01-16 15:15:52, "赵涛" <zh...@qq.com> wrote:
>根据这个方法https://issues.apache.org/jira/browse/CLOUDSTACK-7300
>问题应该能解决,应该是KVM宿主机qemu-img的版本问题:  
>Downgrounding qemu-img to CentOS 6.4 version corrects this problem. Commands  to do so are below:
> 
>mkdir cloud-qemu-img
>cd cloud-qemu-img
>wget http://vault.centos.org/6.4/updates/x86_64/Packages/qemu-img-0.12.1.2-2.355.el6_4_4.1.x86_64.rpm
>rpm2cpio  qemu-img-0.12.1.2-2.355.el6_4_4.1.x86_64.rpm |cpio -idmv
>cp  ./usr/bin/qemu-img /usr/bin/cloud-qemu-img‍
>
>
>
>
>
>------------------ 原始邮件 ------------------
>发件人: "廖延安";<li...@126.com>;
>发送时间: 2015年1月16日(星期五) 中午1:50
>收件人: "users-cn"<us...@cloudstack.apache.org>; 
>
>主题: Re:回复:cloudstack+kvm创建快照遇到问题,求助,谢谢!
>
>
>
>版本是4.3.1
>
>
>
>
>
>
>
>
>At 2015-01-16 13:43:38, "赵涛" <zh...@qq.com> wrote:
>>cs什么版本
>>
>>
>>
>>
>>------------------ 原始邮件 ------------------
>>发件人: "廖延安";<li...@126.com>;
>>发送时间: 2015年1月16日(星期五) 中午11:45
>>收件人: "users-cn"<us...@cloudstack.apache.org>; 
>>
>>主题: cloudstack+kvm创建快照遇到问题,求助,谢谢!
>>
>>
>>
>>在cloudstack的web操作页面上为虚机的卷创建快照,出现报错,大牛们帮我看看,小弟不胜感激。
>>
>>
>>报错信息:
>>Failed to create snapshot due to an internal error creating snapshot for volume 3
>>
>>
>>查看/var/log/messages的信息有如下信息:
>>Jan 16 11:10:43 mgmt automount[2350]: lookup_read_master: lookup(nisplus): couldn't locate nis+ table auto.master
>>Jan 16 11:10:43 mgmt kernel: Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
>>Jan 16 11:10:43 mgmt rpc.mountd[2396]: Version 1.2.3 starting
>>Jan 16 11:10:43 mgmt kernel: NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
>>Jan 16 11:10:43 mgmt kernel: NFSD: starting 90-second grace period
>>Jan 16 11:10:44 mgmt mcelog: failed to prefill DIMM database from DMI data
>>Jan 16 11:10:48 mgmt abrtd: Init complete, entering main loop
>>Jan 16 11:11:34 mgmt kernel: IPMI message handler: BMC returned incorrect response, expected netfn 7 cmd 33, got netfn 7 cmd 34
>>
>>
>>查看/var/log/cloudstack/management/management-server.log的信息有如下错误:
>>2015-01-16 10:28:48,500 DEBUG [c.c.a.t.Request] (AgentManager-Handler-5:null) Seq 1-456589455: Processing:  { Ans: , MgmtId: 40376232520518, via: 1, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Failed to backup a7e5366c-95ef-4a67-ae81-9ec0618a04dc for disk /mnt/d264fc96-fff7-3ce1-95c4-84a87af65f31/91e9d97b-ba5b-41a1-9353-797067744db7 to /mnt/9043d5c8-71f2-3772-8b0f-ba217122cb46/snapshots/2/3","wait":0}}] }
>>2015-01-16 10:28:48,500 DEBUG [c.c.a.t.Request] (Job-Executor-10:ctx-a18662a1 ctx-e67f51df) Seq 1-456589455: Received:  { Ans: , MgmtId: 40376232520518, via: 1, Ver: v1, Flags: 10, { CopyCmdAnswer } }
>>2015-01-16 10:28:48,902 DEBUG [c.c.s.s.SnapshotManagerImpl] (Job-Executor-10:ctx-a18662a1 ctx-e67f51df) Failed to create snapshot
>>com.cloud.utils.exception.CloudRuntimeException: Failed to backup a7e5366c-95ef-4a67-ae81-9ec0618a04dc for disk /mnt/d264fc96-fff7-3ce1-95c4-84a87af65f31/91e9d97b-ba5b-41a1-9353-797067744db7 to /mnt/9043d5c8-71f2-3772-8b0f-ba217122cb46/snapshots/2/3
>>        at org.apache.cloudstack.storage.snapshot.SnapshotServiceImpl.backupSnapshot(SnapshotServiceImpl.java:292)
>>        at org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.backupSnapshot(XenserverSnapshotStrategy.java:142)
>>        at org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.takeSnapshot(XenserverSnapshotStrategy.java:301)
>>        at com.cloud.storage.snapshot.SnapshotManagerImpl.takeSnapshot(SnapshotManagerImpl.java:945)
>>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>        at java.lang.reflect.Method.invoke(Method.java:606)
>>        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
>>        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
>>        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
>>        at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
>>        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
>>        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
>>        at com.sun.proxy.$Proxy160.takeSnapshot(Unknown Source)
>>        at org.apache.cloudstack.storage.volume.VolumeServiceImpl.takeSnapshot(VolumeServiceImpl.java:1381)
>>        at com.cloud.storage.VolumeApiServiceImpl.orchestrateTakeVolumeSnapshot(VolumeApiServiceImpl.java:1783)
>>        at com.cloud.storage.VolumeApiServiceImpl.takeSnapshot(VolumeApiServiceImpl.java:1724)
>>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>        at java.lang.reflect.Method.invoke(Method.java:606)
>>        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
>>        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
>>        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
>>        at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
>>        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
>>        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
>>        at com.sun.proxy.$Proxy196.takeSnapshot(Unknown Source)
>>        at org.apache.cloudstack.api.command.user.snapshot.CreateSnapshotCmd.execute(CreateSnapshotCmd.java:181)
>>        at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161)
>>        at com.cloud.api.ApiAsyncJobDispatcher.runJobInContext(ApiAsyncJobDispatcher.java:109)
>>        at com.cloud.api.ApiAsyncJobDispatcher$1.run(ApiAsyncJobDispatcher.java:66)
>>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>>        at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:63)
>>        at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:509)
>>        at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>>        at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>>        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>        at java.lang.Thread.run(Thread.java:744)
>>2015-01-16 10:28:49,044 DEBUG [o.a.c.s.v.VolumeServiceImpl] (Job-Executor-10:ctx-a18662a1 ctx-e67f51df) Take snapshot: 3 failed
>>com.cloud.utils.exception.CloudRuntimeException: Failed to create snapshot
>>        at com.cloud.storage.snapshot.SnapshotManagerImpl.takeSnapshot(SnapshotManagerImpl.java:963)
>>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>        at java.lang.reflect.Method.invoke(Method.java:606)
>>        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
>>        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
>>        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
>>        at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
>>        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
>>        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
>>        at com.sun.proxy.$Proxy160.takeSnapshot(Unknown Source)
>>        at org.apache.cloudstack.storage.volume.VolumeServiceImpl.takeSnapshot(VolumeServiceImpl.java:1381)
>>        at com.cloud.storage.VolumeApiServiceImpl.orchestrateTakeVolumeSnapshot(VolumeApiServiceImpl.java:1783)
>>        at com.cloud.storage.VolumeApiServiceImpl.takeSnapshot(VolumeApiServiceImpl.java:1724)
>>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>        at java.lang.reflect.Method.invoke(Method.java:606)
>>        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
>>        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
>>        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
>>        at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
>>        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
>>        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
>>        at com.sun.proxy.$Proxy196.takeSnapshot(Unknown Source)
>>        at org.apache.cloudstack.api.command.user.snapshot.CreateSnapshotCmd.execute(CreateSnapshotCmd.java:181)
>>        at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161)
>>        at com.cloud.api.ApiAsyncJobDispatcher.runJobInContext(ApiAsyncJobDispatcher.java:109)
>>        at com.cloud.api.ApiAsyncJobDispatcher$1.run(ApiAsyncJobDispatcher.java:66)
>>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>>        at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:63)
>>        at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:509)
>>        at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>>        at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>>        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>        at java.lang.Thread.run(Thread.java:744)
>>Caused by: com.cloud.utils.exception.CloudRuntimeException: Failed to backup a7e5366c-95ef-4a67-ae81-9ec0618a04dc for disk /mnt/d264fc96-fff7-3ce1-95c4-84a87af65f31/91e9d97b-ba5b-41a1-9353-797067744db7 to /mnt/9043d5c8-71f2-3772-8b0f-ba217122cb46/snapshots/2/3
>>        at org.apache.cloudstack.storage.snapshot.SnapshotServiceImpl.backupSnapshot(SnapshotServiceImpl.java:292)
>>        at org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.backupSnapshot(XenserverSnapshotStrategy.java:142)
>>        at org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.takeSnapshot(XenserverSnapshotStrategy.java:301)
>>        at com.cloud.storage.snapshot.SnapshotManagerImpl.takeSnapshot(SnapshotManagerImpl.java:945)
>>        ... 44 more
>>2015-01-16 10:28:49,045 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Job-Executor-10:ctx-a18662a1) Complete async job-14, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Failed to create snapshot due to an internal error creating snapshot for volume 3"}
>>2015-01-16 10:28:49,119 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Job-Executor-10:ctx-a18662a1) Done executing org.apache.cloudstack.api.command.user.snapshot.CreateSnapshotCmd for job-14
>>2015-01-16 10:28:49,153 INFO  [o.a.c.f.j.i.AsyncJobMonitor] (Job-Executor-10:ctx-a18662a1) Remove job-14 from job monitoring
>>2015-01-16 10:28:49,565 DEBUG [c.c.a.ApiServlet] (catalina-exec-16:ctx-508b1417) ===START===  192.168.220.37 -- GET  command=queryAsyncJobResult&jobId=7461e7ef-93c0-47a6-83fe-b142593d42b6&response=json&sessionkey=lwh%2Ba7QV3jvDiEdPg2i44spsMUM%3D&_=1421375410127
>>2015-01-16 10:28:49,665 DEBUG [c.c.a.ApiServlet] (catalina-exec-16:ctx-508b1417 ctx-b091b789) ===END===  192.168.220.37 -- GET  command=queryAsyncJobResult&jobId=7461e7ef-93c0-47a6-83fe-b142593d42b6&response=json&sessionkey=lwh%2Ba7QV3jvDiEdPg2i44spsMUM%3D&_=1421375410127
>>2015-01-16 10:28:50,348 DEBUG [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-293af423) Zone 1 is ready to launch secondary storage VM
>>2015-01-16 10:28:50,391 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-2fb16202) Zone 1 is ready to launch console proxy
>>2015-01-16 10:28:52,496 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-6:null) SeqA 2-520: Processing Seq 2-520:  { Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n  \"connections\": []\n}","wait":0}}] }
>>2015-01-16 10:28:52,570 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-6:null) SeqA 2-520: Sending Seq 2-520:  { Ans: , MgmtId: 40376232520518, via: 2, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
>>2015-01-16 10:28:53,410 DEBUG [c.c.s.StatsCollector] (StatsCollector-3:ctx-cd96849a) StorageCollector is running...
>>2015-01-16 10:28:53,475 DEBUG [c.c.a.t.Request] (StatsCollector-3:ctx-cd96849a) Seq 3-1162870869: Received:  { Ans: , MgmtId: 40376232520518, via: 3, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
>>2015-01-16 10:28:53,519 DEBUG [c.c.a.t.Request] (StatsCollector-3:ctx-cd96849a) Seq 1-456589456: Received:  { Ans: , MgmtId: 40376232520518, via: 1, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
>>2015-01-16 10:28:57,504 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-9:null) SeqA 2-521: Processing Seq 2-521:  { Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n  \"connections\": []\n}","wait":0}}] }

回复:cloudstack+kvm创建快照遇到问题,求助,谢谢!

Posted by 赵涛 <zh...@qq.com>.
根据这个方法https://issues.apache.org/jira/browse/CLOUDSTACK-7300
问题应该能解决,应该是KVM宿主机qemu-img的版本问题:  
Downgrounding qemu-img to CentOS 6.4 version corrects this problem. Commands  to do so are below:
 
mkdir cloud-qemu-img
cd cloud-qemu-img
wget http://vault.centos.org/6.4/updates/x86_64/Packages/qemu-img-0.12.1.2-2.355.el6_4_4.1.x86_64.rpm
rpm2cpio  qemu-img-0.12.1.2-2.355.el6_4_4.1.x86_64.rpm |cpio -idmv
cp  ./usr/bin/qemu-img /usr/bin/cloud-qemu-img‍





------------------ 原始邮件 ------------------
发件人: "廖延安";<li...@126.com>;
发送时间: 2015年1月16日(星期五) 中午1:50
收件人: "users-cn"<us...@cloudstack.apache.org>; 

主题: Re:回复:cloudstack+kvm创建快照遇到问题,求助,谢谢!



版本是4.3.1








At 2015-01-16 13:43:38, "赵涛" <zh...@qq.com> wrote:
>cs什么版本
>
>
>
>
>------------------ 原始邮件 ------------------
>发件人: "廖延安";<li...@126.com>;
>发送时间: 2015年1月16日(星期五) 中午11:45
>收件人: "users-cn"<us...@cloudstack.apache.org>; 
>
>主题: cloudstack+kvm创建快照遇到问题,求助,谢谢!
>
>
>
>在cloudstack的web操作页面上为虚机的卷创建快照,出现报错,大牛们帮我看看,小弟不胜感激。
>
>
>报错信息:
>Failed to create snapshot due to an internal error creating snapshot for volume 3
>
>
>查看/var/log/messages的信息有如下信息:
>Jan 16 11:10:43 mgmt automount[2350]: lookup_read_master: lookup(nisplus): couldn't locate nis+ table auto.master
>Jan 16 11:10:43 mgmt kernel: Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
>Jan 16 11:10:43 mgmt rpc.mountd[2396]: Version 1.2.3 starting
>Jan 16 11:10:43 mgmt kernel: NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
>Jan 16 11:10:43 mgmt kernel: NFSD: starting 90-second grace period
>Jan 16 11:10:44 mgmt mcelog: failed to prefill DIMM database from DMI data
>Jan 16 11:10:48 mgmt abrtd: Init complete, entering main loop
>Jan 16 11:11:34 mgmt kernel: IPMI message handler: BMC returned incorrect response, expected netfn 7 cmd 33, got netfn 7 cmd 34
>
>
>查看/var/log/cloudstack/management/management-server.log的信息有如下错误:
>2015-01-16 10:28:48,500 DEBUG [c.c.a.t.Request] (AgentManager-Handler-5:null) Seq 1-456589455: Processing:  { Ans: , MgmtId: 40376232520518, via: 1, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Failed to backup a7e5366c-95ef-4a67-ae81-9ec0618a04dc for disk /mnt/d264fc96-fff7-3ce1-95c4-84a87af65f31/91e9d97b-ba5b-41a1-9353-797067744db7 to /mnt/9043d5c8-71f2-3772-8b0f-ba217122cb46/snapshots/2/3","wait":0}}] }
>2015-01-16 10:28:48,500 DEBUG [c.c.a.t.Request] (Job-Executor-10:ctx-a18662a1 ctx-e67f51df) Seq 1-456589455: Received:  { Ans: , MgmtId: 40376232520518, via: 1, Ver: v1, Flags: 10, { CopyCmdAnswer } }
>2015-01-16 10:28:48,902 DEBUG [c.c.s.s.SnapshotManagerImpl] (Job-Executor-10:ctx-a18662a1 ctx-e67f51df) Failed to create snapshot
>com.cloud.utils.exception.CloudRuntimeException: Failed to backup a7e5366c-95ef-4a67-ae81-9ec0618a04dc for disk /mnt/d264fc96-fff7-3ce1-95c4-84a87af65f31/91e9d97b-ba5b-41a1-9353-797067744db7 to /mnt/9043d5c8-71f2-3772-8b0f-ba217122cb46/snapshots/2/3
>        at org.apache.cloudstack.storage.snapshot.SnapshotServiceImpl.backupSnapshot(SnapshotServiceImpl.java:292)
>        at org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.backupSnapshot(XenserverSnapshotStrategy.java:142)
>        at org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.takeSnapshot(XenserverSnapshotStrategy.java:301)
>        at com.cloud.storage.snapshot.SnapshotManagerImpl.takeSnapshot(SnapshotManagerImpl.java:945)
>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>        at java.lang.reflect.Method.invoke(Method.java:606)
>        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
>        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
>        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
>        at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
>        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
>        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
>        at com.sun.proxy.$Proxy160.takeSnapshot(Unknown Source)
>        at org.apache.cloudstack.storage.volume.VolumeServiceImpl.takeSnapshot(VolumeServiceImpl.java:1381)
>        at com.cloud.storage.VolumeApiServiceImpl.orchestrateTakeVolumeSnapshot(VolumeApiServiceImpl.java:1783)
>        at com.cloud.storage.VolumeApiServiceImpl.takeSnapshot(VolumeApiServiceImpl.java:1724)
>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>        at java.lang.reflect.Method.invoke(Method.java:606)
>        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
>        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
>        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
>        at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
>        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
>        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
>        at com.sun.proxy.$Proxy196.takeSnapshot(Unknown Source)
>        at org.apache.cloudstack.api.command.user.snapshot.CreateSnapshotCmd.execute(CreateSnapshotCmd.java:181)
>        at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161)
>        at com.cloud.api.ApiAsyncJobDispatcher.runJobInContext(ApiAsyncJobDispatcher.java:109)
>        at com.cloud.api.ApiAsyncJobDispatcher$1.run(ApiAsyncJobDispatcher.java:66)
>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>        at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:63)
>        at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:509)
>        at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>        at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>        at java.lang.Thread.run(Thread.java:744)
>2015-01-16 10:28:49,044 DEBUG [o.a.c.s.v.VolumeServiceImpl] (Job-Executor-10:ctx-a18662a1 ctx-e67f51df) Take snapshot: 3 failed
>com.cloud.utils.exception.CloudRuntimeException: Failed to create snapshot
>        at com.cloud.storage.snapshot.SnapshotManagerImpl.takeSnapshot(SnapshotManagerImpl.java:963)
>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>        at java.lang.reflect.Method.invoke(Method.java:606)
>        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
>        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
>        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
>        at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
>        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
>        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
>        at com.sun.proxy.$Proxy160.takeSnapshot(Unknown Source)
>        at org.apache.cloudstack.storage.volume.VolumeServiceImpl.takeSnapshot(VolumeServiceImpl.java:1381)
>        at com.cloud.storage.VolumeApiServiceImpl.orchestrateTakeVolumeSnapshot(VolumeApiServiceImpl.java:1783)
>        at com.cloud.storage.VolumeApiServiceImpl.takeSnapshot(VolumeApiServiceImpl.java:1724)
>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>        at java.lang.reflect.Method.invoke(Method.java:606)
>        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
>        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
>        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
>        at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
>        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
>        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
>        at com.sun.proxy.$Proxy196.takeSnapshot(Unknown Source)
>        at org.apache.cloudstack.api.command.user.snapshot.CreateSnapshotCmd.execute(CreateSnapshotCmd.java:181)
>        at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161)
>        at com.cloud.api.ApiAsyncJobDispatcher.runJobInContext(ApiAsyncJobDispatcher.java:109)
>        at com.cloud.api.ApiAsyncJobDispatcher$1.run(ApiAsyncJobDispatcher.java:66)
>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>        at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:63)
>        at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:509)
>        at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>        at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>        at java.lang.Thread.run(Thread.java:744)
>Caused by: com.cloud.utils.exception.CloudRuntimeException: Failed to backup a7e5366c-95ef-4a67-ae81-9ec0618a04dc for disk /mnt/d264fc96-fff7-3ce1-95c4-84a87af65f31/91e9d97b-ba5b-41a1-9353-797067744db7 to /mnt/9043d5c8-71f2-3772-8b0f-ba217122cb46/snapshots/2/3
>        at org.apache.cloudstack.storage.snapshot.SnapshotServiceImpl.backupSnapshot(SnapshotServiceImpl.java:292)
>        at org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.backupSnapshot(XenserverSnapshotStrategy.java:142)
>        at org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.takeSnapshot(XenserverSnapshotStrategy.java:301)
>        at com.cloud.storage.snapshot.SnapshotManagerImpl.takeSnapshot(SnapshotManagerImpl.java:945)
>        ... 44 more
>2015-01-16 10:28:49,045 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Job-Executor-10:ctx-a18662a1) Complete async job-14, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Failed to create snapshot due to an internal error creating snapshot for volume 3"}
>2015-01-16 10:28:49,119 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Job-Executor-10:ctx-a18662a1) Done executing org.apache.cloudstack.api.command.user.snapshot.CreateSnapshotCmd for job-14
>2015-01-16 10:28:49,153 INFO  [o.a.c.f.j.i.AsyncJobMonitor] (Job-Executor-10:ctx-a18662a1) Remove job-14 from job monitoring
>2015-01-16 10:28:49,565 DEBUG [c.c.a.ApiServlet] (catalina-exec-16:ctx-508b1417) ===START===  192.168.220.37 -- GET  command=queryAsyncJobResult&jobId=7461e7ef-93c0-47a6-83fe-b142593d42b6&response=json&sessionkey=lwh%2Ba7QV3jvDiEdPg2i44spsMUM%3D&_=1421375410127
>2015-01-16 10:28:49,665 DEBUG [c.c.a.ApiServlet] (catalina-exec-16:ctx-508b1417 ctx-b091b789) ===END===  192.168.220.37 -- GET  command=queryAsyncJobResult&jobId=7461e7ef-93c0-47a6-83fe-b142593d42b6&response=json&sessionkey=lwh%2Ba7QV3jvDiEdPg2i44spsMUM%3D&_=1421375410127
>2015-01-16 10:28:50,348 DEBUG [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-293af423) Zone 1 is ready to launch secondary storage VM
>2015-01-16 10:28:50,391 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-2fb16202) Zone 1 is ready to launch console proxy
>2015-01-16 10:28:52,496 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-6:null) SeqA 2-520: Processing Seq 2-520:  { Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n  \"connections\": []\n}","wait":0}}] }
>2015-01-16 10:28:52,570 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-6:null) SeqA 2-520: Sending Seq 2-520:  { Ans: , MgmtId: 40376232520518, via: 2, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
>2015-01-16 10:28:53,410 DEBUG [c.c.s.StatsCollector] (StatsCollector-3:ctx-cd96849a) StorageCollector is running...
>2015-01-16 10:28:53,475 DEBUG [c.c.a.t.Request] (StatsCollector-3:ctx-cd96849a) Seq 3-1162870869: Received:  { Ans: , MgmtId: 40376232520518, via: 3, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
>2015-01-16 10:28:53,519 DEBUG [c.c.a.t.Request] (StatsCollector-3:ctx-cd96849a) Seq 1-456589456: Received:  { Ans: , MgmtId: 40376232520518, via: 1, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
>2015-01-16 10:28:57,504 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-9:null) SeqA 2-521: Processing Seq 2-521:  { Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n  \"connections\": []\n}","wait":0}}] }

Re:回复:cloudstack+kvm创建快照遇到问题,求助,谢谢!

Posted by 廖延安 <li...@126.com>.
版本是4.3.1








At 2015-01-16 13:43:38, "赵涛" <zh...@qq.com> wrote:
>cs什么版本
>
>
>
>
>------------------ 原始邮件 ------------------
>发件人: "廖延安";<li...@126.com>;
>发送时间: 2015年1月16日(星期五) 中午11:45
>收件人: "users-cn"<us...@cloudstack.apache.org>; 
>
>主题: cloudstack+kvm创建快照遇到问题,求助,谢谢!
>
>
>
>在cloudstack的web操作页面上为虚机的卷创建快照,出现报错,大牛们帮我看看,小弟不胜感激。
>
>
>报错信息:
>Failed to create snapshot due to an internal error creating snapshot for volume 3
>
>
>查看/var/log/messages的信息有如下信息:
>Jan 16 11:10:43 mgmt automount[2350]: lookup_read_master: lookup(nisplus): couldn't locate nis+ table auto.master
>Jan 16 11:10:43 mgmt kernel: Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
>Jan 16 11:10:43 mgmt rpc.mountd[2396]: Version 1.2.3 starting
>Jan 16 11:10:43 mgmt kernel: NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
>Jan 16 11:10:43 mgmt kernel: NFSD: starting 90-second grace period
>Jan 16 11:10:44 mgmt mcelog: failed to prefill DIMM database from DMI data
>Jan 16 11:10:48 mgmt abrtd: Init complete, entering main loop
>Jan 16 11:11:34 mgmt kernel: IPMI message handler: BMC returned incorrect response, expected netfn 7 cmd 33, got netfn 7 cmd 34
>
>
>查看/var/log/cloudstack/management/management-server.log的信息有如下错误:
>2015-01-16 10:28:48,500 DEBUG [c.c.a.t.Request] (AgentManager-Handler-5:null) Seq 1-456589455: Processing:  { Ans: , MgmtId: 40376232520518, via: 1, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Failed to backup a7e5366c-95ef-4a67-ae81-9ec0618a04dc for disk /mnt/d264fc96-fff7-3ce1-95c4-84a87af65f31/91e9d97b-ba5b-41a1-9353-797067744db7 to /mnt/9043d5c8-71f2-3772-8b0f-ba217122cb46/snapshots/2/3","wait":0}}] }
>2015-01-16 10:28:48,500 DEBUG [c.c.a.t.Request] (Job-Executor-10:ctx-a18662a1 ctx-e67f51df) Seq 1-456589455: Received:  { Ans: , MgmtId: 40376232520518, via: 1, Ver: v1, Flags: 10, { CopyCmdAnswer } }
>2015-01-16 10:28:48,902 DEBUG [c.c.s.s.SnapshotManagerImpl] (Job-Executor-10:ctx-a18662a1 ctx-e67f51df) Failed to create snapshot
>com.cloud.utils.exception.CloudRuntimeException: Failed to backup a7e5366c-95ef-4a67-ae81-9ec0618a04dc for disk /mnt/d264fc96-fff7-3ce1-95c4-84a87af65f31/91e9d97b-ba5b-41a1-9353-797067744db7 to /mnt/9043d5c8-71f2-3772-8b0f-ba217122cb46/snapshots/2/3
>        at org.apache.cloudstack.storage.snapshot.SnapshotServiceImpl.backupSnapshot(SnapshotServiceImpl.java:292)
>        at org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.backupSnapshot(XenserverSnapshotStrategy.java:142)
>        at org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.takeSnapshot(XenserverSnapshotStrategy.java:301)
>        at com.cloud.storage.snapshot.SnapshotManagerImpl.takeSnapshot(SnapshotManagerImpl.java:945)
>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>        at java.lang.reflect.Method.invoke(Method.java:606)
>        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
>        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
>        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
>        at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
>        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
>        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
>        at com.sun.proxy.$Proxy160.takeSnapshot(Unknown Source)
>        at org.apache.cloudstack.storage.volume.VolumeServiceImpl.takeSnapshot(VolumeServiceImpl.java:1381)
>        at com.cloud.storage.VolumeApiServiceImpl.orchestrateTakeVolumeSnapshot(VolumeApiServiceImpl.java:1783)
>        at com.cloud.storage.VolumeApiServiceImpl.takeSnapshot(VolumeApiServiceImpl.java:1724)
>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>        at java.lang.reflect.Method.invoke(Method.java:606)
>        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
>        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
>        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
>        at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
>        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
>        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
>        at com.sun.proxy.$Proxy196.takeSnapshot(Unknown Source)
>        at org.apache.cloudstack.api.command.user.snapshot.CreateSnapshotCmd.execute(CreateSnapshotCmd.java:181)
>        at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161)
>        at com.cloud.api.ApiAsyncJobDispatcher.runJobInContext(ApiAsyncJobDispatcher.java:109)
>        at com.cloud.api.ApiAsyncJobDispatcher$1.run(ApiAsyncJobDispatcher.java:66)
>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>        at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:63)
>        at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:509)
>        at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>        at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>        at java.lang.Thread.run(Thread.java:744)
>2015-01-16 10:28:49,044 DEBUG [o.a.c.s.v.VolumeServiceImpl] (Job-Executor-10:ctx-a18662a1 ctx-e67f51df) Take snapshot: 3 failed
>com.cloud.utils.exception.CloudRuntimeException: Failed to create snapshot
>        at com.cloud.storage.snapshot.SnapshotManagerImpl.takeSnapshot(SnapshotManagerImpl.java:963)
>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>        at java.lang.reflect.Method.invoke(Method.java:606)
>        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
>        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
>        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
>        at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
>        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
>        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
>        at com.sun.proxy.$Proxy160.takeSnapshot(Unknown Source)
>        at org.apache.cloudstack.storage.volume.VolumeServiceImpl.takeSnapshot(VolumeServiceImpl.java:1381)
>        at com.cloud.storage.VolumeApiServiceImpl.orchestrateTakeVolumeSnapshot(VolumeApiServiceImpl.java:1783)
>        at com.cloud.storage.VolumeApiServiceImpl.takeSnapshot(VolumeApiServiceImpl.java:1724)
>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>        at java.lang.reflect.Method.invoke(Method.java:606)
>        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
>        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
>        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
>        at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
>        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
>        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
>        at com.sun.proxy.$Proxy196.takeSnapshot(Unknown Source)
>        at org.apache.cloudstack.api.command.user.snapshot.CreateSnapshotCmd.execute(CreateSnapshotCmd.java:181)
>        at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161)
>        at com.cloud.api.ApiAsyncJobDispatcher.runJobInContext(ApiAsyncJobDispatcher.java:109)
>        at com.cloud.api.ApiAsyncJobDispatcher$1.run(ApiAsyncJobDispatcher.java:66)
>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>        at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:63)
>        at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:509)
>        at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>        at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>        at java.lang.Thread.run(Thread.java:744)
>Caused by: com.cloud.utils.exception.CloudRuntimeException: Failed to backup a7e5366c-95ef-4a67-ae81-9ec0618a04dc for disk /mnt/d264fc96-fff7-3ce1-95c4-84a87af65f31/91e9d97b-ba5b-41a1-9353-797067744db7 to /mnt/9043d5c8-71f2-3772-8b0f-ba217122cb46/snapshots/2/3
>        at org.apache.cloudstack.storage.snapshot.SnapshotServiceImpl.backupSnapshot(SnapshotServiceImpl.java:292)
>        at org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.backupSnapshot(XenserverSnapshotStrategy.java:142)
>        at org.apache.cloudstack.storage.snapshot.XenserverSnapshotStrategy.takeSnapshot(XenserverSnapshotStrategy.java:301)
>        at com.cloud.storage.snapshot.SnapshotManagerImpl.takeSnapshot(SnapshotManagerImpl.java:945)
>        ... 44 more
>2015-01-16 10:28:49,045 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Job-Executor-10:ctx-a18662a1) Complete async job-14, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Failed to create snapshot due to an internal error creating snapshot for volume 3"}
>2015-01-16 10:28:49,119 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Job-Executor-10:ctx-a18662a1) Done executing org.apache.cloudstack.api.command.user.snapshot.CreateSnapshotCmd for job-14
>2015-01-16 10:28:49,153 INFO  [o.a.c.f.j.i.AsyncJobMonitor] (Job-Executor-10:ctx-a18662a1) Remove job-14 from job monitoring
>2015-01-16 10:28:49,565 DEBUG [c.c.a.ApiServlet] (catalina-exec-16:ctx-508b1417) ===START===  192.168.220.37 -- GET  command=queryAsyncJobResult&jobId=7461e7ef-93c0-47a6-83fe-b142593d42b6&response=json&sessionkey=lwh%2Ba7QV3jvDiEdPg2i44spsMUM%3D&_=1421375410127
>2015-01-16 10:28:49,665 DEBUG [c.c.a.ApiServlet] (catalina-exec-16:ctx-508b1417 ctx-b091b789) ===END===  192.168.220.37 -- GET  command=queryAsyncJobResult&jobId=7461e7ef-93c0-47a6-83fe-b142593d42b6&response=json&sessionkey=lwh%2Ba7QV3jvDiEdPg2i44spsMUM%3D&_=1421375410127
>2015-01-16 10:28:50,348 DEBUG [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-293af423) Zone 1 is ready to launch secondary storage VM
>2015-01-16 10:28:50,391 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-2fb16202) Zone 1 is ready to launch console proxy
>2015-01-16 10:28:52,496 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-6:null) SeqA 2-520: Processing Seq 2-520:  { Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n  \"connections\": []\n}","wait":0}}] }
>2015-01-16 10:28:52,570 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-6:null) SeqA 2-520: Sending Seq 2-520:  { Ans: , MgmtId: 40376232520518, via: 2, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
>2015-01-16 10:28:53,410 DEBUG [c.c.s.StatsCollector] (StatsCollector-3:ctx-cd96849a) StorageCollector is running...
>2015-01-16 10:28:53,475 DEBUG [c.c.a.t.Request] (StatsCollector-3:ctx-cd96849a) Seq 3-1162870869: Received:  { Ans: , MgmtId: 40376232520518, via: 3, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
>2015-01-16 10:28:53,519 DEBUG [c.c.a.t.Request] (StatsCollector-3:ctx-cd96849a) Seq 1-456589456: Received:  { Ans: , MgmtId: 40376232520518, via: 1, Ver: v1, Flags: 10, { GetStorageStatsAnswer } }
>2015-01-16 10:28:57,504 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-9:null) SeqA 2-521: Processing Seq 2-521:  { Cmd , MgmtId: -1, via: 2, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n  \"connections\": []\n}","wait":0}}] }