You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by Yesid Mora <ym...@o4it.com> on 2016/04/06 19:06:03 UTC
Problem Download Volumen VM
Hello guys, we have a problem when download a volumen and generate error the error is
"Failed to copy the volume from the source primary storage pool to secondary storage."
The version CS is 4.3.0 and VMware is hypervisor,the other error in VMware is "An error occurred while taking a snapshot: 30 (Read-only file system)."
And logs
2016-04-06 13:01:47,802 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-10:null) (logid:) SeqA 5-2069318: Sending Seq 5-2069318: { Ans: , MgmtId: 345050522867, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2016-04-06 13:01:50,095 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (AgentManager-Handler-11:null) (logid:) Seq 6-8459167475085518716: MgmtId 345050522808: Resp: Routing to peer
2016-04-06 13:01:50,651 DEBUG [c.c.a.ApiServlet] (catalina-exec-12:ctx-d165fa00) (logid:b91f9766) ===START=== 10.3.13.55 -- GET command=queryAsyncJobResult&jobId=57076c62-ccd6-423c-80a7-45e027166df0&response=json&sessionkey=PSk8fRP%2F5LYzX%2BXNRgiL%2FlOd5vs%3D&_=1459962066162
2016-04-06 13:01:50,675 DEBUG [c.c.a.ApiServlet] (catalina-exec-12:ctx-d165fa00 ctx-27d2aa04) (logid:b91f9766) ===END=== 10.3.13.55 -- GET command=queryAsyncJobResult&jobId=57076c62-ccd6-423c-80a7-45e027166df0&response=json&sessionkey=PSk8fRP%2F5LYzX%2BXNRgiL%2FlOd5vs%3D&_=1459962066162
2016-04-06 13:01:50,756 ERROR [c.c.a.ApiAsyncJobDispatcher] (API-Job-Executor-22:ctx-cc5a6799 job-529) (logid:57076c62) Unexpected exception while executing org.apache.cloudstack.api.command.user.volume.ExtractVolumeCmd
com.cloud.utils.exception.CloudRuntimeException: Failed to copy the volume from the source primary storage pool to secondary storage.
at com.cloud.storage.VolumeApiServiceImpl.orchestrateExtractVolume(VolumeApiServiceImpl.java:2163)
at com.cloud.storage.VolumeApiServiceImpl.orchestrateExtractVolume(VolumeApiServiceImpl.java:2726)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
at com.cloud.storage.VolumeApiServiceImpl.handleVmWorkJob(VolumeApiServiceImpl.java:2771)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at com.sun.proxy.$Proxy186.handleVmWorkJob(Unknown Source)
at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:103)
at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:547)
at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:498)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2016-04-06 13:01:50,758 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-22:ctx-cc5a6799 job-529) (logid:57076c62) Complete async job-529, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Failed to copy the volume from the source primary storage pool to secondary storage."}
2016-04-06 13:01:50,760 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-22:ctx-cc5a6799 job-529) (logid:57076c62) Publish async job-529 complete on message bus
2016-04-06 13:01:50,760 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-22:ctx-cc5a6799 job-529) (logid:57076c62) Wake up jobs related to job-529
2016-04-06 13:01:50,760 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-22:ctx-cc5a6799 job-529) (logid:57076c62) Update db status for job-529
2016-04-06 13:01:50,761 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-22:ctx-cc5a6799 job-529) (logid:57076c62) Wake up jobs joined with job-529 and disjoin all subjobs created from job- 529
Thanks
RE: Problem Download Volumen VM
Posted by Yesid Mora <ym...@o4it.com>.
Hello Guys, have a comments or have a possible solution for this problem
Thanks,
-----Mensaje original-----
De: Yesid Mora [mailto:ymora@o4it.com]
Enviado el: Thursday, April 7, 2016 10:50 AM
Para: users@cloudstack.apache.org
Asunto: Problem Download Volumen VM
Hello, thanks for your comments inform that the permission is available and the problem is with a specific VM, I test with other VM and the download is correct, the VM's are in the same storage and the same host
Thanks
-----Mensaje original-----
De: ilya [mailto:ilya.mailing.lists@gmail.com]
Enviado el: Wednesday, April 6, 2016 11:24 PM
Para: users@cloudstack.apache.org
Asunto: Re: Problem Download Volumen VM
Yesid
Is your secondary NFS writtable by ESXi hosts and SSVM? Do you have no root squash enabled or proper permissions on the folders within your NFS Export?
Regards,
ilya
On 4/6/16 10:06 AM, Yesid Mora wrote:
> Hello guys, we have a problem when download a volumen and generate
> error the error is
>
> "Failed to copy the volume from the source primary storage pool to secondary storage."
>
> The version CS is 4.3.0 and VMware is hypervisor,the other error in VMware is "An error occurred while taking a snapshot: 30 (Read-only file system)."
>
> And logs
>
> 2016-04-06 13:01:47,802 DEBUG [c.c.a.m.AgentManagerImpl]
> (AgentManager-Handler-10:null) (logid:) SeqA 5-2069318: Sending Seq
> 5-2069318: { Ans: , MgmtId: 345050522867, via: 5, Ver: v1, Flags:
> 100010,
> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}]
> }
> 2016-04-06 13:01:50,095 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
> (AgentManager-Handler-11:null) (logid:) Seq 6-8459167475085518716:
> MgmtId 345050522808: Resp: Routing to peer
> 2016-04-06 13:01:50,651 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-12:ctx-d165fa00) (logid:b91f9766) ===START===
> 10.3.13.55 -- GET
> command=queryAsyncJobResult&jobId=57076c62-ccd6-423c-80a7-45e027166df0
> &response=json&sessionkey=PSk8fRP%2F5LYzX%2BXNRgiL%2FlOd5vs%3D&_=14599
> 62066162
> 2016-04-06 13:01:50,675 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-12:ctx-d165fa00 ctx-27d2aa04) (logid:b91f9766)
> ===END=== 10.3.13.55 -- GET
> command=queryAsyncJobResult&jobId=57076c62-ccd6-423c-80a7-45e027166df0
> &response=json&sessionkey=PSk8fRP%2F5LYzX%2BXNRgiL%2FlOd5vs%3D&_=14599
> 62066162
> 2016-04-06 13:01:50,756 ERROR [c.c.a.ApiAsyncJobDispatcher]
> (API-Job-Executor-22:ctx-cc5a6799 job-529) (logid:57076c62) Unexpected
> exception while executing
> org.apache.cloudstack.api.command.user.volume.ExtractVolumeCmd
> com.cloud.utils.exception.CloudRuntimeException: Failed to copy the volume from the source primary storage pool to secondary storage.
> at com.cloud.storage.VolumeApiServiceImpl.orchestrateExtractVolume(VolumeApiServiceImpl.java:2163)
> at com.cloud.storage.VolumeApiServiceImpl.orchestrateExtractVolume(VolumeApiServiceImpl.java:2726)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
> at com.cloud.storage.VolumeApiServiceImpl.handleVmWorkJob(VolumeApiServiceImpl.java:2771)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
> at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
> at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
> at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
> at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
> at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
> at com.sun.proxy.$Proxy186.handleVmWorkJob(Unknown Source)
> at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:103)
> at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:547)
> at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
> at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
> at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
> at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
> at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
> at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:498)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> 2016-04-06 13:01:50,758 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-22:ctx-cc5a6799 job-529) (logid:57076c62) Complete
> async job-529, jobStatus: FAILED, resultCode: 530, result:
> org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":
> [],"errorcode":530,"errortext":"Failed to copy the volume from the
> source primary storage pool to secondary storage."}
> 2016-04-06 13:01:50,760 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-22:ctx-cc5a6799 job-529) (logid:57076c62) Publish
> async job-529 complete on message bus
> 2016-04-06 13:01:50,760 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-22:ctx-cc5a6799 job-529) (logid:57076c62) Wake up
> jobs related to job-529
> 2016-04-06 13:01:50,760 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-22:ctx-cc5a6799 job-529) (logid:57076c62) Update db
> status for job-529
> 2016-04-06 13:01:50,761 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-22:ctx-cc5a6799 job-529) (logid:57076c62) Wake up
> jobs joined with job-529 and disjoin all subjobs created from job- 529
>
> Thanks
>
>
Problem Download Volumen VM
Posted by Yesid Mora <ym...@o4it.com>.
Hello, thanks for your comments inform that the permission is available and the problem is with a specific VM, Itest with other VM and the download is correct, the VM's are in the same storage and the same host
Thanks
-----Mensaje original-----
De: ilya [mailto:ilya.mailing.lists@gmail.com]
Enviado el: Wednesday, April 6, 2016 11:24 PM
Para: users@cloudstack.apache.org
Asunto: Re: Problem Download Volumen VM
Yesid
Is your secondary NFS writtable by ESXi hosts and SSVM? Do you have no root squash enabled or proper permissions on the folders within your NFS Export?
Regards,
ilya
On 4/6/16 10:06 AM, Yesid Mora wrote:
> Hello guys, we have a problem when download a volumen and generate
> error the error is
>
> "Failed to copy the volume from the source primary storage pool to secondary storage."
>
> The version CS is 4.3.0 and VMware is hypervisor,the other error in VMware is "An error occurred while taking a snapshot: 30 (Read-only file system)."
>
> And logs
>
> 2016-04-06 13:01:47,802 DEBUG [c.c.a.m.AgentManagerImpl]
> (AgentManager-Handler-10:null) (logid:) SeqA 5-2069318: Sending Seq
> 5-2069318: { Ans: , MgmtId: 345050522867, via: 5, Ver: v1, Flags:
> 100010,
> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}]
> }
> 2016-04-06 13:01:50,095 DEBUG [c.c.a.m.ClusteredAgentManagerImpl]
> (AgentManager-Handler-11:null) (logid:) Seq 6-8459167475085518716:
> MgmtId 345050522808: Resp: Routing to peer
> 2016-04-06 13:01:50,651 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-12:ctx-d165fa00) (logid:b91f9766) ===START===
> 10.3.13.55 -- GET
> command=queryAsyncJobResult&jobId=57076c62-ccd6-423c-80a7-45e027166df0
> &response=json&sessionkey=PSk8fRP%2F5LYzX%2BXNRgiL%2FlOd5vs%3D&_=14599
> 62066162
> 2016-04-06 13:01:50,675 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-12:ctx-d165fa00 ctx-27d2aa04) (logid:b91f9766)
> ===END=== 10.3.13.55 -- GET
> command=queryAsyncJobResult&jobId=57076c62-ccd6-423c-80a7-45e027166df0
> &response=json&sessionkey=PSk8fRP%2F5LYzX%2BXNRgiL%2FlOd5vs%3D&_=14599
> 62066162
> 2016-04-06 13:01:50,756 ERROR [c.c.a.ApiAsyncJobDispatcher]
> (API-Job-Executor-22:ctx-cc5a6799 job-529) (logid:57076c62) Unexpected
> exception while executing
> org.apache.cloudstack.api.command.user.volume.ExtractVolumeCmd
> com.cloud.utils.exception.CloudRuntimeException: Failed to copy the volume from the source primary storage pool to secondary storage.
> at com.cloud.storage.VolumeApiServiceImpl.orchestrateExtractVolume(VolumeApiServiceImpl.java:2163)
> at com.cloud.storage.VolumeApiServiceImpl.orchestrateExtractVolume(VolumeApiServiceImpl.java:2726)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
> at com.cloud.storage.VolumeApiServiceImpl.handleVmWorkJob(VolumeApiServiceImpl.java:2771)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
> at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
> at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
> at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
> at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
> at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
> at com.sun.proxy.$Proxy186.handleVmWorkJob(Unknown Source)
> at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:103)
> at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:547)
> at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
> at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
> at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
> at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
> at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
> at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:498)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> 2016-04-06 13:01:50,758 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-22:ctx-cc5a6799 job-529) (logid:57076c62) Complete
> async job-529, jobStatus: FAILED, resultCode: 530, result:
> org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":
> [],"errorcode":530,"errortext":"Failed to copy the volume from the
> source primary storage pool to secondary storage."}
> 2016-04-06 13:01:50,760 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-22:ctx-cc5a6799 job-529) (logid:57076c62) Publish
> async job-529 complete on message bus
> 2016-04-06 13:01:50,760 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-22:ctx-cc5a6799 job-529) (logid:57076c62) Wake up
> jobs related to job-529
> 2016-04-06 13:01:50,760 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-22:ctx-cc5a6799 job-529) (logid:57076c62) Update db
> status for job-529
> 2016-04-06 13:01:50,761 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-22:ctx-cc5a6799 job-529) (logid:57076c62) Wake up
> jobs joined with job-529 and disjoin all subjobs created from job- 529
>
> Thanks
>
>
Re: Problem Download Volumen VM
Posted by ilya <il...@gmail.com>.
Yesid
Is your secondary NFS writtable by ESXi hosts and SSVM? Do you have no
root squash enabled or proper permissions on the folders within your NFS
Export?
Regards,
ilya
On 4/6/16 10:06 AM, Yesid Mora wrote:
> Hello guys, we have a problem when download a volumen and generate error the error is
>
> "Failed to copy the volume from the source primary storage pool to secondary storage."
>
> The version CS is 4.3.0 and VMware is hypervisor,the other error in VMware is "An error occurred while taking a snapshot: 30 (Read-only file system)."
>
> And logs
>
> 2016-04-06 13:01:47,802 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-10:null) (logid:) SeqA 5-2069318: Sending Seq 5-2069318: { Ans: , MgmtId: 345050522867, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
> 2016-04-06 13:01:50,095 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (AgentManager-Handler-11:null) (logid:) Seq 6-8459167475085518716: MgmtId 345050522808: Resp: Routing to peer
> 2016-04-06 13:01:50,651 DEBUG [c.c.a.ApiServlet] (catalina-exec-12:ctx-d165fa00) (logid:b91f9766) ===START=== 10.3.13.55 -- GET command=queryAsyncJobResult&jobId=57076c62-ccd6-423c-80a7-45e027166df0&response=json&sessionkey=PSk8fRP%2F5LYzX%2BXNRgiL%2FlOd5vs%3D&_=1459962066162
> 2016-04-06 13:01:50,675 DEBUG [c.c.a.ApiServlet] (catalina-exec-12:ctx-d165fa00 ctx-27d2aa04) (logid:b91f9766) ===END=== 10.3.13.55 -- GET command=queryAsyncJobResult&jobId=57076c62-ccd6-423c-80a7-45e027166df0&response=json&sessionkey=PSk8fRP%2F5LYzX%2BXNRgiL%2FlOd5vs%3D&_=1459962066162
> 2016-04-06 13:01:50,756 ERROR [c.c.a.ApiAsyncJobDispatcher] (API-Job-Executor-22:ctx-cc5a6799 job-529) (logid:57076c62) Unexpected exception while executing org.apache.cloudstack.api.command.user.volume.ExtractVolumeCmd
> com.cloud.utils.exception.CloudRuntimeException: Failed to copy the volume from the source primary storage pool to secondary storage.
> at com.cloud.storage.VolumeApiServiceImpl.orchestrateExtractVolume(VolumeApiServiceImpl.java:2163)
> at com.cloud.storage.VolumeApiServiceImpl.orchestrateExtractVolume(VolumeApiServiceImpl.java:2726)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
> at com.cloud.storage.VolumeApiServiceImpl.handleVmWorkJob(VolumeApiServiceImpl.java:2771)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
> at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
> at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
> at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
> at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
> at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
> at com.sun.proxy.$Proxy186.handleVmWorkJob(Unknown Source)
> at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:103)
> at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:547)
> at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
> at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
> at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
> at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
> at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
> at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:498)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> 2016-04-06 13:01:50,758 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-22:ctx-cc5a6799 job-529) (logid:57076c62) Complete async job-529, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Failed to copy the volume from the source primary storage pool to secondary storage."}
> 2016-04-06 13:01:50,760 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-22:ctx-cc5a6799 job-529) (logid:57076c62) Publish async job-529 complete on message bus
> 2016-04-06 13:01:50,760 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-22:ctx-cc5a6799 job-529) (logid:57076c62) Wake up jobs related to job-529
> 2016-04-06 13:01:50,760 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-22:ctx-cc5a6799 job-529) (logid:57076c62) Update db status for job-529
> 2016-04-06 13:01:50,761 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-22:ctx-cc5a6799 job-529) (logid:57076c62) Wake up jobs joined with job-529 and disjoin all subjobs created from job- 529
>
> Thanks
>
>