You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cloudstack.apache.org by GitBox <gi...@apache.org> on 2020/10/28 15:50:08 UTC
[GitHub] [cloudstack] nvazquez commented on issue #4433: Failed to create VOLUME from snapshot
nvazquez commented on issue #4433:
URL: https://github.com/apache/cloudstack/issues/4433#issuecomment-718026184
I was able to reproduce on NFS storage pool, and the same setting values.
```
2020-10-28 15:35:59,214 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru] (API-Job-Executor-32:ctx-ee634337 job-44 ctx-540c9792) (logid:8bbe9b7f) getCommandHostDelegation: class org.apache.cloudstack.storage.command.CopyCommand
2020-10-28 15:35:59,215 DEBUG [c.c.a.t.Request] (API-Job-Executor-32:ctx-ee634337 job-44 ctx-540c9792) (logid:8bbe9b7f) Seq 1-6719370644036780103: Sending { Cmd , MgmtId: 32988956015047, via: 1(ref-trl-1821-k-M7-nicolas-vazquez-kvm1), Ver: v1, Flags: 100011, [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"volume":{"uuid":"88a6ce2c-de4c-475f-827e-696f0f0bdeb2","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"9715ad47-244e-3d24-a382-7ad33a3dc0f1","id":1,"poolType":"NetworkFilesystem","host":"10.10.0.16","path":"/acs/primary/ref-trl-1821-k-M7-nicolas-vazquez/ref-trl-1821-k-M7-nicolas-vazquez-kvm-pri1","port":2049,"url":"NetworkFilesystem://10.10.0.16/acs/primary/ref-trl-1821-k-M7-nicolas-vazquez/ref-trl-1821-k-M7-nicolas-vazquez-kvm-pri1/?ROLE=Primary&STOREUUID=9715ad47-244e-3d24-a382-7ad33a3dc0f1","isManaged":false}},"name":"ROOT-4","size":8589934592,"path":"88a6ce2c
-de4c-475f-827e-696f0f0bdeb2","volumeId":4,"vmName":"i-2-4-VM","accountId":2,"format":"QCOW2","provisioningType":"THIN","id":4,"deviceId":0,"hypervisorType":"KVM","directDownload":false},"dataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"NFS://10.10.0.16/acs/secondary/ref-trl-1821-k-M7-nicolas-vazquez/ref-trl-1821-k-M7-nicolas-vazquez-sec1","_role":"Image"}},"vmName":"i-2-4-VM","name":"snap2","hypervisorType":"KVM","id":2,"quiescevm":false,"physicalSize":0}},"destTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"81832bc9-1c46-4db8-968d-198064a4cec3","volumeType":"DATADISK","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"9715ad47-244e-3d24-a382-7ad33a3dc0f1","id":1,"poolType":"NetworkFilesystem","host":"10.10.0.16","path":"/acs/primary/ref-trl-1821-k-M7-nicolas-vazquez/ref-trl-1821-k-M7-nicolas-vazquez-kvm-pri1","port":2049,"url":"NetworkFilesystem://10.10.0.16/acs/primary/ref-trl-1821-k-M7-nicolas-vazquez/ref-trl-1821-k-M7-nicolas-vazquez-
kvm-pri1/?ROLE=Primary&STOREUUID=9715ad47-244e-3d24-a382-7ad33a3dc0f1","isManaged":false}},"name":"diskfromsnap2","size":21474836480,"volumeId":7,"accountId":2,"format":"QCOW2","provisioningType":"THIN","id":7,"hypervisorType":"KVM","directDownload":false}},"executeInSequence":false,"options":{},"options2":{},"wait":10800}}] }
2020-10-28 15:35:59,224 DEBUG [c.c.a.t.Request] (AgentManager-Handler-15:null) (logid:) Seq 1-6719370644036780103: Processing: { Ans: , MgmtId: 32988956015047, via: 1, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":false,"details":"java.lang.NullPointerException\n\tat com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.createVolumeFromSnapshot(KVMStorageProcessor.java:1599)\n\tat com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:110)\n\tat com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:57)\n\tat com.cloud.hypervisor.kvm.resource.wrapper.LibvirtStorageSubSystemCommandWrapper.execute(LibvirtStorageSubSystemCommandWrapper.java:36)\n\tat com.cloud.hypervisor.kvm.resource.wrapper.LibvirtStorageSubSystemCommandWrapper.execute(LibvirtStorageSubSystemCommandWrapper.java:30)\n\tat com.cloud.hypervisor.kvm.resource.wrapper.LibvirtRequestWra
pper.execute(LibvirtRequestWrapper.java:78)\n\tat com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1637)\n\tat com.cloud.agent.Agent.processRequest(Agent.java:644)\n\tat com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:1057)\n\tat com.cloud.utils.nio.Task.call(Task.java:83)\n\tat com.cloud.utils.nio.Task.call(Task.java:29)\n\tat java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:834)\n","wait":0}}] }
2020-10-28 15:35:59,225 DEBUG [c.c.a.t.Request] (API-Job-Executor-32:ctx-ee634337 job-44 ctx-540c9792) (logid:8bbe9b7f) Seq 1-6719370644036780103: Received: { Ans: , MgmtId: 32988956015047, via: 1(ref-trl-1821-k-M7-nicolas-vazquez-kvm1), Ver: v1, Flags: 10, { Answer } }
2020-10-28 15:35:59,232 WARN [o.a.c.s.d.ObjectInDataStoreManagerImpl] (API-Job-Executor-32:ctx-ee634337 job-44 ctx-540c9792) (logid:8bbe9b7f) Unsupported data object (VOLUME, org.apache.cloudstack.storage.datastore.PrimaryDataStoreImpl@6689d2a6), no need to delete from object in store ref table
2020-10-28 15:35:59,237 DEBUG [o.a.c.e.o.VolumeOrchestrator] (API-Job-Executor-32:ctx-ee634337 job-44 ctx-540c9792) (logid:8bbe9b7f) Failed to create volume from snapshot:java.lang.NullPointerException
at com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.createVolumeFromSnapshot(KVMStorageProcessor.java:1599)
at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:110)
at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:57)
at com.cloud.hypervisor.kvm.resource.wrapper.LibvirtStorageSubSystemCommandWrapper.execute(LibvirtStorageSubSystemCommandWrapper.java:36)
at com.cloud.hypervisor.kvm.resource.wrapper.LibvirtStorageSubSystemCommandWrapper.execute(LibvirtStorageSubSystemCommandWrapper.java:30)
at com.cloud.hypervisor.kvm.resource.wrapper.LibvirtRequestWrapper.execute(LibvirtRequestWrapper.java:78)
at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1637)
at com.cloud.agent.Agent.processRequest(Agent.java:644)
at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:1057)
at com.cloud.utils.nio.Task.call(Task.java:83)
at com.cloud.utils.nio.Task.call(Task.java:29)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:834)
2020-10-28 15:35:59,248 DEBUG [c.c.r.ResourceLimitManagerImpl] (API-Job-Executor-32:ctx-ee634337 job-44 ctx-540c9792) (logid:8bbe9b7f) Updating resource Type = volume count for Account = 2 Operation = decreasing Amount = 1
2020-10-28 15:35:59,255 DEBUG [c.c.r.ResourceLimitManagerImpl] (API-Job-Executor-32:ctx-ee634337 job-44 ctx-540c9792) (logid:8bbe9b7f) Updating resource Type = primary_storage count for Account = 2 Operation = decreasing Amount = 21474836480
2020-10-28 15:35:59,269 ERROR [c.c.a.ApiAsyncJobDispatcher] (API-Job-Executor-32:ctx-ee634337 job-44) (logid:8bbe9b7f) Unexpected exception while executing org.apache.cloudstack.api.command.admin.volume.CreateVolumeCmdByAdmin
com.cloud.utils.exception.CloudRuntimeException: Failed to create volume: 7
at com.cloud.storage.VolumeApiServiceImpl.createVolume(VolumeApiServiceImpl.java:837)
at com.cloud.storage.VolumeApiServiceImpl.createVolume(VolumeApiServiceImpl.java:184)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:107)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
at com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:95)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212)
at com.sun.proxy.$Proxy212.createVolume(Unknown Source)
at org.apache.cloudstack.api.command.user.volume.CreateVolumeCmd.execute(CreateVolumeCmd.java:225)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:156)
at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:603)
at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:551)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: com.cloud.utils.exception.CloudRuntimeException: Failed to create volume from snapshot:java.lang.NullPointerException
at com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.createVolumeFromSnapshot(KVMStorageProcessor.java:1599)
at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:110)
at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:57)
at com.cloud.hypervisor.kvm.resource.wrapper.LibvirtStorageSubSystemCommandWrapper.execute(LibvirtStorageSubSystemCommandWrapper.java:36)
at com.cloud.hypervisor.kvm.resource.wrapper.LibvirtStorageSubSystemCommandWrapper.execute(LibvirtStorageSubSystemCommandWrapper.java:30)
at com.cloud.hypervisor.kvm.resource.wrapper.LibvirtRequestWrapper.execute(LibvirtRequestWrapper.java:78)
at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1637)
at com.cloud.agent.Agent.processRequest(Agent.java:644)
at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:1057)
at com.cloud.utils.nio.Task.call(Task.java:83)
at com.cloud.utils.nio.Task.call(Task.java:29)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:834)
at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.createVolumeFromSnapshot(VolumeOrchestrator.java:432)
at com.cloud.storage.VolumeApiServiceImpl.createVolumeFromSnapshot(VolumeApiServiceImpl.java:859)
at com.cloud.storage.VolumeApiServiceImpl.createVolume(VolumeApiServiceImpl.java:809)
... 31 more
2020-10-28 15:35:59,272 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-32:ctx-ee634337 job-44) (logid:8bbe9b7f) Complete async job-44, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Failed to create volume: 7"}
```
The `KVMStorageProcessor` is expecting a path but its null.
DB:
I've created 2 snapshots, both of them have null path but the first worked and second failed
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org