You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cloudstack.apache.org by GitBox <gi...@apache.org> on 2021/03/12 08:42:43 UTC

[GitHub] [cloudstack] shwstppr commented on pull request #4801: skip lifemigration for centos

shwstppr commented on pull request #4801:
URL: https://github.com/apache/cloudstack/pull/4801#issuecomment-797332488


   @DaanHoogland there seems some issue with one of the test - test_02_migrate_VM_with_two_data_disks. I found it failing on Ubuntu18 as well,
   
   ```
   [root@pr4710-t97-kvm-ubuntu18-marvin marvin]# nosetests --with-xunit --xunit-file=results.xml --with-marvin --marvin-config=./pr4710-t97-kvm-ubuntu18-advanced-cfg -s -a tags=advanced --hypervisor=KVM tests/smoke/atest.py
   
   ==== Marvin Init Started ====
   
   === Marvin Parse Config Successful ===
   
   === Marvin Setting TestData Successful===
   
   ==== Log Folder Path: /marvin/MarvinLogs/Mar_12_2021_08_37_07_133UM3. All logs will be available here ====
   
   === Marvin Init Logging Successful===
   
   ==== Marvin Init Successful ====
   === TestName: test_01_migrate_VM_and_root_volume | Status : SUCCESS ===
   
   === TestName: test_02_migrate_VM_with_two_data_disks | Status : EXCEPTION ===
   
   ```
   
   ```
   2021-03-12 08:39:14,524 DEBUG [o.a.c.s.v.VolumeServiceImpl] (Work-Job-Executor-73:ctx-ad649327 job-188/job-189 ctx-896c5319) (logid:3d8a7bb9) Failed to copy volume
   com.cloud.utils.exception.CloudRuntimeException: Copy operation failed in 'StorageSystemDataMotionStrategy.copyAsync': null
   	at org.apache.cloudstack.storage.motion.StorageSystemDataMotionStrategy.copyAsync(StorageSystemDataMotionStrategy.java:1901)
   	at org.apache.cloudstack.storage.motion.DataMotionServiceImpl.copyAsync(DataMotionServiceImpl.java:119)
   	at org.apache.cloudstack.storage.volume.VolumeServiceImpl.migrateVolumes(VolumeServiceImpl.java:1645)
   	at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.migrateVolumes(VolumeOrchestrator.java:1181)
   	at com.cloud.vm.VirtualMachineManagerImpl.orchestrateMigrateWithStorage(VirtualMachineManagerImpl.java:3000)
   	at com.cloud.vm.VirtualMachineManagerImpl.orchestrateMigrateWithStorage(VirtualMachineManagerImpl.java:5524)
   	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
   	at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
   	at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:5631)
   	at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
   	at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:620)
   	at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:48)
   	at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:55)
   	at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:102)
   	at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:52)
   	at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:45)
   	at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:568)
   	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
   	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
   	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
   	at java.base/java.lang.Thread.run(Thread.java:834)
   2021-03-12 08:39:14,524 DEBUG [o.a.c.e.o.VolumeOrchestrator] (Work-Job-Executor-73:ctx-ad649327 job-188/job-189 ctx-896c5319) (logid:3d8a7bb9) Failed to migrated vm VM[User|i-9-20-VM] along with its volumes. com.cloud.utils.exception.CloudRuntimeException: Copy operation failed in 'StorageSystemDataMotionStrategy.copyAsync': null
   2021-03-12 08:39:14,524 INFO  [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-73:ctx-ad649327 job-188/job-189 ctx-896c5319) (logid:3d8a7bb9) Migration was unsuccessful.  Cleaning up: VM[User|i-9-20-VM]
   2021-03-12 08:39:14,524 WARN  [c.c.a.AlertManagerImpl] (Work-Job-Executor-73:ctx-ad649327 job-188/job-189 ctx-896c5319) (logid:3d8a7bb9) AlertType:: 17 | dataCenterId:: 1 | podId:: 1 | clusterId:: null | message:: Unable to migrate vm i-9-20-VM from host template-ubuntu180401-2 in zone pr4710-t97-kvm-ubuntu18 and pod pr4710-t97-kvm-ubuntu18
   2021-03-12 08:39:14,525 DEBUG [c.c.a.AlertManagerImpl] (Work-Job-Executor-73:ctx-ad649327 job-188/job-189 ctx-896c5319) (logid:3d8a7bb9) Have already sent: 1 emails for alert type '17' -- skipping send email
   2021-03-12 08:39:14,526 DEBUG [c.c.a.m.AgentAttache] (Work-Job-Executor-73:ctx-ad649327 job-188/job-189 ctx-896c5319) (logid:3d8a7bb9) Seq 1-6154731840755204180: Routed from 32985684378381
   2021-03-12 08:39:14,527 DEBUG [c.c.a.t.Request] (Work-Job-Executor-73:ctx-ad649327 job-188/job-189 ctx-896c5319) (logid:3d8a7bb9) Seq 1-6154731840755204180: Sending  { Cmd , MgmtId: 32985684378381, via: 1(template-ubuntu180401), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":"false","checkBeforeCleanup":"false","forceStop":"false","volumesToDisconnect":[],"vmName":"i-9-20-VM","executeInSequence":"false","wait":"0"}}] }
   2021-03-12 08:39:14,530 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-73:ctx-ad649327 job-188/job-189 ctx-896c5319) (logid:3d8a7bb9) VM state transitted from :Migrating to Running with event: OperationFailedvm's original host id: 2 new host id: 2 host id before state transition: 1
   2021-03-12 08:39:14,534 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-73:ctx-ad649327 job-188/job-189 ctx-896c5319) (logid:3d8a7bb9) Hosts's actual total CPU: 6300 and CPU after applying overprovisioning: 12600
   2021-03-12 08:39:14,534 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-73:ctx-ad649327 job-188/job-189 ctx-896c5319) (logid:3d8a7bb9) Hosts's actual total RAM: (6.77 GB) 7266349056 and RAM after applying overprovisioning: (6.77 GB) 7266349056
   2021-03-12 08:39:14,534 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-73:ctx-ad649327 job-188/job-189 ctx-896c5319) (logid:3d8a7bb9) release cpu from host: 1, old used: 1200,reserved: 0, actual total: 6300, total with overprovisioning: 12600; new used: 1100,reserved:0; movedfromreserved: false,moveToReserveredfalse
   2021-03-12 08:39:14,534 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-73:ctx-ad649327 job-188/job-189 ctx-896c5319) (logid:3d8a7bb9) release mem from host: 1, old used: (1.75 GB) 1879048192,reserved: (0 bytes) 0, total: (6.77 GB) 7266349056; new used: (1.50 GB) 1610612736,reserved:(0 bytes) 0; movedfromreserved: false,moveToReserveredfalse
   2021-03-12 08:39:14,539 DEBUG [c.c.n.NetworkModelImpl] (Work-Job-Executor-73:ctx-ad649327 job-188/job-189 ctx-896c5319) (logid:3d8a7bb9) Service SecurityGroup is not supported in the network id=209
   2021-03-12 08:39:14,548 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-73:ctx-ad649327 job-188/job-189 ctx-896c5319) (logid:3d8a7bb9) Invocation exception, caused by: com.cloud.utils.exception.CloudRuntimeException: Failed to migrated vm VM[User|i-9-20-VM] along with its volumes. 
   2021-03-12 08:39:14,548 INFO  [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-73:ctx-ad649327 job-188/job-189 ctx-896c5319) (logid:3d8a7bb9) Rethrow exception com.cloud.utils.exception.CloudRuntimeException: Failed to migrated vm VM[User|i-9-20-VM] along with its volumes. 
   2021-03-12 08:39:14,548 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-73:ctx-ad649327 job-188/job-189) (logid:3d8a7bb9) Done with run of VM work job: com.cloud.vm.VmWorkMigrateWithStorage for VM 20, job origin: 188
   2021-03-12 08:39:14,548 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-73:ctx-ad649327 job-188/job-189) (logid:3d8a7bb9) Unable to complete AsyncJobVO {id:189, userId: 2, accountId: 2, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkMigrateWithStorage, cmdInfo: rO0ABXNyACVjb20uY2xvdWQudm0uVm1Xb3JrTWlncmF0ZVdpdGhTdG9yYWdlsew9z6UxtXMCAANKAApkZXN0SG9zdElkSgAJc3JjSG9zdElkTAAMdm9sdW1lVG9Qb29sdAAPTGphdmEvdXRpbC9NYXA7eHIAE2NvbS5jbG91ZC52bS5WbVdvcmufmbZW8CVnawIABEoACWFjY291bnRJZEoABnVzZXJJZEoABHZtSWRMAAtoYW5kbGVyTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO3hwAAAAAAAAAAIAAAAAAAAAAgAAAAAAAAAUdAAZVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbAAAAAAAAAABAAAAAAAAAAJzcgARamF2YS51dGlsLkhhc2hNYXAFB9rBwxZg0QMAAkYACmxvYWRGYWN0b3JJAAl0aHJlc2hvbGR4cD9AAAAAAAAMdwgAAAAQAAAAAnNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cgAQamF2YS5sYW5nLk51bWJlcoaslR0LlOCLAgAAeHAAAAAAAAAAI3NxAH4ACAAAAAAAAAACc3EAfgAIAAAAAAAAACRxAH4AC3g, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, i
 nitMsid: 32985684378381, completeMsid: null, lastUpdated: null, lastPolled: null, created: Fri Mar 12 08:39:13 UTC 2021, removed: null}, job origin:188
   com.cloud.utils.exception.CloudRuntimeException: Failed to migrated vm VM[User|i-9-20-VM] along with its volumes. 
   	at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.migrateVolumes(VolumeOrchestrator.java:1186)
   	at com.cloud.vm.VirtualMachineManagerImpl.orchestrateMigrateWithStorage(VirtualMachineManagerImpl.java:3000)
   	at com.cloud.vm.VirtualMachineManagerImpl.orchestrateMigrateWithStorage(VirtualMachineManagerImpl.java:5524)
   	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
   	at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
   	at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:5631)
   	at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
   	at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:620)
   	at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:48)
   	at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:55)
   	at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:102)
   	at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:52)
   	at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:45)
   	at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:568)
   	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
   	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
   	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
   	at java.base/java.lang.Thread.run(Thread.java:834)
   2021-03-12 08:39:14,554 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-73:ctx-ad649327 job-188/job-189) (logid:3d8a7bb9) Complete async job-189, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyAC9jb20uY2xvdWQudXRpbHMuZXhjZXB0aW9uLkNsb3VkUnVudGltZUV4Y2VwdGlvbgAAAABWTU9yAwABSQALY3NFcnJvckNvZGV4cgAaamF2YS5sYW5nLlJ1bnRpbWVFeGNlcHRpb26eXwZHCjSD5QIAAHhyABNqYXZhLmxhbmcuRXhjZXB0aW9u0P0fPho7HMQCAAB4cgATamF2YS5sYW5nLlRocm93YWJsZdXGNSc5d7jLAwAETAAFY2F1c2V0ABVMamF2YS9sYW5nL1Rocm93YWJsZTtMAA1kZXRhaWxNZXNzYWdldAASTGphdmEvbGFuZy9TdHJpbmc7WwAKc3RhY2tUcmFjZXQAHltMamF2YS9sYW5nL1N0YWNrVHJhY2VFbGVtZW50O0wAFHN1cHByZXNzZWRFeGNlcHRpb25zdAAQTGphdmEvdXRpbC9MaXN0O3hwcQB-AAh0AEFGYWlsZWQgdG8gbWlncmF0ZWQgdm0gVk1bVXNlcnxpLTktMjAtVk1dIGFsb25nIHdpdGggaXRzIHZvbHVtZXMuIHVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFnNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIACEIABmZvcm1hdEkACmxpbmVOdW1iZXJMAA9jbGFzc0xvYWRlck5hbWVxAH4ABUwADmRlY2xhcmluZ0NsYXNzcQB-AAVMAAhmaWxlTmFtZXEAfgAF
 TAAKbWV0aG9kTmFtZXEAfgAFTAAKbW9kdWxlTmFtZXEAfgAFTAANbW9kdWxlVmVyc2lvbnEAfgAFeHABAAAEonQAA2FwcHQAPW9yZy5hcGFjaGUuY2xvdWRzdGFjay5lbmdpbmUub3JjaGVzdHJhdGlvbi5Wb2x1bWVPcmNoZXN0cmF0b3J0ABdWb2x1bWVPcmNoZXN0cmF0b3IuamF2YXQADm1pZ3JhdGVWb2x1bWVzcHBzcQB-AAwBAAALuHEAfgAOdAAmY29tLmNsb3VkLnZtLlZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGx0AB5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsLmphdmF0AB1vcmNoZXN0cmF0ZU1pZ3JhdGVXaXRoU3RvcmFnZXBwc3EAfgAMAQAAFZRxAH4ADnEAfgATcQB-ABRxAH4AFXBwc3EAfgAMAv____5wdAAtamRrLmludGVybmFsLnJlZmxlY3QuTmF0aXZlTWV0aG9kQWNjZXNzb3JJbXBsdAAdTmF0aXZlTWV0aG9kQWNjZXNzb3JJbXBsLmphdmF0AAdpbnZva2UwdAAJamF2YS5iYXNldAAHMTEuMC4xMHNxAH4ADAIAAAA-cHEAfgAYcQB-ABl0AAZpbnZva2VxAH4AG3EAfgAcc3EAfgAMAgAAACtwdAAxamRrLmludGVybmFsLnJlZmxlY3QuRGVsZWdhdGluZ01ldGhvZEFjY2Vzc29ySW1wbHQAIURlbGVnYXRpbmdNZXRob2RBY2Nlc3NvckltcGwuamF2YXEAfgAecQB-ABtxAH4AHHNxAH4ADAIAAAI2cHQAGGphdmEubGFuZy5yZWZsZWN0Lk1ldGhvZHQAC01ldGhvZC5qYXZhcQB-AB5xAH4AG3EAfgAcc3EAfgAMAQAAAGtxAH4ADnQAImNvbS5jbG91ZC52bS5WbVdvcmtKb2JIYW5kbGVyUHJveHl0ABpWbVdvcmtKb
 2JIYW5kbGVyUHJveHkuamF2YXQAD2hhbmRsZVZtV29ya0pvYnBwc3EAfgAMAQAAFf9xAH4ADnEAfgATcQB-ABRxAH4AKHBwc3EAfgAMAQAAAGZxAH4ADnQAIGNvbS5jbG91ZC52bS5WbVdvcmtKb2JEaXNwYXRjaGVydAAYVm1Xb3JrSm9iRGlzcGF0Y2hlci5qYXZhdAAGcnVuSm9icHBzcQB-AAwBAAACbHEAfgAOdAA_b3JnLmFwYWNoZS5jbG91ZHN0YWNrLmZyYW1ld29yay5qb2JzLmltcGwuQXN5bmNKb2JNYW5hZ2VySW1wbCQ1dAAYQXN5bmNKb2JNYW5hZ2VySW1wbC5qYXZhdAAMcnVuSW5Db250ZXh0cHBzcQB-AAwBAAAAMHEAfgAOdAA-b3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5NYW5hZ2VkQ29udGV4dFJ1bm5hYmxlJDF0ABtNYW5hZ2VkQ29udGV4dFJ1bm5hYmxlLmphdmF0AANydW5wcHNxAH4ADAEAAAA3cQB-AA50AEJvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0JDF0ABpEZWZhdWx0TWFuYWdlZENvbnRleHQuamF2YXQABGNhbGxwcHNxAH4ADAEAAABmcQB-AA50AEBvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0cQB-ADh0AA9jYWxsV2l0aENvbnRleHRwcHNxAH4ADAEAAAA0cQB-AA5xAH4AO3EAfgA4dAAOcnVuV2l0aENvbnRleHRwcHNxAH4ADAEAAAAtcQB-AA50ADxvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb2
 50ZXh0UnVubmFibGVxAH4ANHEAfgA1cHBzcQB-AAwBAAACOHEAfgAOcQB-AC9xAH4AMHEAfgA1cHBzcQB-AAwCAAACA3B0AC5qYXZhLnV0aWwuY29uY3VycmVudC5FeGVjdXRvcnMkUnVubmFibGVBZGFwdGVydAAORXhlY3V0b3JzLmphdmFxAH4AOXEAfgAbcQB-ABxzcQB-AAwCAAABCHB0AB9qYXZhLnV0aWwuY29uY3VycmVudC5GdXR1cmVUYXNrdAAPRnV0dXJlVGFzay5qYXZhcQB-ADVxAH4AG3EAfgAcc3EAfgAMAgAABGhwdAAnamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9ydAAXVGhyZWFkUG9vbEV4ZWN1dG9yLmphdmF0AAlydW5Xb3JrZXJxAH4AG3EAfgAcc3EAfgAMAgAAAnRwdAAuamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9yJFdvcmtlcnEAfgBKcQB-ADVxAH4AG3EAfgAcc3EAfgAMAgAAA0JwdAAQamF2YS5sYW5nLlRocmVhZHQAC1RocmVhZC5qYXZhcQB-ADVxAH4AG3EAfgAcc3IAH2phdmEudXRpbC5Db2xsZWN0aW9ucyRFbXB0eUxpc3R6uBe0PKee3gIAAHhweAAAEJp3CAAAAAAAAAAAeA
   2021-03-12 08:39:14,555 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-73:ctx-ad649327 job-188/job-189) (logid:3d8a7bb9) Publish async job-189 complete on message bus
   2021-03-12 08:39:14,555 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-73:ctx-ad649327 job-188/job-189) (logid:3d8a7bb9) Wake up jobs related to job-189
   2021-03-12 08:39:14,555 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-73:ctx-ad649327 job-188/job-189) (logid:3d8a7bb9) Update db status for job-189
   2021-03-12 08:39:14,560 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-73:ctx-ad649327 job-188/job-189) (logid:3d8a7bb9) Wake up jobs joined with job-189 and disjoin all subjobs created from job- 189
   2021-03-12 08:39:14,564 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-73:ctx-ad649327 job-188/job-189) (logid:3d8a7bb9) Done executing com.cloud.vm.VmWorkMigrateWithStorage for job-189
   2021-03-12 08:39:14,565 INFO  [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-73:ctx-ad649327 job-188/job-189) (logid:3d8a7bb9) Remove job-189 from job monitoring
   2021-03-12 08:39:14,575 ERROR [c.c.a.ApiAsyncJobDispatcher] (API-Job-Executor-109:ctx-3fa14f5c job-188) (logid:3d8a7bb9) Unexpected exception while executing org.apache.cloudstack.api.command.admin.vm.MigrateVirtualMachineWithVolumeCmd
   com.cloud.utils.exception.CloudRuntimeException: Failed to migrated vm VM[User|i-9-20-VM] along with its volumes. 
   	at org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.migrateVolumes(VolumeOrchestrator.java:1186)
   	at com.cloud.vm.VirtualMachineManagerImpl.orchestrateMigrateWithStorage(VirtualMachineManagerImpl.java:3000)
   	at com.cloud.vm.VirtualMachineManagerImpl.orchestrateMigrateWithStorage(VirtualMachineManagerImpl.java:5524)
   	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
   	at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
   	at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:5631)
   	at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
   	at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:620)
   	at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:48)
   	at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:55)
   	at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:102)
   	at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:52)
   	at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:45)
   	at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:568)
   	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
   	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
   	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
   	at java.base/java.lang.Thread.run(Thread.java:834)
   ```
   
   I'll check if I can fix that


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org