You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by Mohammad Rastgoo <mo...@synapti.ca> on 2016/09/12 20:08:24 UTC

Unable to start a Migrated VM to wrong Cluster

Hi,

Thanks in advance.

Our setup:
ACS 4.5.2 Advance zone - KVM Hypervisor

Issue:
We mistakenly migrated a VM to from cluster A to cluster B and VM is no
longer starting. Attempts to migrate it back also fails.

Log:
2016-09-12 15:39:25,648 ERROR [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-12:ctx-f01b9bc8 job-20487/job-20488 ctx-1faf4d56) Failed
to start instance VM[User|i-211-464-VM]
2016-09-12 15:39:26,230 ERROR [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-12:ctx-f01b9bc8 job-20487/job-20488 ctx-1faf4d56)
Invocation exception, caused by:
com.cloud.exception.AgentUnavailableException: Resource [Host:18] is
unreachable: Host 18: Unable to start instance due to Local volume
Vol[753|vm=464|ROOT] cannot be recreated on storagepool Pool[16|Filesystem]
assigned by deploymentPlanner
2016-09-12 15:39:26,230 ERROR [c.c.v.VmWorkJobDispatcher]
(Work-Job-Executor-12:ctx-f01b9bc8 job-20487/job-20488) Unable to complete
AsyncJobVO {id:20488, userId: 2, accountId: 2, instanceType: null,
instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAB0HQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwc3IAEWphdmEudXRpbC5IYXNoTWFwBQfawcMWYNEDAAJGAApsb2FkRmFjdG9ySQAJdGhyZXNob2xkeHA_QAAAAAAADHcIAAAAEAAAAAF0AApWbVBhc3N3b3JkdAAcck8wQUJYUUFEbk5oZG1Wa1gzQmhjM04zYjNKa3hw,
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
result: null, initMsid: 161333665844, completeMsid: null, lastUpdated:
null, lastPolled: null, created: Mon Sep 12 15:39:22 EDT 2016}, job
origin:20487
2016-09-12 15:39:26,457 ERROR [c.c.a.ApiAsyncJobDispatcher]
(API-Job-Executor-32:ctx-661ee1a9 job-20487) Unexpected exception while
executing org.apache.cloudstack.api.command.admin.vm.StartVMCmdByAdmin
2016-09-12 15:39:26,458 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-32:ctx-661ee1a9 job-20487) Complete async job-20487,
jobStatus: FAILED, resultCode: 530, result:
org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable
to start a VM due to concurrent operation"}
2016-09-12 15:51:46,038 ERROR [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-14:ctx-3d3db3ff job-20490/job-20491 ctx-5cec2d45)
Invocation exception, caused by: java.lang.NullPointerException
2016-09-12 15:51:46,038 ERROR [c.c.v.VmWorkJobDispatcher]
(Work-Job-Executor-14:ctx-3d3db3ff job-20490/job-20491) Unable to complete
AsyncJobVO {id:20491, userId: 2, accountId: 2, instanceType: null,
instanceId: null, cmd: com.cloud.vm.VmWorkStorageMigration, cmdInfo:
rO0ABXNyACNjb20uY2xvdWQudm0uVm1Xb3JrU3RvcmFnZU1pZ3JhdGlvboeRn3LBtueeAgABTAAKZGVzdFBvb2xJZHQAEExqYXZhL2xhbmcvTG9uZzt4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1ldAASTGphdmEvbGFuZy9TdHJpbmc7eHAAAAAAAAAAAgAAAAAAAAACAAAAAAAAAdB0ABlWaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsc3IADmphdmEubGFuZy5Mb25nO4vkkMyPI98CAAFKAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAAAAAAAAQ,
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
result: null, initMsid: 161333665844, completeMsid: null, lastUpdated:
null, lastPolled: null, created: Mon Sep 12 15:51:45 EDT 2016}, job
origin:20490
2016-09-12 15:51:46,187 ERROR [c.c.a.ApiAsyncJobDispatcher]
(API-Job-Executor-33:ctx-dd1228f6 job-20490) Unexpected exception while
executing org.apache.cloudstack.api.command.admin.vm.MigrateVMCmd
2016-09-12 15:51:46,187 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-33:ctx-dd1228f6 job-20490) Complete async job-20490,
jobStatus: FAILED, resultCode: 530, result:
org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530}

Re: Unable to start a Migrated VM to wrong Cluster

Posted by Simon Weller <sw...@ena.com>.
Does the original qcow2 still exist on local storage? You might have to dig into the DB to figure out what the name would be.

________________________________
From: Mohammad Rastgoo <mo...@synapti.ca>
Sent: Monday, September 12, 2016 3:32 PM
To: users@cloudstack.apache.org
Subject: Re: Unable to start a Migrated VM to wrong Cluster

It was successful first time.
No signs of qcow2 image on secondary storage.
We use local storage.

On Mon, Sep 12, 2016 at 4:19 PM Simon Weller <sw...@ena.com> wrote:

>  Did the migration succeed the first time? Is the qcow2 image still on
> secondary storage?
>
>
> What type of primary storage?
>
> ________________________________
> From: Mohammad Rastgoo <mo...@synapti.ca>
> Sent: Monday, September 12, 2016 3:08 PM
> To: users@cloudstack.apache.org
> Subject: Unable to start a Migrated VM to wrong Cluster
>
> Hi,
>
> Thanks in advance.
>
> Our setup:
> ACS 4.5.2 Advance zone - KVM Hypervisor
>
> Issue:
> We mistakenly migrated a VM to from cluster A to cluster B and VM is no
> longer starting. Attempts to migrate it back also fails.
>
> Log:
> 2016-09-12 15:39:25,648 ERROR [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-12:ctx-f01b9bc8 job-20487/job-20488 ctx-1faf4d56) Failed
> to start instance VM[User|i-211-464-VM]
> 2016-09-12 15:39:26,230 ERROR [c.c.v.VmWorkJobHandlerProxy]
> (Work-Job-Executor-12:ctx-f01b9bc8 job-20487/job-20488 ctx-1faf4d56)
> Invocation exception, caused by:
> com.cloud.exception.AgentUnavailableException: Resource [Host:18] is
> unreachable: Host 18: Unable to start instance due to Local volume
> Vol[753|vm=464|ROOT] cannot be recreated on storagepool Pool[16|Filesystem]
> assigned by deploymentPlanner
> 2016-09-12 15:39:26,230 ERROR [c.c.v.VmWorkJobDispatcher]
> (Work-Job-Executor-12:ctx-f01b9bc8 job-20487/job-20488) Unable to complete
> AsyncJobVO {id:20488, userId: 2, accountId: 2, instanceType: null,
> instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
>
> rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAB0HQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwc3IAEWphdmEudXRpbC5IYXNoTWFwBQfawcMWYNEDAAJGAApsb2FkRmFjdG9ySQAJdGhyZXNob2xkeHA_QAAAAAAADHcIAAAAEAAAAAF0AApWbVBhc3N3b3JkdAAcck8wQUJYUUFEbk5oZG1Wa1gzQmhjM04zYjNKa3hw,
> cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
> result: null, initMsid: 161333665844, completeMsid: null, lastUpdated:
> null, lastPolled: null, created: Mon Sep 12 15:39:22 EDT 2016}, job
> origin:20487
> 2016-09-12 15:39:26,457 ERROR [c.c.a.ApiAsyncJobDispatcher]
> (API-Job-Executor-32:ctx-661ee1a9 job-20487) Unexpected exception while
> executing org.apache.cloudstack.api.command.admin.vm.StartVMCmdByAdmin
> 2016-09-12 15:39:26,458 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-32:ctx-661ee1a9 job-20487) Complete async job-20487,
> jobStatus: FAILED, resultCode: 530, result:
>
> org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable
> to start a VM due to concurrent operation"}
> 2016-09-12 15:51:46,038 ERROR [c.c.v.VmWorkJobHandlerProxy]
> (Work-Job-Executor-14:ctx-3d3db3ff job-20490/job-20491 ctx-5cec2d45)
> Invocation exception, caused by: java.lang.NullPointerException
> 2016-09-12 15:51:46,038 ERROR [c.c.v.VmWorkJobDispatcher]
> (Work-Job-Executor-14:ctx-3d3db3ff job-20490/job-20491) Unable to complete
> AsyncJobVO {id:20491, userId: 2, accountId: 2, instanceType: null,
> instanceId: null, cmd: com.cloud.vm.VmWorkStorageMigration, cmdInfo:
>
> rO0ABXNyACNjb20uY2xvdWQudm0uVm1Xb3JrU3RvcmFnZU1pZ3JhdGlvboeRn3LBtueeAgABTAAKZGVzdFBvb2xJZHQAEExqYXZhL2xhbmcvTG9uZzt4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1ldAASTGphdmEvbGFuZy9TdHJpbmc7eHAAAAAAAAAAAgAAAAAAAAACAAAAAAAAAdB0ABlWaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsc3IADmphdmEubGFuZy5Mb25nO4vkkMyPI98CAAFKAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAAAAAAAAQ,
> cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
> result: null, initMsid: 161333665844, completeMsid: null, lastUpdated:
> null, lastPolled: null, created: Mon Sep 12 15:51:45 EDT 2016}, job
> origin:20490
> 2016-09-12 15:51:46,187 ERROR [c.c.a.ApiAsyncJobDispatcher]
> (API-Job-Executor-33:ctx-dd1228f6 job-20490) Unexpected exception while
> executing org.apache.cloudstack.api.command.admin.vm.MigrateVMCmd
> 2016-09-12 15:51:46,187 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-33:ctx-dd1228f6 job-20490) Complete async job-20490,
> jobStatus: FAILED, resultCode: 530, result:
>
> org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530}
>

Re: Unable to start a Migrated VM to wrong Cluster

Posted by Mohammad Rastgoo <mo...@synapti.ca>.
It was successful first time.
No signs of qcow2 image on secondary storage.
We use local storage.

On Mon, Sep 12, 2016 at 4:19 PM Simon Weller <sw...@ena.com> wrote:

>  Did the migration succeed the first time? Is the qcow2 image still on
> secondary storage?
>
>
> What type of primary storage?
>
> ________________________________
> From: Mohammad Rastgoo <mo...@synapti.ca>
> Sent: Monday, September 12, 2016 3:08 PM
> To: users@cloudstack.apache.org
> Subject: Unable to start a Migrated VM to wrong Cluster
>
> Hi,
>
> Thanks in advance.
>
> Our setup:
> ACS 4.5.2 Advance zone - KVM Hypervisor
>
> Issue:
> We mistakenly migrated a VM to from cluster A to cluster B and VM is no
> longer starting. Attempts to migrate it back also fails.
>
> Log:
> 2016-09-12 15:39:25,648 ERROR [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-12:ctx-f01b9bc8 job-20487/job-20488 ctx-1faf4d56) Failed
> to start instance VM[User|i-211-464-VM]
> 2016-09-12 15:39:26,230 ERROR [c.c.v.VmWorkJobHandlerProxy]
> (Work-Job-Executor-12:ctx-f01b9bc8 job-20487/job-20488 ctx-1faf4d56)
> Invocation exception, caused by:
> com.cloud.exception.AgentUnavailableException: Resource [Host:18] is
> unreachable: Host 18: Unable to start instance due to Local volume
> Vol[753|vm=464|ROOT] cannot be recreated on storagepool Pool[16|Filesystem]
> assigned by deploymentPlanner
> 2016-09-12 15:39:26,230 ERROR [c.c.v.VmWorkJobDispatcher]
> (Work-Job-Executor-12:ctx-f01b9bc8 job-20487/job-20488) Unable to complete
> AsyncJobVO {id:20488, userId: 2, accountId: 2, instanceType: null,
> instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
>
> rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAB0HQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwc3IAEWphdmEudXRpbC5IYXNoTWFwBQfawcMWYNEDAAJGAApsb2FkRmFjdG9ySQAJdGhyZXNob2xkeHA_QAAAAAAADHcIAAAAEAAAAAF0AApWbVBhc3N3b3JkdAAcck8wQUJYUUFEbk5oZG1Wa1gzQmhjM04zYjNKa3hw,
> cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
> result: null, initMsid: 161333665844, completeMsid: null, lastUpdated:
> null, lastPolled: null, created: Mon Sep 12 15:39:22 EDT 2016}, job
> origin:20487
> 2016-09-12 15:39:26,457 ERROR [c.c.a.ApiAsyncJobDispatcher]
> (API-Job-Executor-32:ctx-661ee1a9 job-20487) Unexpected exception while
> executing org.apache.cloudstack.api.command.admin.vm.StartVMCmdByAdmin
> 2016-09-12 15:39:26,458 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-32:ctx-661ee1a9 job-20487) Complete async job-20487,
> jobStatus: FAILED, resultCode: 530, result:
>
> org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable
> to start a VM due to concurrent operation"}
> 2016-09-12 15:51:46,038 ERROR [c.c.v.VmWorkJobHandlerProxy]
> (Work-Job-Executor-14:ctx-3d3db3ff job-20490/job-20491 ctx-5cec2d45)
> Invocation exception, caused by: java.lang.NullPointerException
> 2016-09-12 15:51:46,038 ERROR [c.c.v.VmWorkJobDispatcher]
> (Work-Job-Executor-14:ctx-3d3db3ff job-20490/job-20491) Unable to complete
> AsyncJobVO {id:20491, userId: 2, accountId: 2, instanceType: null,
> instanceId: null, cmd: com.cloud.vm.VmWorkStorageMigration, cmdInfo:
>
> rO0ABXNyACNjb20uY2xvdWQudm0uVm1Xb3JrU3RvcmFnZU1pZ3JhdGlvboeRn3LBtueeAgABTAAKZGVzdFBvb2xJZHQAEExqYXZhL2xhbmcvTG9uZzt4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1ldAASTGphdmEvbGFuZy9TdHJpbmc7eHAAAAAAAAAAAgAAAAAAAAACAAAAAAAAAdB0ABlWaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsc3IADmphdmEubGFuZy5Mb25nO4vkkMyPI98CAAFKAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAAAAAAAAQ,
> cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
> result: null, initMsid: 161333665844, completeMsid: null, lastUpdated:
> null, lastPolled: null, created: Mon Sep 12 15:51:45 EDT 2016}, job
> origin:20490
> 2016-09-12 15:51:46,187 ERROR [c.c.a.ApiAsyncJobDispatcher]
> (API-Job-Executor-33:ctx-dd1228f6 job-20490) Unexpected exception while
> executing org.apache.cloudstack.api.command.admin.vm.MigrateVMCmd
> 2016-09-12 15:51:46,187 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-33:ctx-dd1228f6 job-20490) Complete async job-20490,
> jobStatus: FAILED, resultCode: 530, result:
>
> org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530}
>

Re: Unable to start a Migrated VM to wrong Cluster

Posted by Simon Weller <sw...@ena.com>.
 Did the migration succeed the first time? Is the qcow2 image still on secondary storage?


What type of primary storage?

________________________________
From: Mohammad Rastgoo <mo...@synapti.ca>
Sent: Monday, September 12, 2016 3:08 PM
To: users@cloudstack.apache.org
Subject: Unable to start a Migrated VM to wrong Cluster

Hi,

Thanks in advance.

Our setup:
ACS 4.5.2 Advance zone - KVM Hypervisor

Issue:
We mistakenly migrated a VM to from cluster A to cluster B and VM is no
longer starting. Attempts to migrate it back also fails.

Log:
2016-09-12 15:39:25,648 ERROR [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-12:ctx-f01b9bc8 job-20487/job-20488 ctx-1faf4d56) Failed
to start instance VM[User|i-211-464-VM]
2016-09-12 15:39:26,230 ERROR [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-12:ctx-f01b9bc8 job-20487/job-20488 ctx-1faf4d56)
Invocation exception, caused by:
com.cloud.exception.AgentUnavailableException: Resource [Host:18] is
unreachable: Host 18: Unable to start instance due to Local volume
Vol[753|vm=464|ROOT] cannot be recreated on storagepool Pool[16|Filesystem]
assigned by deploymentPlanner
2016-09-12 15:39:26,230 ERROR [c.c.v.VmWorkJobDispatcher]
(Work-Job-Executor-12:ctx-f01b9bc8 job-20487/job-20488) Unable to complete
AsyncJobVO {id:20488, userId: 2, accountId: 2, instanceType: null,
instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAB0HQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwc3IAEWphdmEudXRpbC5IYXNoTWFwBQfawcMWYNEDAAJGAApsb2FkRmFjdG9ySQAJdGhyZXNob2xkeHA_QAAAAAAADHcIAAAAEAAAAAF0AApWbVBhc3N3b3JkdAAcck8wQUJYUUFEbk5oZG1Wa1gzQmhjM04zYjNKa3hw,
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
result: null, initMsid: 161333665844, completeMsid: null, lastUpdated:
null, lastPolled: null, created: Mon Sep 12 15:39:22 EDT 2016}, job
origin:20487
2016-09-12 15:39:26,457 ERROR [c.c.a.ApiAsyncJobDispatcher]
(API-Job-Executor-32:ctx-661ee1a9 job-20487) Unexpected exception while
executing org.apache.cloudstack.api.command.admin.vm.StartVMCmdByAdmin
2016-09-12 15:39:26,458 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-32:ctx-661ee1a9 job-20487) Complete async job-20487,
jobStatus: FAILED, resultCode: 530, result:
org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable
to start a VM due to concurrent operation"}
2016-09-12 15:51:46,038 ERROR [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-14:ctx-3d3db3ff job-20490/job-20491 ctx-5cec2d45)
Invocation exception, caused by: java.lang.NullPointerException
2016-09-12 15:51:46,038 ERROR [c.c.v.VmWorkJobDispatcher]
(Work-Job-Executor-14:ctx-3d3db3ff job-20490/job-20491) Unable to complete
AsyncJobVO {id:20491, userId: 2, accountId: 2, instanceType: null,
instanceId: null, cmd: com.cloud.vm.VmWorkStorageMigration, cmdInfo:
rO0ABXNyACNjb20uY2xvdWQudm0uVm1Xb3JrU3RvcmFnZU1pZ3JhdGlvboeRn3LBtueeAgABTAAKZGVzdFBvb2xJZHQAEExqYXZhL2xhbmcvTG9uZzt4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1ldAASTGphdmEvbGFuZy9TdHJpbmc7eHAAAAAAAAAAAgAAAAAAAAACAAAAAAAAAdB0ABlWaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsc3IADmphdmEubGFuZy5Mb25nO4vkkMyPI98CAAFKAAV2YWx1ZXhyABBqYXZhLmxhbmcuTnVtYmVyhqyVHQuU4IsCAAB4cAAAAAAAAAAQ,
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
result: null, initMsid: 161333665844, completeMsid: null, lastUpdated:
null, lastPolled: null, created: Mon Sep 12 15:51:45 EDT 2016}, job
origin:20490
2016-09-12 15:51:46,187 ERROR [c.c.a.ApiAsyncJobDispatcher]
(API-Job-Executor-33:ctx-dd1228f6 job-20490) Unexpected exception while
executing org.apache.cloudstack.api.command.admin.vm.MigrateVMCmd
2016-09-12 15:51:46,187 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-33:ctx-dd1228f6 job-20490) Complete async job-20490,
jobStatus: FAILED, resultCode: 530, result:
org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530}