You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@cloudstack.apache.org by "Ryan (JIRA)" <ji...@apache.org> on 2014/04/09 15:28:16 UTC
[jira] [Created] (CLOUDSTACK-6367) Cold Storage migration fails
between Pods - Basic Network- Xenserver 6.1 CS 4.3
Ryan created CLOUDSTACK-6367:
--------------------------------
Summary: Cold Storage migration fails between Pods - Basic Network- Xenserver 6.1 CS 4.3
Key: CLOUDSTACK-6367
URL: https://issues.apache.org/jira/browse/CLOUDSTACK-6367
Project: CloudStack
Issue Type: Bug
Security Level: Public (Anyone can view this level - this is the default.)
Components: Automation
Affects Versions: 4.3.0
Environment: Xenserver 6.1
Cloudstack 4.3 (Upgraded from 4.1.1)
Reporter: Ryan
We have a 4 node management setup. We have a zone with 2 pods, each with a cluster of 5 Xenserver 6.1 nodes. Both clusters have a primary NFS storage volume. The vm is stored on the primary volume. Basic networking is being used and each pod has it's own guest network, on a different subnet.
The steps taken are:
1. Power down the VM.
2. Attempt to migrate from one POD's primary storage volume to the other.
3. Migration is successful and the volume does appear to have been transferred over to the new volume.
4. When trying to start the VM, the user interface reports "Unable to start a VM due to concurrent operation".
Errors in management-log are as follows:
{noformat}
2014-04-09 14:02:04,243 ERROR [c.c.a.ApiAsyncJobDispatcher] (Job-Executor-59:ctx-4081e333) Unexpected exception while executing org.apache.cloudstack.api.command.user.vm.StartVMCmd
com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due to concurrent operation
at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:607)
at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:237)
at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:207)
at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3581)
at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2043)
at sun.reflect.GeneratedMethodAccessor418.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:50)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at $Proxy169.startVirtualMachine(Unknown Source)
at org.apache.cloudstack.api.command.user.vm.StartVMCmd.execute(StartVMCmd.java:121)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161)
at com.cloud.api.ApiAsyncJobDispatcher.runJobInContext(ApiAsyncJobDispatcher.java:109)
at com.cloud.api.ApiAsyncJobDispatcher$1.run(ApiAsyncJobDispatcher.java:66)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:63)
at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:509)
at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
Caused by: com.cloud.exception.AgentUnavailableException: Resource [Host:206] is unreachable: Host 206: Unable to start instance due to null
at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1072)
at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:601)
... 36 more
Caused by: java.lang.NullPointerException
at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.createDhcpEntryCommand(VirtualNetworkApplianceManagerImpl.java:3527)
at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.access$700(VirtualNetworkApplianceManagerImpl.java:286)
at com.cloud.network.router.VirtualNetworkApplianceManagerImpl$7.execute(VirtualNetworkApplianceManagerImpl.java:3050)
at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyRules(VirtualNetworkApplianceManagerImpl.java:3903)
at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyDhcpEntry(VirtualNetworkApplianceManagerImpl.java:3043)
at sun.reflect.GeneratedMethodAccessor380.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at $Proxy240.applyDhcpEntry(Unknown Source)
at com.cloud.network.element.VirtualRouterElement.addDhcpEntry(VirtualRouterElement.java:921)
at org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.prepareElement(NetworkOrchestrator.java:1187)
at org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.prepareNic(NetworkOrchestrator.java:1309)
at org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.prepare(NetworkOrchestrator.java:1245)
at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
... 38 more
2014-04-09 14:02:04,244 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Job-Executor-59:ctx-4081e333) Complete async job-6364, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable to start a VM due to concurrent operation"}
2014-04-09 14:02:04,255 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Job-Executor-59:ctx-4081e333) Done executing org.apache.cloudstack.api.command.user.vm.StartVMCmd for job-6364
2014-04-09 14:02:04,261 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Job-Executor-59:ctx-4081e333) Remove job-6364 from job monitoring
2014-04-09 14:02:05,800 DEBUG [c.c.a.ApiServlet] (catalina-exec-25:ctx-294549f5) ===START=== 192.168.101.8 -- GET command=queryAsyncJobResult&jobId=24e3f503-dc4d-4042-a89a-e3679d421190&response=json&sessionkey=ndLVG8JwV8KKyfvueQQTn7ci%2F%2B8%3D&_=1397048525803
2014-04-09 14:02:05,843 DEBUG [c.c.a.ApiServlet] (catalina-exec-25:ctx-294549f5 ctx-92460525) ===END=== 192.168.101.8 -- GET command=queryAsyncJobResult&jobId=24e3f503-dc4d-4042-a89a-e3679d421190&response=json&sessionkey=ndLVG8JwV8KKyfvueQQTn7ci%2F%2B8%3D&_=1397048525803
{noformat}
At this point the user interface shows that the root volume is now present in the target volume. The IP address for the VM in the user interface has also been updated and now displays an IP address in the correct range.
However, in the database, the vm_instance table still shows the private_ip_address as being on the old range.
The nics table shows two entries for the instance. The old nic, with an IP on the old POD guest range with a state of Deallocating. It also has an entry with a new nic, on the correct range, with a state of Allocated.
/etc/dhcphosts.txt on the routers however has not been updated. This file still contains the old mac address with the IP on the old POD guest range.
Migrating from local storage to local storage within a POD works fine. Migrating from local storage in one POD to local storage in another POD does not work correctly.
The following error is seen:
{noformat}
010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2014-04-09 14:21:56,497 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (Job-Executor-60:ctx-9fbb1b22 ctx-6aa95237) Applying dhcp entry in network Ntwk[219|Guest|47]
2014-04-09 14:21:56,502 ERROR [c.c.v.VirtualMachineManagerImpl] (Job-Executor-60:ctx-9fbb1b22 ctx-6aa95237) Failed to start instance VM[User|localtest004]
java.lang.NullPointerException
at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.createDhcpEntryCommand(VirtualNetworkApplianceManagerImpl.java:3527)
at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.access$700(VirtualNetworkApplianceManagerImpl.java:286)
at com.cloud.network.router.VirtualNetworkApplianceManagerImpl$7.execute(VirtualNetworkApplianceManagerImpl.java:3050)
at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyRules(VirtualNetworkApplianceManagerImpl.java:3903)
at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyDhcpEntry(VirtualNetworkApplianceManagerImpl.java:3043)
at sun.reflect.GeneratedMethodAccessor380.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at $Proxy240.applyDhcpEntry(Unknown Source)
at com.cloud.network.element.VirtualRouterElement.addDhcpEntry(VirtualRouterElement.java:921)
at org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.prepareElement(NetworkOrchestrator.java:1187)
at org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.prepareNic(NetworkOrchestrator.java:1309)
at org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.prepare(NetworkOrchestrator.java:1245)
at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:960)
at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:601)
at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:228)
at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:207)
at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3581)
at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2043)
at sun.reflect.GeneratedMethodAccessor418.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:50)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at $Proxy169.startVirtualMachine(Unknown Source)
at org.apache.cloudstack.api.command.user.vm.StartVMCmd.execute(StartVMCmd.java:121)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161)
at com.cloud.api.ApiAsyncJobDispatcher.runJobInContext(ApiAsyncJobDispatcher.java:109)
at com.cloud.api.ApiAsyncJobDispatcher$1.run(ApiAsyncJobDispatcher.java:66)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:63)
at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:509)
at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
2014-04-09 14:21:56,510 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-60:ctx-9fbb1b22 ctx-6aa95237) Cleaning up resources for the vm VM[User|localtest004] in Starting state
2014-04-09 14:21:56,515 DEBUG [c.c.a.t.Request] (Job-Executor-60:ctx-9fbb1b22 ctx-6aa95237) Seq 190-780080003: Sending { Cmd , MgmtId: 345049290103, via: 190(dc1csxen002.live.dc1.tradermedia.net), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"i-2-304-VM","wait":0}}] }
2014-04-09 14:21:56,515 DEBUG [c.c.a.t.Request] (Job-Executor-60:ctx-9fbb1b22 ctx-6aa95237) Seq 190-780080003: Executing: { Cmd , MgmtId: 345049290103, via: 190(dc1csxen002.live.dc1.tradermedia.net), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"i-2-304-VM","wait":0}}] }
2014-04-09 14:21:56,516 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-399:ctx-f63e60d9) Seq 190-780080003: Executing request
2014-04-09 14:21:56,610 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-339:ctx-73b5759d) Seq 645-94377697: Response Received:
2014-04-09 14:21:56,610 DEBUG [c.c.a.m.ClusteredAgentManagerImpl] (DirectAgent-339:ctx-73b5759d) Seq 645-94377697: MgmtId 345049276599: Resp: Routing to peer
2014-04-09 14:21:56,691 INFO [c.c.h.x.r.CitrixResourceBase] (DirectAgent-399:ctx-f63e60d9) VM does not exist on XenServer605e9b26-9b55-4fd3-8685-f13238b113b9
2014-04-09 14:21:56,691 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-399:ctx-f63e60d9) Seq 190-780080003: Response Received:
2014-04-09 14:21:56,691 DEBUG [c.c.a.t.Request] (DirectAgent-399:ctx-f63e60d9) Seq 190-780080003: Processing: { Ans: , MgmtId: 345049290103, via: 190, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not exist","wait":0}}] }
****SNIP*******
2014-04-09 14:21:56,985 DEBUG [c.c.d.FirstFitPlanner] (Job-Executor-60:ctx-9fbb1b22 ctx-6aa95237) Removing from the clusterId list these clusters from avoid set: [19]
2014-04-09 14:21:56,985 DEBUG [c.c.d.FirstFitPlanner] (Job-Executor-60:ctx-9fbb1b22 ctx-6aa95237) No clusters found after removing disabled clusters and clusters in avoid list, returning.
2014-04-09 14:21:57,004 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-60:ctx-9fbb1b22 ctx-6aa95237) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
2014-04-09 14:21:57,038 ERROR [c.c.a.ApiAsyncJobDispatcher] (Job-Executor-60:ctx-9fbb1b22) Unexpected exception while executing org.apache.cloudstack.api.command.user.vm.StartVMCmd
com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due to insufficient capacity
at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:605)
at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:237)
at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:207)
at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3581)
at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2043)
at sun.reflect.GeneratedMethodAccessor418.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:50)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at $Proxy169.startVirtualMachine(Unknown Source)
at org.apache.cloudstack.api.command.user.vm.StartVMCmd.execute(StartVMCmd.java:121)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161)
at com.cloud.api.ApiAsyncJobDispatcher.runJobInContext(ApiAsyncJobDispatcher.java:109)
at com.cloud.api.ApiAsyncJobDispatcher$1.run(ApiAsyncJobDispatcher.java:66)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:63)
at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:509)
at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
Caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|localtest004]Scope=interface com.cloud.dc.DataCenter; id=26
at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:921)
at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:761)
at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:601)
... 36 more
2014-04-09 14:21:57,040 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Job-Executor-60:ctx-9fbb1b22) Complete async job-6372, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable to start a VM due to insufficient capacity"}
{noformat}
Error displayed to the end user is:
Unable to start a VM due to insufficient capacity
--
This message was sent by Atlassian JIRA
(v6.2#6252)