You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cloudstack.apache.org by GitBox <gi...@apache.org> on 2018/10/08 11:37:30 UTC
[GitHub] borisstoyanov opened a new issue #2887: NumberFormatException when
adding a VM to VPC tier
borisstoyanov opened a new issue #2887: NumberFormatException when adding a VM to VPC tier
URL: https://github.com/apache/cloudstack/issues/2887
<!--
Verify first that your issue/request is not already reported on GitHub.
Also test if the latest release and master branch are affected too.
Always add information AFTER of these HTML comments, but no need to delete the comments.
-->
##### ISSUE TYPE
<!-- Pick one below and delete the rest -->
* Bug Report
##### COMPONENT NAME
<!--
Categorize the issue, e.g. API, VR, VPN, UI, etc.
-->
~~~
VPC
~~~
##### CLOUDSTACK VERSION
<!--
New line separated list of affected versions, commit ID for issues on master branch.
-->
~~~
4.11
~~~
##### CONFIGURATION
<!--
Information about the configuration if relevant, e.g. basic network, advanced networking, etc. N/A otherwise
-->
Advanced, VPC default offering
##### OS / ENVIRONMENT
<!--
Information about the environment if relevant, N/A otherwise
-->
CentOs7
##### SUMMARY
<!-- Explain the problem/feature briefly -->
When trying to add a new VM to VPC tier network it fails with the following exception
##### STEPS TO REPRODUCE
<!--
For bugs, show exactly how to reproduce the problem, using a minimal test-case. Use Screenshots if accurate.
For new features, show how the feature would be used.
-->
1. Create a VPC
2. Add a Tier
3. Deploy a VM to the tier
```
2018-10-08 11:21:30,208 INFO [c.c.h.v.u.VmwareHelper] (DirectAgent-89:ctx-0df6d51e 10.2.2.154, cmd: NetworkUsageCommand) (logid:4e4c278a) [ignored]failed toi get message for exception: The kexTimeout (60000 ms) expired.
2018-10-08 11:21:30,208 ERROR [c.c.h.v.r.VmwareResource] (DirectAgent-89:ctx-0df6d51e 10.2.2.154, cmd: NetworkUsageCommand) (logid:4e4c278a) Command failed due to Exception: java.net.SocketTimeoutException
Message: The kexTimeout (60000 ms) expired.
2018-10-08 11:21:30,208 DEBUG [c.c.h.v.r.VmwareResource] (DirectAgent-89:ctx-0df6d51e 10.2.2.154, cmd: NetworkUsageCommand) (logid:4e4c278a) vpc_netusage.sh execution result: false
2018-10-08 11:21:30,208 ERROR [c.c.h.v.r.VmwareResource] (DirectAgent-89:ctx-0df6d51e 10.2.2.154, cmd: NetworkUsageCommand) (logid:4e4c278a) Unable to execute NetworkUsage command on DomR (10.2.7.157), domR may not be ready yet. failure due to Command failed due to Exception: java.net.SocketTimeoutException
Message: The kexTimeout (60000 ms) expired.
2018-10-08 11:21:30,209 WARN [c.c.a.m.DirectAgentAttache] (DirectAgent-89:ctx-0df6d51e) (logid:4e4c278a) Seq 1-8510395920846684250: Throwable caught while executing command
java.lang.NumberFormatException: For input string: "Command failed due to Exception"
at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
at java.lang.Long.parseLong(Long.java:589)
at java.lang.Long.parseLong(Long.java:631)
at com.cloud.hypervisor.vmware.resource.VmwareResource.VPCNetworkUsage(VmwareResource.java:891)
at com.cloud.hypervisor.vmware.resource.VmwareResource.execute(VmwareResource.java:837)
at com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:491)
at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:315)
at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2018-10-08 11:21:30,209 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-89:ctx-0df6d51e) (logid:4e4c278a) Seq 1-8510395920846684250: Response Received:
2018-10-08 11:21:30,209 DEBUG [c.c.a.t.Request] (DirectAgent-89:ctx-0df6d51e) (logid:4e4c278a) Seq 1-8510395920846684250: Processing: { Ans: , MgmtId: 6813428811669, via: 1(10.2.2.154), Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":false,"details":"java.lang.NumberFormatException: For input string: \"Command failed due to Exception\"","wait":0}}] }
2018-10-08 11:21:30,209 DEBUG [c.c.a.t.Request] (RouterMonitor-1:ctx-12ca5f12) (logid:4e4c278a) Seq 1-8510395920846684250: Received: { Ans: , MgmtId: 6813428811669, via: 1(10.2.2.154), Ver: v1, Flags: 10, { Answer } }
2018-10-08 11:21:30,209 DEBUG [c.c.a.m.AgentManagerImpl] (RouterMonitor-1:ctx-12ca5f12) (logid:4e4c278a) Details from executing class com.cloud.agent.api.NetworkUsageCommand: java.lang.NumberFormatException: For input string: "Command failed due to Exception"
2018-10-08 11:21:30,209 WARN [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterMonitor-1:ctx-12ca5f12) (logid:4e4c278a) Error while collecting network stats from router: r-5-VM from host: 1
java.lang.ClassCastException: com.cloud.agent.api.Answer cannot be cast to com.cloud.agent.api.NetworkUsageAnswer
at com.cloud.network.router.VirtualNetworkApplianceManagerImpl$NetworkUsageTask.runInContext(VirtualNetworkApplianceManagerImpl.java:710)
at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2018-10-08 11:21:31,535 DEBUG [c.c.a.ApiServlet] (qtp788117692-19:ctx-9268cab3) (logid:7f7d010e) ===START=== 10.1.0.1 -- GET command=queryAsyncJobResult&jobId=e77639e0-cb7d-4e68-b84a-cd39ec5cf283&response=json&_=1538997790539
2018-10-08 11:21:31,537 DEBUG [c.c.a.ApiServer] (qtp788117692-19:ctx-9268cab3 ctx-0a133aa0) (logid:7f7d010e) CIDRs from which account 'Acct[bf53cd0b-cae7-11e8-836d-063260010795-admin]' is allowed to perform API calls: 0.0.0.0/0,::/0
2018-10-08 11:21:31,546 DEBUG [c.c.a.ApiServlet] (qtp788117692-19:ctx-9268cab3 ctx-0a133aa0) (logid:7f7d010e) ===END=== 10.1.0.1 -- GET command=queryAsyncJobResult&jobId=e77639e0-cb7d-4e68-b84a-cd39ec5cf283&response=json&_=1538997790539
2018-10-08 11:21:33,277 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-3:null) (logid:) SeqA 3-148: Processing Seq 3-148: { Cmd , MgmtId: -1, via: 3, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2018-10-08 11:21:33,283 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-3:null) (logid:) SeqA 3-148: Sending Seq 3-148: { Ans: , MgmtId: 6813428811669, via: 3, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2018-10-08 11:21:35,958 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-4:null) (logid:) Ping from 2(s-1-VM)
2018-10-08 11:21:37,850 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-5:null) (logid:) Ping from 3(v-2-VM)
2018-10-08 11:21:39,775 DEBUG [c.c.a.ApiServlet] (qtp788117692-13:ctx-b012f426) (logid:2403698f) ===START=== 10.1.0.1 -- GET command=queryAsyncJobResult&jobId=e77639e0-cb7d-4e68-b84a-cd39ec5cf283&response=json&_=1538997798780
2018-10-08 11:21:39,777 DEBUG [c.c.a.ApiServer] (qtp788117692-13:ctx-b012f426 ctx-57c48297) (logid:2403698f) CIDRs from which account 'Acct[bf53cd0b-cae7-11e8-836d-063260010795-admin]' is allowed to perform API calls: 0.0.0.0/0,::/0
2018-10-08 11:21:39,785 DEBUG [c.c.a.ApiServlet] (qtp788117692-13:ctx-b012f426 ctx-57c48297) (logid:2403698f) ===END=== 10.1.0.1 -- GET command=queryAsyncJobResult&jobId=e77639e0-cb7d-4e68-b84a-cd39ec5cf283&response=json&_=1538997798780
2018-10-08 11:21:39,839 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-ec8aa81d) (logid:7b31ef0c) Begin cleanup expired async-jobs
2018-10-08 11:21:39,841 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-ec8aa81d) (logid:7b31ef0c) End cleanup expired async-jobs
2018-10-08 11:21:43,277 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-6:null) (logid:) SeqA 3-150: Processing Seq 3-150: { Cmd , MgmtId: -1, via: 3, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2018-10-08 11:21:43,280 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-6:null) (logid:) SeqA 3-150: Sending Seq 3-150: { Ans: , MgmtId: 6813428811669, via: 3, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2018-10-08 11:21:45,104 DEBUG [c.c.s.StatsCollector] (StatsCollector-4:ctx-b3d88cba) (logid:9dbe56f7) AutoScaling Monitor is running...
2018-10-08 11:21:45,273 WARN [c.c.h.v.r.VmwareResource] (DirectAgent-46:ctx-5439afd1 10.2.2.154, job-34/job-35, cmd: AggregationControlCommand) (logid:e77639e0) Fail to create file /var/cache/cloud/VR-f07e2933-84da-402e-8d98-11c9b56c819e.cfg in VR 10.2.7.157
java.net.SocketTimeoutException: The kexTimeout (60000 ms) expired.
at com.trilead.ssh2.Connection.connect(Connection.java:810)
at com.trilead.ssh2.Connection.connect(Connection.java:686)
at com.cloud.utils.ssh.SshHelper.scpTo(SshHelper.java:105)
at com.cloud.utils.ssh.SshHelper.scpTo(SshHelper.java:58)
at com.cloud.hypervisor.vmware.resource.VmwareResource.createFileInVR(VmwareResource.java:904)
at com.cloud.agent.resource.virtualnetwork.VirtualRoutingResource.applyConfigToVR(VirtualRoutingResource.java:208)
at com.cloud.agent.resource.virtualnetwork.VirtualRoutingResource.execute(VirtualRoutingResource.java:441)
at com.cloud.agent.resource.virtualnetwork.VirtualRoutingResource.executeRequest(VirtualRoutingResource.java:125)
at com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:415)
at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:315)
at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2018-10-08 11:21:45,273 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-46:ctx-5439afd1) (logid:e77639e0) Seq 1-8510395920846684253: Response Received:
2018-10-08 11:21:45,273 DEBUG [c.c.a.t.Request] (DirectAgent-46:ctx-5439afd1) (logid:e77639e0) Seq 1-8510395920846684253: Processing: { Ans: , MgmtId: 6813428811669, via: 1(10.2.2.154), Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":false,"details":"The kexTimeout (60000 ms) expired.","wait":0}}] }
2018-10-08 11:21:45,274 DEBUG [c.c.a.t.Request] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35 ctx-fea33c36) (logid:e77639e0) Seq 1-8510395920846684253: Received: { Ans: , MgmtId: 6813428811669, via: 1(10.2.2.154), Ver: v1, Flags: 10, { Answer } }
```
```
2018-10-08 11:22:45,105 DEBUG [c.c.s.StatsCollector] (StatsCollector-5:ctx-0b30f381) (logid:a315c397) AutoScaling Monitor is running...
2018-10-08 11:22:45,310 WARN [c.c.h.v.r.VmwareResource] (DirectAgent-96:ctx-3b7c7b5c 10.2.2.154, job-34/job-35, cmd: SetupGuestNetworkCommand) (logid:e77639e0) Prepare SetupGuestNetwork failed due to java.net.SocketTimeoutException: The kexTimeout (60000 ms) expired.
java.net.SocketTimeoutException: The kexTimeout (60000 ms) expired.
at com.trilead.ssh2.Connection.connect(Connection.java:810)
at com.trilead.ssh2.Connection.connect(Connection.java:686)
at com.cloud.utils.ssh.SshHelper.sshExecute(SshHelper.java:144)
at com.cloud.utils.ssh.SshHelper.sshExecute(SshHelper.java:46)
at com.cloud.hypervisor.vmware.resource.VmwareResource.findRouterEthDeviceIndex(VmwareResource.java:958)
at com.cloud.hypervisor.vmware.resource.VmwareResource.prepareNetworkElementCommand(VmwareResource.java:1013)
at com.cloud.hypervisor.vmware.resource.VmwareResource.prepareCommand(VmwareResource.java:925)
at com.cloud.agent.resource.virtualnetwork.VirtualRoutingResource.executeRequest(VirtualRoutingResource.java:104)
at com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:415)
at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:315)
at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2018-10-08 11:22:45,311 ERROR [c.c.a.r.v.VirtualRoutingResource] (DirectAgent-96:ctx-3b7c7b5c 10.2.2.154, job-34/job-35, cmd: SetupGuestNetworkCommand) (logid:e77639e0) Failed to prepare VR command due to Prepare SetupGuestNetwork failed due to java.net.SocketTimeoutException: The kexTimeout (60000 ms) expired.
2018-10-08 11:22:45,311 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-96:ctx-3b7c7b5c) (logid:e77639e0) Seq 1-8510395920846684257: Response Received:
2018-10-08 11:22:45,311 DEBUG [c.c.a.t.Request] (DirectAgent-96:ctx-3b7c7b5c) (logid:e77639e0) Seq 1-8510395920846684257: Processing: { Ans: , MgmtId: 6813428811669, via: 1(10.2.2.154), Ver: v1, Flags: 110, [{"com.cloud.agent.api.Answer":{"result":false,"details":"Prepare SetupGuestNetwork failed due to java.net.SocketTimeoutException: The kexTimeout (60000 ms) expired.","wait":0}}] }
2018-10-08 11:22:45,311 DEBUG [c.c.a.m.AgentAttache] (DirectAgent-96:ctx-3b7c7b5c) (logid:e77639e0) Seq 1-8510395920846684257: No more commands found
2018-10-08 11:22:45,311 DEBUG [c.c.a.t.Request] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35 ctx-fea33c36) (logid:e77639e0) Seq 1-8510395920846684257: Received: { Ans: , MgmtId: 6813428811669, via: 1(10.2.2.154), Ver: v1, Flags: 110, { Answer } }
2018-10-08 11:22:45,311 WARN [c.c.n.r.VpcVirtualNetworkApplianceManagerImpl] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35 ctx-fea33c36) (logid:e77639e0) Unable to destroy guest network on router VM[DomainRouter|r-5-VM]
2018-10-08 11:22:45,311 WARN [c.c.n.r.VpcVirtualNetworkApplianceManagerImpl] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35 ctx-fea33c36) (logid:e77639e0) Failed to destroy guest network config Ntwk[205|Guest|11] on router VM[DomainRouter|r-5-VM]
2018-10-08 11:22:45,311 WARN [c.c.n.e.VpcVirtualRouterElement] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35 ctx-fea33c36) (logid:e77639e0) Failed to unplug nic in network Ntwk[205|Guest|11] for virtual router VM[DomainRouter|r-5-VM]
2018-10-08 11:22:45,311 WARN [o.a.c.e.o.NetworkOrchestrator] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35 ctx-fea33c36) (logid:e77639e0) Unable to complete shutdown of the network elements due to element: VpcVirtualRouter
2018-10-08 11:22:45,316 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35 ctx-fea33c36) (logid:e77639e0) Lock is released for network Ntwk[205|Guest|11] as a part of network shutdown
2018-10-08 11:22:45,320 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35 ctx-fea33c36) (logid:e77639e0) Lock is released for network id 205 as a part of network implement
2018-10-08 11:22:45,320 INFO [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35 ctx-fea33c36) (logid:e77639e0) Unable to contact resource.
com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is unreachable: Unable to apply network rules as a part of network Ntwk[205|Guest|11] implement
at org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implementNetworkElementsAndResources(NetworkOrchestrator.java:1171)
at org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implementNetwork(NetworkOrchestrator.java:1057)
at org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implementNetwork(NetworkOrchestrator.java:987)
at org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.prepare(NetworkOrchestrator.java:1558)
at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1111)
at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4930)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:5093)
at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:581)
at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:529)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2018-10-08 11:22:45,323 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35 ctx-fea33c36) (logid:e77639e0) Cleaning up resources for the vm VM[User|i-2-6-VM] in Starting state
2018-10-08 11:22:45,326 DEBUG [c.c.a.t.Request] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35 ctx-fea33c36) (logid:e77639e0) Seq 1-8510395920846684261: Sending { Cmd , MgmtId: 6813428811669, via: 1(10.2.2.154), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"checkBeforeCleanup":false,"forceStop":false,"volumesToDisconnect":[],"vmName":"i-2-6-VM","executeInSequence":false,"wait":0}}] }
2018-10-08 11:22:45,326 DEBUG [c.c.a.t.Request] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35 ctx-fea33c36) (logid:e77639e0) Seq 1-8510395920846684261: Executing: { Cmd , MgmtId: 6813428811669, via: 1(10.2.2.154), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"checkBeforeCleanup":false,"forceStop":false,"volumesToDisconnect":[],"vmName":"i-2-6-VM","executeInSequence":false,"wait":0}}] }
2018-10-08 11:22:45,326 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-51:ctx-d4acbcc0) (logid:1d26300b) Seq 1-8510395920846684261: Executing request
2018-10-08 11:22:45,326 INFO [c.c.h.v.r.VmwareResource] (DirectAgent-51:ctx-d4acbcc0 10.2.2.154, job-34/job-35, cmd: StopCommand) (logid:e77639e0) Executing resource StopCommand: {"isProxy":false,"checkBeforeCleanup":false,"forceStop":false,"volumesToDisconnect":[],"vmName":"i-2-6-VM","executeInSequence":false,"wait":0}
2018-10-08 11:22:45,341 DEBUG [c.c.h.v.m.HostMO] (DirectAgent-51:ctx-d4acbcc0 10.2.2.154, job-34/job-35, cmd: StopCommand) (logid:e77639e0) find VM i-2-6-VM on host
2018-10-08 11:22:45,341 INFO [c.c.h.v.m.HostMO] (DirectAgent-51:ctx-d4acbcc0 10.2.2.154, job-34/job-35, cmd: StopCommand) (logid:e77639e0) VM i-2-6-VM not found in host cache
2018-10-08 11:22:45,341 DEBUG [c.c.h.v.m.HostMO] (DirectAgent-51:ctx-d4acbcc0 10.2.2.154, job-34/job-35, cmd: StopCommand) (logid:e77639e0) load VM cache on host
2018-10-08 11:22:45,353 INFO [c.c.h.v.r.VmwareResource] (DirectAgent-51:ctx-d4acbcc0 10.2.2.154, job-34/job-35, cmd: StopCommand) (logid:e77639e0) VM i-2-6-VM is no longer in vSphere
2018-10-08 11:22:45,353 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-51:ctx-d4acbcc0) (logid:e77639e0) Seq 1-8510395920846684261: Response Received:
2018-10-08 11:22:45,353 DEBUG [c.c.a.t.Request] (DirectAgent-51:ctx-d4acbcc0) (logid:e77639e0) Seq 1-8510395920846684261: Processing: { Ans: , MgmtId: 6813428811669, via: 1(10.2.2.154), Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM i-2-6-VM is no longer in vSphere","wait":0}}] }
2018-10-08 11:22:45,353 DEBUG [c.c.a.t.Request] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35 ctx-fea33c36) (logid:e77639e0) Seq 1-8510395920846684261: Received: { Ans: , MgmtId: 6813428811669, via: 1(10.2.2.154), Ver: v1, Flags: 10, { StopAnswer } }
2018-10-08 11:22:45,363 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35 ctx-fea33c36) (logid:e77639e0) Successfully released network resources for the vm VM[User|i-2-6-VM]
2018-10-08 11:22:45,363 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35 ctx-fea33c36) (logid:e77639e0) Successfully cleanued up resources for the vm VM[User|i-2-6-VM] in Starting state
2018-10-08 11:22:45,366 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35 ctx-fea33c36) (logid:e77639e0) DeploymentPlanner allocation algorithm: null
2018-10-08 11:22:45,366 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35 ctx-fea33c36) (logid:e77639e0) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:1, requested cpu: 500, requested ram: 536870912
2018-10-08 11:22:45,366 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35 ctx-fea33c36) (logid:e77639e0) Is ROOT volume READY (pool already allocated)?: No
2018-10-08 11:22:45,366 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35 ctx-fea33c36) (logid:e77639e0) DeploymentPlan has host_id specified, choosing this host and making no checks on this host: 1
2018-10-08 11:22:45,367 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35 ctx-fea33c36) (logid:e77639e0) The specified host is in avoid set
2018-10-08 11:22:45,367 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35 ctx-fea33c36) (logid:e77639e0) Cannot deploy to specified host, returning.
2018-10-08 11:22:45,375 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35 ctx-fea33c36) (logid:e77639e0) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 1
2018-10-08 11:22:45,379 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35 ctx-fea33c36) (logid:e77639e0) Hosts's actual total CPU: 5985 and CPU after applying overprovisioning: 11970
2018-10-08 11:22:45,379 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35 ctx-fea33c36) (logid:e77639e0) Hosts's actual total RAM: 8589398016 and RAM after applying overprovisioning: 8589398016
2018-10-08 11:22:45,379 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35 ctx-fea33c36) (logid:e77639e0) release cpu from host: 1, old used: 3500,reserved: 0, actual total: 5985, total with overprovisioning: 11970; new used: 3000,reserved:0; movedfromreserved: false,moveToReserveredfalse
2018-10-08 11:22:45,379 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35 ctx-fea33c36) (logid:e77639e0) release mem from host: 1, old used: 4831838208,reserved: 0, total: 8589398016; new used: 4294967296,reserved:0; movedfromreserved: false,moveToReserveredfalse
2018-10-08 11:22:45,391 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35 ctx-fea33c36) (logid:e77639e0) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|i-2-6-VM]Scope=interface com.cloud.dc.DataCenter; id=1
2018-10-08 11:22:45,391 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35 ctx-fea33c36) (logid:e77639e0) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|i-2-6-VM]Scope=interface com.cloud.dc.DataCenter; id=1
2018-10-08 11:22:45,391 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35) (logid:e77639e0) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 6, job origin: 34
2018-10-08 11:22:45,391 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35) (logid:e77639e0) Unable to complete AsyncJobVO {id:35, userId: 2, accountId: 2, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAABnQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAXBzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHIAEGphdmEubGFuZy5OdW1iZXKGrJUdC5TgiwIAAHhwAAAAAAAAAAFxAH4ACnBwcHEAfgAKcHNyABFqYXZhLnV0aWwuSGFzaE1hcAUH2sHDFmDRAwACRgAKbG9hZEZhY3RvckkACXRocmVzaG9sZHhwP0AAAAAAAAx3CAAAABAAAAABdAAKVm1QYXNzd29yZHQAHHJPMEFCWFFBRG5OaGRtVmtYM0JoYzNOM2IzSmt4cA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 6813428811669, completeMsid: null, lastUpdated: null, lastPolled: null, created: Mon Oct 08 11:09:29 UTC 2018}, job origin:34
com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|i-2-6-VM]Scope=interface com.cloud.dc.DataCenter; id=1
at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1075)
at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4930)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:5093)
at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:581)
at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:529)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2018-10-08 11:22:45,401 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35) (logid:e77639e0) Complete async job-35, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAAzVW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1VzZXJ8aS0yLTYtVk1ddXIAHltMamF2YS5sYW5nLlN0YWNrVHJhY2VFbGVtZW50OwJGKjw8_SI5AgAAeHAAAAAVc3IAG2phdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudGEJxZomNt2FAgAESQAKbGluZU51bWJlckwADmRlY2xhcmluZ0NsYXNzcQB-AApMAAhmaWxlTmFtZXEAfgAKTAAKbWV0aG9kTmFtZXEAfgAKeHAAAAQzdAAmY29tLmNsb3VkLnZtLlZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGx0AB5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsLmphdmF0ABBvcmNoZXN0cmF0ZVN0YXJ0c3EAfgARAAATQnEAfgATcQB-ABRxAH4AFXNxAH4AEf____50ACRzdW4ucmVmbGVjdC5OYXRpdmVNZXRob2RBY2Nlc3NvckltcGx0AB1OYXRpdmVNZXRob2RBY2Nlc3NvckltcGwuamF2YXQAB2ludm9rZTBzcQB-ABEAAAA-cQB-ABhxAH4AGXQABmludm9rZXNxAH4AEQAAACt0AChzdW4ucmVmbGVjdC5EZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsdAAhRGVsZWdhdGluZ01ldGhvZEFjY2Vzc29ySW1wbC5qYXZhcQB-ABxzcQB-ABEAAAHydAAYamF2YS5sYW5nLnJlZmxlY3QuTWV0aG9kdAALTWV0aG9kLmphdmFxAH4AHHNxAH4AEQAAAGt0ACJjb20uY2xvdWQudm0uVm1Xb3JrSm9iSGFuZGxlclByb3h5dAAaVm1Xb3JrSm9iSGFuZGxlclByb3h5LmphdmF0AA9oYW5kbGVWbVdvcmtKb2JzcQB-ABEAABPlcQB-ABNxAH4AFHEAfgAmc3EAfgARAAAAZnQAIGNvbS5jbG91ZC52bS5WbVdvcmtKb2JEaXNwYXRjaGVydAAYVm1Xb3JrSm9iRGlzcGF0Y2hlci5qYXZhdAAGcnVuSm9ic3EAfgARAAACRXQAP29yZy5hcGFjaGUuY2xvdWRzdGFjay5mcmFtZXdvcmsuam9icy5pbXBsLkFzeW5jSm9iTWFuYWdlckltcGwkNXQAGEFzeW5jSm9iTWFuYWdlckltcGwuamF2YXQADHJ1bkluQ29udGV4dHNxAH4AEQAAADF0AD5vcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGUkMXQAG01hbmFnZWRDb250ZXh0UnVubmFibGUuamF2YXQAA3J1bnNxAH4AEQAAADh0AEJvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0JDF0ABpEZWZhdWx0TWFuYWdlZENvbnRleHQuamF2YXQABGNhbGxzcQB-ABEAAABndABAb3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5pbXBsLkRlZmF1bHRNYW5hZ2VkQ29udGV4dHEAfgA2dAAPY2FsbFdpdGhDb250ZXh0c3EAfgARAAAANXEAfgA5cQB-ADZ0AA5ydW5XaXRoQ29udGV4dHNxAH4AEQAAAC50ADxvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGVxAH4AMnEAfgAzc3EAfgARAAACEXEAfgAtcQB-AC5xAH4AM3NxAH4AEQAAAf90AC5qYXZhLnV0aWwuY29uY3VycmVudC5FeGVjdXRvcnMkUnVubmFibGVBZGFwdGVydAAORXhlY3V0b3JzLmphdmFxAH4AN3NxAH4AEQAAAQp0AB9qYXZhLnV0aWwuY29uY3VycmVudC5GdXR1cmVUYXNrdAAPRnV0dXJlVGFzay5qYXZhcQB-ADNzcQB-ABEAAAR9dAAnamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9ydAAXVGhyZWFkUG9vbEV4ZWN1dG9yLmphdmF0AAlydW5Xb3JrZXJzcQB-ABEAAAJwdAAuamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9yJFdvcmtlcnEAfgBIcQB-ADNzcQB-ABEAAALsdAAQamF2YS5sYW5nLlRocmVhZHQAC1RocmVhZC5qYXZhcQB-ADNzcgAmamF2YS51dGlsLkNvbGxlY3Rpb25zJFVubW9kaWZpYWJsZUxpc3T8DyUxteyOEAIAAUwABGxpc3RxAH4ADHhyACxqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlQ29sbGVjdGlvbhlCAIDLXvceAgABTAABY3QAFkxqYXZhL3V0aWwvQ29sbGVjdGlvbjt4cHNyABNqYXZhLnV0aWwuQXJyYXlMaXN0eIHSHZnHYZ0DAAFJAARzaXpleHAAAAAAdwQAAAAAeHEAfgBUeHNyABFqYXZhLmxhbmcuSW50ZWdlchLioKT3gYc4AgABSQAFdmFsdWV4cgAQamF2YS5sYW5nLk51bWJlcoaslR0LlOCLAgAAeHAAABDvc3EAfgBTAAAAAHcEAAAAAHhzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHEAfgBWAAAAAAAAAAF2cgAXY29tLmNsb3VkLmRjLkRhdGFDZW50ZXJjQfdzv5V8swIAAHhwAA
2018-10-08 11:22:45,408 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35) (logid:e77639e0) Publish async job-35 complete on message bus
2018-10-08 11:22:45,408 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35) (logid:e77639e0) Wake up jobs related to job-35
2018-10-08 11:22:45,408 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35) (logid:e77639e0) Update db status for job-35
2018-10-08 11:22:45,408 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35) (logid:e77639e0) Wake up jobs joined with job-35 and disjoin all subjobs created from job- 35
2018-10-08 11:22:45,417 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35) (logid:e77639e0) Done executing com.cloud.vm.VmWorkStart for job-35
2018-10-08 11:22:45,418 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-5:ctx-7d77d251 job-34/job-35) (logid:e77639e0) Remove job-35 from job monitoring
2018-10-08 11:22:45,433 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-27:ctx-ae5cca7a job-34 ctx-2fc2676e) (logid:e77639e0) Sync job-37 execution on object VmWorkJobQueue.6
2018-10-08 11:22:45,841 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-bc5325cb) (logid:fd047b28) Execute sync-queue item: SyncQueueItemVO {id:6, queueId: 5, contentType: AsyncJob, contentId: 37, lastProcessMsid: 6813428811669, lastprocessNumber: 2, lastProcessTime: Mon Oct 08 11:22:45 UTC 2018, created: Mon Oct 08 11:22:45 UTC 2018}
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services