You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cloudstack.apache.org by GitBox <gi...@apache.org> on 2020/03/18 11:34:57 UTC
[GitHub] [cloudstack] davidjumani opened a new issue #3978: systemvms do not
come up on vmware
davidjumani opened a new issue #3978: systemvms do not come up on vmware
URL: https://github.com/apache/cloudstack/issues/3978
When deploying cloudstack on VMware, systemvms are unable to come up and are continually redeployed. This appears to be due to a null pointer exception.
When it is build on commit `dc225de8115a5f03b7eb8959c7e726943dfb2be8`, it all works fine and the systemvms come up as usual
##### ISSUE TYPE
* Bug Report
##### COMPONENT NAME
VmwareResource
##### CLOUDSTACK VERSION
master (4.14)
##### CONFIGURATION
Just on bringing up the management server for the first time
##### OS / ENVIRONMENT
Identified on vmware 65
##### SUMMARY
The systemvms do not come up but get endlessly recreated,
##### STEPS TO REPRODUCE
Just build the master as of commit 36efbfcfd1db812dfbe2b005108f0d0a90170fcf and deploy on VMware
##### EXPECTED RESULTS
The systemvms fail to come up and the following log errors
~~~
2020-03-18 09:23:49,203 INFO [c.c.h.v.r.VmwareResource] (DirectAgent-22:ctx-4d5ca7b7 10.2.3.170, job-38/job-44, cmd: StartCommand) (logid:69db3762) Executing resource StartCommand: {"vm":{"id":6,"name":"v-6-VM","bootloader":"HVM","state":"Starting","type":"ConsoleProxy","cpus":1,"minSpeed":250,"maxSpeed":500,"minRam":1073741824,"maxRam":1073741824,"hostName":"v-6-VM","arch":"x86_64","os":"Other Linux (64-bit)","platformEmulator":"otherLinux64Guest","bootArgs":" template=domP type=consoleproxy host=10.2.3.243 port=8250 name=v-6-VM premium=true zone=1 pod=1 guid=Proxy.6 proxy_vm=6 disable_rp_filter=true eth2ip=10.1.36.162 eth2mask=255.255.224.0 gateway=10.1.63.254 eth0ip=0.0.0.0 eth0mask=0.0.0.0 eth1ip=10.2.8.128 eth1mask=255.255.0.0 mgmtcidr=10.2.0.0/16 localgw=10.2.254.254 internaldns1=8.8.8.8 internaldns2=8.8.4.4 dns1=8.8.8.8 dns2=8.8.4.4","enableHA":false,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"z2udCq7b4hpXI87OGEwccA","params":{"cpuOvercommitRatio":"2.0","vmware.reserve.mem":"false","vmware.reserve.cpu":"false","memoryOvercommitRatio":"1.0","nicAdapter":"E1000"},"uuid":"38badf91-b9cf-4fdd-88a8-3fd94add7a5e","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"5aac8e4b-156c-4382-97bb-7e832c2d5a46","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"d8d96070-6f33-3574-ac36-ed3f3349b304","id":2,"poolType":"NetworkFilesystem","host":"10.2.0.16","path":"/acs/primary/trl-221-v-M7-djumani/trl-221-v-M7-djumani-esxi-pri2","port":2049,"url":"NetworkFilesystem://10.2.0.16/acs/primary/trl-221-v-M7-djumani/trl-221-v-M7-djumani-esxi-pri2/?ROLE=Primary&STOREUUID=d8d96070-6f33-3574-ac36-ed3f3349b304","isManaged":false}},"name":"ROOT-6","size":0,"path":"ROOT-6","volumeId":6,"vmName":"v-6-VM","accountId":1,"format":"OVA","provisioningType":"THIN","id":6,"deviceId":0,"bytesReadRate":0,"bytesWriteRate":0,"iopsReadRate":0,"iopsWriteRate":0,"hypervisorType":"VMware","directDownload":false}},"diskSeq":0,"path":"ROOT-6","type":"ROOT","_details":{"storageHost":"10.2.0.16","managed":"false","storagePort":"2049","volumeSize":"0"}}],"nics":[{"deviceId":2,"networkRateMbps":-1,"defaultNic":true,"pxeDisable":true,"nicUuid":"f22aeb91-8721-4b3d-80c7-6812041717dd","details":{"MacAddressChanges":"true","PromiscuousMode":"false","ForgedTransmits":"true"},"dpdkEnabled":false,"uuid":"f1e62679-7d86-43d5-95e5-12e2ffcead7f","ip":"10.1.36.162","netmask":"255.255.224.0","gateway":"10.1.63.254","mac":"1e:00:36:00:00:02","dns1":"8.8.8.8","dns2":"8.8.4.4","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://7","isolationUri":"vlan://7","isSecurityGroupEnabled":false,"name":"vSwitch1,,vmwaresvs"},{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"pxeDisable":true,"nicUuid":"1094b7d3-4be5-424a-ae88-1c4da8b8e39d","details":{"MacAddressChanges":"true","PromiscuousMode":"false","ForgedTransmits":"true"},"dpdkEnabled":false,"uuid":"b6614297-1f5b-4030-869e-60284abf0ce3","mac":"02:00:5a:ad:00:06","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false,"name":"vSwitch0,,vmwaresvs"},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"pxeDisable":true,"nicUuid":"f978470b-9f73-4f7e-ba9f-5aa3477b1fba","details":{"MacAddressChanges":"true","PromiscuousMode":"false","ForgedTransmits":"true"},"dpdkEnabled":false,"uuid":"b55693c5-f807-464e-80d3-a0224f1dc930","ip":"10.2.8.128","netmask":"255.255.0.0","gateway":"10.2.254.254","mac":"1e:00:05:00:00:1c","broadcastType":"Native","type":"Management","isSecurityGroupEnabled":false,"name":"vSwitch0,,vmwaresvs"}],"guestOsDetails":{},"extraConfig":{}},"hostIp":"10.2.3.170","executeInSequence":false,"wait":0}
2020-03-18 09:23:49,342 DEBUG [c.c.h.v.r.VmwareResource] (DirectAgent-22:ctx-4d5ca7b7 10.2.3.170, job-38/job-44, cmd: StartCommand) (logid:69db3762) Using mapping name : OTHER_LINUX_64_GUEST
2020-03-18 09:23:49,420 DEBUG [c.c.h.v.m.HostMO] (DirectAgent-22:ctx-4d5ca7b7 10.2.3.170, job-38/job-44, cmd: StartCommand) (logid:69db3762) find VM v-6-VM on host
2020-03-18 09:23:49,420 INFO [c.c.h.v.m.HostMO] (DirectAgent-22:ctx-4d5ca7b7 10.2.3.170, job-38/job-44, cmd: StartCommand) (logid:69db3762) VM v-6-VM not found in host cache
2020-03-18 09:23:49,420 DEBUG [c.c.h.v.m.HostMO] (DirectAgent-22:ctx-4d5ca7b7 10.2.3.170, job-38/job-44, cmd: StartCommand) (logid:69db3762) load VM cache on host
2020-03-18 09:23:49,613 INFO [c.c.h.v.r.VmwareResource] (DirectAgent-22:ctx-4d5ca7b7 10.2.3.170, job-38/job-44, cmd: StartCommand) (logid:69db3762) Found vm v-6-VM at other host, relocate to 10.2.3.170
2020-03-18 09:23:50,712 DEBUG [c.c.h.v.m.HypervisorHostHelper] (DirectAgent-37:ctx-0d022993 10.2.3.147, job-37/job-43, cmd: StartCommand) (logid:bd8aa2d5) Prepare network on other host, vlan: 7, host: 10.2.3.170
2020-03-18 09:23:50,936 INFO [c.c.h.v.m.HypervisorHostHelper] (DirectAgent-37:ctx-0d022993 10.2.3.147, job-37/job-43, cmd: StartCommand) (logid:bd8aa2d5) Network cloud.public.7.0.1-vSwitch1 is ready on vSwitch vSwitch1
2020-03-18 09:23:50,936 INFO [c.c.h.v.m.HypervisorHostHelper] (DirectAgent-37:ctx-0d022993 10.2.3.147, job-37/job-43, cmd: StartCommand) (logid:bd8aa2d5) Network cloud.public.7.0.1-vSwitch1 is ready on vSwitch vSwitch1
2020-03-18 09:23:50,936 INFO [c.c.h.v.r.VmwareResource] (DirectAgent-37:ctx-0d022993 10.2.3.147, job-37/job-43, cmd: StartCommand) (logid:bd8aa2d5) Preparing NIC device on network cloud.public.7.0.1-vSwitch1
2020-03-18 09:23:50,936 DEBUG [c.c.h.v.r.VmwareResource] (DirectAgent-37:ctx-0d022993 10.2.3.147, job-37/job-43, cmd: StartCommand) (logid:bd8aa2d5) Prepare NIC at new device {"operation":"ADD","device":{"addressType":"Manual","macAddress":"1e:00:4f:00:00:01","key":-5,"backing":{"network":{"value":"network-63","type":"Network"},"deviceName":"cloud.public.7.0.1-vSwitch1"},"connectable":{"startConnected":true,"allowGuestControl":true,"connected":true}}}
2020-03-18 09:23:50,936 DEBUG [c.c.h.v.m.HostMO] (DirectAgent-37:ctx-0d022993 10.2.3.147, job-37/job-43, cmd: StartCommand) (logid:bd8aa2d5) find VM s-5-VM on host
2020-03-18 09:23:50,936 DEBUG [c.c.h.v.m.HostMO] (DirectAgent-37:ctx-0d022993 10.2.3.147, job-37/job-43, cmd: StartCommand) (logid:bd8aa2d5) VM s-5-VM found in host cache
2020-03-18 09:23:50,968 INFO [c.c.h.v.r.VmwareResource] (DirectAgent-37:ctx-0d022993 10.2.3.147, job-37/job-43, cmd: StartCommand) (logid:bd8aa2d5) Configure VNC port for VM s-5-VM, port: 5947, host: 10.2.3.147
2020-03-18 09:23:50,969 INFO [c.c.h.v.u.VmwareHelper] (DirectAgent-37:ctx-0d022993 10.2.3.147, job-37/job-43, cmd: StartCommand) (logid:bd8aa2d5) [ignored]failed to get message for exception: null
2020-03-18 09:23:50,969 WARN [c.c.h.v.r.VmwareResource] (DirectAgent-37:ctx-0d022993 10.2.3.147, job-37/job-43, cmd: StartCommand) (logid:bd8aa2d5) StartCommand failed due to Exception: java.lang.NullPointerException
Message: null
java.lang.NullPointerException
at com.cloud.hypervisor.vmware.resource.VmwareResource.execute(VmwareResource.java:2289)
at com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:531)
at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:315)
at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:834)
2020-03-18 09:23:50,970 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-37:ctx-0d022993) (logid:bd8aa2d5) Seq 2-7490612080223977492: Cancelling because one of the answers is false and it is stop on error.
2020-03-18 09:23:50,970 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-37:ctx-0d022993) (logid:bd8aa2d5) Seq 2-7490612080223977492: Response Received:
~~~
guessing this is because the bootmode is null, from the VirtualMachineTO object
This is soon followed by logs about how there are insufficient resources to bring up the vm
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [cloudstack] davidjumani commented on issue #3978: systemvms do not
come up on vmware
Posted by GitBox <gi...@apache.org>.
davidjumani commented on issue #3978: systemvms do not come up on vmware
URL: https://github.com/apache/cloudstack/issues/3978#issuecomment-600609449
More logs :
~~~
2020-03-18 09:45:49,727 INFO [c.c.h.v.m.HypervisorHostHelper] (DirectAgent-121:ctx-62c2dd3e 10.2.3.170, job-75/job-131, cmd: StartCommand) (logid:226ac729) Network cloud.private.untagged.0.1-vSwitch0 is ready on vSwitch vSwitch0
2020-03-18 09:45:49,728 INFO [c.c.h.v.m.HypervisorHostHelper] (DirectAgent-121:ctx-62c2dd3e 10.2.3.170, job-75/job-131, cmd: StartCommand) (logid:226ac729) Network cloud.private.untagged.0.1-vSwitch0 is ready on vSwitch vSwitch0
2020-03-18 09:45:49,728 INFO [c.c.h.v.r.VmwareResource] (DirectAgent-121:ctx-62c2dd3e 10.2.3.170, job-75/job-131, cmd: StartCommand) (logid:226ac729) Preparing NIC device on network cloud.private.untagged.0.1-vSwitch0
2020-03-18 09:45:49,728 DEBUG [c.c.h.v.r.VmwareResource] (DirectAgent-121:ctx-62c2dd3e 10.2.3.170, job-75/job-131, cmd: StartCommand) (logid:226ac729) Prepare NIC at new device {"operation":"ADD","device":{"addressType":"Manual","macAddress":"1e:00:98:00:00:1a","key":-4,"backing":{"network":{"value":"network-52","type":"Network"},"deviceName":"cloud.private.untagged.0.1-vSwitch0"},"connectable":{"startConnected":true,"allowGuestControl":true,"connected":true}}}
2020-03-18 09:45:49,728 INFO [c.c.h.v.r.VmwareResource] (DirectAgent-121:ctx-62c2dd3e 10.2.3.170, job-75/job-131, cmd: StartCommand) (logid:226ac729) Prepare NIC device based on NicTO: {"deviceId":2,"networkRateMbps":-1,"defaultNic":true,"pxeDisable":true,"nicUuid":"4c2f2de6-b2ca-400b-a189-16e52a745dc2","details":{"MacAddressChanges":"true","ForgedTransmits":"true","PromiscuousMode":"false"},"dpdkEnabled":false,"uuid":"f1e62679-7d86-43d5-95e5-12e2ffcead7f","ip":"10.1.36.161","netmask":"255.255.224.0","gateway":"10.1.63.254","mac":"1e:00:90:00:00:01","dns1":"8.8.8.8","dns2":"8.8.4.4","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://7","isolationUri":"vlan://7","isSecurityGroupEnabled":false,"name":"vSwitch1,,vmwaresvs"}
2020-03-18 09:45:49,731 DEBUG [c.c.h.v.r.VmwareResource] (DirectAgent-122:ctx-895406cd 10.2.3.147, job-76/job-132, cmd: StartCommand) (logid:5ff6a978) Using mapping name : OTHER_LINUX_64_GUEST
2020-03-18 09:45:49,739 INFO [c.c.h.v.r.VmwareResource] (DirectAgent-121:ctx-62c2dd3e 10.2.3.170, job-75/job-131, cmd: StartCommand) (logid:226ac729) Prepare network on vmwaresvs vSwitch1 with name prefix: cloud.public
2020-03-18 09:45:49,772 DEBUG [c.c.h.v.m.HostMO] (DirectAgent-122:ctx-895406cd 10.2.3.147, job-76/job-132, cmd: StartCommand) (logid:5ff6a978) find VM s-34-VM on host
2020-03-18 09:45:49,772 INFO [c.c.h.v.m.HostMO] (DirectAgent-122:ctx-895406cd 10.2.3.147, job-76/job-132, cmd: StartCommand) (logid:5ff6a978) VM s-34-VM not found in host cache
2020-03-18 09:45:49,772 DEBUG [c.c.h.v.m.HostMO] (DirectAgent-122:ctx-895406cd 10.2.3.147, job-76/job-132, cmd: StartCommand) (logid:5ff6a978) load VM cache on host
2020-03-18 09:45:49,869 INFO [c.c.h.v.r.VmwareResource] (DirectAgent-122:ctx-895406cd 10.2.3.147, job-76/job-132, cmd: StartCommand) (logid:5ff6a978) Found vm s-34-VM at other host, relocate to 10.2.3.147
2020-03-18 09:45:50,125 DEBUG [c.c.h.v.m.HypervisorHostHelper] (DirectAgent-121:ctx-62c2dd3e 10.2.3.170, job-75/job-131, cmd: StartCommand) (logid:226ac729) Prepare network on other host, vlan: 7, host: 10.2.3.147
2020-03-18 09:45:50,396 INFO [c.c.h.v.m.HypervisorHostHelper] (DirectAgent-121:ctx-62c2dd3e 10.2.3.170, job-75/job-131, cmd: StartCommand) (logid:226ac729) Network cloud.public.7.0.1-vSwitch1 is ready on vSwitch vSwitch1
2020-03-18 09:45:50,396 INFO [c.c.h.v.m.HypervisorHostHelper] (DirectAgent-121:ctx-62c2dd3e 10.2.3.170, job-75/job-131, cmd: StartCommand) (logid:226ac729) Network cloud.public.7.0.1-vSwitch1 is ready on vSwitch vSwitch1
2020-03-18 09:45:50,396 INFO [c.c.h.v.r.VmwareResource] (DirectAgent-121:ctx-62c2dd3e 10.2.3.170, job-75/job-131, cmd: StartCommand) (logid:226ac729) Preparing NIC device on network cloud.public.7.0.1-vSwitch1
2020-03-18 09:45:50,396 DEBUG [c.c.h.v.r.VmwareResource] (DirectAgent-121:ctx-62c2dd3e 10.2.3.170, job-75/job-131, cmd: StartCommand) (logid:226ac729) Prepare NIC at new device {"operation":"ADD","device":{"addressType":"Manual","macAddress":"1e:00:90:00:00:01","key":-5,"backing":{"network":{"value":"network-63","type":"Network"},"deviceName":"cloud.public.7.0.1-vSwitch1"},"connectable":{"startConnected":true,"allowGuestControl":true,"connected":true}}}
2020-03-18 09:45:50,396 DEBUG [c.c.h.v.m.HostMO] (DirectAgent-121:ctx-62c2dd3e 10.2.3.170, job-75/job-131, cmd: StartCommand) (logid:226ac729) find VM v-33-VM on host
2020-03-18 09:45:50,397 DEBUG [c.c.h.v.m.HostMO] (DirectAgent-121:ctx-62c2dd3e 10.2.3.170, job-75/job-131, cmd: StartCommand) (logid:226ac729) VM v-33-VM found in host cache
2020-03-18 09:45:50,443 INFO [c.c.h.v.r.VmwareResource] (DirectAgent-121:ctx-62c2dd3e 10.2.3.170, job-75/job-131, cmd: StartCommand) (logid:226ac729) Configure VNC port for VM v-33-VM, port: 5956, host: 10.2.3.170
2020-03-18 09:45:50,443 INFO [c.c.h.v.u.VmwareHelper] (DirectAgent-121:ctx-62c2dd3e 10.2.3.170, job-75/job-131, cmd: StartCommand) (logid:226ac729) [ignored]failed to get message for exception: null
2020-03-18 09:45:50,443 WARN [c.c.h.v.r.VmwareResource] (DirectAgent-121:ctx-62c2dd3e 10.2.3.170, job-75/job-131, cmd: StartCommand) (logid:226ac729) StartCommand failed due to Exception: java.lang.NullPointerException
Message: null
java.lang.NullPointerException
at com.cloud.hypervisor.vmware.resource.VmwareResource.execute(VmwareResource.java:2289)
at com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:531)
at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:315)
at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:834)
2020-03-18 09:45:50,447 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-121:ctx-62c2dd3e) (logid:226ac729) Seq 1-8190921822280089720: Cancelling because one of the answers is false and it is stop on error.
2020-03-18 09:45:50,447 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-121:ctx-62c2dd3e) (logid:226ac729) Seq 1-8190921822280089720: Response Received:
2020-03-18 09:45:50,447 DEBUG [c.c.a.t.Request] (DirectAgent-121:ctx-62c2dd3e) (logid:226ac729) Seq 1-8190921822280089720: Processing: { Ans: , MgmtId: 32985516673259, via: 1(10.2.3.170), Ver: v1, Flags: 10, [{"com.cloud.agent.api.StartAnswer":{"vm":{"id":33,"name":"v-33-VM","bootloader":"HVM","state":"Starting","type":"ConsoleProxy","cpus":1,"minSpeed":250,"maxSpeed":500,"minRam":1073741824,"maxRam":1073741824,"hostName":"v-33-VM","arch":"x86_64","os":"Other Linux (64-bit)","platformEmulator":"otherLinux64Guest","bootArgs":" template=domP type=consoleproxy host=10.2.3.243 port=8250 name=v-33-VM premium=true zone=1 pod=1 guid=Proxy.33 proxy_vm=33 disable_rp_filter=true eth2ip=10.1.36.161 eth2mask=255.255.224.0 gateway=10.1.63.254 eth0ip=0.0.0.0 eth0mask=0.0.0.0 eth1ip=10.2.8.126 eth1mask=255.255.0.0 mgmtcidr=10.2.0.0/16 localgw=10.2.254.254 internaldns1=8.8.8.8 internaldns2=8.8.4.4 dns1=8.8.8.8 dns2=8.8.4.4","enableHA":false,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"C3NI8vv0aT5yWdSkp1zO7w","params":{"cpuOvercommitRatio":"2.0","vmware.reserve.mem":"false","vmware.reserve.cpu":"false","memoryOvercommitRatio":"1.0","nicAdapter":"E1000"},"uuid":"166d2068-f840-48ae-876c-b1ad625a8af5","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"bedf0eed-eb82-4017-8184-dfdf2b425b66","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"d8d96070-6f33-3574-ac36-ed3f3349b304","id":2,"poolType":"NetworkFilesystem","host":"10.2.0.16","path":"/acs/primary/trl-221-v-M7-djumani/trl-221-v-M7-djumani-esxi-pri2","port":2049,"url":"NetworkFilesystem://10.2.0.16/acs/primary/trl-221-v-M7-djumani/trl-221-v-M7-djumani-esxi-pri2/?ROLE=Primary&STOREUUID=d8d96070-6f33-3574-ac36-ed3f3349b304","isManaged":false}},"name":"ROOT-33","size":0,"path":"ROOT-33","volumeId":33,"vmName":"v-33-VM","accountId":1,"format":"OVA","provisioningType":"THIN","id":33,"deviceId":0,"bytesReadRate":0,"bytesWriteRate":0,"iopsReadRate":0,"iopsWriteRate":0,"hypervisorType":"VMware","directDownload":false}},"diskSeq":0,"path":"ROOT-33","type":"ROOT","_details":{"storageHost":"10.2.0.16","managed":"false","storagePort":"2049","volumeSize":"0"}}],"nics":[{"deviceId":2,"networkRateMbps":-1,"defaultNic":true,"pxeDisable":true,"nicUuid":"4c2f2de6-b2ca-400b-a189-16e52a745dc2","details":{"MacAddressChanges":"true","ForgedTransmits":"true","PromiscuousMode":"false"},"dpdkEnabled":false,"uuid":"f1e62679-7d86-43d5-95e5-12e2ffcead7f","ip":"10.1.36.161","netmask":"255.255.224.0","gateway":"10.1.63.254","mac":"1e:00:90:00:00:01","dns1":"8.8.8.8","dns2":"8.8.4.4","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://7","isolationUri":"vlan://7","isSecurityGroupEnabled":false,"name":"vSwitch1,,vmwaresvs"},{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"pxeDisable":true,"nicUuid":"2ace9a75-006a-4de3-bf28-e2f012ef3ff0","details":{"MacAddressChanges":"true","ForgedTransmits":"true","PromiscuousMode":"false"},"dpdkEnabled":false,"uuid":"b6614297-1f5b-4030-869e-60284abf0ce3","mac":"02:00:07:09:00:21","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false,"name":"vSwitch0,,vmwaresvs"},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"pxeDisable":true,"nicUuid":"ac656158-54ff-4e56-a223-f38745f02f7d","details":{"MacAddressChanges":"true","ForgedTransmits":"true","PromiscuousMode":"false"},"dpdkEnabled":false,"uuid":"b55693c5-f807-464e-80d3-a0224f1dc930","ip":"10.2.8.126","netmask":"255.255.0.0","gateway":"10.2.254.254","mac":"1e:00:98:00:00:1a","broadcastType":"Native","type":"Management","isSecurityGroupEnabled":false,"name":"vSwitch0,,vmwaresvs"}],"guestOsDetails":{},"extraConfig":{}},"result":false,"details":"StartCommand failed due to Exception: java.lang.NullPointerException\nMessage: null\n","wait":0}}] }
2020-03-18 09:45:50,447 DEBUG [c.c.a.t.Request] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) Seq 1-8190921822280089720: Received: { Ans: , MgmtId: 32985516673259, via: 1(10.2.3.170), Ver: v1, Flags: 10, { StartAnswer } }
2020-03-18 09:45:50,452 INFO [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) Unable to start VM on Host[-1-Routing] due to StartCommand failed due to Exception: java.lang.NullPointerException
Message: null
2020-03-18 09:45:50,455 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) Cleaning up resources for the vm VM[ConsoleProxy|v-33-VM] in Starting state
2020-03-18 09:45:50,459 DEBUG [c.c.a.t.Request] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) Seq 1-8190921822280089722: Sending { Cmd , MgmtId: 32985516673259, via: 1(10.2.3.170), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"checkBeforeCleanup":false,"forceStop":false,"volumesToDisconnect":[],"vmName":"v-33-VM","executeInSequence":false,"wait":0}}] }
2020-03-18 09:45:50,459 DEBUG [c.c.a.t.Request] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) Seq 1-8190921822280089722: Executing: { Cmd , MgmtId: 32985516673259, via: 1(10.2.3.170), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"checkBeforeCleanup":false,"forceStop":false,"volumesToDisconnect":[],"vmName":"v-33-VM","executeInSequence":false,"wait":0}}] }
2020-03-18 09:45:50,459 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-61:ctx-fd195d01) (logid:2776e940) Seq 1-8190921822280089722: Executing request
2020-03-18 09:45:50,459 INFO [c.c.h.v.r.VmwareResource] (DirectAgent-61:ctx-fd195d01 10.2.3.170, job-75/job-131, cmd: StopCommand) (logid:226ac729) Executing resource StopCommand: {"isProxy":false,"checkBeforeCleanup":false,"forceStop":false,"volumesToDisconnect":[],"vmName":"v-33-VM","executeInSequence":false,"wait":0}
2020-03-18 09:45:50,480 DEBUG [c.c.h.v.m.HostMO] (DirectAgent-61:ctx-fd195d01 10.2.3.170, job-75/job-131, cmd: StopCommand) (logid:226ac729) find VM v-33-VM on host
2020-03-18 09:45:50,480 INFO [c.c.h.v.m.HostMO] (DirectAgent-61:ctx-fd195d01 10.2.3.170, job-75/job-131, cmd: StopCommand) (logid:226ac729) VM v-33-VM not found in host cache
2020-03-18 09:45:50,480 DEBUG [c.c.h.v.m.HostMO] (DirectAgent-61:ctx-fd195d01 10.2.3.170, job-75/job-131, cmd: StopCommand) (logid:226ac729) load VM cache on host
2020-03-18 09:45:50,588 INFO [c.c.h.v.r.VmwareResource] (DirectAgent-61:ctx-fd195d01 10.2.3.170, job-75/job-131, cmd: StopCommand) (logid:226ac729) VM v-33-VM is already in stopped state
2020-03-18 09:45:50,589 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-61:ctx-fd195d01) (logid:226ac729) Seq 1-8190921822280089722: Response Received:
2020-03-18 09:45:50,589 DEBUG [c.c.a.t.Request] (DirectAgent-61:ctx-fd195d01) (logid:226ac729) Seq 1-8190921822280089722: Processing: { Ans: , MgmtId: 32985516673259, via: 1(10.2.3.170), Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM v-33-VM is already in stopped state","wait":0}}] }
2020-03-18 09:45:50,589 DEBUG [c.c.a.t.Request] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) Seq 1-8190921822280089722: Received: { Ans: , MgmtId: 32985516673259, via: 1(10.2.3.170), Ver: v1, Flags: 10, { StopAnswer } }
2020-03-18 09:45:50,603 DEBUG [c.c.d.d.DataCenterIpAddressDaoImpl] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) Releasing ip address for reservationId=6337b341-4529-45f0-aba3-604fc1214ccb, instance=99
2020-03-18 09:45:50,604 DEBUG [c.c.n.g.PodBasedNetworkGuru] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) Released nic: NicProfile[99-33-null-null-null
2020-03-18 09:45:50,607 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) Successfully released network resources for the vm VM[ConsoleProxy|v-33-VM]
2020-03-18 09:45:50,607 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) Successfully cleaned up resources for the VM VM[ConsoleProxy|v-33-VM] in Starting state
2020-03-18 09:45:50,608 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) Root volume is ready, need to place VM in volume's cluster
2020-03-18 09:45:50,608 DEBUG [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) Vol[33|vm=33|ROOT] is READY, changing deployment plan to use this pool's dcId: 1 , podId: 1 , and clusterId: 1
--
2020-03-18 09:45:50,622 DEBUG [c.c.a.m.a.i.FirstFitAllocator] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566 FirstFitRoutingAllocator) (logid:226ac729) Host Allocator returning 0 suitable hosts
2020-03-18 09:45:50,622 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) No suitable hosts found
2020-03-18 09:45:50,622 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) No suitable hosts found under this Cluster: 1
2020-03-18 09:45:50,622 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) Could not find suitable Deployment Destination for this VM under any clusters, returning.
2020-03-18 09:45:50,623 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) Searching resources only under specified Cluster: 1
2020-03-18 09:45:50,623 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) The specified cluster is in avoid set, returning.
2020-03-18 09:45:50,623 INFO [c.c.v.VirtualMachineManagerImpl] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) Uefi params UefiFlag: null Boot Type: null Boot Mode: null
2020-03-18 09:45:50,624 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) DeploymentPlanner allocation algorithm: null
2020-03-18 09:45:50,624 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) Trying to allocate a host and storage pools from dc:1, pod:1,cluster:null, requested cpu: 500, requested ram: 1073741824
2020-03-18 09:45:50,624 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) Is ROOT volume READY (pool already allocated)?: No
2020-03-18 09:45:50,624 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) Deploy avoids pods: null, clusters: [1], hosts: [1, 2]
2020-03-18 09:45:50,625 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) Searching resources only under specified Pod: 1
2020-03-18 09:45:50,626 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Pod: 1
2020-03-18 09:45:50,628 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) Removing from the clusterId list these clusters from avoid set: [1]
2020-03-18 09:45:50,629 DEBUG [c.c.d.FirstFitPlanner] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) No clusters found after removing disabled clusters and clusters in avoid list, returning.
2020-03-18 09:45:50,636 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 1
2020-03-18 09:45:50,641 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) Hosts's actual total CPU: 7050 and CPU after applying overprovisioning: 14100
2020-03-18 09:45:50,641 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) Hosts's actual total RAM: 8589328384 and RAM after applying overprovisioning: 8589328384
2020-03-18 09:45:50,641 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) release cpu from host: 1, old used: 500,reserved: 0, actual total: 7050, total with overprovisioning: 14100; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
2020-03-18 09:45:50,641 DEBUG [c.c.c.CapacityManagerImpl] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) release mem from host: 1, old used: 1073741824,reserved: 0, total: 8589328384; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse
2020-03-18 09:45:50,647 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) Invocation exception, caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-33-VM]Scope=interface com.cloud.dc.DataCenter; id=1
2020-03-18 09:45:50,647 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131 ctx-5ed39566) (logid:226ac729) Rethrow exception com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-33-VM]Scope=interface com.cloud.dc.DataCenter; id=1
2020-03-18 09:45:50,647 DEBUG [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131) (logid:226ac729) Done with run of VM work job: com.cloud.vm.VmWorkStart for VM 33, job origin: 75
2020-03-18 09:45:50,647 ERROR [c.c.v.VmWorkJobDispatcher] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131) (logid:226ac729) Unable to complete AsyncJobVO {id:131, userId: 1, accountId: 1, instanceType: null, instanceId: null, cmd: com.cloud.vm.VmWorkStart, cmdInfo: rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAABAAAAAAAAAAEAAAAAAAAAIXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwcHA, cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: null, initMsid: 32985516673259, completeMsid: null, lastUpdated: null, lastPolled: null, created: Wed Mar 18 09:45:37 UTC 2020, removed: null}, job origin:75
com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-33-VM]Scope=interface com.cloud.dc.DataCenter; id=1
at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1089)
at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:5227)
at jdk.internal.reflect.GeneratedMethodAccessor236.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:5390)
at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:586)
at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:534)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:834)
2020-03-18 09:45:50,648 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131) (logid:226ac729) Complete async job-131, jobStatus: FAILED, resultCode: 0, result: rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAA6VW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW0NvbnNvbGVQcm94eXx2LTMzLVZNXXVyAB5bTGphdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudDsCRio8PP0iOQIAAHhwAAAAFHNyABtqYXZhLmxhbmcuU3RhY2tUcmFjZUVsZW1lbnRhCcWaJjbdhQIACEIABmZvcm1hdEkACmxpbmVOdW1iZXJMAA9jbGFzc0xvYWRlck5hbWVxAH4ACkwADmRlY2xhcmluZ0NsYXNzcQB-AApMAAhmaWxlTmFtZXEAfgAKTAAKbWV0aG9kTmFtZXEAfgAKTAAKbW9kdWxlTmFtZXEAfgAKTAANbW9kdWxlVmVyc2lvbnEAfgAKeHABAAAEQXQAA2FwcHQAJmNvbS5jbG91ZC52bS5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsdAAeVmlydHVhbE1hY2hpbmVNYW5hZ2VySW1wbC5qYXZhdAAQb3JjaGVzdHJhdGVTdGFydHBwc3EAfgARAQAAFGtxAH4AE3EAfgAUcQB-ABVxAH4AFnBwc3EAfgARAP____9wdAAvamRrLmludGVybmFsLnJlZmxlY3QuR2VuZXJhdGVkTWV0aG9kQWNjZXNzb3IyMzZwdAAGaW52b2tlcHBzcQB-ABECAAAAK3B0ADFqZGsuaW50ZXJuYWwucmVmbGVjdC5EZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsdAAhRGVsZWdhdGluZ01ldGhvZEFjY2Vzc29ySW1wbC5qYXZhcQB-ABp0AAlqYXZhLmJhc2V0AAYxMS4wLjZzcQB-ABECAAACNnB0ABhqYXZhLmxhbmcucmVmbGVjdC5NZXRob2R0AAtNZXRob2QuamF2YXEAfgAacQB-AB5xAH4AH3NxAH4AEQEAAABrcQB-ABN0ACJjb20uY2xvdWQudm0uVm1Xb3JrSm9iSGFuZGxlclByb3h5dAAaVm1Xb3JrSm9iSGFuZGxlclByb3h5LmphdmF0AA9oYW5kbGVWbVdvcmtKb2JwcHNxAH4AEQEAABUOcQB-ABNxAH4AFHEAfgAVcQB-ACZwcHNxAH4AEQEAAABmcQB-ABN0ACBjb20uY2xvdWQudm0uVm1Xb3JrSm9iRGlzcGF0Y2hlcnQAGFZtV29ya0pvYkRpc3BhdGNoZXIuamF2YXQABnJ1bkpvYnBwc3EAfgARAQAAAkpxAH4AE3QAP29yZy5hcGFjaGUuY2xvdWRzdGFjay5mcmFtZXdvcmsuam9icy5pbXBsLkFzeW5jSm9iTWFuYWdlckltcGwkNXQAGEFzeW5jSm9iTWFuYWdlckltcGwuamF2YXQADHJ1bkluQ29udGV4dHBwc3EAfgARAQAAADFxAH4AE3QAPm9yZy5hcGFjaGUuY2xvdWRzdGFjay5tYW5hZ2VkLmNvbnRleHQuTWFuYWdlZENvbnRleHRSdW5uYWJsZSQxdAAbTWFuYWdlZENvbnRleHRSdW5uYWJsZS5qYXZhdAADcnVucHBzcQB-ABEBAAAAOHEAfgATdABCb3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5pbXBsLkRlZmF1bHRNYW5hZ2VkQ29udGV4dCQxdAAaRGVmYXVsdE1hbmFnZWRDb250ZXh0LmphdmF0AARjYWxscHBzcQB-ABEBAAAAZ3EAfgATdABAb3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5pbXBsLkRlZmF1bHRNYW5hZ2VkQ29udGV4dHEAfgA2dAAPY2FsbFdpdGhDb250ZXh0cHBzcQB-ABEBAAAANXEAfgATcQB-ADlxAH4ANnQADnJ1bldpdGhDb250ZXh0cHBzcQB-ABEBAAAALnEAfgATdAA8b3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5NYW5hZ2VkQ29udGV4dFJ1bm5hYmxlcQB-ADJxAH4AM3Bwc3EAfgARAQAAAhZxAH4AE3EAfgAtcQB-AC5xAH4AM3Bwc3EAfgARAgAAAgNwdAAuamF2YS51dGlsLmNvbmN1cnJlbnQuRXhlY3V0b3JzJFJ1bm5hYmxlQWRhcHRlcnQADkV4ZWN1dG9ycy5qYXZhcQB-ADdxAH4AHnEAfgAfc3EAfgARAgAAAQhwdAAfamF2YS51dGlsLmNvbmN1cnJlbnQuRnV0dXJlVGFza3QAD0Z1dHVyZVRhc2suamF2YXEAfgAzcQB-AB5xAH4AH3NxAH4AEQIAAARocHQAJ2phdmEudXRpbC5jb25jdXJyZW50LlRocmVhZFBvb2xFeGVjdXRvcnQAF1RocmVhZFBvb2xFeGVjdXRvci5qYXZhdAAJcnVuV29ya2VycQB-AB5xAH4AH3NxAH4AEQIAAAJ0cHQALmphdmEudXRpbC5jb25jdXJyZW50LlRocmVhZFBvb2xFeGVjdXRvciRXb3JrZXJxAH4ASHEAfgAzcQB-AB5xAH4AH3NxAH4AEQIAAANCcHQAEGphdmEubGFuZy5UaHJlYWR0AAtUaHJlYWQuamF2YXEAfgAzcQB-AB5xAH4AH3NyAB9qYXZhLnV0aWwuQ29sbGVjdGlvbnMkRW1wdHlMaXN0ergXtDynnt4CAAB4cHhzcgARamF2YS5sYW5nLkludGVnZXIS4qCk94GHOAIAAUkABXZhbHVleHIAEGphdmEubGFuZy5OdW1iZXKGrJUdC5TgiwIAAHhwAAAQ73NyABNqYXZhLnV0aWwuQXJyYXlMaXN0eIHSHZnHYZ0DAAFJAARzaXpleHAAAAAAdwQAAAAAeHNyAA5qYXZhLmxhbmcuTG9uZzuL5JDMjyPfAgABSgAFdmFsdWV4cQB-AFIAAAAAAAAAAXZyABdjb20uY2xvdWQuZGMuRGF0YUNlbnRlclPoJBrS07ZcAgAAeHAA
2020-03-18 09:45:50,648 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131) (logid:226ac729) Publish async job-131 complete on message bus
2020-03-18 09:45:50,648 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131) (logid:226ac729) Wake up jobs related to job-131
2020-03-18 09:45:50,648 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131) (logid:226ac729) Update db status for job-131
2020-03-18 09:45:50,649 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131) (logid:226ac729) Wake up jobs joined with job-131 and disjoin all subjobs created from job- 131
2020-03-18 09:45:50,656 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131) (logid:226ac729) Done executing com.cloud.vm.VmWorkStart for job-131
2020-03-18 09:45:50,660 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-55:ctx-b2cc197a job-75/job-131) (logid:226ac729) Remove job-131 from job monitoring
2020-03-18 09:45:50,667 WARN [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-72c5d08e) (logid:df302191) Exception while trying to start console proxy
com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[ConsoleProxy|v-33-VM]Scope=interface com.cloud.dc.DataCenter; id=1
at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1089)
at com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:5227)
at jdk.internal.reflect.GeneratedMethodAccessor236.invoke(Unknown Source)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
at com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:5390)
at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:586)
at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:534)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:834)
--
~~~
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [cloudstack] borisstoyanov closed issue #3978: systemvms do not
come up on vmware
Posted by GitBox <gi...@apache.org>.
borisstoyanov closed issue #3978: systemvms do not come up on vmware
URL: https://github.com/apache/cloudstack/issues/3978
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [cloudstack] davidjumani edited a comment on issue #3978: systemvms
do not come up on vmware
Posted by GitBox <gi...@apache.org>.
davidjumani edited a comment on issue #3978: systemvms do not come up on vmware
URL: https://github.com/apache/cloudstack/issues/3978#issuecomment-600610517
Possibly has something to do with this ?
https://github.com/apache/cloudstack/commit/d4b537efa7ed27ef88b735a22493808b61529186#diff-b5942d0e7fe160052321adaaafbe2d6bR297
Can also add a null check at https://github.com/apache/cloudstack/blob/d4b537efa7ed27ef88b735a22493808b61529186/plugins/hypervisors/vmware/src/main/java/com/cloud/hypervisor/vmware/resource/VmwareResource.java#L1729
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [cloudstack] davidjumani edited a comment on issue #3978: systemvms
do not come up on vmware
Posted by GitBox <gi...@apache.org>.
davidjumani edited a comment on issue #3978: systemvms do not come up on vmware
URL: https://github.com/apache/cloudstack/issues/3978#issuecomment-600610517
Possibly has something to do with this ?
https://github.com/apache/cloudstack/blob/d4b537efa7ed27ef88b735a22493808b61529186/plugins/hypervisors/vmware/src/main/java/com/cloud/hypervisor/guru/VMwareGuru.java#L297
Put the boot type instead of the boot mode
Can also add a null check at https://github.com/apache/cloudstack/blob/d4b537efa7ed27ef88b735a22493808b61529186/plugins/hypervisors/vmware/src/main/java/com/cloud/hypervisor/vmware/resource/VmwareResource.java#L1729
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [cloudstack] davidjumani commented on issue #3978: systemvms do not
come up on vmware
Posted by GitBox <gi...@apache.org>.
davidjumani commented on issue #3978: systemvms do not come up on vmware
URL: https://github.com/apache/cloudstack/issues/3978#issuecomment-600610517
Possibly has something to do with this ?
https://github.com/apache/cloudstack/commit/d4b537efa7ed27ef88b735a22493808b61529186#diff-b5942d0e7fe160052321adaaafbe2d6bR297
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [cloudstack] borisstoyanov commented on issue #3978: systemvms do
not come up on vmware
Posted by GitBox <gi...@apache.org>.
borisstoyanov commented on issue #3978: systemvms do not come up on vmware
URL: https://github.com/apache/cloudstack/issues/3978#issuecomment-603785892
fixed in #3985
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services