You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by kotipalli venkatesh <ve...@gmail.com> on 2015/11/26 13:38:47 UTC
Insufficient Memory error
Hi All,
I have successfully installed Cloudstack 4.6.0 setup
hypervisor is xenserver 6.5
Successfully up and running SSVM and CPVM and Default templates downloaded.
When i am spin the new instance it 's troughs *insufficient memory error*.
But i have *sufficient place* *RAM* and *STORAGE* also.
Please look in to this Management server log:
2015-11-26 17:49:10,572 WARN [o.a.c.alerts]
(API-Job-Executor-1:ctx-801f0a96 job-56 ctx-63dfadf9) alertType:: 8 //
dataCenterId:: 3 // podId:: 3 // clusterId:: null // message:: Failed to
deploy Vm with Id: 3, on Host with Id: null
2015-11-26 17:49:10,601 ERROR [c.c.a.ApiAsyncJobDispatcher]
(API-Job-Executor-1:ctx-801f0a96 job-56) Unexpected exception while
executing org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin
com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due
to insufficient capacity
at
com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:622)
at
org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:242)
at
org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:212)
at
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3870)
at
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3488)
at
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3476)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at
org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:106)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at
com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at com.sun.proxy.$Proxy202.startVirtualMachine(Unknown Source)
at
org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin.execute(DeployVMCmdByAdmin.java:50)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
at
com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: com.cloud.exception.InsufficientServerCapacityException: Unable
to create a deployment for VM[User|i-2-3-VM]Scope=interface
com.cloud.dc.DataCenter; id=3
at
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:959)
Please any suggestion....
Warm Regards,
Venkatesh.k
Re: Insufficient Memory error
Posted by Rubens Malheiro <ru...@gmail.com>.
has reached its value to overprovision?
And remember in some clusters the CloudStack reserve 15% of memory.
> Em 27 de nov de 2015, à(s) 02:21, Anshul Gangwar <an...@citrix.com> escreveu:
>
> Can you check your second storage?
>
> From below exception it seems there are 2 VDI template at location /export/secondary/template/tmpl/1/5. Remove/move the unneeded one.
>
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Unable to
>>> contact resource.
>>> com.cloud.exception.StorageUnavailableException: Resource [StoragePool:8]
>>> is unreachable: Unable to create Vol[6|vm=5|ROOT]:Expected 1 VDI template
>>> but found 2 VDI template(s) on: 10.0.0.170:
>>> /export/secondary/template/tmpl/1/5
>
>
>
>> On 27-Nov-2015, at 9:38 AM, kotipalli venkatesh <ve...@gmail.com> wrote:
>>
>> Hi Weingärtner,
>>
>> Yes, storage server is available on host and Sufficient place in RAM also.
>>
>> Could you please help me guys..
>> Regards,
>> Venkatesh.k
>>
>> On Fri, Nov 27, 2015 at 4:01 AM, Rafael Weingärtner <
>> rafaelweingartner@gmail.com> wrote:
>>
>>> is the storage server available on your hosts ?
>>> I notice that on your log files:
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Unable to
>>> contact resource.
>>> com.cloud.exception.StorageUnavailableException: Resource [StoragePool:8]
>>> is unreachable: Unable to create Vol[6|vm=5|ROOT]:Expected 1 VDI template
>>> but found 2 VDI template(s) on: 10.0.0.170:
>>> /export/secondary/template/tmpl/1/5
>>> at
>>>
>>> On Thu, Nov 26, 2015 at 1:49 PM, kotipalli venkatesh <
>>> venkateshcloudtest@gmail.com> wrote:
>>>
>>>> Hi Erik,
>>>>
>>>> Please look in to this full log:
>>>>
>>>>
>>>> 2015-11-26 20:21:46,959 DEBUG [c.c.a.m.AgentManagerImpl]
>>>> (AgentManager-Handler-15:null) SeqA 5-1781: Processing Seq 5-1781: {
>>> Cmd ,
>>>> MgmtId: -1, via: 5, Ver: v1, Flags: 11,
>>>>
>>>>
>>> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
>>>> \"connections\": []\n}","wait":0}}] }
>>>> 2015-11-26 20:21:46,962 DEBUG [c.c.a.m.AgentManagerImpl]
>>>> (AgentManager-Handler-15:null) SeqA 5-1781: Sending Seq 5-1781: { Ans: ,
>>>> MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
>>>> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
>>>> 2015-11-26 20:21:48,018 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (AsyncJobMgr-Heartbeat-1:ctx-0bf05867) Begin cleanup expired async-jobs
>>>> 2015-11-26 20:21:48,020 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (AsyncJobMgr-Heartbeat-1:ctx-0bf05867) End cleanup expired async-jobs
>>>> 2015-11-26 20:21:48,210 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (RouterStatusMonitor-1:ctx-0e1a35ca) Found 1 routers to update status.
>>>> 2015-11-26 20:21:48,210 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (RouterStatusMonitor-1:ctx-0e1a35ca) Found 0 VPC networks to update
>>>> Redundant State.
>>>> 2015-11-26 20:21:48,211 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (RouterStatusMonitor-1:ctx-0e1a35ca) Found 0 networks to update RvR
>>> status.
>>>> 2015-11-26 20:21:48,222 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (RouterStatusMonitor-1:ctx-71753b97) Found 1 routers to update status.
>>>> 2015-11-26 20:21:48,222 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (RouterStatusMonitor-1:ctx-71753b97) Found 0 VPC networks to update
>>>> Redundant State.
>>>> 2015-11-26 20:21:48,223 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (RouterStatusMonitor-1:ctx-71753b97) Found 0 networks to update RvR
>>> status.
>>>> 2015-11-26 20:21:53,165 DEBUG [c.c.h.d.HostDaoImpl]
>>> (ClusteredAgentManager
>>>> Timer:ctx-3ab0cd7f) Resetting hosts suitable for reconnect
>>>> 2015-11-26 20:21:53,166 DEBUG [c.c.h.d.HostDaoImpl]
>>> (ClusteredAgentManager
>>>> Timer:ctx-3ab0cd7f) Completed resetting hosts suitable for reconnect
>>>> 2015-11-26 20:21:53,166 DEBUG [c.c.h.d.HostDaoImpl]
>>> (ClusteredAgentManager
>>>> Timer:ctx-3ab0cd7f) Acquiring hosts for clusters already owned by this
>>>> management server
>>>> 2015-11-26 20:21:53,168 DEBUG [c.c.h.d.HostDaoImpl]
>>> (ClusteredAgentManager
>>>> Timer:ctx-3ab0cd7f) Completed acquiring hosts for clusters already owned
>>> by
>>>> this management server
>>>> 2015-11-26 20:21:53,168 DEBUG [c.c.h.d.HostDaoImpl]
>>> (ClusteredAgentManager
>>>> Timer:ctx-3ab0cd7f) Acquiring hosts for clusters not owned by any
>>>> management server
>>>> 2015-11-26 20:21:53,168 DEBUG [c.c.h.d.HostDaoImpl]
>>> (ClusteredAgentManager
>>>> Timer:ctx-3ab0cd7f) Completed acquiring hosts for clusters not owned by
>>> any
>>>> management server
>>>> 2015-11-26 20:21:55,958 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-2:ctx-5db7a86d) ===START=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=deployVirtualMachine&response=json&zoneid=5b752672-2ac9-4ec0-86a6-103cae8217d1&templateid=900a5634-9414-11e5-ae19-000c29255f5e&hypervisor=XenServer&serviceofferingid=94b83ad1-406c-44d5-86c0-d4dbb82a50a1&diskofferingid=30f3f1fa-76b2-4bcb-82c5-449ce7d9a4c8&iptonetworklist%5B0%5D.networkid=2e97fcee-3d01-40d2-a624-376661747d0c&displayname=Test002&name=Test002&_=1448549581263
>>>> 2015-11-26 20:21:55,969 DEBUG [c.c.u.AccountManagerImpl]
>>>> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Access granted to
>>>> Acct[20064ffe-9415-11e5-a790-000c29255f5e-admin] to
>>>> com.cloud.service.ServiceOfferingVO$$EnhancerByCGLIB$$8b588241@5020f5b3
>>> by
>>>> AffinityGroupAccessChecker
>>>> 2015-11-26 20:21:55,969 DEBUG [c.c.u.AccountManagerImpl]
>>>> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Access granted to
>>>> Acct[20064ffe-9415-11e5-a790-000c29255f5e-admin] to
>>>> com.cloud.storage.DiskOfferingVO$$EnhancerByCGLIB$$a160ea41@45e982eb by
>>>> AffinityGroupAccessChecker
>>>> 2015-11-26 20:21:55,976 DEBUG [c.c.n.NetworkModelImpl]
>>>> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Service SecurityGroup is not
>>>> supported in the network id=212
>>>> 2015-11-26 20:21:55,982 DEBUG [c.c.v.UserVmManagerImpl]
>>>> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Allocating in the DB for vm
>>>> 2015-11-26 20:21:55,988 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Allocating entries for VM:
>>>> VM[User|i-2-5-VM]
>>>> 2015-11-26 20:21:55,988 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Allocating nics for
>>>> VM[User|i-2-5-VM]
>>>> 2015-11-26 20:21:55,989 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Allocating nic for vm
>>>> VM[User|i-2-5-VM] in network Ntwk[212|Guest|8] with requested profile
>>>> NicProfile[0-0-null-null-null
>>>> 2015-11-26 20:21:55,996 DEBUG [c.c.n.NetworkModelImpl]
>>>> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Service SecurityGroup is not
>>>> supported in the network id=212
>>>> 2015-11-26 20:21:55,997 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Allocating disks for
>>>> VM[User|i-2-5-VM]
>>>> 2015-11-26 20:21:56,008 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Allocation completed for VM:
>>>> VM[User|i-2-5-VM]
>>>> 2015-11-26 20:21:56,009 DEBUG [c.c.v.UserVmManagerImpl]
>>>> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Successfully allocated DB
>>> entry
>>>> for VM[User|i-2-5-VM]
>>>> 2015-11-26 20:21:56,034 DEBUG [c.c.n.NetworkModelImpl]
>>>> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Service SecurityGroup is not
>>>> supported in the network id=212
>>>> 2015-11-26 20:21:56,037 DEBUG [c.c.n.NetworkModelImpl]
>>>> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Service SecurityGroup is not
>>>> supported in the network id=212
>>>> 2015-11-26 20:21:56,053 INFO [o.a.c.f.j.i.AsyncJobMonitor]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68) Add job-68 into job monitoring
>>>> 2015-11-26 20:21:56,054 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) submit async job-68, details:
>>>> AsyncJobVO {id:68, userId: 2, accountId: 2, instanceType: VirtualMachine,
>>>> instanceId: 5, cmd:
>>>> org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin, cmdInfo:
>>>>
>>>>
>>> {"serviceofferingid":"94b83ad1-406c-44d5-86c0-d4dbb82a50a1","cmdEventType":"VM.CREATE","ctxUserId":"2","zoneid":"5b752672-2ac9-4ec0-86a6-103cae8217d1","httpmethod":"GET","templateid":"900a5634-9414-11e5-ae19-000c29255f5e","response":"json","id":"5","ctxDetails":"{\"interface
>>>>
>>>>
>>> com.cloud.template.VirtualMachineTemplate\":\"900a5634-9414-11e5-ae19-000c29255f5e\",\"interface
>>>>
>>>>
>>> com.cloud.offering.DiskOffering\":\"30f3f1fa-76b2-4bcb-82c5-449ce7d9a4c8\",\"interface
>>>>
>>>>
>>> com.cloud.offering.ServiceOffering\":\"94b83ad1-406c-44d5-86c0-d4dbb82a50a1\",\"interface
>>>>
>>>>
>>> com.cloud.vm.VirtualMachine\":\"4ce4731f-22a7-42ac-8e78-093d5f2e9a34\",\"interface
>>>>
>>>>
>>> com.cloud.dc.DataCenter\":\"5b752672-2ac9-4ec0-86a6-103cae8217d1\"}","hypervisor":"XenServer","name":"Test002","iptonetworklist[0].networkid":"2e97fcee-3d01-40d2-a624-376661747d0c","_":"1448549581263","uuid":"4ce4731f-22a7-42ac-8e78-093d5f2e9a34","ctxAccountId":"2","diskofferingid":"30f3f1fa-76b2-4bcb-82c5-449ce7d9a4c8","ctxStartEventId":"168","displayname":"Test002"},
>>>> cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
>>>> result: null, initMsid: 52229922654, completeMsid: null, lastUpdated:
>>> null,
>>>> lastPolled: null, created: null}
>>>> 2015-11-26 20:21:56,058 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) ===END=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=deployVirtualMachine&response=json&zoneid=5b752672-2ac9-4ec0-86a6-103cae8217d1&templateid=900a5634-9414-11e5-ae19-000c29255f5e&hypervisor=XenServer&serviceofferingid=94b83ad1-406c-44d5-86c0-d4dbb82a50a1&diskofferingid=30f3f1fa-76b2-4bcb-82c5-449ce7d9a4c8&iptonetworklist%5B0%5D.networkid=2e97fcee-3d01-40d2-a624-376661747d0c&displayname=Test002&name=Test002&_=1448549581263
>>>> 2015-11-26 20:21:56,061 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68) Executing AsyncJobVO {id:68,
>>>> userId: 2, accountId: 2, instanceType: VirtualMachine, instanceId: 5,
>>> cmd:
>>>> org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin, cmdInfo:
>>>>
>>>>
>>> {"serviceofferingid":"94b83ad1-406c-44d5-86c0-d4dbb82a50a1","cmdEventType":"VM.CREATE","ctxUserId":"2","zoneid":"5b752672-2ac9-4ec0-86a6-103cae8217d1","httpmethod":"GET","templateid":"900a5634-9414-11e5-ae19-000c29255f5e","response":"json","id":"5","ctxDetails":"{\"interface
>>>>
>>>>
>>> com.cloud.template.VirtualMachineTemplate\":\"900a5634-9414-11e5-ae19-000c29255f5e\",\"interface
>>>>
>>>>
>>> com.cloud.offering.DiskOffering\":\"30f3f1fa-76b2-4bcb-82c5-449ce7d9a4c8\",\"interface
>>>>
>>>>
>>> com.cloud.offering.ServiceOffering\":\"94b83ad1-406c-44d5-86c0-d4dbb82a50a1\",\"interface
>>>>
>>>>
>>> com.cloud.vm.VirtualMachine\":\"4ce4731f-22a7-42ac-8e78-093d5f2e9a34\",\"interface
>>>>
>>>>
>>> com.cloud.dc.DataCenter\":\"5b752672-2ac9-4ec0-86a6-103cae8217d1\"}","hypervisor":"XenServer","name":"Test002","iptonetworklist[0].networkid":"2e97fcee-3d01-40d2-a624-376661747d0c","_":"1448549581263","uuid":"4ce4731f-22a7-42ac-8e78-093d5f2e9a34","ctxAccountId":"2","diskofferingid":"30f3f1fa-76b2-4bcb-82c5-449ce7d9a4c8","ctxStartEventId":"168","displayname":"Test002"},
>>>> cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
>>>> result: null, initMsid: 52229922654, completeMsid: null, lastUpdated:
>>> null,
>>>> lastPolled: null, created: null}
>>>> 2015-11-26 20:21:56,085 DEBUG [c.c.n.NetworkModelImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Service
>>> SecurityGroup
>>>> is not supported in the network id=212
>>>> 2015-11-26 20:21:56,087 DEBUG [c.c.n.NetworkModelImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Service
>>> SecurityGroup
>>>> is not supported in the network id=212
>>>> 2015-11-26 20:21:56,094 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Deploy avoids pods:
>>>> [], clusters: [], hosts: []
>>>> 2015-11-26 20:21:56,095 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) DeploymentPlanner
>>>> allocation algorithm: com.cloud.deploy.FirstFitPlanner@1136745
>>>> 2015-11-26 20:21:56,095 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Trying to allocate
>>> a
>>>> host and storage pools from dc:3, pod:null,cluster:null, requested cpu:
>>>> 1000, requested ram: 1073741824
>>>> 2015-11-26 20:21:56,095 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Is ROOT volume
>>> READY
>>>> (pool already allocated)?: No
>>>> 2015-11-26 20:21:56,095 DEBUG [c.c.d.FirstFitPlanner]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Searching all
>>>> possible resources under this Zone: 3
>>>> 2015-11-26 20:21:56,096 DEBUG [c.c.d.FirstFitPlanner]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Listing clusters in
>>>> order of aggregate capacity, that have (atleast one host with) enough CPU
>>>> and RAM capacity under this Zone: 3
>>>> 2015-11-26 20:21:56,097 DEBUG [c.c.d.FirstFitPlanner]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Removing from the
>>>> clusterId list these clusters from avoid set: []
>>>> 2015-11-26 20:21:56,103 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking resources
>>> in
>>>> Cluster: 3 under Pod: 3
>>>> 2015-11-26 20:21:56,104 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
>>>> FirstFitRoutingAllocator) Looking for hosts in dc: 3 pod:3 cluster:3
>>>> 2015-11-26 20:21:56,105 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
>>>> FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for
>>>> allocation: [Host[-4-Routing]]
>>>> 2015-11-26 20:21:56,108 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
>>>> FirstFitRoutingAllocator) Found 1 hosts for allocation after
>>>> prioritization: [Host[-4-Routing]]
>>>> 2015-11-26 20:21:56,108 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
>>>> FirstFitRoutingAllocator) Looking for speed=1000Mhz, Ram=1024
>>>> 2015-11-26 20:21:56,111 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
>>>> FirstFitRoutingAllocator) Host: 4 has cpu capability (cpu:1, speed:3399)
>>> to
>>>> support requested CPU: 1 and requested speed: 1000
>>>> 2015-11-26 20:21:56,111 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
>>>> FirstFitRoutingAllocator) Checking if host: 4 has enough capacity for
>>>> requested CPU: 1000 and requested RAM: 1073741824 ,
>>>> cpuOverprovisioningFactor: 1.0
>>>> 2015-11-26 20:21:56,113 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
>>>> FirstFitRoutingAllocator) Hosts's actual total CPU: 3399 and CPU after
>>>> applying overprovisioning: 3399
>>>> 2015-11-26 20:21:56,113 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
>>>> FirstFitRoutingAllocator) Free CPU: 2399 , Requested CPU: 1000
>>>> 2015-11-26 20:21:56,113 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
>>>> FirstFitRoutingAllocator) Free RAM: 13743892480 , Requested RAM:
>>> 1073741824
>>>> 2015-11-26 20:21:56,113 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
>>>> FirstFitRoutingAllocator) Host has enough CPU and RAM available
>>>> 2015-11-26 20:21:56,113 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
>>>> FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 4, used: 1000,
>>>> reserved: 0, actual total: 3399, total with overprovisioning: 3399;
>>>> requested cpu:1000,alloc_from_last_host?:false
>>> ,considerReservedCapacity?:
>>>> true
>>>> 2015-11-26 20:21:56,113 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
>>>> FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 4, used:
>>>> 1610612736, reserved: 0, total: 15354505216; requested mem:
>>>> 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
>>>> 2015-11-26 20:21:56,113 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
>>>> FirstFitRoutingAllocator) Found a suitable host, adding to list: 4
>>>> 2015-11-26 20:21:56,113 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
>>>> FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts
>>>> 2015-11-26 20:21:56,115 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking suitable
>>>> pools for volume (Id, Type): (6,ROOT)
>>>> 2015-11-26 20:21:56,115 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) We need to allocate
>>>> new storagepool for this volume
>>>> 2015-11-26 20:21:56,115 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Calling
>>>> StoragePoolAllocators to find suitable pools
>>>> 2015-11-26 20:21:56,116 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e)
>>>> LocalStoragePoolAllocator trying to find storage pool to fit the vm
>>>> 2015-11-26 20:21:56,116 DEBUG
>>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e)
>>>> ClusterScopeStoragePoolAllocator looking for storage pool
>>>> 2015-11-26 20:21:56,116 DEBUG
>>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Looking for pools
>>> in
>>>> dc: 3 pod:3 cluster:3. Disabled pools will be ignored.
>>>> 2015-11-26 20:21:56,117 DEBUG
>>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found pools
>>> matching
>>>> tags: [Pool[8|NetworkFilesystem]]
>>>> 2015-11-26 20:21:56,118 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking if storage
>>>> pool is suitable, name: null ,poolId: 8
>>>> 2015-11-26 20:21:56,119 INFO [c.c.s.StorageManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Storage pool null
>>> (8)
>>>> does not supply IOPS capacity, assuming enough capacity
>>>> 2015-11-26 20:21:56,120 DEBUG [c.c.s.StorageManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool 8 for
>>>> storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
>>>> 0.019253810234789077, disable threshold: 0.85
>>>> 2015-11-26 20:21:56,130 DEBUG [c.c.s.StorageManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found storage pool
>>>> primary of type NetworkFilesystem with overprovisioning factor 2
>>>> 2015-11-26 20:21:56,130 DEBUG [c.c.s.StorageManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total over
>>>> provisioned capacity calculated is 2 * 526199291904
>>>> 2015-11-26 20:21:56,130 DEBUG [c.c.s.StorageManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total capacity of
>>> the
>>>> pool primary id: 8 is 1052398583808
>>>> 2015-11-26 20:21:56,130 DEBUG [c.c.s.StorageManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool: 8
>>> for
>>>> volume allocation [Vol[6|vm=5|ROOT]], maxSize : 1052398583808,
>>>> totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
>>>> disable threshold: 0.85
>>>> 2015-11-26 20:21:56,130 DEBUG
>>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e)
>>>> ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
>>>> 2015-11-26 20:21:56,130 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking suitable
>>>> pools for volume (Id, Type): (7,DATADISK)
>>>> 2015-11-26 20:21:56,130 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) We need to allocate
>>>> new storagepool for this volume
>>>> 2015-11-26 20:21:56,131 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Calling
>>>> StoragePoolAllocators to find suitable pools
>>>> 2015-11-26 20:21:56,131 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e)
>>>> LocalStoragePoolAllocator trying to find storage pool to fit the vm
>>>> 2015-11-26 20:21:56,131 DEBUG
>>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e)
>>>> ClusterScopeStoragePoolAllocator looking for storage pool
>>>> 2015-11-26 20:21:56,131 DEBUG
>>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Looking for pools
>>> in
>>>> dc: 3 pod:3 cluster:3. Disabled pools will be ignored.
>>>> 2015-11-26 20:21:56,131 DEBUG
>>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found pools
>>> matching
>>>> tags: [Pool[8|NetworkFilesystem]]
>>>> 2015-11-26 20:21:56,132 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking if storage
>>>> pool is suitable, name: null ,poolId: 8
>>>> 2015-11-26 20:21:56,132 INFO [c.c.s.StorageManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Storage pool null
>>> (8)
>>>> does not supply IOPS capacity, assuming enough capacity
>>>> 2015-11-26 20:21:56,133 DEBUG [c.c.s.StorageManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool 8 for
>>>> storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
>>>> 0.019253810234789077, disable threshold: 0.85
>>>> 2015-11-26 20:21:56,139 DEBUG [c.c.s.StorageManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found storage pool
>>>> primary of type NetworkFilesystem with overprovisioning factor 2
>>>> 2015-11-26 20:21:56,139 DEBUG [c.c.s.StorageManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total over
>>>> provisioned capacity calculated is 2 * 526199291904
>>>> 2015-11-26 20:21:56,139 DEBUG [c.c.s.StorageManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total capacity of
>>> the
>>>> pool primary id: 8 is 1052398583808
>>>> 2015-11-26 20:21:56,140 DEBUG [c.c.s.StorageManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool: 8
>>> for
>>>> volume allocation [Vol[7|vm=5|DATADISK]], maxSize : 1052398583808,
>>>> totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
>>>> disable threshold: 0.85
>>>> 2015-11-26 20:21:56,140 DEBUG
>>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e)
>>>> ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
>>>> 2015-11-26 20:21:56,140 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Trying to find a
>>>> potenial host and associated storage pools from the suitable host/pool
>>>> lists for this VM
>>>> 2015-11-26 20:21:56,140 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking if host: 4
>>>> can access any suitable storage pool for volume: DATADISK
>>>> 2015-11-26 20:21:56,140 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Host: 4 can access
>>>> pool: 8
>>>> 2015-11-26 20:21:56,141 DEBUG [c.c.s.StorageManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool 8 for
>>>> storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
>>>> 0.019253810234789077, disable threshold: 0.85
>>>> 2015-11-26 20:21:56,142 DEBUG [c.c.s.StorageManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found storage pool
>>>> primary of type NetworkFilesystem with overprovisioning factor 2
>>>> 2015-11-26 20:21:56,142 DEBUG [c.c.s.StorageManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total over
>>>> provisioned capacity calculated is 2 * 526199291904
>>>> 2015-11-26 20:21:56,143 DEBUG [c.c.s.StorageManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total capacity of
>>> the
>>>> pool primary id: 8 is 1052398583808
>>>> 2015-11-26 20:21:56,143 DEBUG [c.c.s.StorageManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool: 8
>>> for
>>>> volume allocation [Vol[7|vm=5|DATADISK]], maxSize : 1052398583808,
>>>> totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
>>>> disable threshold: 0.85
>>>> 2015-11-26 20:21:56,143 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking if host: 4
>>>> can access any suitable storage pool for volume: ROOT
>>>> 2015-11-26 20:21:56,143 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Host: 4 can access
>>>> pool: 8
>>>> 2015-11-26 20:21:56,144 DEBUG [c.c.s.StorageManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool 8 for
>>>> storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
>>>> 0.019253810234789077, disable threshold: 0.85
>>>> 2015-11-26 20:21:56,146 DEBUG [c.c.s.StorageManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found storage pool
>>>> primary of type NetworkFilesystem with overprovisioning factor 2
>>>> 2015-11-26 20:21:56,146 DEBUG [c.c.s.StorageManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total over
>>>> provisioned capacity calculated is 2 * 526199291904
>>>> 2015-11-26 20:21:56,146 DEBUG [c.c.s.StorageManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total capacity of
>>> the
>>>> pool primary id: 8 is 1052398583808
>>>> 2015-11-26 20:21:56,147 DEBUG [c.c.s.StorageManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool: 8
>>> for
>>>> volume allocation [Vol[6|vm=5|ROOT]], maxSize : 1052398583808,
>>>> totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
>>>> disable threshold: 0.85
>>>> 2015-11-26 20:21:56,147 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found a potential
>>>> host id: 4 name: xenserver and associated storage pools for this VM
>>>> 2015-11-26 20:21:56,148 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Returning
>>> Deployment
>>>> Destination:
>>>>
>>>>
>>> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
>>>> :
>>>>
>>>>
>>> Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage(Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
>>>> Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
>>>> Volume(7|DATADISK-->Pool(8))]
>>>> 2015-11-26 20:21:56,155 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Sync job-69
>>> execution
>>>> on object VmWorkJobQueue.5
>>>> 2015-11-26 20:21:56,961 DEBUG [c.c.a.m.AgentManagerImpl]
>>>> (AgentManager-Handler-1:null) SeqA 5-1782: Processing Seq 5-1782: { Cmd
>>> ,
>>>> MgmtId: -1, via: 5, Ver: v1, Flags: 11,
>>>>
>>>>
>>> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
>>>> \"connections\": []\n}","wait":0}}] }
>>>> 2015-11-26 20:21:56,966 DEBUG [c.c.a.m.AgentManagerImpl]
>>>> (AgentManager-Handler-1:null) SeqA 5-1782: Sending Seq 5-1782: { Ans: ,
>>>> MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
>>>> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
>>>> 2015-11-26 20:21:58,022 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (AsyncJobMgr-Heartbeat-1:ctx-7d4d1e50) Execute sync-queue item:
>>>> SyncQueueItemVO {id:9, queueId: 9, contentType: AsyncJob, contentId: 69,
>>>> lastProcessMsid: 52229922654, lastprocessNumber: 1, lastProcessTime: Thu
>>>> Nov 26 20:21:58 IST 2015, created: Thu Nov 26 20:21:56 IST 2015}
>>>> 2015-11-26 20:21:58,022 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (AsyncJobMgr-Heartbeat-1:ctx-7d4d1e50) Schedule queued job-69
>>>> 2015-11-26 20:21:58,026 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (AsyncJobMgr-Heartbeat-1:ctx-05b26563) Begin cleanup expired async-jobs
>>>> 2015-11-26 20:21:58,029 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (AsyncJobMgr-Heartbeat-1:ctx-05b26563) End cleanup expired async-jobs
>>>> 2015-11-26 20:21:58,029 INFO [o.a.c.f.j.i.AsyncJobMonitor]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Add job-69 into job
>>>> monitoring
>>>> 2015-11-26 20:21:58,033 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Executing AsyncJobVO
>>>> {id:69, userId: 2, accountId: 2, instanceType: null, instanceId: null,
>>> cmd:
>>>> com.cloud.vm.VmWorkStart, cmdInfo:
>>>>
>>>>
>>> rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAABXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAA3BzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHIAEGphdmEubGFuZy5OdW1iZXKGrJUdC5TgiwIAAHhwAAAAAAAAAANzcQB-AAgAAAAAAAAABHBwcHEAfgAKcHNyABFqYXZhLnV0aWwuSGFzaE1hcAUH2sHDFmDRAwACRgAKbG9hZEZhY3RvckkACXRocmVzaG9sZHhwP0AAAAAAAAx3CAAAABAAAAABdAAKVm1QYXNzd29yZHQAHHJPMEFCWFFBRG5OaGRtVmtYM0JoYzNOM2IzSmt4cA,
>>>> cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
>>>> result: null, initMsid: 52229922654, completeMsid: null, lastUpdated:
>>> null,
>>>> lastPolled: null, created: Thu Nov 26 20:21:56 IST 2015}
>>>> 2015-11-26 20:21:58,033 DEBUG [c.c.v.VmWorkJobDispatcher]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Run VM work job:
>>>> com.cloud.vm.VmWorkStart for VM 5, job origin: 68
>>>> 2015-11-26 20:21:58,034 DEBUG [c.c.v.VmWorkJobHandlerProxy]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Execute VM
>>>> work job:
>>>>
>>>>
>>> com.cloud.vm.VmWorkStart{"dcId":3,"podId":3,"clusterId":3,"hostId":4,"rawParams":{"VmPassword":"rO0ABXQADnNhdmVkX3Bhc3N3b3Jk"},"userId":2,"accountId":2,"vmId":5,"handlerName":"VirtualMachineManagerImpl"}
>>>> 2015-11-26 20:21:58,038 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM state
>>>> transitted from :Stopped to Starting with event: StartRequestedvm's
>>>> original host id: null new host id: null host id before state transition:
>>>> null
>>>> 2015-11-26 20:21:58,038 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>> Successfully
>>>> transitioned to start state for VM[User|i-2-5-VM] reservation id =
>>>> 2a4a184a-eac9-4609-8a70-4d230ee3a37d
>>>> 2015-11-26 20:21:58,040 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
>>>> deploy VM, vm has dcId: 3 and podId: null
>>>> 2015-11-26 20:21:58,041 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>> advanceStart:
>>>> DeploymentPlan is provided, using dcId:3, podId: 3, clusterId: 3, hostId:
>>>> 4, poolId: null
>>>> 2015-11-26 20:21:58,041 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deploy
>>> avoids
>>>> pods: null, clusters: null, hosts: null
>>>> 2015-11-26 20:21:58,045 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deploy
>>> avoids
>>>> pods: [], clusters: [], hosts: []
>>>> 2015-11-26 20:21:58,046 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>>> DeploymentPlanner allocation algorithm:
>>>> com.cloud.deploy.FirstFitPlanner@1136745
>>>> 2015-11-26 20:21:58,046 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
>>>> allocate a host and storage pools from dc:3, pod:3,cluster:3, requested
>>>> cpu: 1000, requested ram: 1073741824
>>>> 2015-11-26 20:21:58,046 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Is ROOT
>>>> volume READY (pool already allocated)?: No
>>>> 2015-11-26 20:21:58,046 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>>> DeploymentPlan has host_id specified, choosing this host and making no
>>>> checks on this host: 4
>>>> 2015-11-26 20:21:58,046 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Looking for
>>>> suitable pools for this host under zone: 3, pod: 3, cluster: 3
>>>> 2015-11-26 20:21:58,048 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
>>>> suitable pools for volume (Id, Type): (6,ROOT)
>>>> 2015-11-26 20:21:58,048 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) We need to
>>>> allocate new storagepool for this volume
>>>> 2015-11-26 20:21:58,049 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Calling
>>>> StoragePoolAllocators to find suitable pools
>>>> 2015-11-26 20:21:58,049 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>>> LocalStoragePoolAllocator trying to find storage pool to fit the vm
>>>> 2015-11-26 20:21:58,049 DEBUG
>>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>>> ClusterScopeStoragePoolAllocator looking for storage pool
>>>> 2015-11-26 20:21:58,049 DEBUG
>>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Looking for
>>>> pools in dc: 3 pod:3 cluster:3. Disabled pools will be ignored.
>>>> 2015-11-26 20:21:58,049 DEBUG
>>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found pools
>>>> matching tags: [Pool[8|NetworkFilesystem]]
>>>> 2015-11-26 20:21:58,050 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
>>>> storage pool is suitable, name: null ,poolId: 8
>>>> 2015-11-26 20:21:58,051 INFO [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Storage
>>> pool
>>>> null (8) does not supply IOPS capacity, assuming enough capacity
>>>> 2015-11-26 20:21:58,052 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
>>> pool
>>>> 8 for storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
>>>> 0.019253810234789077, disable threshold: 0.85
>>>> 2015-11-26 20:21:58,054 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found
>>> storage
>>>> pool primary of type NetworkFilesystem with overprovisioning factor 2
>>>> 2015-11-26 20:21:58,055 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total over
>>>> provisioned capacity calculated is 2 * 526199291904
>>>> 2015-11-26 20:21:58,055 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total
>>>> capacity of the pool primary id: 8 is 1052398583808
>>>> 2015-11-26 20:21:58,055 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
>>>> pool: 8 for volume allocation [Vol[6|vm=5|ROOT]], maxSize :
>>> 1052398583808,
>>>> totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
>>>> disable threshold: 0.85
>>>> 2015-11-26 20:21:58,055 DEBUG
>>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>>> ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
>>>> 2015-11-26 20:21:58,055 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
>>>> suitable pools for volume (Id, Type): (7,DATADISK)
>>>> 2015-11-26 20:21:58,055 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) We need to
>>>> allocate new storagepool for this volume
>>>> 2015-11-26 20:21:58,055 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Calling
>>>> StoragePoolAllocators to find suitable pools
>>>> 2015-11-26 20:21:58,055 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>>> LocalStoragePoolAllocator trying to find storage pool to fit the vm
>>>> 2015-11-26 20:21:58,055 DEBUG
>>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>>> ClusterScopeStoragePoolAllocator looking for storage pool
>>>> 2015-11-26 20:21:58,055 DEBUG
>>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Looking for
>>>> pools in dc: 3 pod:3 cluster:3. Disabled pools will be ignored.
>>>> 2015-11-26 20:21:58,056 DEBUG
>>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found pools
>>>> matching tags: [Pool[8|NetworkFilesystem]]
>>>> 2015-11-26 20:21:58,056 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
>>>> storage pool is suitable, name: null ,poolId: 8
>>>> 2015-11-26 20:21:58,057 INFO [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Storage
>>> pool
>>>> null (8) does not supply IOPS capacity, assuming enough capacity
>>>> 2015-11-26 20:21:58,057 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
>>> pool
>>>> 8 for storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
>>>> 0.019253810234789077, disable threshold: 0.85
>>>> 2015-11-26 20:21:58,059 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found
>>> storage
>>>> pool primary of type NetworkFilesystem with overprovisioning factor 2
>>>> 2015-11-26 20:21:58,059 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total over
>>>> provisioned capacity calculated is 2 * 526199291904
>>>> 2015-11-26 20:21:58,059 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total
>>>> capacity of the pool primary id: 8 is 1052398583808
>>>> 2015-11-26 20:21:58,060 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
>>>> pool: 8 for volume allocation [Vol[7|vm=5|DATADISK]], maxSize :
>>>> 1052398583808, totalAllocatedSize : 12156207104, askingSize :
>>> 21474836480,
>>>> allocated disable threshold: 0.85
>>>> 2015-11-26 20:21:58,060 DEBUG
>>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>>> ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
>>>> 2015-11-26 20:21:58,060 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
>>>> find a potenial host and associated storage pools from the suitable
>>>> host/pool lists for this VM
>>>> 2015-11-26 20:21:58,060 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
>>>> host: 4 can access any suitable storage pool for volume: DATADISK
>>>> 2015-11-26 20:21:58,060 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Host: 4 can
>>>> access pool: 8
>>>> 2015-11-26 20:21:58,061 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
>>> pool
>>>> 8 for storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
>>>> 0.019253810234789077, disable threshold: 0.85
>>>> 2015-11-26 20:21:58,062 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found
>>> storage
>>>> pool primary of type NetworkFilesystem with overprovisioning factor 2
>>>> 2015-11-26 20:21:58,062 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total over
>>>> provisioned capacity calculated is 2 * 526199291904
>>>> 2015-11-26 20:21:58,062 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total
>>>> capacity of the pool primary id: 8 is 1052398583808
>>>> 2015-11-26 20:21:58,063 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
>>>> pool: 8 for volume allocation [Vol[7|vm=5|DATADISK]], maxSize :
>>>> 1052398583808, totalAllocatedSize : 12156207104, askingSize :
>>> 21474836480,
>>>> allocated disable threshold: 0.85
>>>> 2015-11-26 20:21:58,063 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
>>>> host: 4 can access any suitable storage pool for volume: ROOT
>>>> 2015-11-26 20:21:58,063 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Host: 4 can
>>>> access pool: 8
>>>> 2015-11-26 20:21:58,064 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
>>> pool
>>>> 8 for storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
>>>> 0.019253810234789077, disable threshold: 0.85
>>>> 2015-11-26 20:21:58,067 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found
>>> storage
>>>> pool primary of type NetworkFilesystem with overprovisioning factor 2
>>>> 2015-11-26 20:21:58,067 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total over
>>>> provisioned capacity calculated is 2 * 526199291904
>>>> 2015-11-26 20:21:58,067 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total
>>>> capacity of the pool primary id: 8 is 1052398583808
>>>> 2015-11-26 20:21:58,067 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
>>>> pool: 8 for volume allocation [Vol[6|vm=5|ROOT]], maxSize :
>>> 1052398583808,
>>>> totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
>>>> disable threshold: 0.85
>>>> 2015-11-26 20:21:58,067 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found a
>>>> potential host id: 4 name: xenserver and associated storage pools for
>>> this
>>>> VM
>>>> 2015-11-26 20:21:58,068 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Returning
>>>> Deployment Destination:
>>>>
>>>>
>>> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
>>>> :
>>>>
>>>>
>>> Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage(Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
>>>> Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
>>>> Volume(7|DATADISK-->Pool(8))]
>>>> 2015-11-26 20:21:58,068 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deployment
>>>> found - P0=VM[User|i-2-5-VM],
>>>>
>>>>
>>> P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
>>>> :
>>>>
>>>>
>>> Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage(Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
>>>> Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
>>>> Volume(7|DATADISK-->Pool(8))]
>>>> 2015-11-26 20:21:58,073 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM state
>>>> transitted from :Starting to Starting with event: OperationRetryvm's
>>>> original host id: null new host id: 4 host id before state transition:
>>> null
>>>> 2015-11-26 20:21:58,076 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Hosts's
>>>> actual total CPU: 3399 and CPU after applying overprovisioning: 3399
>>>> 2015-11-26 20:21:58,076 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) We are
>>>> allocating VM, increasing the used capacity of this host:4
>>>> 2015-11-26 20:21:58,076 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Current
>>> Used
>>>> CPU: 1000 , Free CPU:2399 ,Requested CPU: 1000
>>>> 2015-11-26 20:21:58,076 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Current
>>> Used
>>>> RAM: 1610612736 , Free RAM:13743892480 ,Requested RAM: 1073741824
>>>> 2015-11-26 20:21:58,076 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) CPU STATS
>>>> after allocation: for host: 4, old used: 1000, old reserved: 0, actual
>>>> total: 3399, total with overprovisioning: 3399; new used:2000,
>>> reserved:0;
>>>> requested cpu:1000,alloc_from_last:false
>>>> 2015-11-26 20:21:58,076 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) RAM STATS
>>>> after allocation: for host: 4, old used: 1610612736, old reserved: 0,
>>>> total: 15354505216; new used: 2684354560, reserved: 0; requested mem:
>>>> 1073741824,alloc_from_last:false
>>>> 2015-11-26 20:21:58,094 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM is being
>>>> created in podId: 3
>>>> 2015-11-26 20:21:58,097 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Lock is
>>>> acquired for network id 212 as a part of network implement
>>>> 2015-11-26 20:21:58,097 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Asking
>>>> ExternalGuestNetworkGuru to implement Ntwk[212|Guest|8]
>>>> 2015-11-26 20:21:58,117 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Asking
>>>> VirtualRouter to implemenet Ntwk[212|Guest|8]
>>>> 2015-11-26 20:21:58,120 DEBUG [c.c.n.r.NetworkHelperImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Starting
>>>> router VM[DomainRouter|r-4-VM]
>>>> 2015-11-26 20:21:58,127 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM state
>>>> transitted from :Stopped to Starting with event: StartRequestedvm's
>>>> original host id: 4 new host id: null host id before state transition:
>>> null
>>>> 2015-11-26 20:21:58,127 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>> Successfully
>>>> transitioned to start state for VM[DomainRouter|r-4-VM] reservation id =
>>>> 36f90bcc-1fad-40d8-b878-3996e5c69c0e
>>>> 2015-11-26 20:21:58,130 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
>>>> deploy VM, vm has dcId: 3 and podId: 3
>>>> 2015-11-26 20:21:58,130 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deploy
>>> avoids
>>>> pods: null, clusters: null, hosts: null
>>>> 2015-11-26 20:21:58,131 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Root volume
>>>> is ready, need to place VM in volume's cluster
>>>> 2015-11-26 20:21:58,131 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>>> Vol[5|vm=4|ROOT] is READY, changing deployment plan to use this pool's
>>>> dcId: 3 , podId: 3 , and clusterId: 3
>>>> 2015-11-26 20:21:58,137 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deploy
>>> avoids
>>>> pods: [], clusters: [], hosts: []
>>>> 2015-11-26 20:21:58,137 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>>> DeploymentPlanner allocation algorithm:
>>>> com.cloud.deploy.FirstFitPlanner@1136745
>>>> 2015-11-26 20:21:58,137 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
>>>> allocate a host and storage pools from dc:3, pod:3,cluster:3, requested
>>>> cpu: 500, requested ram: 268435456
>>>> 2015-11-26 20:21:58,137 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Is ROOT
>>>> volume READY (pool already allocated)?: Yes
>>>> 2015-11-26 20:21:58,137 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) This VM has
>>>> last host_id specified, trying to choose the same host: 4
>>>> 2015-11-26 20:21:58,141 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Host: 4 has
>>>> cpu capability (cpu:1, speed:3399) to support requested CPU: 1 and
>>>> requested speed: 500
>>>> 2015-11-26 20:21:58,141 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
>>>> host: 4 has enough capacity for requested CPU: 500 and requested RAM:
>>>> 268435456 , cpuOverprovisioningFactor: 1.0
>>>> 2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Hosts's
>>>> actual total CPU: 3399 and CPU after applying overprovisioning: 3399
>>>> 2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) We need to
>>>> allocate to the last host again, so checking if there is enough reserved
>>>> capacity
>>>> 2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reserved
>>> CPU:
>>>> 0 , Requested CPU: 500
>>>> 2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reserved
>>> RAM:
>>>> 0 , Requested RAM: 268435456
>>>> 2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) STATS:
>>> Failed
>>>> to alloc resource from host: 4 reservedCpu: 0, requested cpu: 500,
>>>> reservedMem: 0, requested mem: 268435456
>>>> 2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Host does
>>> not
>>>> have enough reserved CPU available, cannot allocate to this host.
>>>> 2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
>>>> host: 4 has enough capacity for requested CPU: 500 and requested RAM:
>>>> 268435456 , cpuOverprovisioningFactor: 1.0
>>>> 2015-11-26 20:21:58,143 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Hosts's
>>>> actual total CPU: 3399 and CPU after applying overprovisioning: 3399
>>>> 2015-11-26 20:21:58,143 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Free CPU:
>>>> 1399 , Requested CPU: 500
>>>> 2015-11-26 20:21:58,143 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Free RAM:
>>>> 12670150656 , Requested RAM: 268435456
>>>> 2015-11-26 20:21:58,143 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Host has
>>>> enough CPU and RAM available
>>>> 2015-11-26 20:21:58,143 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) STATS: Can
>>>> alloc CPU from host: 4, used: 2000, reserved: 0, actual total: 3399,
>>> total
>>>> with overprovisioning: 3399; requested
>>> cpu:500,alloc_from_last_host?:false
>>>> ,considerReservedCapacity?: true
>>>> 2015-11-26 20:21:58,143 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) STATS: Can
>>>> alloc MEM from host: 4, used: 2684354560, reserved: 0, total:
>>> 15354505216;
>>>> requested mem: 268435456,alloc_from_last_host?:false
>>>> ,considerReservedCapacity?: true
>>>> 2015-11-26 20:21:58,143 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) The last
>>> host
>>>> of this VM is UP and has enough capacity
>>>> 2015-11-26 20:21:58,143 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Now
>>> checking
>>>> for suitable pools under zone: 3, pod: 3, cluster: 3
>>>> 2015-11-26 20:21:58,145 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
>>>> suitable pools for volume (Id, Type): (5,ROOT)
>>>> 2015-11-26 20:21:58,145 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Volume has
>>>> pool already allocated, checking if pool can be reused, poolId: 8
>>>> 2015-11-26 20:21:58,145 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Planner
>>> need
>>>> not allocate a pool for this volume since its READY
>>>> 2015-11-26 20:21:58,145 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
>>>> find a potenial host and associated storage pools from the suitable
>>>> host/pool lists for this VM
>>>> 2015-11-26 20:21:58,145 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
>>>> host: 4 can access any suitable storage pool for volume: ROOT
>>>> 2015-11-26 20:21:58,146 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Host: 4 can
>>>> access pool: 8
>>>> 2015-11-26 20:21:58,146 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found a
>>>> potential host id: 4 name: xenserver and associated storage pools for
>>> this
>>>> VM
>>>> 2015-11-26 20:21:58,146 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Returning
>>>> Deployment Destination:
>>>>
>>>>
>>> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
>>>> : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage()]
>>>> 2015-11-26 20:21:58,146 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deployment
>>>> found - P0=VM[DomainRouter|r-4-VM],
>>>>
>>>>
>>> P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
>>>> : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage()]
>>>> 2015-11-26 20:21:58,153 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM state
>>>> transitted from :Starting to Starting with event: OperationRetryvm's
>>>> original host id: 4 new host id: 4 host id before state transition: null
>>>> 2015-11-26 20:21:58,153 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM starting
>>>> again on the last host it was stopped on
>>>> 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Hosts's
>>>> actual total CPU: 3399 and CPU after applying overprovisioning: 3399
>>>> 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) We are
>>>> allocating VM, increasing the used capacity of this host:4
>>>> 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Current
>>> Used
>>>> CPU: 2000 , Free CPU:1399 ,Requested CPU: 500
>>>> 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Current
>>> Used
>>>> RAM: 2684354560 , Free RAM:12670150656 ,Requested RAM: 268435456
>>>> 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) We are
>>>> allocating VM to the last host again, so adjusting the reserved capacity
>>> if
>>>> it is not less than required
>>>> 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reserved
>>> CPU:
>>>> 0 , Requested CPU: 500
>>>> 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reserved
>>> RAM:
>>>> 0 , Requested RAM: 268435456
>>>> 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) CPU STATS
>>>> after allocation: for host: 4, old used: 2000, old reserved: 0, actual
>>>> total: 3399, total with overprovisioning: 3399; new used:2500,
>>> reserved:0;
>>>> requested cpu:500,alloc_from_last:true
>>>> 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) RAM STATS
>>>> after allocation: for host: 4, old used: 2684354560, old reserved: 0,
>>>> total: 15354505216; new used: 2952790016, reserved: 0; requested mem:
>>>> 268435456,alloc_from_last:true
>>>> 2015-11-26 20:21:58,158 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM is being
>>>> created in podId: 3
>>>> 2015-11-26 20:21:58,173 DEBUG [c.c.n.NetworkModelImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
>>>> SecurityGroup is not supported in the network id=212
>>>> 2015-11-26 20:21:58,179 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Asking
>>>> VirtualRouter to prepare for
>>>> Nic[8-4-36f90bcc-1fad-40d8-b878-3996e5c69c0e-10.1.1.1]
>>>> 2015-11-26 20:21:58,179 DEBUG [c.c.n.NetworkModelImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
>>>> SecurityGroup is not supported in the network id=212
>>>> 2015-11-26 20:21:58,193 DEBUG [o.a.c.e.o.VolumeOrchestrator]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
>>>> we need to prepare 1 volumes for VM[DomainRouter|r-4-VM]
>>>> 2015-11-26 20:21:58,193 DEBUG [o.a.c.e.o.VolumeOrchestrator]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) No need to
>>>> recreate the volume: Vol[5|vm=4|ROOT], since it already has a pool
>>>> assigned: 8, adding disk to VM
>>>> 2015-11-26 20:21:58,207 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Boot Args
>>> for
>>>> VM[DomainRouter|r-4-VM]: template=domP name=r-4-VM eth2ip=10.0.0.174
>>>> eth2mask=255.255.255.0 gateway=10.0.0.1 eth0ip=10.1.1.1
>>>> eth0mask=255.255.255.0 domain=cs2cloud.internal cidrsize=24
>>>> dhcprange=10.1.1.1 eth1ip=169.254.0.43 eth1mask=255.255.0.0 type=router
>>>> disable_rp_filter=true dns1=8.8.8.8
>>>>
>>>>
>>> baremetalnotificationsecuritykey=MD4bWVy5t0anMd4eq4UlKWj6cZTW4gFDMeDd0WR3H3BuAsrxVX28ShzvJgbd8RR5eMRZ7rNYAsaF9RPXAZoCrQ
>>>>
>>>>
>>> baremetalnotificationapikey=ZWNcizzJ0xXQE0Ubr6Sr_kN7xlMMMMtziuPTxHwZOyIN-Lo2f2CzvPhNw0o01LkNP3X4bp61YiZu0EWF-Mbfew
>>>> host=10.0.0.170 port=8080
>>>> 2015-11-26 20:21:58,229 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 1
>>> ip(s)
>>>> to apply as a part of domR VM[DomainRouter|r-4-VM] start.
>>>> 2015-11-26 20:21:58,237 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Resending
>>>> ipAssoc, port forwarding, load balancing rules as a part of Virtual
>>> router
>>>> start
>>>> 2015-11-26 20:21:58,241 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Egress
>>> policy
>>>> for the Network 212 is already defined as Deny. So, no need to default
>>> the
>>>> rule to Allow.
>>>> 2015-11-26 20:21:58,241 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
>>>> firewall Egress rule(s) to apply as a part of domR
>>> VM[DomainRouter|r-4-VM]
>>>> start.
>>>> 2015-11-26 20:21:58,243 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
>>>> static nat(s) to apply as a part of domR VM[DomainRouter|r-4-VM] start.
>>>> 2015-11-26 20:21:58,243 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
>>>> firewall Ingress rule(s) to apply as a part of domR
>>> VM[DomainRouter|r-4-VM]
>>>> start.
>>>> 2015-11-26 20:21:58,243 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
>>> port
>>>> forwarding rule(s) to apply as a part of domR VM[DomainRouter|r-4-VM]
>>>> start.
>>>> 2015-11-26 20:21:58,243 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
>>>> static nat rule(s) to apply as a part of domR VM[DomainRouter|r-4-VM]
>>>> start.
>>>> 2015-11-26 20:21:58,243 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
>>>> vpn(s) to apply as a part of domR VM[DomainRouter|r-4-VM] start.
>>>> 2015-11-26 20:21:58,244 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
>>> load
>>>> balancing rule(s) to apply as a part of domR VM[DomainRouter|r-4-VM]
>>> start.
>>>> 2015-11-26 20:21:58,245 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Creating
>>>> monitoring services on VM[DomainRouter|r-4-VM] start...
>>>> 2015-11-26 20:21:58,248 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reapplying
>>>> dhcp entries as a part of domR VM[DomainRouter|r-4-VM] start...
>>>> 2015-11-26 20:21:58,249 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reapplying
>>> vm
>>>> data (userData and metaData) entries as a part of domR
>>>> VM[DomainRouter|r-4-VM] start...
>>>> 2015-11-26 20:21:58,254 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>>> 4-8612571337392652838: Sending { Cmd , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>>
>>>>
>>> [{"com.cloud.agent.api.StartCommand":{"vm":{"id":4,"name":"r-4-VM","bootloader":"PyGrub","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":268435456,"maxRam":268435456,"arch":"x86_64","os":"Debian
>>>> GNU/Linux 7(64-bit)","platformEmulator":"Debian Wheezy 7.0
>>>> (64-bit)","bootArgs":" template=domP name=r-4-VM eth2ip=10.0.0.174
>>>> eth2mask=255.255.255.0 gateway=10.0.0.1 eth0ip=10.1.1.1
>>>> eth0mask=255.255.255.0 domain=cs2cloud.internal cidrsize=24
>>>> dhcprange=10.1.1.1 eth1ip=169.254.0.43 eth1mask=255.255.0.0 type=router
>>>> disable_rp_filter=true dns1=8.8.8.8
>>>>
>>>>
>>> baremetalnotificationsecuritykey=MD4bWVy5t0anMd4eq4UlKWj6cZTW4gFDMeDd0WR3H3BuAsrxVX28ShzvJgbd8RR5eMRZ7rNYAsaF9RPXAZoCrQ
>>>>
>>>>
>>> baremetalnotificationapikey=ZWNcizzJ0xXQE0Ubr6Sr_kN7xlMMMMtziuPTxHwZOyIN-Lo2f2CzvPhNw0o01LkNP3X4bp61YiZu0EWF-Mbfew
>>>> host=10.0.0.170
>>>>
>>>>
>>> port=8080","enableHA":true,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"SlzaiXi9iLi3YpfQ7v3kZw","params":{},"uuid":"27157005-7e89-4251-89e4-2c53ff43bb70","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"9478a811-8b96-4cfa-b6bf-1e09c3fecd39","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
>>>>
>>>>
>>> 10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc
>>>>
>>>>
>>> "}},"name":"ROOT-4","size":3145728000,"path":"dcc1ce80-4cd5-4f59-b063-34e2a93ed99a","volumeId":5,"vmName":"r-4-VM","accountId":2,"format":"VHD","provisioningType":"THIN","id":5,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"dcc1ce80-4cd5-4f59-b063-34e2a93ed99a","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"10.0.0.170","volumeSize":"3145728000"}}],"nics":[{"deviceId":2,"networkRateMbps":200,"defaultNic":true,"pxeDisable":true,"nicUuid":"9fbc00ea-599c-4455-a416-8e66986d9454","uuid":"8872476c-2fd1-4ed3-bfb1-c62efe2b6eab","ip":"10.0.0.174","netmask":"255.255.255.0","gateway":"10.0.0.1","mac":"06:a0:8a:00:00:09","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"mgmt"},{"deviceId":0,"networkRateMbps":200,"defaultNic":false,"pxeDisable":true,"nicUuid":"f38511fa-d2e8-4935-9fc4-74b2eea7621b","uuid":"2e97fcee-3d01-40d2-a624-376661747d0c","ip":"10.1.1.1","netmask":"255.255.255.0","mac":"02:00:4d:27:00:02","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://500","isolationUri":"vlan://500","isSecurityGroupEnabled":false,"name":"mgmt"},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"pxeDisable":true,"nicUuid":"5c6cd3fa-fddb-4ee0-bff2-87e5c04f8d81","uuid":"914b3b0d-541c-4c63-b331-3377672a824d","ip":"169.254.0.43","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:00:2b","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.0.0.171","executeInSequence":false,"wait":0}},{"com.cloud.agent.api.check.CheckSshCommand":{"ip":"169.254.0.43","port":3922,"interval":6,"retries":100,"name":"r-4-VM","wait":0}},{"com.cloud.agent.api.GetDomRVersionCmd":{"accessDetails":{"
>>>> router.name
>>>>
>>>>
>>> ":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}},{},{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Start","accessDetails":{"router.guest.ip":"10.1.1.1","
>>>> router.name
>>>>
>>>>
>>> ":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}},{"com.cloud.agent.api.routing.IpAssocCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.0.0.174","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":true,"broadcastUri":"vlan://untagged","vlanGateway":"10.0.0.1","vlanNetmask":"255.255.255.0","vifMacAddress":"06:35:62:00:00:09","networkRate":200,"trafficType":"Public","networkName":"mgmt","newNic":false}],"accessDetails":{"zone.network.type":"Advanced","
>>>> router.name
>>>>
>>>>
>>> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.SetMonitorServiceCommand":{"services":[{"id":0,"service":"dhcp","processname":"dnsmasq","serviceName":"dnsmasq","servicePath":"/var/run/dnsmasq/dnsmasq.pid","pidFile":"/var/run/dnsmasq/dnsmasq.pid","isDefault":false},{"id":0,"service":"loadbalancing","processname":"haproxy","serviceName":"haproxy","servicePath":"/var/run/haproxy.pid","pidFile":"/var/run/haproxy.pid","isDefault":false},{"id":0,"service":"ssh","processname":"sshd","serviceName":"ssh","servicePath":"/var/run/sshd.pid","pidFile":"/var/run/sshd.pid","isDefault":true},{"id":0,"service":"webserver","processname":"apache2","serviceName":"apache2","servicePath":"/var/run/apache2.pid","pidFile":"/var/run/apache2.pid","isDefault":true}],"accessDetails":{"
>>>> router.name
>>>>
>>>>
>>> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Finish","accessDetails":{"router.guest.ip":"10.1.1.1","
>>>> router.name":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}}] }
>>>> 2015-11-26 20:21:58,255 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>>> 4-8612571337392652838: Executing: { Cmd , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>>
>>>>
>>> [{"com.cloud.agent.api.StartCommand":{"vm":{"id":4,"name":"r-4-VM","bootloader":"PyGrub","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":268435456,"maxRam":268435456,"arch":"x86_64","os":"Debian
>>>> GNU/Linux 7(64-bit)","platformEmulator":"Debian Wheezy 7.0
>>>> (64-bit)","bootArgs":" template=domP name=r-4-VM eth2ip=10.0.0.174
>>>> eth2mask=255.255.255.0 gateway=10.0.0.1 eth0ip=10.1.1.1
>>>> eth0mask=255.255.255.0 domain=cs2cloud.internal cidrsize=24
>>>> dhcprange=10.1.1.1 eth1ip=169.254.0.43 eth1mask=255.255.0.0 type=router
>>>> disable_rp_filter=true dns1=8.8.8.8
>>>>
>>>>
>>> baremetalnotificationsecuritykey=MD4bWVy5t0anMd4eq4UlKWj6cZTW4gFDMeDd0WR3H3BuAsrxVX28ShzvJgbd8RR5eMRZ7rNYAsaF9RPXAZoCrQ
>>>>
>>>>
>>> baremetalnotificationapikey=ZWNcizzJ0xXQE0Ubr6Sr_kN7xlMMMMtziuPTxHwZOyIN-Lo2f2CzvPhNw0o01LkNP3X4bp61YiZu0EWF-Mbfew
>>>> host=10.0.0.170
>>>>
>>>>
>>> port=8080","enableHA":true,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"SlzaiXi9iLi3YpfQ7v3kZw","params":{},"uuid":"27157005-7e89-4251-89e4-2c53ff43bb70","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"9478a811-8b96-4cfa-b6bf-1e09c3fecd39","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
>>>>
>>>>
>>> 10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc
>>>>
>>>>
>>> "}},"name":"ROOT-4","size":3145728000,"path":"dcc1ce80-4cd5-4f59-b063-34e2a93ed99a","volumeId":5,"vmName":"r-4-VM","accountId":2,"format":"VHD","provisioningType":"THIN","id":5,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"dcc1ce80-4cd5-4f59-b063-34e2a93ed99a","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"10.0.0.170","volumeSize":"3145728000"}}],"nics":[{"deviceId":2,"networkRateMbps":200,"defaultNic":true,"pxeDisable":true,"nicUuid":"9fbc00ea-599c-4455-a416-8e66986d9454","uuid":"8872476c-2fd1-4ed3-bfb1-c62efe2b6eab","ip":"10.0.0.174","netmask":"255.255.255.0","gateway":"10.0.0.1","mac":"06:a0:8a:00:00:09","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"mgmt"},{"deviceId":0,"networkRateMbps":200,"defaultNic":false,"pxeDisable":true,"nicUuid":"f38511fa-d2e8-4935-9fc4-74b2eea7621b","uuid":"2e97fcee-3d01-40d2-a624-376661747d0c","ip":"10.1.1.1","netmask":"255.255.255.0","mac":"02:00:4d:27:00:02","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://500","isolationUri":"vlan://500","isSecurityGroupEnabled":false,"name":"mgmt"},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"pxeDisable":true,"nicUuid":"5c6cd3fa-fddb-4ee0-bff2-87e5c04f8d81","uuid":"914b3b0d-541c-4c63-b331-3377672a824d","ip":"169.254.0.43","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:00:2b","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.0.0.171","executeInSequence":false,"wait":0}},{"com.cloud.agent.api.check.CheckSshCommand":{"ip":"169.254.0.43","port":3922,"interval":6,"retries":100,"name":"r-4-VM","wait":0}},{"com.cloud.agent.api.GetDomRVersionCmd":{"accessDetails":{"
>>>> router.name
>>>>
>>>>
>>> ":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}},{},{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Start","accessDetails":{"router.guest.ip":"10.1.1.1","
>>>> router.name
>>>>
>>>>
>>> ":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}},{"com.cloud.agent.api.routing.IpAssocCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.0.0.174","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":true,"broadcastUri":"vlan://untagged","vlanGateway":"10.0.0.1","vlanNetmask":"255.255.255.0","vifMacAddress":"06:35:62:00:00:09","networkRate":200,"trafficType":"Public","networkName":"mgmt","newNic":false}],"accessDetails":{"zone.network.type":"Advanced","
>>>> router.name
>>>>
>>>>
>>> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.SetMonitorServiceCommand":{"services":[{"id":0,"service":"dhcp","processname":"dnsmasq","serviceName":"dnsmasq","servicePath":"/var/run/dnsmasq/dnsmasq.pid","pidFile":"/var/run/dnsmasq/dnsmasq.pid","isDefault":false},{"id":0,"service":"loadbalancing","processname":"haproxy","serviceName":"haproxy","servicePath":"/var/run/haproxy.pid","pidFile":"/var/run/haproxy.pid","isDefault":false},{"id":0,"service":"ssh","processname":"sshd","serviceName":"ssh","servicePath":"/var/run/sshd.pid","pidFile":"/var/run/sshd.pid","isDefault":true},{"id":0,"service":"webserver","processname":"apache2","serviceName":"apache2","servicePath":"/var/run/apache2.pid","pidFile":"/var/run/apache2.pid","isDefault":true}],"accessDetails":{"
>>>> router.name
>>>>
>>>>
>>> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Finish","accessDetails":{"router.guest.ip":"10.1.1.1","
>>>> router.name":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}}] }
>>>> 2015-11-26 20:21:58,256 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-69:ctx-a18e64d5) Seq 4-8612571337392652838: Executing
>>> request
>>>> 2015-11-26 20:21:58,263 DEBUG [c.c.h.x.r.w.x.CitrixStartCommandWrapper]
>>>> (DirectAgent-69:ctx-a18e64d5) 1. The VM r-4-VM is in Starting state.
>>>> 2015-11-26 20:21:58,292 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-69:ctx-a18e64d5) Created VM
>>>> 0d0fa28c-0513-b806-84fd-c528dfc1dbfb for r-4-VM
>>>> 2015-11-26 20:21:58,298 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-69:ctx-a18e64d5) PV args are -- quiet
>>>>
>>>>
>>> console=hvc0%template=domP%name=r-4-VM%eth2ip=10.0.0.174%eth2mask=255.255.255.0%gateway=10.0.0.1%eth0ip=10.1.1.1%eth0mask=255.255.255.0%domain=cs2cloud.internal%cidrsize=24%dhcprange=10.1.1.1%eth1ip=169.254.0.43%eth1mask=255.255.0.0%type=router%disable_rp_filter=true%dns1=8.8.8.8%baremetalnotificationsecuritykey=MD4bWVy5t0anMd4eq4UlKWj6cZTW4gFDMeDd0WR3H3BuAsrxVX28ShzvJgbd8RR5eMRZ7rNYAsaF9RPXAZoCrQ%baremetalnotificationapikey=ZWNcizzJ0xXQE0Ubr6Sr_kN7xlMMMMtziuPTxHwZOyIN-Lo2f2CzvPhNw0o01LkNP3X4bp61YiZu0EWF-Mbfew%host=10.0.0.170%port=8080
>>>> 2015-11-26 20:21:58,325 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-69:ctx-a18e64d5) VBD 11a8fbfd-fd97-18bc-1490-e088576f26e7
>>>> created for com.cloud.agent.api.to.DiskTO@2578f349
>>>> 2015-11-26 20:21:58,325 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-69:ctx-a18e64d5) Creating VIF for r-4-VM on nic
>>>> [Nic:Public-10.0.0.174-vlan://untagged]
>>>> 2015-11-26 20:21:58,327 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-69:ctx-a18e64d5) Looking for network named mgmt
>>>> 2015-11-26 20:21:58,334 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-69:ctx-a18e64d5) Created a vif
>>>> b7ad658b-483c-a442-cb04-02b2a54bfbc8 on 2
>>>> 2015-11-26 20:21:58,334 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-69:ctx-a18e64d5) Creating VIF for r-4-VM on nic
>>>> [Nic:Guest-10.1.1.1-vlan://500]
>>>> 2015-11-26 20:21:58,335 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-69:ctx-a18e64d5) Looking for network named mgmt
>>>> 2015-11-26 20:21:58,341 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-69:ctx-a18e64d5) Couldn't find vlan network with the new
>>> name
>>>> so trying old name: VLAN500
>>>> 2015-11-26 20:21:58,342 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-69:ctx-a18e64d5) Creating VLAN network for 500 on host
>>>> 10.0.0.171
>>>> 2015-11-26 20:21:58,349 DEBUG [c.c.h.x.r.XsLocalNetwork]
>>>> (DirectAgent-69:ctx-a18e64d5) Found a network called mgmt on
>>>> host=10.0.0.171; Network=1a561762-42f8-4907-9cc2-c90e69fc3a4d;
>>>> pif=ebede886-b90c-4605-dcef-5b24824b154b
>>>> 2015-11-26 20:21:58,352 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-69:ctx-a18e64d5) Creating VLAN 500 on host 10.0.0.171 on
>>>> device eth0
>>>> 2015-11-26 20:21:58,664 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-69:ctx-a18e64d5) VLAN is created for 500. The uuid is
>>>> 4cf68d23-f831-273a-27a6-7639dadf3d04
>>>> 2015-11-26 20:21:58,669 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-69:ctx-a18e64d5) Created a vif
>>>> c21979e3-f425-6c92-24cb-356cfbdd3320 on 0
>>>> 2015-11-26 20:21:58,669 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-69:ctx-a18e64d5) Creating VIF for r-4-VM on nic
>>>> [Nic:Control-169.254.0.43-null]
>>>> 2015-11-26 20:21:58,683 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-69:ctx-a18e64d5) already have a vif on dom0 for link local
>>>> network
>>>> 2015-11-26 20:21:58,787 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-69:ctx-a18e64d5) Created a vif
>>>> 990f4458-ecb6-434f-2930-73b1e6d42e8c on 1
>>>> 2015-11-26 20:21:59,092 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-13:ctx-2798b9c4) ===START=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549584411
>>>> 2015-11-26 20:21:59,103 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-13:ctx-2798b9c4 ctx-c2ce3a57) ===END=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549584411
>>>> 2015-11-26 20:22:02,111 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-14:ctx-38676bd6) ===START=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549587414
>>>> 2015-11-26 20:22:02,124 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-14:ctx-38676bd6 ctx-947b14ea) ===END=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549587414
>>>> 2015-11-26 20:22:02,803 DEBUG [c.c.h.x.r.w.x.CitrixStartCommandWrapper]
>>>> (DirectAgent-69:ctx-a18e64d5) 2. The VM r-4-VM is in Running state.
>>>> 2015-11-26 20:22:02,807 DEBUG
>>> [c.c.h.x.r.w.x.CitrixCheckSshCommandWrapper]
>>>> (DirectAgent-69:ctx-a18e64d5) Ping command port, 169.254.0.43:3922
>>>> 2015-11-26 20:22:02,809 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-69:ctx-a18e64d5) Trying to connect to 169.254.0.43 attempt 0
>>>> of 100
>>>> 2015-11-26 20:22:04,361 DEBUG [o.a.c.s.SecondaryStorageManagerImpl]
>>>> (secstorage-1:ctx-2215d989) Zone 3 is ready to launch secondary storage
>>> VM
>>>> 2015-11-26 20:22:04,681 DEBUG [c.c.c.ConsoleProxyManagerImpl]
>>>> (consoleproxy-1:ctx-2ce987bc) Zone 3 is ready to launch console proxy
>>>> 2015-11-26 20:22:05,104 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-15:ctx-4fa06d24) ===START=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549590422
>>>> 2015-11-26 20:22:05,116 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-15:ctx-4fa06d24 ctx-19dff864) ===END=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549590422
>>>> 2015-11-26 20:22:06,962 DEBUG [c.c.a.m.AgentManagerImpl]
>>>> (AgentManager-Handler-14:null) SeqA 5-1783: Processing Seq 5-1783: {
>>> Cmd ,
>>>> MgmtId: -1, via: 5, Ver: v1, Flags: 11,
>>>>
>>>>
>>> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
>>>> \"connections\": []\n}","wait":0}}] }
>>>> 2015-11-26 20:22:06,968 DEBUG [c.c.a.m.AgentManagerImpl]
>>>> (AgentManager-Handler-14:null) SeqA 5-1783: Sending Seq 5-1783: { Ans: ,
>>>> MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
>>>> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
>>>> 2015-11-26 20:22:08,018 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (AsyncJobMgr-Heartbeat-1:ctx-5e29ee49) Begin cleanup expired async-jobs
>>>> 2015-11-26 20:22:08,022 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (AsyncJobMgr-Heartbeat-1:ctx-5e29ee49) End cleanup expired async-jobs
>>>> 2015-11-26 20:22:08,103 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-17:ctx-9917fe4e) ===START=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549593422
>>>> 2015-11-26 20:22:08,114 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-17:ctx-9917fe4e ctx-bfd32cd5) ===END=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549593422
>>>> 2015-11-26 20:22:11,103 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-12:ctx-88343d26) ===START=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549596422
>>>> 2015-11-26 20:22:11,113 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-12:ctx-88343d26 ctx-6f3d43d4) ===END=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549596422
>>>> 2015-11-26 20:22:14,215 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-16:ctx-725778e3) ===START=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549599535
>>>> 2015-11-26 20:22:14,234 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-16:ctx-725778e3 ctx-dd88dc8f) ===END=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549599535
>>>> 2015-11-26 20:22:15,885 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-69:ctx-a18e64d5) Trying to connect to 169.254.0.43 attempt 1
>>>> of 100
>>>> 2015-11-26 20:22:16,964 DEBUG [c.c.a.m.AgentManagerImpl]
>>>> (AgentManager-Handler-3:null) SeqA 5-1784: Processing Seq 5-1784: { Cmd
>>> ,
>>>> MgmtId: -1, via: 5, Ver: v1, Flags: 11,
>>>>
>>>>
>>> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
>>>> \"connections\": []\n}","wait":0}}] }
>>>> 2015-11-26 20:22:16,967 DEBUG [c.c.a.m.AgentManagerImpl]
>>>> (AgentManager-Handler-3:null) SeqA 5-1784: Sending Seq 5-1784: { Ans: ,
>>>> MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
>>>> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
>>>> 2015-11-26 20:22:17,215 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-18:ctx-60f98a31) ===START=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549602535
>>>> 2015-11-26 20:22:17,225 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-18:ctx-60f98a31 ctx-d1134f47) ===END=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549602535
>>>> 2015-11-26 20:22:17,995 DEBUG [c.c.s.StatsCollector]
>>>> (StatsCollector-3:ctx-98795072) StorageCollector is running...
>>>> 2015-11-26 20:22:18,018 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (AsyncJobMgr-Heartbeat-1:ctx-d66f35e7) Begin cleanup expired async-jobs
>>>> 2015-11-26 20:22:18,020 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (AsyncJobMgr-Heartbeat-1:ctx-d66f35e7) End cleanup expired async-jobs
>>>> 2015-11-26 20:22:18,050 DEBUG [c.c.a.t.Request]
>>>> (StatsCollector-3:ctx-98795072) Seq 6-2074470578357534957: Received: {
>>>> Ans: , MgmtId: 52229922654, via: 6(s-2-VM), Ver: v1, Flags: 10, {
>>>> GetStorageStatsAnswer } }
>>>> 2015-11-26 20:22:18,051 DEBUG [c.c.h.XenServerGuru]
>>>> (StatsCollector-3:ctx-98795072) getCommandHostDelegation: class
>>>> com.cloud.agent.api.GetStorageStatsCommand
>>>> 2015-11-26 20:22:18,052 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-275:ctx-69cd6660) Seq 4-8612571337392652839: Executing
>>> request
>>>> 2015-11-26 20:22:18,210 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (RouterStatusMonitor-1:ctx-e533ad2d) Found 1 routers to update status.
>>>> 2015-11-26 20:22:18,212 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (RouterStatusMonitor-1:ctx-e533ad2d) Found 0 VPC networks to update
>>>> Redundant State.
>>>> 2015-11-26 20:22:18,213 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (RouterStatusMonitor-1:ctx-e533ad2d) Found 0 networks to update RvR
>>> status.
>>>> 2015-11-26 20:22:18,223 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (RouterStatusMonitor-1:ctx-ce59a463) Found 1 routers to update status.
>>>> 2015-11-26 20:22:18,224 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (RouterStatusMonitor-1:ctx-ce59a463) Found 0 VPC networks to update
>>>> Redundant State.
>>>> 2015-11-26 20:22:18,225 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (RouterStatusMonitor-1:ctx-ce59a463) Found 0 networks to update RvR
>>> status.
>>>> 2015-11-26 20:22:18,378 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-275:ctx-69cd6660) Seq 4-8612571337392652839: Response
>>>> Received:
>>>> 2015-11-26 20:22:18,379 DEBUG [c.c.a.t.Request]
>>>> (StatsCollector-3:ctx-98795072) Seq 4-8612571337392652839: Received: {
>>>> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10, {
>>>> GetStorageStatsAnswer } }
>>>> 2015-11-26 20:22:20,215 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-22:ctx-c6c73f9b) ===START=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549605535
>>>> 2015-11-26 20:22:20,225 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-22:ctx-c6c73f9b ctx-135e3cc8) ===END=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549605535
>>>> 2015-11-26 20:22:21,593 DEBUG [c.c.a.m.AgentManagerImpl]
>>>> (AgentManager-Handler-2:null) Ping from 6
>>>> 2015-11-26 20:22:21,679 DEBUG [c.c.a.m.AgentManagerImpl]
>>>> (AgentManager-Handler-5:null) Ping from 5
>>>> 2015-11-26 20:22:23,216 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-19:ctx-db19c3ed) ===START=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549608535
>>>> 2015-11-26 20:22:23,227 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-19:ctx-db19c3ed ctx-846db858) ===END=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549608535
>>>> 2015-11-26 20:22:24,782 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgentCronJob-79:ctx-8c839142) Ping from 4(xenserver)
>>>> 2015-11-26 20:22:24,782 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
>>>> (DirectAgentCronJob-79:ctx-8c839142) Process host VM state report from
>>> ping
>>>> process. host: 4
>>>> 2015-11-26 20:22:24,785 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
>>>> (DirectAgentCronJob-79:ctx-8c839142) Process VM state report. host: 4,
>>>> number of records in report: 3
>>>> 2015-11-26 20:22:24,785 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
>>>> (DirectAgentCronJob-79:ctx-8c839142) VM state report. host: 4, vm id: 1,
>>>> power state: PowerOn
>>>> 2015-11-26 20:22:24,786 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
>>>> (DirectAgentCronJob-79:ctx-8c839142) VM power state does not change, skip
>>>> DB writing. vm id: 1
>>>> 2015-11-26 20:22:24,786 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
>>>> (DirectAgentCronJob-79:ctx-8c839142) VM state report. host: 4, vm id: 2,
>>>> power state: PowerOn
>>>> 2015-11-26 20:22:24,787 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
>>>> (DirectAgentCronJob-79:ctx-8c839142) VM power state does not change, skip
>>>> DB writing. vm id: 2
>>>> 2015-11-26 20:22:24,787 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
>>>> (DirectAgentCronJob-79:ctx-8c839142) VM state report. host: 4, vm id: 4,
>>>> power state: PowerOn
>>>> 2015-11-26 20:22:24,788 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
>>>> (DirectAgentCronJob-79:ctx-8c839142) VM power state does not change, skip
>>>> DB writing. vm id: 4
>>>> 2015-11-26 20:22:24,790 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
>>>> (DirectAgentCronJob-79:ctx-8c839142) Run missing VM report. current time:
>>>> 1448549544790
>>>> 2015-11-26 20:22:24,791 WARN [c.c.v.VirtualMachinePowerStateSyncImpl]
>>>> (DirectAgentCronJob-79:ctx-8c839142) VM state was updated but update time
>>>> is null?! vm id: 5
>>>> 2015-11-26 20:22:24,794 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
>>>> (DirectAgentCronJob-79:ctx-8c839142) Detected missing VM. host: 4, vm id:
>>>> 5, power state: PowerReportMissing, last state update: 1448549544790
>>>> 2015-11-26 20:22:24,794 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
>>>> (DirectAgentCronJob-79:ctx-8c839142) vm id: 5 - time since last state
>>>> update(0ms) has not passed graceful period yet
>>>> 2015-11-26 20:22:24,794 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
>>>> (DirectAgentCronJob-79:ctx-8c839142) Done with process of VM state
>>> report.
>>>> host: 4
>>>> 2015-11-26 20:22:25,994 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-69:ctx-a18e64d5) Trying to connect to 169.254.0.43 attempt 2
>>>> of 100
>>>> 2015-11-26 20:22:26,110 DEBUG
>>> [c.c.h.x.r.w.x.CitrixCheckSshCommandWrapper]
>>>> (DirectAgent-69:ctx-a18e64d5) Ping command port succeeded for vm r-4-VM
>>>> 2015-11-26 20:22:26,111 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-69:ctx-a18e64d5) Executing command in VR:
>>>> /opt/cloud/bin/router_proxy.sh get_template_version.sh 169.254.0.43 null
>>>> 2015-11-26 20:22:26,246 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-20:ctx-06bd0169) ===START=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549611535
>>>> 2015-11-26 20:22:26,271 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-20:ctx-06bd0169 ctx-3118df18) ===END=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549611535
>>>> 2015-11-26 20:22:26,389 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-69:ctx-a18e64d5) Executing command in VR:
>>>> /opt/cloud/bin/router_proxy.sh netusage.sh 169.254.0.43 -c
>>>> 2015-11-26 20:22:26,677 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-69:ctx-a18e64d5) Looking for network named mgmt
>>>> 2015-11-26 20:22:26,692 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>>> (DirectAgent-69:ctx-a18e64d5) Transforming
>>>> com.cloud.agent.api.routing.IpAssocCommand to ConfigItems
>>>> 2015-11-26 20:22:26,692 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>>> (DirectAgent-69:ctx-a18e64d5) Transforming
>>>> com.cloud.agent.api.routing.SetMonitorServiceCommand to ConfigItems
>>>> 2015-11-26 20:22:26,695 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-69:ctx-a18e64d5) Copying VR with ip 169.254.0.43 config file
>>>> into host 10.0.0.171
>>>> 2015-11-26 20:22:26,964 DEBUG [c.c.a.m.AgentManagerImpl]
>>>> (AgentManager-Handler-6:null) SeqA 5-1786: Processing Seq 5-1786: { Cmd
>>> ,
>>>> MgmtId: -1, via: 5, Ver: v1, Flags: 11,
>>>>
>>>>
>>> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
>>>> \"connections\": []\n}","wait":0}}] }
>>>> 2015-11-26 20:22:26,966 DEBUG [c.c.a.m.AgentManagerImpl]
>>>> (AgentManager-Handler-6:null) SeqA 5-1786: Sending Seq 5-1786: { Ans: ,
>>>> MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
>>>> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
>>>> 2015-11-26 20:22:27,075 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-69:ctx-a18e64d5) VR Config file
>>>> VR-d0244a1d-2334-4771-868b-2910b7a8c359.cfg got created in VR, ip
>>>> 169.254.0.43 with content
>>>> #Apache CloudStack Virtual Router Config File
>>>> <version>
>>>> 1.0
>>>> </version>
>>>> <file>
>>>> /var/cache/cloud/ip_associations.json
>>>>
>>>>
>>> {"ip_address":[{"public_ip":"10.0.0.174","source_nat":true,"add":true,"one_to_one_nat":false,"first_i_p":true,"gateway":"10.0.0.1","netmask":"255.255.255.0","vif_mac_address":"06:35:62:00:00:09","nic_dev_id":2,"new_nic":false}],"type":"ips"}
>>>> </file>
>>>> <script>
>>>> /opt/cloud/bin/update_config.py ip_associations.json
>>>> </script>
>>>> <file>
>>>> /var/cache/cloud/monitor_service.json
>>>>
>>>>
>>> {"config":"[dhcp]:processname=dnsmasq:servicename=dnsmasq:pidfile=/var/run/dnsmasq/dnsmasq.pid:,[loadbalancing]:processname=haproxy:servicename=haproxy:pidfile=/var/run/haproxy.pid:,[ssh]:processname=sshd:servicename=ssh:pidfile=/var/run/sshd.pid:,[webserver]:processname=apache2:servicename=apache2:pidfile=/var/run/apache2.pid:,","type":"monitorservice"}
>>>> </file>
>>>> <script>
>>>> /opt/cloud/bin/update_config.py monitor_service.json
>>>> </script>
>>>>
>>>> 2015-11-26 20:22:27,075 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-69:ctx-a18e64d5) Executing command in VR:
>>>> /opt/cloud/bin/router_proxy.sh vr_cfg.sh 169.254.0.43 -c
>>>> /var/cache/cloud/VR-d0244a1d-2334-4771-868b-2910b7a8c359.cfg
>>>> 2015-11-26 20:22:28,018 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (AsyncJobMgr-Heartbeat-1:ctx-ed233495) Begin cleanup expired async-jobs
>>>> 2015-11-26 20:22:28,021 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (AsyncJobMgr-Heartbeat-1:ctx-ed233495) End cleanup expired async-jobs
>>>> 2015-11-26 20:22:29,218 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-21:ctx-1da30083) ===START=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549614535
>>>> 2015-11-26 20:22:29,235 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-21:ctx-1da30083 ctx-605fe303) ===END=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549614535
>>>> 2015-11-26 20:22:32,250 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-7:ctx-63ad70cb) ===START=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549617569
>>>> 2015-11-26 20:22:32,277 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-7:ctx-63ad70cb ctx-3f0ef7d5) ===END=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549617569
>>>> 2015-11-26 20:22:32,387 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-69:ctx-a18e64d5) Seq 4-8612571337392652838: Response
>>> Received:
>>>> 2015-11-26 20:22:32,388 DEBUG [c.c.a.t.Request]
>>>> (DirectAgent-69:ctx-a18e64d5) Seq 4-8612571337392652838: Processing: {
>>>> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
>>>>
>>>>
>>> [{"com.cloud.agent.api.StartAnswer":{"vm":{"id":4,"name":"r-4-VM","bootloader":"PyGrub","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":268435456,"maxRam":268435456,"arch":"x86_64","os":"Debian
>>>> GNU/Linux 7(64-bit)","platformEmulator":"Debian Wheezy 7.0
>>>> (64-bit)","bootArgs":" template=domP name=r-4-VM eth2ip=10.0.0.174
>>>> eth2mask=255.255.255.0 gateway=10.0.0.1 eth0ip=10.1.1.1
>>>> eth0mask=255.255.255.0 domain=cs2cloud.internal cidrsize=24
>>>> dhcprange=10.1.1.1 eth1ip=169.254.0.43 eth1mask=255.255.0.0 type=router
>>>> disable_rp_filter=true dns1=8.8.8.8
>>>>
>>>>
>>> baremetalnotificationsecuritykey=MD4bWVy5t0anMd4eq4UlKWj6cZTW4gFDMeDd0WR3H3BuAsrxVX28ShzvJgbd8RR5eMRZ7rNYAsaF9RPXAZoCrQ
>>>>
>>>>
>>> baremetalnotificationapikey=ZWNcizzJ0xXQE0Ubr6Sr_kN7xlMMMMtziuPTxHwZOyIN-Lo2f2CzvPhNw0o01LkNP3X4bp61YiZu0EWF-Mbfew
>>>> host=10.0.0.170
>>>>
>>>>
>>> port=8080","enableHA":true,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"SlzaiXi9iLi3YpfQ7v3kZw","params":{},"uuid":"27157005-7e89-4251-89e4-2c53ff43bb70","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"9478a811-8b96-4cfa-b6bf-1e09c3fecd39","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
>>>>
>>>>
>>> 10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc
>>>>
>>> "}},"name":"ROOT-4","size":3145728000,"path":"dcc1ce80-4cd5-4f59-b063-34e2a93ed99a","volumeId":5,"vmName":"r-4-VM","accountId":2,"format":"VHD","provisioningType":"THIN","id":5,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"dcc1ce80-4cd5-4f59-b063-34e2a93ed99a","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"10.0.0.170","volumeSize":"3145728000"}}],"nics":[{"deviceId":2,"networkRateMbps":200,"defaultNic":true,"pxeDisable":true,"nicUuid":"9fbc00ea-599c-4455-a416-8e66986d9454","uuid":"8872476c-2fd1-4ed3-bfb1-c62efe2b6eab","ip":"10.0.0.174","netmask":"255.255.255.0","gateway":"10.0.0.1","mac":"06:a0:8a:00:00:09","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"mgmt"},{"deviceId":0,"networkRateMbps":200,"defaultNic":false,"pxeDisable":true,"nicUuid":"f38511fa-d2e8-4935-9fc4-74b2eea7621b","uuid":"2e97fcee-3d01-40d2-a624-376661747d0c","ip":"10.1.1.1","netmask":"255.255.255.0","mac":"02:00:4d:27:00:02","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://500","isolationUri":"vlan://500","isSecurityGroupEnabled":false,"name":"mgmt"},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"pxeDisable":true,"nicUuid":"5c6cd3fa-fddb-4ee0-bff2-87e5c04f8d81","uuid":"914b3b0d-541c-4c63-b331-3377672a824d","ip":"169.254.0.43","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:00:2b","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"_iqnToPath":{},"result":true,"wait":0}},{"com.cloud.agent.api.check.CheckSshAnswer":{"result":true,"wait":0}},{"com.cloud.agent.api.GetDomRVersionAnswer":{"templateVersion":"Cloudstack
>>>> Release 4.6.0 Mon Nov 9 11:21:06 UTC
>>>>
>>>>
>>> 2015","scriptsVersion":"4042f3d5b3337372cf94955f2ae8a149\n","result":true,"details":"Cloudstack
>>>> Release 4.6.0 Mon Nov 9 11:21:06 UTC
>>>>
>>>>
>>> 2015&4042f3d5b3337372cf94955f2ae8a149\n","wait":0}},{"com.cloud.agent.api.NetworkUsageAnswer":{"routerName":"r-4-VM","bytesSent":0,"bytesReceived":0,"result":true,"details":"","wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"details":"Command
>>>> aggregation
>>>>
>>>>
>>> started","wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"details":"Command
>>>> aggregation finished","wait":0}}] }
>>>> 2015-11-26 20:22:32,389 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>>> 4-8612571337392652838: Received: { Ans: , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 10, { StartAnswer, CheckSshAnswer,
>>>> GetDomRVersionAnswer, NetworkUsageAnswer, Answer, Answer, Answer, Answer
>>> }
>>>> }
>>>> 2015-11-26 20:22:32,405 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM state
>>>> transitted from :Starting to Running with event: OperationSucceededvm's
>>>> original host id: 4 new host id: 4 host id before state transition: 4
>>>> 2015-11-26 20:22:32,408 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Start
>>>> completed for VM VM[DomainRouter|r-4-VM]
>>>> 2015-11-26 20:22:32,412 DEBUG [c.c.n.NetworkModelImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
>>>> SecurityGroup is not supported in the network id=212
>>>> 2015-11-26 20:22:32,417 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>>> 4-8612571337392652840: Sending { Cmd , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>>
>>>>
>>> [{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Start","accessDetails":{"router.guest.ip":"10.1.1.1","
>>>> router.name":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}}] }
>>>> 2015-11-26 20:22:32,418 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>>> 4-8612571337392652840: Executing: { Cmd , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>>
>>>>
>>> [{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Start","accessDetails":{"router.guest.ip":"10.1.1.1","
>>>> router.name":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}}] }
>>>> 2015-11-26 20:22:32,418 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-138:ctx-d5c945c8) Seq 4-8612571337392652840: Executing
>>> request
>>>> 2015-11-26 20:22:32,418 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-138:ctx-d5c945c8) Seq 4-8612571337392652840: Response
>>>> Received:
>>>> 2015-11-26 20:22:32,418 DEBUG [c.c.a.t.Request]
>>>> (DirectAgent-138:ctx-d5c945c8) Seq 4-8612571337392652840: Processing: {
>>>> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
>>>> [{"com.cloud.agent.api.Answer":{"result":true,"details":"Command
>>>> aggregation started","wait":0}}] }
>>>> 2015-11-26 20:22:32,418 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>>> 4-8612571337392652840: Received: { Ans: , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 10, { Answer } }
>>>> 2015-11-26 20:22:32,418 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>> Reprogramming
>>>> network Ntwk[212|Guest|8] as a part of network implement
>>>> 2015-11-26 20:22:32,419 DEBUG [c.c.n.f.FirewallManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) applying
>>>> default firewall egress rules
>>>> 2015-11-26 20:22:32,425 DEBUG [o.a.c.n.t.BasicNetworkTopology]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) APPLYING
>>>> FIREWALL RULES
>>>> 2015-11-26 20:22:32,425 DEBUG [o.a.c.n.t.BasicNetworkTopology]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Applying
>>>> firewall rules in network Ntwk[212|Guest|8]
>>>> 2015-11-26 20:22:32,430 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>>> 4-8612571337392652841: Sending { Cmd , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 100001,
>>>>
>>>>
>>> [{"com.cloud.agent.api.routing.SetFirewallRulesCommand":{"rules":[{"id":0,"srcIp":"","protocol":"all","revoked":false,"alreadyAdded":false,"sourceCidrList":[],"purpose":"Firewall","trafficType":"Egress","defaultEgressPolicy":false}],"accessDetails":{"router.guest.ip":"10.1.1.1","firewall.egress.default":"System","zone.network.type":"Advanced","router.ip":"169.254.0.43","
>>>> router.name":"r-4-VM"},"wait":0}}] }
>>>> 2015-11-26 20:22:32,430 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>>> 4-8612571337392652841: Executing: { Cmd , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 100001,
>>>>
>>>>
>>> [{"com.cloud.agent.api.routing.SetFirewallRulesCommand":{"rules":[{"id":0,"srcIp":"","protocol":"all","revoked":false,"alreadyAdded":false,"sourceCidrList":[],"purpose":"Firewall","trafficType":"Egress","defaultEgressPolicy":false}],"accessDetails":{"router.guest.ip":"10.1.1.1","firewall.egress.default":"System","zone.network.type":"Advanced","router.ip":"169.254.0.43","
>>>> router.name":"r-4-VM"},"wait":0}}] }
>>>> 2015-11-26 20:22:32,430 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-276:ctx-9bb810d3) Seq 4-8612571337392652841: Executing
>>> request
>>>> 2015-11-26 20:22:32,430 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-276:ctx-9bb810d3) Seq 4-8612571337392652841: Response
>>>> Received:
>>>> 2015-11-26 20:22:32,430 DEBUG [c.c.a.t.Request]
>>>> (DirectAgent-276:ctx-9bb810d3) Seq 4-8612571337392652841: Processing: {
>>>> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 0,
>>>> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
>>>> 2015-11-26 20:22:32,430 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>>> 4-8612571337392652841: Received: { Ans: , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 0, { Answer } }
>>>> 2015-11-26 20:22:32,432 DEBUG [c.c.n.f.FirewallManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are
>>> no
>>>> firewall rules to apply
>>>> 2015-11-26 20:22:32,432 DEBUG [c.c.n.r.RulesManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are
>>> no
>>>> static nat to apply for network id=212
>>>> 2015-11-26 20:22:32,432 DEBUG [c.c.n.f.FirewallManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are
>>> no
>>>> firewall rules to apply
>>>> 2015-11-26 20:22:32,433 DEBUG [c.c.n.r.RulesManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are
>>> no
>>>> port forwarding rules to apply for network id=212
>>>> 2015-11-26 20:22:32,433 DEBUG [c.c.n.r.RulesManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are
>>> no
>>>> static nat rules to apply for network id=212
>>>> 2015-11-26 20:22:32,433 DEBUG [c.c.n.l.LoadBalancingRulesManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Applying
>>> load
>>>> balancer rules of scheme Public in network id=212
>>>> 2015-11-26 20:22:32,434 DEBUG [c.c.n.l.LoadBalancingRulesManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are
>>> no
>>>> Load Balancing Rules to forward to the network elements
>>>> 2015-11-26 20:22:32,434 DEBUG [c.c.n.l.LoadBalancingRulesManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Applying
>>> load
>>>> balancer rules of scheme Internal in network id=212
>>>> 2015-11-26 20:22:32,434 DEBUG [c.c.n.l.LoadBalancingRulesManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are
>>> no
>>>> Load Balancing Rules to forward to the network elements
>>>> 2015-11-26 20:22:32,435 DEBUG [c.c.n.NetworkModelImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
>>>> SecurityGroup is not supported in the network id=212
>>>> 2015-11-26 20:22:32,439 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>>> 4-8612571337392652842: Sending { Cmd , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>>
>>>>
>>> [{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Finish","accessDetails":{"router.guest.ip":"10.1.1.1","
>>>> router.name":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}}] }
>>>> 2015-11-26 20:22:32,439 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>>> 4-8612571337392652842: Executing: { Cmd , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>>
>>>>
>>> [{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Finish","accessDetails":{"router.guest.ip":"10.1.1.1","
>>>> router.name":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}}] }
>>>> 2015-11-26 20:22:32,439 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-70:ctx-436aff22) Seq 4-8612571337392652842: Executing
>>> request
>>>> 2015-11-26 20:22:32,439 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>>> (DirectAgent-70:ctx-436aff22) Transforming
>>>> com.cloud.agent.api.routing.SetFirewallRulesCommand to ConfigItems
>>>> 2015-11-26 20:22:32,445 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-70:ctx-436aff22) Copying VR with ip 169.254.0.43 config file
>>>> into host 10.0.0.171
>>>> 2015-11-26 20:22:32,848 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-70:ctx-436aff22) VR Config file
>>>> VR-a8dcb409-d150-4d21-b2c7-53b76dccedb3.cfg got created in VR, ip
>>>> 169.254.0.43 with content
>>>> #Apache CloudStack Virtual Router Config File
>>>> <version>
>>>> 1.0
>>>> </version>
>>>> <file>
>>>> /var/cache/cloud/firewall_rules.json
>>>>
>>>>
>>> {"rules":[{"id":0,"src_ip":"","protocol":"all","revoked":false,"already_added":false,"source_cidr_list":[],"purpose":"Firewall","traffic_type":"Egress","default_egress_policy":false}],"type":"firewallrules"}
>>>> </file>
>>>> <script>
>>>> /opt/cloud/bin/update_config.py firewall_rules.json
>>>> </script>
>>>>
>>>> 2015-11-26 20:22:32,849 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-70:ctx-436aff22) Executing command in VR:
>>>> /opt/cloud/bin/router_proxy.sh vr_cfg.sh 169.254.0.43 -c
>>>> /var/cache/cloud/VR-a8dcb409-d150-4d21-b2c7-53b76dccedb3.cfg
>>>> 2015-11-26 20:22:33,458 DEBUG [c.c.s.StatsCollector]
>>>> (StatsCollector-4:ctx-f3f3d8c7) AutoScaling Monitor is running...
>>>> 2015-11-26 20:22:33,734 DEBUG [c.c.s.StatsCollector]
>>>> (StatsCollector-2:ctx-bc3ff1c1) VmStatsCollector is running...
>>>> 2015-11-26 20:22:34,354 DEBUG [o.a.c.s.SecondaryStorageManagerImpl]
>>>> (secstorage-1:ctx-7f9c4728) Zone 3 is ready to launch secondary storage
>>> VM
>>>> 2015-11-26 20:22:34,681 DEBUG [c.c.c.ConsoleProxyManagerImpl]
>>>> (consoleproxy-1:ctx-7ffdffac) Zone 3 is ready to launch console proxy
>>>> 2015-11-26 20:22:35,261 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-23:ctx-032600be) ===START=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549620578
>>>> 2015-11-26 20:22:35,273 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-23:ctx-032600be ctx-30e2f925) ===END=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549620578
>>>> 2015-11-26 20:22:35,601 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-70:ctx-436aff22) Seq 4-8612571337392652842: Response
>>> Received:
>>>> 2015-11-26 20:22:35,601 DEBUG [c.c.a.t.Request]
>>>> (DirectAgent-70:ctx-436aff22) Seq 4-8612571337392652842: Processing: {
>>>> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
>>>> [{"com.cloud.agent.api.Answer":{"result":true,"details":"Command
>>>> aggregation finished","wait":0}}] }
>>>> 2015-11-26 20:22:35,601 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>>> 4-8612571337392652842: Received: { Ans: , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 10, { Answer } }
>>>> 2015-11-26 20:22:35,609 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Lock is
>>>> released for network id 212 as a part of network implement
>>>> 2015-11-26 20:22:35,616 DEBUG [c.c.n.NetworkModelImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
>>>> SecurityGroup is not supported in the network id=212
>>>> 2015-11-26 20:22:35,618 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Changing
>>>> active number of nics for network id=212 on 1
>>>> 2015-11-26 20:22:35,621 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Asking
>>>> VirtualRouter to prepare for
>>>> Nic[11-5-2a4a184a-eac9-4609-8a70-4d230ee3a37d-10.1.1.88]
>>>> 2015-11-26 20:22:35,630 DEBUG [c.c.n.NetworkModelImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
>>>> SecurityGroup is not supported in the network id=212
>>>> 2015-11-26 20:22:35,631 DEBUG [o.a.c.n.t.BasicNetworkTopology]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) CONFIG DHCP
>>>> FOR SUBNETS RULES
>>>> 2015-11-26 20:22:35,636 DEBUG [c.c.n.NetworkModelImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
>>>> SecurityGroup is not supported in the network id=212
>>>> 2015-11-26 20:22:35,637 DEBUG [o.a.c.n.t.AdvancedNetworkTopology]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) APPLYING
>>> VPC
>>>> DHCP ENTRY RULES
>>>> 2015-11-26 20:22:35,637 DEBUG [o.a.c.n.t.BasicNetworkTopology]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Applying
>>> dhcp
>>>> entry in network Ntwk[212|Guest|8]
>>>> 2015-11-26 20:22:35,665 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>>> 4-8612571337392652843: Sending { Cmd , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>>
>>>>
>>> [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:71:ff:00:03","vmIpAddress":"10.1.1.88","vmName":"Test002","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:71:ff:00:03","isDefault":true,"executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","router.guest.ip":"10.1.1.1","router.ip":"169.254.0.43","
>>>> router.name":"r-4-VM"},"wait":0}}] }
>>>> 2015-11-26 20:22:35,667 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>>> 4-8612571337392652843: Executing: { Cmd , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>>
>>>>
>>> [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:71:ff:00:03","vmIpAddress":"10.1.1.88","vmName":"Test002","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:71:ff:00:03","isDefault":true,"executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","router.guest.ip":"10.1.1.1","router.ip":"169.254.0.43","
>>>> router.name":"r-4-VM"},"wait":0}}] }
>>>> 2015-11-26 20:22:35,667 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-277:ctx-490bf746) Seq 4-8612571337392652843: Executing
>>> request
>>>> 2015-11-26 20:22:35,667 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>>> (DirectAgent-277:ctx-490bf746) Transforming
>>>> com.cloud.agent.api.routing.DhcpEntryCommand to ConfigItems
>>>> 2015-11-26 20:22:35,672 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-277:ctx-490bf746) Copying VR with ip 169.254.0.43 config
>>> file
>>>> into host 10.0.0.171
>>>> 2015-11-26 20:22:36,054 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-277:ctx-490bf746) VR Config file vm_dhcp_entry.json got
>>>> created in VR, ip 169.254.0.43 with content
>>>>
>>>>
>>> {"host_name":"Test002","mac_address":"02:00:71:ff:00:03","ipv4_adress":"10.1.1.88","ipv6_duid":"00:03:00:01:02:00:71:ff:00:03","dns_adresses":"10.1.1.1","default_gateway":"10.1.1.1","default_entry":true,"type":"dhcpentry"}
>>>> 2015-11-26 20:22:36,054 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>>> (DirectAgent-277:ctx-490bf746) Processing FileConfigItem, copying 222
>>>> characters to vm_dhcp_entry.json took 387ms
>>>> 2015-11-26 20:22:36,054 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-277:ctx-490bf746) Executing command in VR:
>>>> /opt/cloud/bin/router_proxy.sh update_config.py 169.254.0.43
>>>> vm_dhcp_entry.json
>>>> 2015-11-26 20:22:36,965 DEBUG [c.c.a.m.AgentManagerImpl]
>>>> (AgentManager-Handler-9:null) SeqA 5-1787: Processing Seq 5-1787: { Cmd
>>> ,
>>>> MgmtId: -1, via: 5, Ver: v1, Flags: 11,
>>>>
>>>>
>>> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
>>>> \"connections\": []\n}","wait":0}}] }
>>>> 2015-11-26 20:22:36,969 DEBUG [c.c.a.m.AgentManagerImpl]
>>>> (AgentManager-Handler-9:null) SeqA 5-1787: Sending Seq 5-1787: { Ans: ,
>>>> MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
>>>> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
>>>> 2015-11-26 20:22:38,021 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (AsyncJobMgr-Heartbeat-1:ctx-a7e1fd79) Begin cleanup expired async-jobs
>>>> 2015-11-26 20:22:38,023 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (AsyncJobMgr-Heartbeat-1:ctx-a7e1fd79) End cleanup expired async-jobs
>>>> 2015-11-26 20:22:38,275 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-6:ctx-d344515b) ===START=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549623593
>>>> 2015-11-26 20:22:38,288 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-6:ctx-d344515b ctx-ff44d35a) ===END=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549623593
>>>> 2015-11-26 20:22:38,760 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>>> (DirectAgent-277:ctx-490bf746) Processing ScriptConfigItem, executing
>>>> update_config.py vm_dhcp_entry.json took 2706ms
>>>> 2015-11-26 20:22:38,760 WARN [c.c.a.r.v.VirtualRoutingResource]
>>>> (DirectAgent-277:ctx-490bf746) Expected 1 answers while executing
>>>> DhcpEntryCommand but received 2
>>>> 2015-11-26 20:22:38,760 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-277:ctx-490bf746) Seq 4-8612571337392652843: Response
>>>> Received:
>>>> 2015-11-26 20:22:38,760 DEBUG [c.c.a.t.Request]
>>>> (DirectAgent-277:ctx-490bf746) Seq 4-8612571337392652843: Processing: {
>>>> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
>>>> [{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null - success:
>>>> ","null - success: RTNETLINK answers: File exists\nRTNETLINK answers:
>>> File
>>>> exists\nRTNETLINK answers: File exists\n[INFO] update_config.py ::
>>>> Processing incoming file => vm_dhcp_entry.json\n[INFO] Processing JSON
>>> file
>>>> vm_dhcp_entry.json\nTest01 Test002\n"],"result":true,"wait":0}}] }
>>>> 2015-11-26 20:22:38,760 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>>> 4-8612571337392652843: Received: { Ans: , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 10, { GroupAnswer } }
>>>> 2015-11-26 20:22:38,766 DEBUG [c.c.n.NetworkModelImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
>>>> SecurityGroup is not supported in the network id=212
>>>> 2015-11-26 20:22:38,768 DEBUG [o.a.c.n.t.AdvancedNetworkTopology]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) APPLYING
>>> VPC
>>>> USERDATA RULES
>>>> 2015-11-26 20:22:38,768 DEBUG [o.a.c.n.t.BasicNetworkTopology]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Applying
>>>> userdata and password entry in network Ntwk[212|Guest|8]
>>>> 2015-11-26 20:22:38,778 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>>> 4-8612571337392652844: Sending { Cmd , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>>
>>>>
>>> [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
>>>> router.name
>>>>
>>>>
>>> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
>>>> router.name
>>>>
>>> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}}]
>>>> }
>>>> 2015-11-26 20:22:38,779 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>>> 4-8612571337392652844: Executing: { Cmd , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>>
>>>>
>>> [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
>>>> router.name
>>>>
>>>>
>>> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
>>>> router.name
>>>>
>>> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}}]
>>>> }
>>>> 2015-11-26 20:22:38,779 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-139:ctx-69673506) Seq 4-8612571337392652844: Executing
>>> request
>>>> 2015-11-26 20:22:38,779 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>>> (DirectAgent-139:ctx-69673506) Transforming
>>>> com.cloud.agent.api.routing.SavePasswordCommand to ConfigItems
>>>> 2015-11-26 20:22:38,787 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-139:ctx-69673506) Copying VR with ip 169.254.0.43 config
>>> file
>>>> into host 10.0.0.171
>>>> 2015-11-26 20:22:39,199 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-139:ctx-69673506) VR Config file vm_password.json got
>>> created
>>>> in VR, ip 169.254.0.43 with content
>>>>
>>> {"ip_address":"10.1.1.88","password":"saved_password","type":"vmpassword"}
>>>> 2015-11-26 20:22:39,199 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>>> (DirectAgent-139:ctx-69673506) Processing FileConfigItem, copying 74
>>>> characters to vm_password.json took 420ms
>>>> 2015-11-26 20:22:39,199 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-139:ctx-69673506) Executing command in VR:
>>>> /opt/cloud/bin/router_proxy.sh update_config.py 169.254.0.43
>>>> vm_password.json
>>>> 2015-11-26 20:22:40,237 DEBUG [c.c.s.StatsCollector]
>>>> (StatsCollector-1:ctx-32277352) HostStatsCollector is running...
>>>> 2015-11-26 20:22:40,245 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-278:ctx-dc01444e) Seq 4-8612571337392652845: Executing
>>> request
>>>> 2015-11-26 20:22:40,260 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-278:ctx-dc01444e) Seq 4-8612571337392652845: Response
>>>> Received:
>>>> 2015-11-26 20:22:40,260 DEBUG [c.c.a.t.Request]
>>>> (StatsCollector-1:ctx-32277352) Seq 4-8612571337392652845: Received: {
>>>> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10, {
>>>> GetHostStatsAnswer } }
>>>> 2015-11-26 20:22:40,263 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-18:ctx-53bf8c75) Seq 4-8612571337392652846: Executing
>>> request
>>>> 2015-11-26 20:22:40,273 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-18:ctx-53bf8c75) Seq 4-8612571337392652846: Response
>>> Received:
>>>> 2015-11-26 20:22:40,274 DEBUG [c.c.a.t.Request]
>>>> (StatsCollector-1:ctx-32277352) Seq 4-8612571337392652846: Received: {
>>>> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10, {
>>>> GetGPUStatsAnswer } }
>>>> 2015-11-26 20:22:41,275 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-4:ctx-f2410d29) ===START=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549626594
>>>> 2015-11-26 20:22:41,287 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-4:ctx-f2410d29 ctx-f6f4a185) ===END=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549626594
>>>> 2015-11-26 20:22:41,959 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>>> (DirectAgent-139:ctx-69673506) Processing ScriptConfigItem, executing
>>>> update_config.py vm_password.json took 2760ms
>>>> 2015-11-26 20:22:41,959 WARN [c.c.a.r.v.VirtualRoutingResource]
>>>> (DirectAgent-139:ctx-69673506) Expected 1 answers while executing
>>>> SavePasswordCommand but received 2
>>>> 2015-11-26 20:22:41,960 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>>> (DirectAgent-139:ctx-69673506) Transforming
>>>> com.cloud.agent.api.routing.VmDataCommand to ConfigItems
>>>> 2015-11-26 20:22:41,964 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-139:ctx-69673506) Copying VR with ip 169.254.0.43 config
>>> file
>>>> into host 10.0.0.171
>>>> 2015-11-26 20:22:42,370 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-139:ctx-69673506) VR Config file vm_metadata.json got
>>> created
>>>> in VR, ip 169.254.0.43 with content
>>>>
>>>>
>>> {"vm_ip_address":"10.1.1.88","vm_metadata":[["userdata","user-data",null],["metadata","service-offering","Medium
>>>>
>>>>
>>> Instance"],["metadata","availability-zone","TestZone"],["metadata","local-ipv4","10.1.1.88"],["metadata","local-hostname","Test002"],["metadata","public-ipv4","10.0.0.174"],["metadata","public-hostname","10.0.0.174"],["metadata","instance-id","4ce4731f-22a7-42ac-8e78-093d5f2e9a34"],["metadata","vm-id","4ce4731f-22a7-42ac-8e78-093d5f2e9a34"],["metadata","public-keys",null],["metadata","cloud-identifier","CloudStack-{de65e551-2e87-423b-90e6-03cd3eb706bb}"]],"type":"vmdata"}
>>>> 2015-11-26 20:22:42,371 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>>> (DirectAgent-139:ctx-69673506) Processing FileConfigItem, copying 589
>>>> characters to vm_metadata.json took 411ms
>>>> 2015-11-26 20:22:42,371 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-139:ctx-69673506) Executing command in VR:
>>>> /opt/cloud/bin/router_proxy.sh update_config.py 169.254.0.43
>>>> vm_metadata.json
>>>> 2015-11-26 20:22:44,606 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-25:ctx-128f2f7a) ===START=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549629925
>>>> 2015-11-26 20:22:44,619 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-25:ctx-128f2f7a ctx-291bcd97) ===END=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549629925
>>>> 2015-11-26 20:22:45,153 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>>> (DirectAgent-139:ctx-69673506) Processing ScriptConfigItem, executing
>>>> update_config.py vm_metadata.json took 2782ms
>>>> 2015-11-26 20:22:45,153 WARN [c.c.a.r.v.VirtualRoutingResource]
>>>> (DirectAgent-139:ctx-69673506) Expected 1 answers while executing
>>>> VmDataCommand but received 2
>>>> 2015-11-26 20:22:45,153 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-139:ctx-69673506) Seq 4-8612571337392652844: Response
>>>> Received:
>>>> 2015-11-26 20:22:45,163 DEBUG [c.c.a.t.Request]
>>>> (DirectAgent-139:ctx-69673506) Seq 4-8612571337392652844: Processing: {
>>>> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
>>>> [{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null - success:
>>>> ","null - success: RTNETLINK answers: File exists\nRTNETLINK answers:
>>> File
>>>> exists\nRTNETLINK answers: File exists\n[INFO] update_config.py ::
>>>> Processing incoming file => vm_password.json\n[INFO] Processing JSON file
>>>>
>>>>
>>> vm_password.json\n"],"result":true,"wait":0}},{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null
>>>> - success: ","null - success: RTNETLINK answers: File exists\nRTNETLINK
>>>> answers: File exists\nRTNETLINK answers: File exists\n[INFO]
>>>> update_config.py :: Processing incoming file => vm_metadata.json\n[INFO]
>>>> Processing JSON file vm_metadata.json\n"],"result":true,"wait":0}}] }
>>>> 2015-11-26 20:22:45,163 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>>> 4-8612571337392652844: Received: { Ans: , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 10, { GroupAnswer, GroupAnswer } }
>>>> 2015-11-26 20:22:45,164 DEBUG [c.c.n.NetworkModelImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
>>>> SecurityGroup is not supported in the network id=212
>>>> 2015-11-26 20:22:45,165 DEBUG [o.a.c.e.o.VolumeOrchestrator]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
>>>> we need to prepare 2 volumes for VM[User|i-2-5-VM]
>>>> 2015-11-26 20:22:45,168 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) template 5
>>> is
>>>> already in store:1, type:Image
>>>> 2015-11-26 20:22:45,169 DEBUG [o.a.c.s.d.PrimaryDataStoreImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Not found
>>>> (templateId:5poolId:8) in template_spool_ref, persisting it
>>>> 2015-11-26 20:22:45,173 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) template 5
>>> is
>>>> already in store:8, type:Primary
>>>> 2015-11-26 20:22:45,174 DEBUG [o.a.c.s.v.VolumeServiceImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found
>>>> template centos56-x86_64-xen in storage pool 8 with VMTemplateStoragePool
>>>> id: 3
>>>> 2015-11-26 20:22:45,174 DEBUG [o.a.c.s.v.VolumeServiceImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Acquire
>>> lock
>>>> on VMTemplateStoragePool 3 with timeout 3600 seconds
>>>> 2015-11-26 20:22:45,175 INFO [o.a.c.s.v.VolumeServiceImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) lock is
>>>> acquired for VMTemplateStoragePool 3
>>>> 2015-11-26 20:22:45,179 DEBUG [o.a.c.s.m.AncientDataMotionStrategy]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) copyAsync
>>>> inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE
>>>> 2015-11-26 20:22:45,182 DEBUG [c.c.h.XenServerGuru]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>>> getCommandHostDelegation: class
>>>> org.apache.cloudstack.storage.command.CopyCommand
>>>> 2015-11-26 20:22:45,183 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>>> 4-8612571337392652847: Sending { Cmd , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 100111,
>>>>
>>>>
>>> [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/5/3986df71-b1d0-3e20-a655-7e42dd144370.vhd","origUrl":"
>>>> http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
>>>>
>>> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
>>>> 5.6(64-bit) no GUI
>>>>
>>>>
>>> (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://
>>>> 10.0.0.170/export/secondary
>>>>
>>>>
>>> ","_role":"Image"}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"
>>>> http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
>>>>
>>> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
>>>> 5.6(64-bit) no GUI
>>>>
>>>>
>>> (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
>>>>
>>>>
>>> 10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc
>>>>
>>> "}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"executeInSequence":true,"options":{},"options2":{},"wait":10800}}]
>>>> }
>>>> 2015-11-26 20:22:45,184 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>>> 4-8612571337392652847: Executing: { Cmd , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 100111,
>>>>
>>>>
>>> [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/5/3986df71-b1d0-3e20-a655-7e42dd144370.vhd","origUrl":"
>>>> http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
>>>>
>>> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
>>>> 5.6(64-bit) no GUI
>>>>
>>>>
>>> (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://
>>>> 10.0.0.170/export/secondary
>>>>
>>>>
>>> ","_role":"Image"}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"
>>>> http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
>>>>
>>> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
>>>> 5.6(64-bit) no GUI
>>>>
>>>>
>>> (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
>>>>
>>>>
>>> 10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc
>>>>
>>> "}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"executeInSequence":true,"options":{},"options2":{},"wait":10800}}]
>>>> }
>>>> 2015-11-26 20:22:45,184 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-279:ctx-532427fb) Seq 4-8612571337392652847: Executing
>>> request
>>>> 2015-11-26 20:22:46,489 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-279:ctx-532427fb) Host 10.0.0.171
>>>> OpaqueRef:53354999-bf25-32b9-01df-a695a039ba8d: Removing SR
>>>> 2015-11-26 20:22:46,500 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-279:ctx-532427fb) Host 10.0.0.171
>>>> OpaqueRef:f33f27b6-88c3-8c94-c8b3-40c094d9e66d: Unplugging pbd
>>>> 2015-11-26 20:22:46,598 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-279:ctx-532427fb) Host 10.0.0.171
>>>> OpaqueRef:53354999-bf25-32b9-01df-a695a039ba8d: Forgetting
>>>> 2015-11-26 20:22:46,601 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-279:ctx-532427fb) Seq 4-8612571337392652847: Response
>>>> Received:
>>>> 2015-11-26 20:22:46,602 DEBUG [c.c.a.t.Request]
>>>> (DirectAgent-279:ctx-532427fb) Seq 4-8612571337392652847: Processing: {
>>>> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 110,
>>>>
>>>>
>>> [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Expected
>>>> 1 VDI template but found 2 VDI template(s) on:
>>>> 10.0.0.170:/export/secondary/template/tmpl/1/5","wait":0}}]
>>>> }
>>>> 2015-11-26 20:22:46,602 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>>> 4-8612571337392652847: Received: { Ans: , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 110, { CopyCmdAnswer } }
>>>> 2015-11-26 20:22:46,603 DEBUG [c.c.a.m.AgentAttache]
>>>> (DirectAgent-279:ctx-532427fb) Seq 4-8612571337392652847: No more
>>> commands
>>>> found
>>>> 2015-11-26 20:22:46,607 INFO [o.a.c.s.v.VolumeServiceImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) releasing
>>>> lock for VMTemplateStoragePool 3
>>>> 2015-11-26 20:22:46,608 DEBUG [o.a.c.e.o.VolumeOrchestrator]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Unable to
>>>> create Vol[6|vm=5|ROOT]:Expected 1 VDI template but found 2 VDI
>>> template(s)
>>>> on: 10.0.0.170:/export/secondary/template/tmpl/1/5
>>>> 2015-11-26 20:22:46,608 INFO [c.c.v.VirtualMachineManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Unable to
>>>> contact resource.
>>>> com.cloud.exception.StorageUnavailableException: Resource [StoragePool:8]
>>>> is unreachable: Unable to create Vol[6|vm=5|ROOT]:Expected 1 VDI template
>>>> but found 2 VDI template(s) on: 10.0.0.170:
>>>> /export/secondary/template/tmpl/1/5
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1278)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1336)
>>>> at
>>>>
>>>>
>>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1000)
>>>> at
>>>>
>>>>
>>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4580)
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>> at
>>>>
>>>>
>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>>> at
>>>>
>>>>
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>>> at java.lang.reflect.Method.invoke(Method.java:606)
>>>> at
>>>>
>>>>
>>> com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
>>>> at
>>>>
>>>>
>>> com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4736)
>>>> at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
>>>> at
>>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>>> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>>>> at
>>>>
>>>>
>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>>> at
>>>>
>>>>
>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>>> at java.lang.Thread.run(Thread.java:745)
>>>> 2015-11-26 20:22:46,611 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Cleaning up
>>>> resources for the vm VM[User|i-2-5-VM] in Starting state
>>>> 2015-11-26 20:22:46,612 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>>> 4-8612571337392652848: Sending { Cmd , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>>
>>>>
>>> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"checkBeforeCleanup":false,"vmName":"i-2-5-VM","wait":0}}]
>>>> }
>>>> 2015-11-26 20:22:46,612 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>>> 4-8612571337392652848: Executing: { Cmd , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>>
>>>>
>>> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"checkBeforeCleanup":false,"vmName":"i-2-5-VM","wait":0}}]
>>>> }
>>>> 2015-11-26 20:22:46,613 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-140:ctx-7f6d3e96) Seq 4-8612571337392652848: Executing
>>> request
>>>> 2015-11-26 20:22:46,618 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-140:ctx-7f6d3e96) Seq 4-8612571337392652848: Response
>>>> Received:
>>>> 2015-11-26 20:22:46,618 DEBUG [c.c.a.t.Request]
>>>> (DirectAgent-140:ctx-7f6d3e96) Seq 4-8612571337392652848: Processing: {
>>>> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
>>>> [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not
>>>> exist","wait":0}}] }
>>>> 2015-11-26 20:22:46,618 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>>> 4-8612571337392652848: Received: { Ans: , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 10, { StopAnswer } }
>>>> 2015-11-26 20:22:46,623 DEBUG [c.c.n.NetworkModelImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
>>>> SecurityGroup is not supported in the network id=212
>>>> 2015-11-26 20:22:46,625 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Changing
>>>> active number of nics for network id=212 on -1
>>>> 2015-11-26 20:22:46,630 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Asking
>>>> VirtualRouter to release
>>>> NicProfile[11-5-2a4a184a-eac9-4609-8a70-4d230ee3a37d-10.1.1.88-null
>>>> 2015-11-26 20:22:46,630 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>> Successfully
>>>> released network resources for the vm VM[User|i-2-5-VM]
>>>> 2015-11-26 20:22:46,630 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>> Successfully
>>>> cleanued up resources for the vm VM[User|i-2-5-VM] in Starting state
>>>> 2015-11-26 20:22:46,635 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deploy
>>> avoids
>>>> pods: [], clusters: [], hosts: [4]
>>>> 2015-11-26 20:22:46,636 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>>> DeploymentPlanner allocation algorithm:
>>>> com.cloud.deploy.FirstFitPlanner@1136745
>>>> 2015-11-26 20:22:46,636 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
>>>> allocate a host and storage pools from dc:3, pod:3,cluster:3, requested
>>>> cpu: 1000, requested ram: 1073741824
>>>> 2015-11-26 20:22:46,636 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Is ROOT
>>>> volume READY (pool already allocated)?: No
>>>> 2015-11-26 20:22:46,636 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>>> DeploymentPlan has host_id specified, choosing this host and making no
>>>> checks on this host: 4
>>>> 2015-11-26 20:22:46,636 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) The
>>> specified
>>>> host is in avoid set
>>>> 2015-11-26 20:22:46,636 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Cannot
>>> deploy
>>>> to specified host, returning.
>>>> 2015-11-26 20:22:46,645 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM state
>>>> transitted from :Starting to Stopped with event: OperationFailedvm's
>>>> original host id: null new host id: null host id before state
>>> transition: 4
>>>> 2015-11-26 20:22:46,648 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Hosts's
>>>> actual total CPU: 3399 and CPU after applying overprovisioning: 3399
>>>> 2015-11-26 20:22:46,649 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Hosts's
>>>> actual total RAM: 15354505344 and RAM after applying overprovisioning:
>>>> 15354505216
>>>> 2015-11-26 20:22:46,649 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) release cpu
>>>> from host: 4, old used: 2500,reserved: 0, actual total: 3399, total with
>>>> overprovisioning: 3399; new used: 1500,reserved:0; movedfromreserved:
>>>> false,moveToReserveredfalse
>>>> 2015-11-26 20:22:46,649 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) release mem
>>>> from host: 4, old used: 2952790016,reserved: 0, total: 15354505216; new
>>>> used: 1879048192,reserved:0; movedfromreserved:
>>> false,moveToReserveredfalse
>>>> 2015-11-26 20:22:46,654 ERROR [c.c.v.VmWorkJobHandlerProxy]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Invocation
>>>> exception, caused by:
>>>> com.cloud.exception.InsufficientServerCapacityException: Unable to
>>> create a
>>>> deployment for VM[User|i-2-5-VM]Scope=interface com.cloud.dc.DataCenter;
>>>> id=3
>>>> 2015-11-26 20:22:46,654 INFO [c.c.v.VmWorkJobHandlerProxy]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Rethrow
>>>> exception com.cloud.exception.InsufficientServerCapacityException: Unable
>>>> to create a deployment for VM[User|i-2-5-VM]Scope=interface
>>>> com.cloud.dc.DataCenter; id=3
>>>> 2015-11-26 20:22:46,654 DEBUG [c.c.v.VmWorkJobDispatcher]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Done with run of VM work
>>>> job: com.cloud.vm.VmWorkStart for VM 5, job origin: 68
>>>> 2015-11-26 20:22:46,654 ERROR [c.c.v.VmWorkJobDispatcher]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Unable to complete
>>>> AsyncJobVO {id:69, userId: 2, accountId: 2, instanceType: null,
>>> instanceId:
>>>> null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
>>>>
>>>>
>>> rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAABXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAA3BzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHIAEGphdmEubGFuZy5OdW1iZXKGrJUdC5TgiwIAAHhwAAAAAAAAAANzcQB-AAgAAAAAAAAABHBwcHEAfgAKcHNyABFqYXZhLnV0aWwuSGFzaE1hcAUH2sHDFmDRAwACRgAKbG9hZEZhY3RvckkACXRocmVzaG9sZHhwP0AAAAAAAAx3CAAAABAAAAABdAAKVm1QYXNzd29yZHQAHHJPMEFCWFFBRG5OaGRtVmtYM0JoYzNOM2IzSmt4cA,
>>>> cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
>>>> result: null, initMsid: 52229922654, completeMsid: null, lastUpdated:
>>> null,
>>>> lastPolled: null, created: Thu Nov 26 20:21:56 IST 2015}, job origin:68
>>>> com.cloud.exception.InsufficientServerCapacityException: Unable to
>>> create a
>>>> deployment for VM[User|i-2-5-VM]Scope=interface com.cloud.dc.DataCenter;
>>>> id=3
>>>> at
>>>>
>>>>
>>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:959)
>>>> at
>>>>
>>>>
>>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4580)
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>> at
>>>>
>>>>
>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>>> at
>>>>
>>>>
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>>> at java.lang.reflect.Method.invoke(Method.java:606)
>>>> at
>>>>
>>>>
>>> com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
>>>> at
>>>>
>>>>
>>> com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4736)
>>>> at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
>>>> at
>>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>>> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>>>> at
>>>>
>>>>
>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>>> at
>>>>
>>>>
>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>>> at java.lang.Thread.run(Thread.java:745)
>>>> 2015-11-26 20:22:46,662 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Complete async job-69,
>>>> jobStatus: FAILED, resultCode: 0, result:
>>>>
>>>>
>>> rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAAzVW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1VzZXJ8aS0yLTUtVk1ddXIAHltMamF2YS5sYW5nLlN0YWNrVHJhY2VFbGVtZW50OwJGKjw8_SI5AgAAeHAAAAAVc3IAG2phdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudGEJxZomNt2FAgAESQAKbGluZU51bWJlckwADmRlY2xhcmluZ0NsYXNzcQB-AApMAAhmaWxlTmFtZXEAfgAKTAAKbWV0aG9kTmFtZXEAfgAKeHAAAAO_dAAmY29tLmNsb3VkLnZtLlZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGx0AB5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsLmphdmF0ABBvcmNoZXN0cmF0ZVN0YXJ0c3EAfgARAAAR5HEAfgATcQB-ABRxAH4AFXNxAH4AEf____50ACRzdW4ucmVmbGVjdC5OYXRpdmVNZXRob2RBY2Nlc3NvckltcGx0AB1OYXRpdmVNZXRob2RBY2Nlc3NvckltcGwuamF2YXQAB2ludm9rZTBzcQB-ABEAAAA5cQB-ABhxAH4AGXQABmludm9rZXNxAH4AEQAAACt0AChzdW4ucmVmbGVjdC5EZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsdAAhRGVsZWdhdGluZ01ldGhvZEFjY2Vzc29ySW1wbC5qYXZhcQB-ABxzcQB-ABEAAAJedAAYamF2YS5sYW5nLnJlZmxlY3QuTWV0aG9kdAALTWV0aG9kLmphdmFxAH4AHHNxAH4AEQAAAGt0ACJjb20uY2xvdWQudm0uVm1Xb3JrSm9iSGFuZGxlclByb3h5dAAaVm1Xb3JrSm9iSGFuZGxlclByb3h5LmphdmF0AA9oYW5kbGVWbVdvcmtKb2JzcQB-ABEAABKAcQB-ABNxAH4AFHEAfgAmc3EAfgARAAAAZnQAIGNvbS5jbG91ZC52bS5WbVdvcmtKb2JEaXNwYXRjaGVydAAYVm1Xb3JrSm9iRGlzcGF0Y2hlci5qYXZhdAAGcnVuSm9ic3EAfgARAAACGXQAP29yZy5hcGFjaGUuY2xvdWRzdGFjay5mcmFtZXdvcmsuam9icy5pbXBsLkFzeW5jSm9iTWFuYWdlckltcGwkNXQAGEFzeW5jSm9iTWFuYWdlckltcGwuamF2YXQADHJ1bkluQ29udGV4dHNxAH4AEQAAADF0AD5vcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGUkMXQAG01hbmFnZWRDb250ZXh0UnVubmFibGUuamF2YXQAA3J1bnNxAH4AEQAAADh0AEJvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0JDF0ABpEZWZhdWx0TWFuYWdlZENvbnRleHQuamF2YXQABGNhbGxzcQB-ABEAAABndABAb3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5pbXBsLkRlZmF1bHRNYW5hZ2VkQ29udGV4dHEAfgA2dAAPY2FsbFdpdGhDb250ZXh0c3EAfgARAAAANXEAfgA5cQB-ADZ0AA5ydW5XaXRoQ29udGV4dHNxAH4AEQAAAC50ADxvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGVxAH4AMnEAfgAzc3EAfgARAAAB7nEAfgAtcQB-AC5xAH4AM3NxAH4AEQAAAdd0AC5qYXZhLnV0aWwuY29uY3VycmVudC5FeGVjdXRvcnMkUnVubmFibGVBZGFwdGVydAAORXhlY3V0b3JzLmphdmFxAH4AN3NxAH4AEQAAAQZ0AB9qYXZhLnV0aWwuY29uY3VycmVudC5GdXR1cmVUYXNrdAAPRnV0dXJlVGFzay5qYXZhcQB-ADNzcQB-ABEAAAR5dAAnamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9ydAAXVGhyZWFkUG9vbEV4ZWN1dG9yLmphdmF0AAlydW5Xb3JrZXJzcQB-ABEAAAJndAAuamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9yJFdvcmtlcnEAfgBIcQB-ADNzcQB-ABEAAALpdAAQamF2YS5sYW5nLlRocmVhZHQAC1RocmVhZC5qYXZhcQB-ADNzcgAmamF2YS51dGlsLkNvbGxlY3Rpb25zJFVubW9kaWZpYWJsZUxpc3T8DyUxteyOEAIAAUwABGxpc3RxAH4ADHhyACxqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlQ29sbGVjdGlvbhlCAIDLXvceAgABTAABY3QAFkxqYXZhL3V0aWwvQ29sbGVjdGlvbjt4cHNyABNqYXZhLnV0aWwuQXJyYXlMaXN0eIHSHZnHYZ0DAAFJAARzaXpleHAAAAAAdwQAAAAAeHEAfgBUeHNyABFqYXZhLmxhbmcuSW50ZWdlchLioKT3gYc4AgABSQAFdmFsdWV4cgAQamF2YS5sYW5nLk51bWJlcoaslR0LlOCLAgAAeHAAABDvc3EAfgBTAAAAAHcEAAAAAHhzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHEAfgBWAAAAAAAAAAN2cgAXY29tLmNsb3VkLmRjLkRhdGFDZW50ZXKy8Qrrp-d4vgIAAHhwAA
>>>> 2015-11-26 20:22:46,663 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Publish async job-69
>>>> complete on message bus
>>>> 2015-11-26 20:22:46,663 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Wake up jobs related to
>>>> job-69
>>>> 2015-11-26 20:22:46,663 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Update db status for
>>>> job-69
>>>> 2015-11-26 20:22:46,664 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Wake up jobs joined with
>>>> job-69 and disjoin all subjobs created from job- 69
>>>> 2015-11-26 20:22:46,671 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Done executing
>>>> com.cloud.vm.VmWorkStart for job-69
>>>> 2015-11-26 20:22:46,672 INFO [o.a.c.f.j.i.AsyncJobMonitor]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Remove job-69 from job
>>>> monitoring
>>>> 2015-11-26 20:22:46,680 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Sync job-71
>>> execution
>>>> on object VmWorkJobQueue.5
>>>> 2015-11-26 20:22:46,966 DEBUG [c.c.a.m.AgentManagerImpl]
>>>> (AgentManager-Handler-7:null) SeqA 5-1788: Processing Seq 5-1788: { Cmd
>>> ,
>>>> MgmtId: -1, via: 5, Ver: v1, Flags: 11,
>>>>
>>>>
>>> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
>>>> \"connections\": []\n}","wait":0}}] }
>>>> 2015-11-26 20:22:46,971 DEBUG [c.c.a.m.AgentManagerImpl]
>>>> (AgentManager-Handler-7:null) SeqA 5-1788: Sending Seq 5-1788: { Ans: ,
>>>> MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
>>>> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
>>>> 2015-11-26 20:22:48,032 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (AsyncJobMgr-Heartbeat-1:ctx-a78c3581) Execute sync-queue item:
>>>> SyncQueueItemVO {id:10, queueId: 9, contentType: AsyncJob, contentId: 71,
>>>> lastProcessMsid: 52229922654, lastprocessNumber: 2, lastProcessTime: Thu
>>>> Nov 26 20:22:48 IST 2015, created: Thu Nov 26 20:22:46 IST 2015}
>>>> 2015-11-26 20:22:48,033 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (AsyncJobMgr-Heartbeat-1:ctx-a78c3581) Schedule queued job-71
>>>> 2015-11-26 20:22:48,038 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (AsyncJobMgr-Heartbeat-1:ctx-5936202f) Begin cleanup expired async-jobs
>>>> 2015-11-26 20:22:48,041 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (AsyncJobMgr-Heartbeat-1:ctx-5936202f) End cleanup expired async-jobs
>>>> 2015-11-26 20:22:48,041 INFO [o.a.c.f.j.i.AsyncJobMonitor]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Add job-71 into job
>>>> monitoring
>>>> 2015-11-26 20:22:48,045 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Executing AsyncJobVO
>>>> {id:71, userId: 2, accountId: 2, instanceType: null, instanceId: null,
>>> cmd:
>>>> com.cloud.vm.VmWorkStart, cmdInfo:
>>>>
>>>>
>>> rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAABXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwc3IAEWphdmEudXRpbC5IYXNoTWFwBQfawcMWYNEDAAJGAApsb2FkRmFjdG9ySQAJdGhyZXNob2xkeHA_QAAAAAAADHcIAAAAEAAAAAF0AApWbVBhc3N3b3JkdAAcck8wQUJYUUFEbk5oZG1Wa1gzQmhjM04zYjNKa3hw,
>>>> cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
>>>> result: null, initMsid: 52229922654, completeMsid: null, lastUpdated:
>>> null,
>>>> lastPolled: null, created: Thu Nov 26 20:22:46 IST 2015}
>>>> 2015-11-26 20:22:48,046 DEBUG [c.c.v.VmWorkJobDispatcher]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Run VM work job:
>>>> com.cloud.vm.VmWorkStart for VM 5, job origin: 68
>>>> 2015-11-26 20:22:48,046 DEBUG [c.c.v.VmWorkJobHandlerProxy]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Execute VM
>>>> work job:
>>>>
>>>>
>>> com.cloud.vm.VmWorkStart{"dcId":0,"rawParams":{"VmPassword":"rO0ABXQADnNhdmVkX3Bhc3N3b3Jk"},"userId":2,"accountId":2,"vmId":5,"handlerName":"VirtualMachineManagerImpl"}
>>>> 2015-11-26 20:22:48,050 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) VM state
>>>> transitted from :Stopped to Starting with event: StartRequestedvm's
>>>> original host id: null new host id: null host id before state transition:
>>>> null
>>>> 2015-11-26 20:22:48,050 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
>>> Successfully
>>>> transitioned to start state for VM[User|i-2-5-VM] reservation id =
>>>> 718d2456-bf61-48ad-9663-22ccfd4556f1
>>>> 2015-11-26 20:22:48,052 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Trying to
>>>> deploy VM, vm has dcId: 3 and podId: 3
>>>> 2015-11-26 20:22:48,052 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Deploy
>>> avoids
>>>> pods: null, clusters: null, hosts: null
>>>> 2015-11-26 20:22:48,057 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Deploy
>>> avoids
>>>> pods: [], clusters: [], hosts: []
>>>> 2015-11-26 20:22:48,057 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
>>>> DeploymentPlanner allocation algorithm:
>>>> com.cloud.deploy.FirstFitPlanner@1136745
>>>> 2015-11-26 20:22:48,057 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Trying to
>>>> allocate a host and storage pools from dc:3, pod:3,cluster:null,
>>> requested
>>>> cpu: 1000, requested ram: 1073741824
>>>> 2015-11-26 20:22:48,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Is ROOT
>>>> volume READY (pool already allocated)?: No
>>>> 2015-11-26 20:22:48,058 DEBUG [c.c.d.FirstFitPlanner]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Searching
>>>> resources only under specified Pod: 3
>>>> 2015-11-26 20:22:48,058 DEBUG [c.c.d.FirstFitPlanner]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Listing
>>>> clusters in order of aggregate capacity, that have (atleast one host
>>> with)
>>>> enough CPU and RAM capacity under this Pod: 3
>>>> 2015-11-26 20:22:48,059 DEBUG [c.c.d.FirstFitPlanner]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Removing
>>> from
>>>> the clusterId list these clusters from avoid set: []
>>>> 2015-11-26 20:22:48,063 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
>>>> resources in Cluster: 3 under Pod: 3
>>>> 2015-11-26 20:22:48,063 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
>>>> FirstFitRoutingAllocator) Looking for hosts in dc: 3 pod:3 cluster:3
>>>> 2015-11-26 20:22:48,065 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
>>>> FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for
>>>> allocation: [Host[-4-Routing]]
>>>> 2015-11-26 20:22:48,067 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
>>>> FirstFitRoutingAllocator) Found 1 hosts for allocation after
>>>> prioritization: [Host[-4-Routing]]
>>>> 2015-11-26 20:22:48,067 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
>>>> FirstFitRoutingAllocator) Looking for speed=1000Mhz, Ram=1024
>>>> 2015-11-26 20:22:48,070 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
>>>> FirstFitRoutingAllocator) Host: 4 has cpu capability (cpu:1, speed:3399)
>>> to
>>>> support requested CPU: 1 and requested speed: 1000
>>>> 2015-11-26 20:22:48,070 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
>>>> FirstFitRoutingAllocator) Checking if host: 4 has enough capacity for
>>>> requested CPU: 1000 and requested RAM: 1073741824 ,
>>>> cpuOverprovisioningFactor: 1.0
>>>> 2015-11-26 20:22:48,071 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
>>>> FirstFitRoutingAllocator) Hosts's actual total CPU: 3399 and CPU after
>>>> applying overprovisioning: 3399
>>>> 2015-11-26 20:22:48,071 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
>>>> FirstFitRoutingAllocator) Free CPU: 1899 , Requested CPU: 1000
>>>> 2015-11-26 20:22:48,071 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
>>>> FirstFitRoutingAllocator) Free RAM: 13475457024 , Requested RAM:
>>> 1073741824
>>>> 2015-11-26 20:22:48,071 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
>>>> FirstFitRoutingAllocator) Host has enough CPU and RAM available
>>>> 2015-11-26 20:22:48,071 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
>>>> FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 4, used: 1500,
>>>> reserved: 0, actual total: 3399, total with overprovisioning: 3399;
>>>> requested cpu:1000,alloc_from_last_host?:false
>>> ,considerReservedCapacity?:
>>>> true
>>>> 2015-11-26 20:22:48,071 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
>>>> FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 4, used:
>>>> 1879048192, reserved: 0, total: 15354505216; requested mem:
>>>> 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
>>>> 2015-11-26 20:22:48,071 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
>>>> FirstFitRoutingAllocator) Found a suitable host, adding to list: 4
>>>> 2015-11-26 20:22:48,071 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
>>>> FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts
>>>> 2015-11-26 20:22:48,072 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
>>>> suitable pools for volume (Id, Type): (6,ROOT)
>>>> 2015-11-26 20:22:48,072 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) We need to
>>>> allocate new storagepool for this volume
>>>> 2015-11-26 20:22:48,073 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Calling
>>>> StoragePoolAllocators to find suitable pools
>>>> 2015-11-26 20:22:48,073 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
>>>> LocalStoragePoolAllocator trying to find storage pool to fit the vm
>>>> 2015-11-26 20:22:48,073 DEBUG
>>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
>>>> ClusterScopeStoragePoolAllocator looking for storage pool
>>>> 2015-11-26 20:22:48,073 DEBUG
>>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Looking for
>>>> pools in dc: 3 pod:3 cluster:3. Disabled pools will be ignored.
>>>> 2015-11-26 20:22:48,073 DEBUG
>>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found pools
>>>> matching tags: [Pool[8|NetworkFilesystem]]
>>>> 2015-11-26 20:22:48,074 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking if
>>>> storage pool is suitable, name: null ,poolId: 8
>>>> 2015-11-26 20:22:48,075 INFO [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Storage
>>> pool
>>>> null (8) does not supply IOPS capacity, assuming enough capacity
>>>> 2015-11-26 20:22:48,076 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
>>> pool
>>>> 8 for storage, totalSize: 526199291904, usedBytes: 10131603456, usedPct:
>>>> 0.019254308418659775, disable threshold: 0.85
>>>> 2015-11-26 20:22:48,078 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found
>>> storage
>>>> pool primary of type NetworkFilesystem with overprovisioning factor 2
>>>> 2015-11-26 20:22:48,078 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total over
>>>> provisioned capacity calculated is 2 * 526199291904
>>>> 2015-11-26 20:22:48,079 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total
>>>> capacity of the pool primary id: 8 is 1052398583808
>>>> 2015-11-26 20:22:48,079 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
>>>> pool: 8 for volume allocation [Vol[6|vm=5|ROOT]], maxSize :
>>> 1052398583808,
>>>> totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
>>>> disable threshold: 0.85
>>>> 2015-11-26 20:22:48,079 DEBUG
>>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
>>>> ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
>>>> 2015-11-26 20:22:48,079 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
>>>> suitable pools for volume (Id, Type): (7,DATADISK)
>>>> 2015-11-26 20:22:48,079 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) We need to
>>>> allocate new storagepool for this volume
>>>> 2015-11-26 20:22:48,079 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Calling
>>>> StoragePoolAllocators to find suitable pools
>>>> 2015-11-26 20:22:48,079 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
>>>> LocalStoragePoolAllocator trying to find storage pool to fit the vm
>>>> 2015-11-26 20:22:48,079 DEBUG
>>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
>>>> ClusterScopeStoragePoolAllocator looking for storage pool
>>>> 2015-11-26 20:22:48,079 DEBUG
>>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Looking for
>>>> pools in dc: 3 pod:3 cluster:3. Disabled pools will be ignored.
>>>> 2015-11-26 20:22:48,080 DEBUG
>>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found pools
>>>> matching tags: [Pool[8|NetworkFilesystem]]
>>>> 2015-11-26 20:22:48,080 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking if
>>>> storage pool is suitable, name: null ,poolId: 8
>>>> 2015-11-26 20:22:48,081 INFO [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Storage
>>> pool
>>>> null (8) does not supply IOPS capacity, assuming enough capacity
>>>> 2015-11-26 20:22:48,081 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
>>> pool
>>>> 8 for storage, totalSize: 526199291904, usedBytes: 10131603456, usedPct:
>>>> 0.019254308418659775, disable threshold: 0.85
>>>> 2015-11-26 20:22:48,083 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found
>>> storage
>>>> pool primary of type NetworkFilesystem with overprovisioning factor 2
>>>> 2015-11-26 20:22:48,083 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total over
>>>> provisioned capacity calculated is 2 * 526199291904
>>>> 2015-11-26 20:22:48,083 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total
>>>> capacity of the pool primary id: 8 is 1052398583808
>>>> 2015-11-26 20:22:48,083 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
>>>> pool: 8 for volume allocation [Vol[7|vm=5|DATADISK]], maxSize :
>>>> 1052398583808, totalAllocatedSize : 12156207104, askingSize :
>>> 21474836480,
>>>> allocated disable threshold: 0.85
>>>> 2015-11-26 20:22:48,083 DEBUG
>>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
>>>> ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
>>>> 2015-11-26 20:22:48,083 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Trying to
>>>> find a potenial host and associated storage pools from the suitable
>>>> host/pool lists for this VM
>>>> 2015-11-26 20:22:48,083 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking if
>>>> host: 4 can access any suitable storage pool for volume: DATADISK
>>>> 2015-11-26 20:22:48,084 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Host: 4 can
>>>> access pool: 8
>>>> 2015-11-26 20:22:48,084 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
>>> pool
>>>> 8 for storage, totalSize: 526199291904, usedBytes: 10131603456, usedPct:
>>>> 0.019254308418659775, disable threshold: 0.85
>>>> 2015-11-26 20:22:48,086 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found
>>> storage
>>>> pool primary of type NetworkFilesystem with overprovisioning factor 2
>>>> 2015-11-26 20:22:48,086 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total over
>>>> provisioned capacity calculated is 2 * 526199291904
>>>> 2015-11-26 20:22:48,086 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total
>>>> capacity of the pool primary id: 8 is 1052398583808
>>>> 2015-11-26 20:22:48,086 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
>>>> pool: 8 for volume allocation [Vol[7|vm=5|DATADISK]], maxSize :
>>>> 1052398583808, totalAllocatedSize : 12156207104, askingSize :
>>> 21474836480,
>>>> allocated disable threshold: 0.85
>>>> 2015-11-26 20:22:48,086 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking if
>>>> host: 4 can access any suitable storage pool for volume: ROOT
>>>> 2015-11-26 20:22:48,087 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Host: 4 can
>>>> access pool: 8
>>>> 2015-11-26 20:22:48,087 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
>>> pool
>>>> 8 for storage, totalSize: 526199291904, usedBytes: 10131603456, usedPct:
>>>> 0.019254308418659775, disable threshold: 0.85
>>>> 2015-11-26 20:22:48,090 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found
>>> storage
>>>> pool primary of type NetworkFilesystem with overprovisioning factor 2
>>>> 2015-11-26 20:22:48,090 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total over
>>>> provisioned capacity calculated is 2 * 526199291904
>>>> 2015-11-26 20:22:48,090 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total
>>>> capacity of the pool primary id: 8 is 1052398583808
>>>> 2015-11-26 20:22:48,090 DEBUG [c.c.s.StorageManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
>>>> pool: 8 for volume allocation [Vol[6|vm=5|ROOT]], maxSize :
>>> 1052398583808,
>>>> totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
>>>> disable threshold: 0.85
>>>> 2015-11-26 20:22:48,090 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found a
>>>> potential host id: 4 name: xenserver and associated storage pools for
>>> this
>>>> VM
>>>> 2015-11-26 20:22:48,091 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Returning
>>>> Deployment Destination:
>>>>
>>>>
>>> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
>>>> :
>>>>
>>>>
>>> Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage(Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
>>>> Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
>>>> Volume(7|DATADISK-->Pool(8))]
>>>> 2015-11-26 20:22:48,091 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Deployment
>>>> found - P0=VM[User|i-2-5-VM],
>>>>
>>>>
>>> P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
>>>> :
>>>>
>>>>
>>> Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage(Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
>>>> Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
>>>> Volume(7|DATADISK-->Pool(8))]
>>>> 2015-11-26 20:22:48,097 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) VM state
>>>> transitted from :Starting to Starting with event: OperationRetryvm's
>>>> original host id: null new host id: 4 host id before state transition:
>>> null
>>>> 2015-11-26 20:22:48,100 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Hosts's
>>>> actual total CPU: 3399 and CPU after applying overprovisioning: 3399
>>>> 2015-11-26 20:22:48,100 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) We are
>>>> allocating VM, increasing the used capacity of this host:4
>>>> 2015-11-26 20:22:48,100 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Current
>>> Used
>>>> CPU: 1500 , Free CPU:1899 ,Requested CPU: 1000
>>>> 2015-11-26 20:22:48,100 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Current
>>> Used
>>>> RAM: 1879048192 , Free RAM:13475457024 ,Requested RAM: 1073741824
>>>> 2015-11-26 20:22:48,100 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) CPU STATS
>>>> after allocation: for host: 4, old used: 1500, old reserved: 0, actual
>>>> total: 3399, total with overprovisioning: 3399; new used:2500,
>>> reserved:0;
>>>> requested cpu:1000,alloc_from_last:false
>>>> 2015-11-26 20:22:48,100 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) RAM STATS
>>>> after allocation: for host: 4, old used: 1879048192, old reserved: 0,
>>>> total: 15354505216; new used: 2952790016, reserved: 0; requested mem:
>>>> 1073741824,alloc_from_last:false
>>>> 2015-11-26 20:22:48,102 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) VM is being
>>>> created in podId: 3
>>>> 2015-11-26 20:22:48,103 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Network
>>>> id=212 is already implemented
>>>> 2015-11-26 20:22:48,109 DEBUG [c.c.n.NetworkModelImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Service
>>>> SecurityGroup is not supported in the network id=212
>>>> 2015-11-26 20:22:48,111 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Changing
>>>> active number of nics for network id=212 on 1
>>>> 2015-11-26 20:22:48,114 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Asking
>>>> VirtualRouter to prepare for
>>>> Nic[11-5-718d2456-bf61-48ad-9663-22ccfd4556f1-10.1.1.88]
>>>> 2015-11-26 20:22:48,123 DEBUG [c.c.n.NetworkModelImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Service
>>>> SecurityGroup is not supported in the network id=212
>>>> 2015-11-26 20:22:48,125 DEBUG [o.a.c.n.t.BasicNetworkTopology]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) CONFIG DHCP
>>>> FOR SUBNETS RULES
>>>> 2015-11-26 20:22:48,129 DEBUG [c.c.n.NetworkModelImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Service
>>>> SecurityGroup is not supported in the network id=212
>>>> 2015-11-26 20:22:48,130 DEBUG [o.a.c.n.t.AdvancedNetworkTopology]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) APPLYING
>>> VPC
>>>> DHCP ENTRY RULES
>>>> 2015-11-26 20:22:48,130 DEBUG [o.a.c.n.t.BasicNetworkTopology]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Applying
>>> dhcp
>>>> entry in network Ntwk[212|Guest|8]
>>>> 2015-11-26 20:22:48,138 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
>>>> 4-8612571337392652849: Sending { Cmd , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>>
>>>>
>>> [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:71:ff:00:03","vmIpAddress":"10.1.1.88","vmName":"Test002","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:71:ff:00:03","isDefault":true,"executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","router.guest.ip":"10.1.1.1","router.ip":"169.254.0.43","
>>>> router.name":"r-4-VM"},"wait":0}}] }
>>>> 2015-11-26 20:22:48,139 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
>>>> 4-8612571337392652849: Executing: { Cmd , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>>
>>>>
>>> [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:71:ff:00:03","vmIpAddress":"10.1.1.88","vmName":"Test002","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:71:ff:00:03","isDefault":true,"executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","router.guest.ip":"10.1.1.1","router.ip":"169.254.0.43","
>>>> router.name":"r-4-VM"},"wait":0}}] }
>>>> 2015-11-26 20:22:48,139 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-280:ctx-eb580854) Seq 4-8612571337392652849: Executing
>>> request
>>>> 2015-11-26 20:22:48,139 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>>> (DirectAgent-280:ctx-eb580854) Transforming
>>>> com.cloud.agent.api.routing.DhcpEntryCommand to ConfigItems
>>>> 2015-11-26 20:22:48,144 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-280:ctx-eb580854) Copying VR with ip 169.254.0.43 config
>>> file
>>>> into host 10.0.0.171
>>>> 2015-11-26 20:22:48,211 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (RouterStatusMonitor-1:ctx-8884e0d0) Found 1 routers to update status.
>>>> 2015-11-26 20:22:48,213 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (RouterStatusMonitor-1:ctx-8884e0d0) Found 0 VPC networks to update
>>>> Redundant State.
>>>> 2015-11-26 20:22:48,214 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (RouterStatusMonitor-1:ctx-8884e0d0) Found 0 networks to update RvR
>>> status.
>>>> 2015-11-26 20:22:48,222 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (RouterStatusMonitor-1:ctx-7dc158f2) Found 1 routers to update status.
>>>> 2015-11-26 20:22:48,223 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (RouterStatusMonitor-1:ctx-7dc158f2) Found 0 VPC networks to update
>>>> Redundant State.
>>>> 2015-11-26 20:22:48,223 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>>> (RouterStatusMonitor-1:ctx-7dc158f2) Found 0 networks to update RvR
>>> status.
>>>> 2015-11-26 20:22:48,509 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-280:ctx-eb580854) VR Config file vm_dhcp_entry.json got
>>>> created in VR, ip 169.254.0.43 with content
>>>>
>>>>
>>> {"host_name":"Test002","mac_address":"02:00:71:ff:00:03","ipv4_adress":"10.1.1.88","ipv6_duid":"00:03:00:01:02:00:71:ff:00:03","dns_adresses":"10.1.1.1","default_gateway":"10.1.1.1","default_entry":true,"type":"dhcpentry"}
>>>> 2015-11-26 20:22:48,509 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>>> (DirectAgent-280:ctx-eb580854) Processing FileConfigItem, copying 222
>>>> characters to vm_dhcp_entry.json took 370ms
>>>> 2015-11-26 20:22:48,510 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-280:ctx-eb580854) Executing command in VR:
>>>> /opt/cloud/bin/router_proxy.sh update_config.py 169.254.0.43
>>>> vm_dhcp_entry.json
>>>> 2015-11-26 20:22:48,606 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-5:ctx-6424a9fc) ===START=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549633925
>>>> 2015-11-26 20:22:48,618 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-5:ctx-6424a9fc ctx-7c6e9282) ===END=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549633925
>>>> 2015-11-26 20:22:51,265 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>>> (DirectAgent-280:ctx-eb580854) Processing ScriptConfigItem, executing
>>>> update_config.py vm_dhcp_entry.json took 2756ms
>>>> 2015-11-26 20:22:51,265 WARN [c.c.a.r.v.VirtualRoutingResource]
>>>> (DirectAgent-280:ctx-eb580854) Expected 1 answers while executing
>>>> DhcpEntryCommand but received 2
>>>> 2015-11-26 20:22:51,265 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-280:ctx-eb580854) Seq 4-8612571337392652849: Response
>>>> Received:
>>>> 2015-11-26 20:22:51,266 DEBUG [c.c.a.t.Request]
>>>> (DirectAgent-280:ctx-eb580854) Seq 4-8612571337392652849: Processing: {
>>>> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
>>>> [{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null - success:
>>>> ","null - success: RTNETLINK answers: File exists\nRTNETLINK answers:
>>> File
>>>> exists\nRTNETLINK answers: File exists\n[INFO] update_config.py ::
>>>> Processing incoming file => vm_dhcp_entry.json\n[INFO] Processing JSON
>>> file
>>>> vm_dhcp_entry.json\nTest002 Test002\nTest01
>>>> Test002\n"],"result":true,"wait":0}}] }
>>>> 2015-11-26 20:22:51,266 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
>>>> 4-8612571337392652849: Received: { Ans: , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 10, { GroupAnswer } }
>>>> 2015-11-26 20:22:51,268 DEBUG [c.c.n.NetworkModelImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Service
>>>> SecurityGroup is not supported in the network id=212
>>>> 2015-11-26 20:22:51,269 DEBUG [o.a.c.n.t.AdvancedNetworkTopology]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) APPLYING
>>> VPC
>>>> USERDATA RULES
>>>> 2015-11-26 20:22:51,269 DEBUG [o.a.c.n.t.BasicNetworkTopology]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Applying
>>>> userdata and password entry in network Ntwk[212|Guest|8]
>>>> 2015-11-26 20:22:51,278 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
>>>> 4-8612571337392652850: Sending { Cmd , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>>
>>>>
>>> [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
>>>> router.name
>>>>
>>>>
>>> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
>>>> router.name
>>>>
>>> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}}]
>>>> }
>>>> 2015-11-26 20:22:51,279 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
>>>> 4-8612571337392652850: Executing: { Cmd , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>>
>>>>
>>> [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
>>>> router.name
>>>>
>>>>
>>> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
>>>> router.name
>>>>
>>> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}}]
>>>> }
>>>> 2015-11-26 20:22:51,279 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-71:ctx-0080bc2a) Seq 4-8612571337392652850: Executing
>>> request
>>>> 2015-11-26 20:22:51,279 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>>> (DirectAgent-71:ctx-0080bc2a) Transforming
>>>> com.cloud.agent.api.routing.SavePasswordCommand to ConfigItems
>>>> 2015-11-26 20:22:51,282 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-71:ctx-0080bc2a) Copying VR with ip 169.254.0.43 config file
>>>> into host 10.0.0.171
>>>> 2015-11-26 20:22:51,662 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-71:ctx-0080bc2a) VR Config file vm_password.json got created
>>>> in VR, ip 169.254.0.43 with content
>>>>
>>> {"ip_address":"10.1.1.88","password":"saved_password","type":"vmpassword"}
>>>> 2015-11-26 20:22:51,662 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>>> (DirectAgent-71:ctx-0080bc2a) Processing FileConfigItem, copying 74
>>>> characters to vm_password.json took 383ms
>>>> 2015-11-26 20:22:51,662 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-71:ctx-0080bc2a) Executing command in VR:
>>>> /opt/cloud/bin/router_proxy.sh update_config.py 169.254.0.43
>>>> vm_password.json
>>>> 2015-11-26 20:22:51,966 DEBUG [c.c.a.m.AgentManagerImpl]
>>>> (AgentManager-Handler-8:null) SeqA 5-1789: Processing Seq 5-1789: { Cmd
>>> ,
>>>> MgmtId: -1, via: 5, Ver: v1, Flags: 11,
>>>>
>>>>
>>> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
>>>> \"connections\": []\n}","wait":0}}] }
>>>> 2015-11-26 20:22:51,969 DEBUG [c.c.a.m.AgentManagerImpl]
>>>> (AgentManager-Handler-8:null) SeqA 5-1789: Sending Seq 5-1789: { Ans: ,
>>>> MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
>>>> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
>>>> 2015-11-26 20:22:52,954 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-24:ctx-bcef2c6d) ===START=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549638271
>>>> 2015-11-26 20:22:52,968 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-24:ctx-bcef2c6d ctx-2fd0c6b9) ===END=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549638271
>>>> 2015-11-26 20:22:54,399 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>>> (DirectAgent-71:ctx-0080bc2a) Processing ScriptConfigItem, executing
>>>> update_config.py vm_password.json took 2737ms
>>>> 2015-11-26 20:22:54,399 WARN [c.c.a.r.v.VirtualRoutingResource]
>>>> (DirectAgent-71:ctx-0080bc2a) Expected 1 answers while executing
>>>> SavePasswordCommand but received 2
>>>> 2015-11-26 20:22:54,401 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>>> (DirectAgent-71:ctx-0080bc2a) Transforming
>>>> com.cloud.agent.api.routing.VmDataCommand to ConfigItems
>>>> 2015-11-26 20:22:54,404 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-71:ctx-0080bc2a) Copying VR with ip 169.254.0.43 config file
>>>> into host 10.0.0.171
>>>> 2015-11-26 20:22:54,786 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-71:ctx-0080bc2a) VR Config file vm_metadata.json got created
>>>> in VR, ip 169.254.0.43 with content
>>>>
>>>>
>>> {"vm_ip_address":"10.1.1.88","vm_metadata":[["userdata","user-data",null],["metadata","service-offering","Medium
>>>>
>>>>
>>> Instance"],["metadata","availability-zone","TestZone"],["metadata","local-ipv4","10.1.1.88"],["metadata","local-hostname","Test002"],["metadata","public-ipv4","10.0.0.174"],["metadata","public-hostname","10.0.0.174"],["metadata","instance-id","4ce4731f-22a7-42ac-8e78-093d5f2e9a34"],["metadata","vm-id","4ce4731f-22a7-42ac-8e78-093d5f2e9a34"],["metadata","public-keys",null],["metadata","cloud-identifier","CloudStack-{de65e551-2e87-423b-90e6-03cd3eb706bb}"]],"type":"vmdata"}
>>>> 2015-11-26 20:22:54,786 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>>> (DirectAgent-71:ctx-0080bc2a) Processing FileConfigItem, copying 589
>>>> characters to vm_metadata.json took 385ms
>>>> 2015-11-26 20:22:54,786 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-71:ctx-0080bc2a) Executing command in VR:
>>>> /opt/cloud/bin/router_proxy.sh update_config.py 169.254.0.43
>>>> vm_metadata.json
>>>> 2015-11-26 20:22:56,607 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-3:ctx-060754d7) ===START=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549641926
>>>> 2015-11-26 20:22:56,624 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-3:ctx-060754d7 ctx-a1cce698) ===END=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549641926
>>>> 2015-11-26 20:22:57,514 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>>> (DirectAgent-71:ctx-0080bc2a) Processing ScriptConfigItem, executing
>>>> update_config.py vm_metadata.json took 2728ms
>>>> 2015-11-26 20:22:57,514 WARN [c.c.a.r.v.VirtualRoutingResource]
>>>> (DirectAgent-71:ctx-0080bc2a) Expected 1 answers while executing
>>>> VmDataCommand but received 2
>>>> 2015-11-26 20:22:57,515 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-71:ctx-0080bc2a) Seq 4-8612571337392652850: Response
>>> Received:
>>>> 2015-11-26 20:22:57,523 DEBUG [c.c.a.t.Request]
>>>> (DirectAgent-71:ctx-0080bc2a) Seq 4-8612571337392652850: Processing: {
>>>> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
>>>> [{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null - success:
>>>> ","null - success: RTNETLINK answers: File exists\nRTNETLINK answers:
>>> File
>>>> exists\nRTNETLINK answers: File exists\n[INFO] update_config.py ::
>>>> Processing incoming file => vm_password.json\n[INFO] Processing JSON file
>>>>
>>>>
>>> vm_password.json\n"],"result":true,"wait":0}},{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null
>>>> - success: ","null - success: RTNETLINK answers: File exists\nRTNETLINK
>>>> answers: File exists\nRTNETLINK answers: File exists\n[INFO]
>>>> update_config.py :: Processing incoming file => vm_metadata.json\n[INFO]
>>>> Processing JSON file vm_metadata.json\n"],"result":true,"wait":0}}] }
>>>> 2015-11-26 20:22:57,523 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
>>>> 4-8612571337392652850: Received: { Ans: , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 10, { GroupAnswer, GroupAnswer } }
>>>> 2015-11-26 20:22:57,524 DEBUG [c.c.n.NetworkModelImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Service
>>>> SecurityGroup is not supported in the network id=212
>>>> 2015-11-26 20:22:57,525 DEBUG [o.a.c.e.o.VolumeOrchestrator]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking if
>>>> we need to prepare 2 volumes for VM[User|i-2-5-VM]
>>>> 2015-11-26 20:22:57,529 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) template 5
>>> is
>>>> already in store:1, type:Image
>>>> 2015-11-26 20:22:57,530 DEBUG [o.a.c.s.d.PrimaryDataStoreImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Not found
>>>> (templateId:5poolId:8) in template_spool_ref, persisting it
>>>> 2015-11-26 20:22:57,533 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) template 5
>>> is
>>>> already in store:8, type:Primary
>>>> 2015-11-26 20:22:57,533 DEBUG [o.a.c.s.v.VolumeServiceImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found
>>>> template centos56-x86_64-xen in storage pool 8 with VMTemplateStoragePool
>>>> id: 4
>>>> 2015-11-26 20:22:57,534 DEBUG [o.a.c.s.v.VolumeServiceImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Acquire
>>> lock
>>>> on VMTemplateStoragePool 4 with timeout 3600 seconds
>>>> 2015-11-26 20:22:57,535 INFO [o.a.c.s.v.VolumeServiceImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) lock is
>>>> acquired for VMTemplateStoragePool 4
>>>> 2015-11-26 20:22:57,537 DEBUG [o.a.c.s.m.AncientDataMotionStrategy]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) copyAsync
>>>> inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE
>>>> 2015-11-26 20:22:57,541 DEBUG [c.c.h.XenServerGuru]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
>>>> getCommandHostDelegation: class
>>>> org.apache.cloudstack.storage.command.CopyCommand
>>>> 2015-11-26 20:22:57,542 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
>>>> 4-8612571337392652851: Sending { Cmd , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 100111,
>>>>
>>>>
>>> [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/5/3986df71-b1d0-3e20-a655-7e42dd144370.vhd","origUrl":"
>>>> http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
>>>>
>>> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
>>>> 5.6(64-bit) no GUI
>>>>
>>>>
>>> (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://
>>>> 10.0.0.170/export/secondary
>>>>
>>>>
>>> ","_role":"Image"}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"
>>>> http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
>>>>
>>> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
>>>> 5.6(64-bit) no GUI
>>>>
>>>>
>>> (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
>>>>
>>>>
>>> 10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc
>>>>
>>> "}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"executeInSequence":true,"options":{},"options2":{},"wait":10800}}]
>>>> }
>>>> 2015-11-26 20:22:57,542 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
>>>> 4-8612571337392652851: Executing: { Cmd , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 100111,
>>>>
>>>>
>>> [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/5/3986df71-b1d0-3e20-a655-7e42dd144370.vhd","origUrl":"
>>>> http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
>>>>
>>> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
>>>> 5.6(64-bit) no GUI
>>>>
>>>>
>>> (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://
>>>> 10.0.0.170/export/secondary
>>>>
>>>>
>>> ","_role":"Image"}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"
>>>> http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
>>>>
>>> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
>>>> 5.6(64-bit) no GUI
>>>>
>>>>
>>> (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
>>>>
>>>>
>>> 10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc
>>>>
>>> "}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"executeInSequence":true,"options":{},"options2":{},"wait":10800}}]
>>>> }
>>>> 2015-11-26 20:22:57,542 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-281:ctx-03a8f398) Seq 4-8612571337392652851: Executing
>>> request
>>>> 2015-11-26 20:22:58,021 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (AsyncJobMgr-Heartbeat-1:ctx-92cf866f) Begin cleanup expired async-jobs
>>>> 2015-11-26 20:22:58,023 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (AsyncJobMgr-Heartbeat-1:ctx-92cf866f) End cleanup expired async-jobs
>>>> 2015-11-26 20:22:58,833 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-281:ctx-03a8f398) Host 10.0.0.171
>>>> OpaqueRef:b0284c5b-613d-0522-5c44-797be269d661: Removing SR
>>>> 2015-11-26 20:22:58,843 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-281:ctx-03a8f398) Host 10.0.0.171
>>>> OpaqueRef:bfb2ccc2-135c-4f9a-bc84-143021c71bae: Unplugging pbd
>>>> 2015-11-26 20:22:58,950 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>>> (DirectAgent-281:ctx-03a8f398) Host 10.0.0.171
>>>> OpaqueRef:b0284c5b-613d-0522-5c44-797be269d661: Forgetting
>>>> 2015-11-26 20:22:58,953 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-281:ctx-03a8f398) Seq 4-8612571337392652851: Response
>>>> Received:
>>>> 2015-11-26 20:22:58,953 DEBUG [c.c.a.t.Request]
>>>> (DirectAgent-281:ctx-03a8f398) Seq 4-8612571337392652851: Processing: {
>>>> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 110,
>>>>
>>>>
>>> [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Expected
>>>> 1 VDI template but found 2 VDI template(s) on:
>>>> 10.0.0.170:/export/secondary/template/tmpl/1/5","wait":0}}]
>>>> }
>>>> 2015-11-26 20:22:58,953 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
>>>> 4-8612571337392652851: Received: { Ans: , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 110, { CopyCmdAnswer } }
>>>> 2015-11-26 20:22:58,955 DEBUG [c.c.a.m.AgentAttache]
>>>> (DirectAgent-281:ctx-03a8f398) Seq 4-8612571337392652851: No more
>>> commands
>>>> found
>>>> 2015-11-26 20:22:58,959 INFO [o.a.c.s.v.VolumeServiceImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) releasing
>>>> lock for VMTemplateStoragePool 4
>>>> 2015-11-26 20:22:58,959 DEBUG [o.a.c.e.o.VolumeOrchestrator]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Unable to
>>>> create Vol[6|vm=5|ROOT]:Expected 1 VDI template but found 2 VDI
>>> template(s)
>>>> on: 10.0.0.170:/export/secondary/template/tmpl/1/5
>>>> 2015-11-26 20:22:58,959 INFO [c.c.v.VirtualMachineManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Unable to
>>>> contact resource.
>>>> com.cloud.exception.StorageUnavailableException: Resource [StoragePool:8]
>>>> is unreachable: Unable to create Vol[6|vm=5|ROOT]:Expected 1 VDI template
>>>> but found 2 VDI template(s) on: 10.0.0.170:
>>>> /export/secondary/template/tmpl/1/5
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1278)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1336)
>>>> at
>>>>
>>>>
>>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1000)
>>>> at
>>>>
>>>>
>>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4580)
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>> at
>>>>
>>>>
>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>>> at
>>>>
>>>>
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>>> at java.lang.reflect.Method.invoke(Method.java:606)
>>>> at
>>>>
>>>>
>>> com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
>>>> at
>>>>
>>>>
>>> com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4736)
>>>> at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
>>>> at
>>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>>> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>>>> at
>>>>
>>>>
>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>>> at
>>>>
>>>>
>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>>> at java.lang.Thread.run(Thread.java:745)
>>>> 2015-11-26 20:22:58,962 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Cleaning up
>>>> resources for the vm VM[User|i-2-5-VM] in Starting state
>>>> 2015-11-26 20:22:58,964 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
>>>> 4-8612571337392652852: Sending { Cmd , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>>
>>>>
>>> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"checkBeforeCleanup":false,"vmName":"i-2-5-VM","wait":0}}]
>>>> }
>>>> 2015-11-26 20:22:58,964 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
>>>> 4-8612571337392652852: Executing: { Cmd , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>>
>>>>
>>> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"checkBeforeCleanup":false,"vmName":"i-2-5-VM","wait":0}}]
>>>> }
>>>> 2015-11-26 20:22:58,964 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-141:ctx-62326db5) Seq 4-8612571337392652852: Executing
>>> request
>>>> 2015-11-26 20:22:58,971 DEBUG [c.c.a.m.DirectAgentAttache]
>>>> (DirectAgent-141:ctx-62326db5) Seq 4-8612571337392652852: Response
>>>> Received:
>>>> 2015-11-26 20:22:58,971 DEBUG [c.c.a.t.Request]
>>>> (DirectAgent-141:ctx-62326db5) Seq 4-8612571337392652852: Processing: {
>>>> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
>>>> [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not
>>>> exist","wait":0}}] }
>>>> 2015-11-26 20:22:58,971 DEBUG [c.c.a.t.Request]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
>>>> 4-8612571337392652852: Received: { Ans: , MgmtId: 52229922654, via:
>>>> 4(xenserver), Ver: v1, Flags: 10, { StopAnswer } }
>>>> 2015-11-26 20:22:58,976 DEBUG [c.c.n.NetworkModelImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Service
>>>> SecurityGroup is not supported in the network id=212
>>>> 2015-11-26 20:22:58,977 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Changing
>>>> active number of nics for network id=212 on -1
>>>> 2015-11-26 20:22:58,982 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Asking
>>>> VirtualRouter to release
>>>> NicProfile[11-5-718d2456-bf61-48ad-9663-22ccfd4556f1-10.1.1.88-null
>>>> 2015-11-26 20:22:58,982 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
>>> Successfully
>>>> released network resources for the vm VM[User|i-2-5-VM]
>>>> 2015-11-26 20:22:58,982 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
>>> Successfully
>>>> cleanued up resources for the vm VM[User|i-2-5-VM] in Starting state
>>>> 2015-11-26 20:22:58,986 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Deploy
>>> avoids
>>>> pods: [], clusters: [], hosts: [4]
>>>> 2015-11-26 20:22:58,987 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
>>>> DeploymentPlanner allocation algorithm:
>>>> com.cloud.deploy.FirstFitPlanner@1136745
>>>> 2015-11-26 20:22:58,987 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Trying to
>>>> allocate a host and storage pools from dc:3, pod:3,cluster:null,
>>> requested
>>>> cpu: 1000, requested ram: 1073741824
>>>> 2015-11-26 20:22:58,987 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Is ROOT
>>>> volume READY (pool already allocated)?: No
>>>> 2015-11-26 20:22:58,987 DEBUG [c.c.d.FirstFitPlanner]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Searching
>>>> resources only under specified Pod: 3
>>>> 2015-11-26 20:22:58,987 DEBUG [c.c.d.FirstFitPlanner]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Listing
>>>> clusters in order of aggregate capacity, that have (atleast one host
>>> with)
>>>> enough CPU and RAM capacity under this Pod: 3
>>>> 2015-11-26 20:22:58,988 DEBUG [c.c.d.FirstFitPlanner]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) No clusters
>>>> found having a host with enough capacity, returning.
>>>> 2015-11-26 20:22:58,995 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) VM state
>>>> transitted from :Starting to Stopped with event: OperationFailedvm's
>>>> original host id: null new host id: null host id before state
>>> transition: 4
>>>> 2015-11-26 20:22:58,998 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Hosts's
>>>> actual total CPU: 3399 and CPU after applying overprovisioning: 3399
>>>> 2015-11-26 20:22:58,998 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Hosts's
>>>> actual total RAM: 15354505344 and RAM after applying overprovisioning:
>>>> 15354505216
>>>> 2015-11-26 20:22:58,998 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) release cpu
>>>> from host: 4, old used: 2500,reserved: 0, actual total: 3399, total with
>>>> overprovisioning: 3399; new used: 1500,reserved:0; movedfromreserved:
>>>> false,moveToReserveredfalse
>>>> 2015-11-26 20:22:58,998 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) release mem
>>>> from host: 4, old used: 2952790016,reserved: 0, total: 15354505216; new
>>>> used: 1879048192,reserved:0; movedfromreserved:
>>> false,moveToReserveredfalse
>>>> 2015-11-26 20:22:59,004 ERROR [c.c.v.VmWorkJobHandlerProxy]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Invocation
>>>> exception, caused by:
>>>> com.cloud.exception.InsufficientServerCapacityException: Unable to
>>> create a
>>>> deployment for VM[User|i-2-5-VM]Scope=interface com.cloud.dc.DataCenter;
>>>> id=3
>>>> 2015-11-26 20:22:59,004 INFO [c.c.v.VmWorkJobHandlerProxy]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Rethrow
>>>> exception com.cloud.exception.InsufficientServerCapacityException: Unable
>>>> to create a deployment for VM[User|i-2-5-VM]Scope=interface
>>>> com.cloud.dc.DataCenter; id=3
>>>> 2015-11-26 20:22:59,004 DEBUG [c.c.v.VmWorkJobDispatcher]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Done with run of VM work
>>>> job: com.cloud.vm.VmWorkStart for VM 5, job origin: 68
>>>> 2015-11-26 20:22:59,004 ERROR [c.c.v.VmWorkJobDispatcher]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Unable to complete
>>>> AsyncJobVO {id:71, userId: 2, accountId: 2, instanceType: null,
>>> instanceId:
>>>> null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
>>>>
>>>>
>>> rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAABXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwc3IAEWphdmEudXRpbC5IYXNoTWFwBQfawcMWYNEDAAJGAApsb2FkRmFjdG9ySQAJdGhyZXNob2xkeHA_QAAAAAAADHcIAAAAEAAAAAF0AApWbVBhc3N3b3JkdAAcck8wQUJYUUFEbk5oZG1Wa1gzQmhjM04zYjNKa3hw,
>>>> cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
>>>> result: null, initMsid: 52229922654, completeMsid: null, lastUpdated:
>>> null,
>>>> lastPolled: null, created: Thu Nov 26 20:22:46 IST 2015}, job origin:68
>>>> com.cloud.exception.InsufficientServerCapacityException: Unable to
>>> create a
>>>> deployment for VM[User|i-2-5-VM]Scope=interface com.cloud.dc.DataCenter;
>>>> id=3
>>>> at
>>>>
>>>>
>>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:959)
>>>> at
>>>>
>>>>
>>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4580)
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>> at
>>>>
>>>>
>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>>> at
>>>>
>>>>
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>>> at java.lang.reflect.Method.invoke(Method.java:606)
>>>> at
>>>>
>>>>
>>> com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
>>>> at
>>>>
>>>>
>>> com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4736)
>>>> at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
>>>> at
>>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>>> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>>>> at
>>>>
>>>>
>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>>> at
>>>>
>>>>
>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>>> at java.lang.Thread.run(Thread.java:745)
>>>> 2015-11-26 20:22:59,013 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Complete async job-71,
>>>> jobStatus: FAILED, resultCode: 0, result:
>>>>
>>>>
>>> rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAAzVW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1VzZXJ8aS0yLTUtVk1ddXIAHltMamF2YS5sYW5nLlN0YWNrVHJhY2VFbGVtZW50OwJGKjw8_SI5AgAAeHAAAAAVc3IAG2phdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudGEJxZomNt2FAgAESQAKbGluZU51bWJlckwADmRlY2xhcmluZ0NsYXNzcQB-AApMAAhmaWxlTmFtZXEAfgAKTAAKbWV0aG9kTmFtZXEAfgAKeHAAAAO_dAAmY29tLmNsb3VkLnZtLlZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGx0AB5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsLmphdmF0ABBvcmNoZXN0cmF0ZVN0YXJ0c3EAfgARAAAR5HEAfgATcQB-ABRxAH4AFXNxAH4AEf____50ACRzdW4ucmVmbGVjdC5OYXRpdmVNZXRob2RBY2Nlc3NvckltcGx0AB1OYXRpdmVNZXRob2RBY2Nlc3NvckltcGwuamF2YXQAB2ludm9rZTBzcQB-ABEAAAA5cQB-ABhxAH4AGXQABmludm9rZXNxAH4AEQAAACt0AChzdW4ucmVmbGVjdC5EZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsdAAhRGVsZWdhdGluZ01ldGhvZEFjY2Vzc29ySW1wbC5qYXZhcQB-ABxzcQB-ABEAAAJedAAYamF2YS5sYW5nLnJlZmxlY3QuTWV0aG9kdAALTWV0aG9kLmphdmFxAH4AHHNxAH4AEQAAAGt0ACJjb20uY2xvdWQudm0uVm1Xb3JrSm9iSGFuZGxlclByb3h5dAAaVm1Xb3JrSm9iSGFuZGxlclByb3h5LmphdmF0AA9oYW5kbGVWbVdvcmtKb2JzcQB-ABEAABKAcQB-ABNxAH4AFHEAfgAmc3EAfgARAAAAZnQAIGNvbS5jbG91ZC52bS5WbVdvcmtKb2JEaXNwYXRjaGVydAAYVm1Xb3JrSm9iRGlzcGF0Y2hlci5qYXZhdAAGcnVuSm9ic3EAfgARAAACGXQAP29yZy5hcGFjaGUuY2xvdWRzdGFjay5mcmFtZXdvcmsuam9icy5pbXBsLkFzeW5jSm9iTWFuYWdlckltcGwkNXQAGEFzeW5jSm9iTWFuYWdlckltcGwuamF2YXQADHJ1bkluQ29udGV4dHNxAH4AEQAAADF0AD5vcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGUkMXQAG01hbmFnZWRDb250ZXh0UnVubmFibGUuamF2YXQAA3J1bnNxAH4AEQAAADh0AEJvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0JDF0ABpEZWZhdWx0TWFuYWdlZENvbnRleHQuamF2YXQABGNhbGxzcQB-ABEAAABndABAb3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5pbXBsLkRlZmF1bHRNYW5hZ2VkQ29udGV4dHEAfgA2dAAPY2FsbFdpdGhDb250ZXh0c3EAfgARAAAANXEAfgA5cQB-ADZ0AA5ydW5XaXRoQ29udGV4dHNxAH4AEQAAAC50ADxvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGVxAH4AMnEAfgAzc3EAfgARAAAB7nEAfgAtcQB-AC5xAH4AM3NxAH4AEQAAAdd0AC5qYXZhLnV0aWwuY29uY3VycmVudC5FeGVjdXRvcnMkUnVubmFibGVBZGFwdGVydAAORXhlY3V0b3JzLmphdmFxAH4AN3NxAH4AEQAAAQZ0AB9qYXZhLnV0aWwuY29uY3VycmVudC5GdXR1cmVUYXNrdAAPRnV0dXJlVGFzay5qYXZhcQB-ADNzcQB-ABEAAAR5dAAnamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9ydAAXVGhyZWFkUG9vbEV4ZWN1dG9yLmphdmF0AAlydW5Xb3JrZXJzcQB-ABEAAAJndAAuamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9yJFdvcmtlcnEAfgBIcQB-ADNzcQB-ABEAAALpdAAQamF2YS5sYW5nLlRocmVhZHQAC1RocmVhZC5qYXZhcQB-ADNzcgAmamF2YS51dGlsLkNvbGxlY3Rpb25zJFVubW9kaWZpYWJsZUxpc3T8DyUxteyOEAIAAUwABGxpc3RxAH4ADHhyACxqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlQ29sbGVjdGlvbhlCAIDLXvceAgABTAABY3QAFkxqYXZhL3V0aWwvQ29sbGVjdGlvbjt4cHNyABNqYXZhLnV0aWwuQXJyYXlMaXN0eIHSHZnHYZ0DAAFJAARzaXpleHAAAAAAdwQAAAAAeHEAfgBUeHNyABFqYXZhLmxhbmcuSW50ZWdlchLioKT3gYc4AgABSQAFdmFsdWV4cgAQamF2YS5sYW5nLk51bWJlcoaslR0LlOCLAgAAeHAAABDvc3EAfgBTAAAAAHcEAAAAAHhzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHEAfgBWAAAAAAAAAAN2cgAXY29tLmNsb3VkLmRjLkRhdGFDZW50ZXKy8Qrrp-d4vgIAAHhwAA
>>>> 2015-11-26 20:22:59,015 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Publish async job-71
>>>> complete on message bus
>>>> 2015-11-26 20:22:59,015 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Wake up jobs related to
>>>> job-71
>>>> 2015-11-26 20:22:59,016 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Update db status for
>>>> job-71
>>>> 2015-11-26 20:22:59,016 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Wake up jobs joined with
>>>> job-71 and disjoin all subjobs created from job- 71
>>>> 2015-11-26 20:22:59,022 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Done executing
>>>> com.cloud.vm.VmWorkStart for job-71
>>>> 2015-11-26 20:22:59,022 INFO [o.a.c.f.j.i.AsyncJobMonitor]
>>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Remove job-71 from job
>>>> monitoring
>>>> 2015-11-26 20:22:59,032 DEBUG [c.c.v.UserVmManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Destroying vm
>>>> VM[User|i-2-5-VM] as it failed to create on Host with Id:null
>>>> 2015-11-26 20:22:59,040 DEBUG [c.c.c.CapacityManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) VM state transitted
>>>> from :Stopped to Error with event: OperationFailedToErrorvm's original
>>> host
>>>> id: null new host id: null host id before state transition: null
>>>> 2015-11-26 20:22:59,051 DEBUG [c.c.u.AccountManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Access granted to
>>>> Acct[20064ffe-9415-11e5-a790-000c29255f5e-admin] to Domain:1/ by
>>>> AffinityGroupAccessChecker
>>>> 2015-11-26 20:22:59,076 DEBUG [c.c.u.AccountManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Access granted to
>>>> Acct[20064ffe-9415-11e5-a790-000c29255f5e-admin] to Domain:1/ by
>>>> AffinityGroupAccessChecker
>>>> 2015-11-26 20:22:59,080 WARN [o.a.c.alerts]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) alertType:: 8 //
>>>> dataCenterId:: 3 // podId:: 3 // clusterId:: null // message:: Failed to
>>>> deploy Vm with Id: 5, on Host with Id: null
>>>> 2015-11-26 20:22:59,095 ERROR [c.c.a.ApiAsyncJobDispatcher]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68) Unexpected exception while
>>>> executing org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin
>>>> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due
>>>> to insufficient capacity
>>>> at
>>>>
>>>>
>>> com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:622)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:242)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:212)
>>>> at
>>>>
>>>>
>>> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3870)
>>>> at
>>>>
>>>>
>>> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3488)
>>>> at
>>>>
>>>>
>>> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3476)
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>> at
>>>>
>>>>
>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>>> at
>>>>
>>>>
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>>> at java.lang.reflect.Method.invoke(Method.java:606)
>>>> at
>>>>
>>>>
>>> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
>>>> at
>>>>
>>>>
>>> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
>>>> at
>>>>
>>>>
>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:106)
>>>> at
>>>>
>>>>
>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
>>>> at
>>>>
>>>>
>>> com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
>>>> at
>>>>
>>>>
>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
>>>> at
>>>>
>>>>
>>> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
>>>> at
>>>>
>>>>
>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
>>>> at
>>>>
>>>>
>>> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
>>>> at com.sun.proxy.$Proxy202.startVirtualMachine(Unknown Source)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin.execute(DeployVMCmdByAdmin.java:50)
>>>> at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
>>>> at
>>>>
>>> com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>>>> at
>>>>
>>>>
>>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
>>>> at
>>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>>> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>>>> at
>>>>
>>>>
>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>>> at
>>>>
>>>>
>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>>> at java.lang.Thread.run(Thread.java:745)
>>>> Caused by: com.cloud.exception.InsufficientServerCapacityException:
>>> Unable
>>>> to create a deployment for VM[User|i-2-5-VM]Scope=interface
>>>> com.cloud.dc.DataCenter; id=3
>>>> at
>>>>
>>>>
>>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:959)
>>>> at
>>>>
>>>>
>>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4580)
>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>> ... 18 more
>>>> 2015-11-26 20:22:59,097 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68) Complete async job-68,
>>> jobStatus:
>>>> FAILED, resultCode: 530, result:
>>>>
>>>>
>>> org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable
>>>> to start a VM due to insufficient capacity"}
>>>> 2015-11-26 20:22:59,097 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68) Publish async job-68 complete on
>>>> message bus
>>>> 2015-11-26 20:22:59,097 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68) Wake up jobs related to job-68
>>>> 2015-11-26 20:22:59,097 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68) Update db status for job-68
>>>> 2015-11-26 20:22:59,098 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68) Wake up jobs joined with job-68
>>>> and disjoin all subjobs created from job- 68
>>>> 2015-11-26 20:22:59,100 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68) Done executing
>>>> org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin for job-68
>>>> 2015-11-26 20:22:59,100 INFO [o.a.c.f.j.i.AsyncJobMonitor]
>>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68) Remove job-68 from job
>>> monitoring
>>>> 2015-11-26 20:22:59,608 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-8:ctx-dd95e514) ===START=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549644927
>>>> 2015-11-26 20:22:59,619 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-8:ctx-dd95e514 ctx-3583ca96) ===END=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549644927
>>>> 2015-11-26 20:22:59,623 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-9:ctx-c94acc67) ===START=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=listVirtualMachines&id=4ce4731f-22a7-42ac-8e78-093d5f2e9a34&response=json&_=1448549644944
>>>> 2015-11-26 20:22:59,639 DEBUG [c.c.a.ApiServlet]
>>>> (catalina-exec-9:ctx-c94acc67 ctx-b3ea1be2) ===END=== 10.0.0.93 -- GET
>>>>
>>>>
>>> command=listVirtualMachines&id=4ce4731f-22a7-42ac-8e78-093d5f2e9a34&response=json&_=1448549644944
>>>> 2015-11-26 20:23:01,968 DEBUG [c.c.a.m.AgentManagerImpl]
>>>> (AgentManager-Handler-10:null) SeqA 5-1790: Processing Seq 5-1790: {
>>> Cmd ,
>>>> MgmtId: -1, via: 5, Ver: v1, Flags: 11,
>>>>
>>>>
>>> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
>>>> \"connections\": []\n}","wait":0}}] }
>>>> 2015-11-26 20:23:01,972 DEBUG [c.c.a.m.AgentManagerImpl]
>>>> (AgentManager-Handler-10:null) SeqA 5-1790: Sending Seq 5-1790: { Ans: ,
>>>> MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
>>>> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
>>>> 2015-11-26 20:23:04,354 DEBUG [o.a.c.s.SecondaryStorageManagerImpl]
>>>> (secstorage-1:ctx-e4c5abdc) Zone 3 is ready to launch secondary storage
>>> VM
>>>> 2015-11-26 20:23:04,680 DEBUG [c.c.c.ConsoleProxyManagerImpl]
>>>> (consoleproxy-1:ctx-f87cf64e) Zone 3 is ready to launch console proxy
>>>> 2015-11-26 20:23:08,020 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (AsyncJobMgr-Heartbeat-1:ctx-39ec59bb) Begin cleanup expired async-jobs
>>>> 2015-11-26 20:23:08,023 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> (AsyncJobMgr-Heartbeat-1:ctx-39ec59bb) End cleanup expired async-jobs
>>>>
>>>> Regards,
>>>> Venkatesh.k
>>>>
>>>>
>>>> On Thu, Nov 26, 2015 at 9:04 PM, kotipalli venkatesh <
>>>> venkateshcloudtest@gmail.com> wrote:
>>>>
>>>>> Hi Erik,
>>>>>
>>>>> We found the error log, Please look in to this below error log,
>>>>>
>>>>> 2015-11-26 20:22:46,603 DEBUG [c.c.a.m.AgentAttache]
>>>>> (DirectAgent-279:ctx-532427fb) Seq 4-8612571337392652847: No more
>>>> commands
>>>>> found
>>>>> 2015-11-26 20:22:46,607 INFO [o.a.c.s.v.VolumeServiceImpl]
>>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) releasing
>>>>> lock for VMTemplateStoragePool 3
>>>>> 2015-11-26 20:22:46,608 DEBUG [o.a.c.e.o.VolumeOrchestrator]
>>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Unable to
>>>>> create Vol[6|vm=5|ROOT]:Expected 1 VDI template but found 2 VDI
>>>> template(s)
>>>>> on: 10.0.0.170:/export/secondary/template/tmpl/1/5
>>>>> 2015-11-26 20:22:46,608 INFO [c.c.v.VirtualMachineManagerImpl]
>>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Unable to
>>>>> contact resource.
>>>>> com.cloud.exception.StorageUnavailableException: Resource
>>> [StoragePool:8]
>>>>> is unreachable: Unable to create Vol[6|vm=5|ROOT]:Expected 1 VDI
>>> template
>>>>> but found 2 VDI template(s) on: 10.0.0.170:
>>>>> /export/secondary/template/tmpl/1/5
>>>>>
>>>>>
>>>>> /export/secondary/template/tmpl/1/5 Inside the 2 .vhd files and one
>>>>> template properties file is there please look in to the below files;
>>>>>
>>>>> 3986df71-b1d0-3e20-a655-7e42dd144370.vhd
>>>>> 429d6340-6a5f-31ce-a581-cc05618500ab.vhd template.properties
>>>>>
>>>>> Which one is remove?
>>>>>
>>>>> Could you please suggest.
>>>>>
>>>>> Regards,
>>>>> Venkatesh.k
>>>>>
>>>>> On Thu, Nov 26, 2015 at 6:11 PM, Erik Weber <te...@gmail.com>
>>> wrote:
>>>>>
>>>>>> You need to paste more of your logs, in particular the (a lot of)
>>> lines
>>>>>> before the exception where all the resource allocations happen.
>>>>>>
>>>>>> --
>>>>>> Erik
>>>>>>
>>>>>> On Thu, Nov 26, 2015 at 1:38 PM, kotipalli venkatesh <
>>>>>> venkateshcloudtest@gmail.com> wrote:
>>>>>>
>>>>>>> Hi All,
>>>>>>>
>>>>>>> I have successfully installed Cloudstack 4.6.0 setup
>>>>>>> hypervisor is xenserver 6.5
>>>>>>>
>>>>>>> Successfully up and running SSVM and CPVM and Default templates
>>>>>> downloaded.
>>>>>>>
>>>>>>> When i am spin the new instance it 's troughs *insufficient memory
>>>>>> error*.
>>>>>>> But i have *sufficient place* *RAM* and *STORAGE* also.
>>>>>>>
>>>>>>> Please look in to this Management server log:
>>>>>>>
>>>>>>> 2015-11-26 17:49:10,572 WARN [o.a.c.alerts]
>>>>>>> (API-Job-Executor-1:ctx-801f0a96 job-56 ctx-63dfadf9) alertType:: 8
>>>> //
>>>>>>> dataCenterId:: 3 // podId:: 3 // clusterId:: null // message::
>>> Failed
>>>> to
>>>>>>> deploy Vm with Id: 3, on Host with Id: null
>>>>>>> 2015-11-26 17:49:10,601 ERROR [c.c.a.ApiAsyncJobDispatcher]
>>>>>>> (API-Job-Executor-1:ctx-801f0a96 job-56) Unexpected exception while
>>>>>>> executing
>>>> org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin
>>>>>>> com.cloud.utils.exception.CloudRuntimeException: Unable to start a
>>> VM
>>>>>> due
>>>>>>> to insufficient capacity
>>>>>>> at
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>> com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:622)
>>>>>>> at
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>> org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:242)
>>>>>>> at
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>> org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:212)
>>>>>>> at
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3870)
>>>>>>> at
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3488)
>>>>>>> at
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3476)
>>>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
>>> Method)
>>>>>>> at
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>>>>>> at
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>>>>>> at java.lang.reflect.Method.invoke(Method.java:606)
>>>>>>> at
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
>>>>>>> at
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
>>>>>>> at
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
>>>>>>> at
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>> org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:106)
>>>>>>> at
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
>>>>>>> at
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>> com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
>>>>>>> at
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
>>>>>>> at
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
>>>>>>> at
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
>>>>>>> at
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
>>>>>>> at com.sun.proxy.$Proxy202.startVirtualMachine(Unknown
>>> Source)
>>>>>>> at
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>> org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin.execute(DeployVMCmdByAdmin.java:50)
>>>>>>> at
>>>> com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
>>>>>>> at
>>>>>>>
>>>>>>
>>>>
>>> com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
>>>>>>> at
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
>>>>>>> at
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>>>>>>> at
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>>>>>>> at
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>>>>>>> at
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>>>>>>> at
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>>>>>>> at
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
>>>>>>> at
>>>>>>>
>>>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>>>>>> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>>>>>>> at
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>>>>>> at
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>>>>>> at java.lang.Thread.run(Thread.java:745)
>>>>>>> Caused by: com.cloud.exception.InsufficientServerCapacityException:
>>>>>> Unable
>>>>>>> to create a deployment for VM[User|i-2-3-VM]Scope=interface
>>>>>>> com.cloud.dc.DataCenter; id=3
>>>>>>> at
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:959)
>>>>>>>
>>>>>>> Please any suggestion....
>>>>>>>
>>>>>>> Warm Regards,
>>>>>>> Venkatesh.k
>>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>
>>>
>>>
>>> --
>>> Rafael Weingärtner
>>>
>
Re: Insufficient Memory error
Posted by Anshul Gangwar <an...@citrix.com>.
Can you check your second storage?
From below exception it seems there are 2 VDI template at location /export/secondary/template/tmpl/1/5. Remove/move the unneeded one.
>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Unable to
>> contact resource.
>> com.cloud.exception.StorageUnavailableException: Resource [StoragePool:8]
>> is unreachable: Unable to create Vol[6|vm=5|ROOT]:Expected 1 VDI template
>> but found 2 VDI template(s) on: 10.0.0.170:
>> /export/secondary/template/tmpl/1/5
> On 27-Nov-2015, at 9:38 AM, kotipalli venkatesh <ve...@gmail.com> wrote:
>
> Hi Weingärtner,
>
> Yes, storage server is available on host and Sufficient place in RAM also.
>
> Could you please help me guys..
> Regards,
> Venkatesh.k
>
> On Fri, Nov 27, 2015 at 4:01 AM, Rafael Weingärtner <
> rafaelweingartner@gmail.com> wrote:
>
>> is the storage server available on your hosts ?
>> I notice that on your log files:
>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Unable to
>> contact resource.
>> com.cloud.exception.StorageUnavailableException: Resource [StoragePool:8]
>> is unreachable: Unable to create Vol[6|vm=5|ROOT]:Expected 1 VDI template
>> but found 2 VDI template(s) on: 10.0.0.170:
>> /export/secondary/template/tmpl/1/5
>> at
>>
>> On Thu, Nov 26, 2015 at 1:49 PM, kotipalli venkatesh <
>> venkateshcloudtest@gmail.com> wrote:
>>
>>> Hi Erik,
>>>
>>> Please look in to this full log:
>>>
>>>
>>> 2015-11-26 20:21:46,959 DEBUG [c.c.a.m.AgentManagerImpl]
>>> (AgentManager-Handler-15:null) SeqA 5-1781: Processing Seq 5-1781: {
>> Cmd ,
>>> MgmtId: -1, via: 5, Ver: v1, Flags: 11,
>>>
>>>
>> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
>>> \"connections\": []\n}","wait":0}}] }
>>> 2015-11-26 20:21:46,962 DEBUG [c.c.a.m.AgentManagerImpl]
>>> (AgentManager-Handler-15:null) SeqA 5-1781: Sending Seq 5-1781: { Ans: ,
>>> MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
>>> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
>>> 2015-11-26 20:21:48,018 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (AsyncJobMgr-Heartbeat-1:ctx-0bf05867) Begin cleanup expired async-jobs
>>> 2015-11-26 20:21:48,020 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (AsyncJobMgr-Heartbeat-1:ctx-0bf05867) End cleanup expired async-jobs
>>> 2015-11-26 20:21:48,210 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (RouterStatusMonitor-1:ctx-0e1a35ca) Found 1 routers to update status.
>>> 2015-11-26 20:21:48,210 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (RouterStatusMonitor-1:ctx-0e1a35ca) Found 0 VPC networks to update
>>> Redundant State.
>>> 2015-11-26 20:21:48,211 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (RouterStatusMonitor-1:ctx-0e1a35ca) Found 0 networks to update RvR
>> status.
>>> 2015-11-26 20:21:48,222 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (RouterStatusMonitor-1:ctx-71753b97) Found 1 routers to update status.
>>> 2015-11-26 20:21:48,222 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (RouterStatusMonitor-1:ctx-71753b97) Found 0 VPC networks to update
>>> Redundant State.
>>> 2015-11-26 20:21:48,223 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (RouterStatusMonitor-1:ctx-71753b97) Found 0 networks to update RvR
>> status.
>>> 2015-11-26 20:21:53,165 DEBUG [c.c.h.d.HostDaoImpl]
>> (ClusteredAgentManager
>>> Timer:ctx-3ab0cd7f) Resetting hosts suitable for reconnect
>>> 2015-11-26 20:21:53,166 DEBUG [c.c.h.d.HostDaoImpl]
>> (ClusteredAgentManager
>>> Timer:ctx-3ab0cd7f) Completed resetting hosts suitable for reconnect
>>> 2015-11-26 20:21:53,166 DEBUG [c.c.h.d.HostDaoImpl]
>> (ClusteredAgentManager
>>> Timer:ctx-3ab0cd7f) Acquiring hosts for clusters already owned by this
>>> management server
>>> 2015-11-26 20:21:53,168 DEBUG [c.c.h.d.HostDaoImpl]
>> (ClusteredAgentManager
>>> Timer:ctx-3ab0cd7f) Completed acquiring hosts for clusters already owned
>> by
>>> this management server
>>> 2015-11-26 20:21:53,168 DEBUG [c.c.h.d.HostDaoImpl]
>> (ClusteredAgentManager
>>> Timer:ctx-3ab0cd7f) Acquiring hosts for clusters not owned by any
>>> management server
>>> 2015-11-26 20:21:53,168 DEBUG [c.c.h.d.HostDaoImpl]
>> (ClusteredAgentManager
>>> Timer:ctx-3ab0cd7f) Completed acquiring hosts for clusters not owned by
>> any
>>> management server
>>> 2015-11-26 20:21:55,958 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-2:ctx-5db7a86d) ===START=== 10.0.0.93 -- GET
>>>
>>>
>> command=deployVirtualMachine&response=json&zoneid=5b752672-2ac9-4ec0-86a6-103cae8217d1&templateid=900a5634-9414-11e5-ae19-000c29255f5e&hypervisor=XenServer&serviceofferingid=94b83ad1-406c-44d5-86c0-d4dbb82a50a1&diskofferingid=30f3f1fa-76b2-4bcb-82c5-449ce7d9a4c8&iptonetworklist%5B0%5D.networkid=2e97fcee-3d01-40d2-a624-376661747d0c&displayname=Test002&name=Test002&_=1448549581263
>>> 2015-11-26 20:21:55,969 DEBUG [c.c.u.AccountManagerImpl]
>>> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Access granted to
>>> Acct[20064ffe-9415-11e5-a790-000c29255f5e-admin] to
>>> com.cloud.service.ServiceOfferingVO$$EnhancerByCGLIB$$8b588241@5020f5b3
>> by
>>> AffinityGroupAccessChecker
>>> 2015-11-26 20:21:55,969 DEBUG [c.c.u.AccountManagerImpl]
>>> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Access granted to
>>> Acct[20064ffe-9415-11e5-a790-000c29255f5e-admin] to
>>> com.cloud.storage.DiskOfferingVO$$EnhancerByCGLIB$$a160ea41@45e982eb by
>>> AffinityGroupAccessChecker
>>> 2015-11-26 20:21:55,976 DEBUG [c.c.n.NetworkModelImpl]
>>> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Service SecurityGroup is not
>>> supported in the network id=212
>>> 2015-11-26 20:21:55,982 DEBUG [c.c.v.UserVmManagerImpl]
>>> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Allocating in the DB for vm
>>> 2015-11-26 20:21:55,988 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Allocating entries for VM:
>>> VM[User|i-2-5-VM]
>>> 2015-11-26 20:21:55,988 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Allocating nics for
>>> VM[User|i-2-5-VM]
>>> 2015-11-26 20:21:55,989 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Allocating nic for vm
>>> VM[User|i-2-5-VM] in network Ntwk[212|Guest|8] with requested profile
>>> NicProfile[0-0-null-null-null
>>> 2015-11-26 20:21:55,996 DEBUG [c.c.n.NetworkModelImpl]
>>> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Service SecurityGroup is not
>>> supported in the network id=212
>>> 2015-11-26 20:21:55,997 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Allocating disks for
>>> VM[User|i-2-5-VM]
>>> 2015-11-26 20:21:56,008 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Allocation completed for VM:
>>> VM[User|i-2-5-VM]
>>> 2015-11-26 20:21:56,009 DEBUG [c.c.v.UserVmManagerImpl]
>>> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Successfully allocated DB
>> entry
>>> for VM[User|i-2-5-VM]
>>> 2015-11-26 20:21:56,034 DEBUG [c.c.n.NetworkModelImpl]
>>> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Service SecurityGroup is not
>>> supported in the network id=212
>>> 2015-11-26 20:21:56,037 DEBUG [c.c.n.NetworkModelImpl]
>>> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Service SecurityGroup is not
>>> supported in the network id=212
>>> 2015-11-26 20:21:56,053 INFO [o.a.c.f.j.i.AsyncJobMonitor]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68) Add job-68 into job monitoring
>>> 2015-11-26 20:21:56,054 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) submit async job-68, details:
>>> AsyncJobVO {id:68, userId: 2, accountId: 2, instanceType: VirtualMachine,
>>> instanceId: 5, cmd:
>>> org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin, cmdInfo:
>>>
>>>
>> {"serviceofferingid":"94b83ad1-406c-44d5-86c0-d4dbb82a50a1","cmdEventType":"VM.CREATE","ctxUserId":"2","zoneid":"5b752672-2ac9-4ec0-86a6-103cae8217d1","httpmethod":"GET","templateid":"900a5634-9414-11e5-ae19-000c29255f5e","response":"json","id":"5","ctxDetails":"{\"interface
>>>
>>>
>> com.cloud.template.VirtualMachineTemplate\":\"900a5634-9414-11e5-ae19-000c29255f5e\",\"interface
>>>
>>>
>> com.cloud.offering.DiskOffering\":\"30f3f1fa-76b2-4bcb-82c5-449ce7d9a4c8\",\"interface
>>>
>>>
>> com.cloud.offering.ServiceOffering\":\"94b83ad1-406c-44d5-86c0-d4dbb82a50a1\",\"interface
>>>
>>>
>> com.cloud.vm.VirtualMachine\":\"4ce4731f-22a7-42ac-8e78-093d5f2e9a34\",\"interface
>>>
>>>
>> com.cloud.dc.DataCenter\":\"5b752672-2ac9-4ec0-86a6-103cae8217d1\"}","hypervisor":"XenServer","name":"Test002","iptonetworklist[0].networkid":"2e97fcee-3d01-40d2-a624-376661747d0c","_":"1448549581263","uuid":"4ce4731f-22a7-42ac-8e78-093d5f2e9a34","ctxAccountId":"2","diskofferingid":"30f3f1fa-76b2-4bcb-82c5-449ce7d9a4c8","ctxStartEventId":"168","displayname":"Test002"},
>>> cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
>>> result: null, initMsid: 52229922654, completeMsid: null, lastUpdated:
>> null,
>>> lastPolled: null, created: null}
>>> 2015-11-26 20:21:56,058 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) ===END=== 10.0.0.93 -- GET
>>>
>>>
>> command=deployVirtualMachine&response=json&zoneid=5b752672-2ac9-4ec0-86a6-103cae8217d1&templateid=900a5634-9414-11e5-ae19-000c29255f5e&hypervisor=XenServer&serviceofferingid=94b83ad1-406c-44d5-86c0-d4dbb82a50a1&diskofferingid=30f3f1fa-76b2-4bcb-82c5-449ce7d9a4c8&iptonetworklist%5B0%5D.networkid=2e97fcee-3d01-40d2-a624-376661747d0c&displayname=Test002&name=Test002&_=1448549581263
>>> 2015-11-26 20:21:56,061 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68) Executing AsyncJobVO {id:68,
>>> userId: 2, accountId: 2, instanceType: VirtualMachine, instanceId: 5,
>> cmd:
>>> org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin, cmdInfo:
>>>
>>>
>> {"serviceofferingid":"94b83ad1-406c-44d5-86c0-d4dbb82a50a1","cmdEventType":"VM.CREATE","ctxUserId":"2","zoneid":"5b752672-2ac9-4ec0-86a6-103cae8217d1","httpmethod":"GET","templateid":"900a5634-9414-11e5-ae19-000c29255f5e","response":"json","id":"5","ctxDetails":"{\"interface
>>>
>>>
>> com.cloud.template.VirtualMachineTemplate\":\"900a5634-9414-11e5-ae19-000c29255f5e\",\"interface
>>>
>>>
>> com.cloud.offering.DiskOffering\":\"30f3f1fa-76b2-4bcb-82c5-449ce7d9a4c8\",\"interface
>>>
>>>
>> com.cloud.offering.ServiceOffering\":\"94b83ad1-406c-44d5-86c0-d4dbb82a50a1\",\"interface
>>>
>>>
>> com.cloud.vm.VirtualMachine\":\"4ce4731f-22a7-42ac-8e78-093d5f2e9a34\",\"interface
>>>
>>>
>> com.cloud.dc.DataCenter\":\"5b752672-2ac9-4ec0-86a6-103cae8217d1\"}","hypervisor":"XenServer","name":"Test002","iptonetworklist[0].networkid":"2e97fcee-3d01-40d2-a624-376661747d0c","_":"1448549581263","uuid":"4ce4731f-22a7-42ac-8e78-093d5f2e9a34","ctxAccountId":"2","diskofferingid":"30f3f1fa-76b2-4bcb-82c5-449ce7d9a4c8","ctxStartEventId":"168","displayname":"Test002"},
>>> cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
>>> result: null, initMsid: 52229922654, completeMsid: null, lastUpdated:
>> null,
>>> lastPolled: null, created: null}
>>> 2015-11-26 20:21:56,085 DEBUG [c.c.n.NetworkModelImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Service
>> SecurityGroup
>>> is not supported in the network id=212
>>> 2015-11-26 20:21:56,087 DEBUG [c.c.n.NetworkModelImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Service
>> SecurityGroup
>>> is not supported in the network id=212
>>> 2015-11-26 20:21:56,094 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Deploy avoids pods:
>>> [], clusters: [], hosts: []
>>> 2015-11-26 20:21:56,095 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) DeploymentPlanner
>>> allocation algorithm: com.cloud.deploy.FirstFitPlanner@1136745
>>> 2015-11-26 20:21:56,095 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Trying to allocate
>> a
>>> host and storage pools from dc:3, pod:null,cluster:null, requested cpu:
>>> 1000, requested ram: 1073741824
>>> 2015-11-26 20:21:56,095 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Is ROOT volume
>> READY
>>> (pool already allocated)?: No
>>> 2015-11-26 20:21:56,095 DEBUG [c.c.d.FirstFitPlanner]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Searching all
>>> possible resources under this Zone: 3
>>> 2015-11-26 20:21:56,096 DEBUG [c.c.d.FirstFitPlanner]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Listing clusters in
>>> order of aggregate capacity, that have (atleast one host with) enough CPU
>>> and RAM capacity under this Zone: 3
>>> 2015-11-26 20:21:56,097 DEBUG [c.c.d.FirstFitPlanner]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Removing from the
>>> clusterId list these clusters from avoid set: []
>>> 2015-11-26 20:21:56,103 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking resources
>> in
>>> Cluster: 3 under Pod: 3
>>> 2015-11-26 20:21:56,104 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
>>> FirstFitRoutingAllocator) Looking for hosts in dc: 3 pod:3 cluster:3
>>> 2015-11-26 20:21:56,105 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
>>> FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for
>>> allocation: [Host[-4-Routing]]
>>> 2015-11-26 20:21:56,108 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
>>> FirstFitRoutingAllocator) Found 1 hosts for allocation after
>>> prioritization: [Host[-4-Routing]]
>>> 2015-11-26 20:21:56,108 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
>>> FirstFitRoutingAllocator) Looking for speed=1000Mhz, Ram=1024
>>> 2015-11-26 20:21:56,111 DEBUG [c.c.c.CapacityManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
>>> FirstFitRoutingAllocator) Host: 4 has cpu capability (cpu:1, speed:3399)
>> to
>>> support requested CPU: 1 and requested speed: 1000
>>> 2015-11-26 20:21:56,111 DEBUG [c.c.c.CapacityManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
>>> FirstFitRoutingAllocator) Checking if host: 4 has enough capacity for
>>> requested CPU: 1000 and requested RAM: 1073741824 ,
>>> cpuOverprovisioningFactor: 1.0
>>> 2015-11-26 20:21:56,113 DEBUG [c.c.c.CapacityManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
>>> FirstFitRoutingAllocator) Hosts's actual total CPU: 3399 and CPU after
>>> applying overprovisioning: 3399
>>> 2015-11-26 20:21:56,113 DEBUG [c.c.c.CapacityManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
>>> FirstFitRoutingAllocator) Free CPU: 2399 , Requested CPU: 1000
>>> 2015-11-26 20:21:56,113 DEBUG [c.c.c.CapacityManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
>>> FirstFitRoutingAllocator) Free RAM: 13743892480 , Requested RAM:
>> 1073741824
>>> 2015-11-26 20:21:56,113 DEBUG [c.c.c.CapacityManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
>>> FirstFitRoutingAllocator) Host has enough CPU and RAM available
>>> 2015-11-26 20:21:56,113 DEBUG [c.c.c.CapacityManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
>>> FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 4, used: 1000,
>>> reserved: 0, actual total: 3399, total with overprovisioning: 3399;
>>> requested cpu:1000,alloc_from_last_host?:false
>> ,considerReservedCapacity?:
>>> true
>>> 2015-11-26 20:21:56,113 DEBUG [c.c.c.CapacityManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
>>> FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 4, used:
>>> 1610612736, reserved: 0, total: 15354505216; requested mem:
>>> 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
>>> 2015-11-26 20:21:56,113 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
>>> FirstFitRoutingAllocator) Found a suitable host, adding to list: 4
>>> 2015-11-26 20:21:56,113 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
>>> FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts
>>> 2015-11-26 20:21:56,115 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking suitable
>>> pools for volume (Id, Type): (6,ROOT)
>>> 2015-11-26 20:21:56,115 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) We need to allocate
>>> new storagepool for this volume
>>> 2015-11-26 20:21:56,115 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Calling
>>> StoragePoolAllocators to find suitable pools
>>> 2015-11-26 20:21:56,116 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e)
>>> LocalStoragePoolAllocator trying to find storage pool to fit the vm
>>> 2015-11-26 20:21:56,116 DEBUG
>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e)
>>> ClusterScopeStoragePoolAllocator looking for storage pool
>>> 2015-11-26 20:21:56,116 DEBUG
>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Looking for pools
>> in
>>> dc: 3 pod:3 cluster:3. Disabled pools will be ignored.
>>> 2015-11-26 20:21:56,117 DEBUG
>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found pools
>> matching
>>> tags: [Pool[8|NetworkFilesystem]]
>>> 2015-11-26 20:21:56,118 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking if storage
>>> pool is suitable, name: null ,poolId: 8
>>> 2015-11-26 20:21:56,119 INFO [c.c.s.StorageManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Storage pool null
>> (8)
>>> does not supply IOPS capacity, assuming enough capacity
>>> 2015-11-26 20:21:56,120 DEBUG [c.c.s.StorageManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool 8 for
>>> storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
>>> 0.019253810234789077, disable threshold: 0.85
>>> 2015-11-26 20:21:56,130 DEBUG [c.c.s.StorageManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found storage pool
>>> primary of type NetworkFilesystem with overprovisioning factor 2
>>> 2015-11-26 20:21:56,130 DEBUG [c.c.s.StorageManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total over
>>> provisioned capacity calculated is 2 * 526199291904
>>> 2015-11-26 20:21:56,130 DEBUG [c.c.s.StorageManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total capacity of
>> the
>>> pool primary id: 8 is 1052398583808
>>> 2015-11-26 20:21:56,130 DEBUG [c.c.s.StorageManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool: 8
>> for
>>> volume allocation [Vol[6|vm=5|ROOT]], maxSize : 1052398583808,
>>> totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
>>> disable threshold: 0.85
>>> 2015-11-26 20:21:56,130 DEBUG
>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e)
>>> ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
>>> 2015-11-26 20:21:56,130 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking suitable
>>> pools for volume (Id, Type): (7,DATADISK)
>>> 2015-11-26 20:21:56,130 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) We need to allocate
>>> new storagepool for this volume
>>> 2015-11-26 20:21:56,131 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Calling
>>> StoragePoolAllocators to find suitable pools
>>> 2015-11-26 20:21:56,131 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e)
>>> LocalStoragePoolAllocator trying to find storage pool to fit the vm
>>> 2015-11-26 20:21:56,131 DEBUG
>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e)
>>> ClusterScopeStoragePoolAllocator looking for storage pool
>>> 2015-11-26 20:21:56,131 DEBUG
>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Looking for pools
>> in
>>> dc: 3 pod:3 cluster:3. Disabled pools will be ignored.
>>> 2015-11-26 20:21:56,131 DEBUG
>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found pools
>> matching
>>> tags: [Pool[8|NetworkFilesystem]]
>>> 2015-11-26 20:21:56,132 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking if storage
>>> pool is suitable, name: null ,poolId: 8
>>> 2015-11-26 20:21:56,132 INFO [c.c.s.StorageManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Storage pool null
>> (8)
>>> does not supply IOPS capacity, assuming enough capacity
>>> 2015-11-26 20:21:56,133 DEBUG [c.c.s.StorageManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool 8 for
>>> storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
>>> 0.019253810234789077, disable threshold: 0.85
>>> 2015-11-26 20:21:56,139 DEBUG [c.c.s.StorageManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found storage pool
>>> primary of type NetworkFilesystem with overprovisioning factor 2
>>> 2015-11-26 20:21:56,139 DEBUG [c.c.s.StorageManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total over
>>> provisioned capacity calculated is 2 * 526199291904
>>> 2015-11-26 20:21:56,139 DEBUG [c.c.s.StorageManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total capacity of
>> the
>>> pool primary id: 8 is 1052398583808
>>> 2015-11-26 20:21:56,140 DEBUG [c.c.s.StorageManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool: 8
>> for
>>> volume allocation [Vol[7|vm=5|DATADISK]], maxSize : 1052398583808,
>>> totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
>>> disable threshold: 0.85
>>> 2015-11-26 20:21:56,140 DEBUG
>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e)
>>> ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
>>> 2015-11-26 20:21:56,140 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Trying to find a
>>> potenial host and associated storage pools from the suitable host/pool
>>> lists for this VM
>>> 2015-11-26 20:21:56,140 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking if host: 4
>>> can access any suitable storage pool for volume: DATADISK
>>> 2015-11-26 20:21:56,140 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Host: 4 can access
>>> pool: 8
>>> 2015-11-26 20:21:56,141 DEBUG [c.c.s.StorageManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool 8 for
>>> storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
>>> 0.019253810234789077, disable threshold: 0.85
>>> 2015-11-26 20:21:56,142 DEBUG [c.c.s.StorageManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found storage pool
>>> primary of type NetworkFilesystem with overprovisioning factor 2
>>> 2015-11-26 20:21:56,142 DEBUG [c.c.s.StorageManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total over
>>> provisioned capacity calculated is 2 * 526199291904
>>> 2015-11-26 20:21:56,143 DEBUG [c.c.s.StorageManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total capacity of
>> the
>>> pool primary id: 8 is 1052398583808
>>> 2015-11-26 20:21:56,143 DEBUG [c.c.s.StorageManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool: 8
>> for
>>> volume allocation [Vol[7|vm=5|DATADISK]], maxSize : 1052398583808,
>>> totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
>>> disable threshold: 0.85
>>> 2015-11-26 20:21:56,143 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking if host: 4
>>> can access any suitable storage pool for volume: ROOT
>>> 2015-11-26 20:21:56,143 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Host: 4 can access
>>> pool: 8
>>> 2015-11-26 20:21:56,144 DEBUG [c.c.s.StorageManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool 8 for
>>> storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
>>> 0.019253810234789077, disable threshold: 0.85
>>> 2015-11-26 20:21:56,146 DEBUG [c.c.s.StorageManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found storage pool
>>> primary of type NetworkFilesystem with overprovisioning factor 2
>>> 2015-11-26 20:21:56,146 DEBUG [c.c.s.StorageManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total over
>>> provisioned capacity calculated is 2 * 526199291904
>>> 2015-11-26 20:21:56,146 DEBUG [c.c.s.StorageManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total capacity of
>> the
>>> pool primary id: 8 is 1052398583808
>>> 2015-11-26 20:21:56,147 DEBUG [c.c.s.StorageManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool: 8
>> for
>>> volume allocation [Vol[6|vm=5|ROOT]], maxSize : 1052398583808,
>>> totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
>>> disable threshold: 0.85
>>> 2015-11-26 20:21:56,147 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found a potential
>>> host id: 4 name: xenserver and associated storage pools for this VM
>>> 2015-11-26 20:21:56,148 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Returning
>> Deployment
>>> Destination:
>>>
>>>
>> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
>>> :
>>>
>>>
>> Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage(Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
>>> Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
>>> Volume(7|DATADISK-->Pool(8))]
>>> 2015-11-26 20:21:56,155 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Sync job-69
>> execution
>>> on object VmWorkJobQueue.5
>>> 2015-11-26 20:21:56,961 DEBUG [c.c.a.m.AgentManagerImpl]
>>> (AgentManager-Handler-1:null) SeqA 5-1782: Processing Seq 5-1782: { Cmd
>> ,
>>> MgmtId: -1, via: 5, Ver: v1, Flags: 11,
>>>
>>>
>> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
>>> \"connections\": []\n}","wait":0}}] }
>>> 2015-11-26 20:21:56,966 DEBUG [c.c.a.m.AgentManagerImpl]
>>> (AgentManager-Handler-1:null) SeqA 5-1782: Sending Seq 5-1782: { Ans: ,
>>> MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
>>> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
>>> 2015-11-26 20:21:58,022 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (AsyncJobMgr-Heartbeat-1:ctx-7d4d1e50) Execute sync-queue item:
>>> SyncQueueItemVO {id:9, queueId: 9, contentType: AsyncJob, contentId: 69,
>>> lastProcessMsid: 52229922654, lastprocessNumber: 1, lastProcessTime: Thu
>>> Nov 26 20:21:58 IST 2015, created: Thu Nov 26 20:21:56 IST 2015}
>>> 2015-11-26 20:21:58,022 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (AsyncJobMgr-Heartbeat-1:ctx-7d4d1e50) Schedule queued job-69
>>> 2015-11-26 20:21:58,026 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (AsyncJobMgr-Heartbeat-1:ctx-05b26563) Begin cleanup expired async-jobs
>>> 2015-11-26 20:21:58,029 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (AsyncJobMgr-Heartbeat-1:ctx-05b26563) End cleanup expired async-jobs
>>> 2015-11-26 20:21:58,029 INFO [o.a.c.f.j.i.AsyncJobMonitor]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Add job-69 into job
>>> monitoring
>>> 2015-11-26 20:21:58,033 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Executing AsyncJobVO
>>> {id:69, userId: 2, accountId: 2, instanceType: null, instanceId: null,
>> cmd:
>>> com.cloud.vm.VmWorkStart, cmdInfo:
>>>
>>>
>> rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAABXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAA3BzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHIAEGphdmEubGFuZy5OdW1iZXKGrJUdC5TgiwIAAHhwAAAAAAAAAANzcQB-AAgAAAAAAAAABHBwcHEAfgAKcHNyABFqYXZhLnV0aWwuSGFzaE1hcAUH2sHDFmDRAwACRgAKbG9hZEZhY3RvckkACXRocmVzaG9sZHhwP0AAAAAAAAx3CAAAABAAAAABdAAKVm1QYXNzd29yZHQAHHJPMEFCWFFBRG5OaGRtVmtYM0JoYzNOM2IzSmt4cA,
>>> cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
>>> result: null, initMsid: 52229922654, completeMsid: null, lastUpdated:
>> null,
>>> lastPolled: null, created: Thu Nov 26 20:21:56 IST 2015}
>>> 2015-11-26 20:21:58,033 DEBUG [c.c.v.VmWorkJobDispatcher]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Run VM work job:
>>> com.cloud.vm.VmWorkStart for VM 5, job origin: 68
>>> 2015-11-26 20:21:58,034 DEBUG [c.c.v.VmWorkJobHandlerProxy]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Execute VM
>>> work job:
>>>
>>>
>> com.cloud.vm.VmWorkStart{"dcId":3,"podId":3,"clusterId":3,"hostId":4,"rawParams":{"VmPassword":"rO0ABXQADnNhdmVkX3Bhc3N3b3Jk"},"userId":2,"accountId":2,"vmId":5,"handlerName":"VirtualMachineManagerImpl"}
>>> 2015-11-26 20:21:58,038 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM state
>>> transitted from :Stopped to Starting with event: StartRequestedvm's
>>> original host id: null new host id: null host id before state transition:
>>> null
>>> 2015-11-26 20:21:58,038 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>> Successfully
>>> transitioned to start state for VM[User|i-2-5-VM] reservation id =
>>> 2a4a184a-eac9-4609-8a70-4d230ee3a37d
>>> 2015-11-26 20:21:58,040 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
>>> deploy VM, vm has dcId: 3 and podId: null
>>> 2015-11-26 20:21:58,041 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>> advanceStart:
>>> DeploymentPlan is provided, using dcId:3, podId: 3, clusterId: 3, hostId:
>>> 4, poolId: null
>>> 2015-11-26 20:21:58,041 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deploy
>> avoids
>>> pods: null, clusters: null, hosts: null
>>> 2015-11-26 20:21:58,045 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deploy
>> avoids
>>> pods: [], clusters: [], hosts: []
>>> 2015-11-26 20:21:58,046 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>> DeploymentPlanner allocation algorithm:
>>> com.cloud.deploy.FirstFitPlanner@1136745
>>> 2015-11-26 20:21:58,046 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
>>> allocate a host and storage pools from dc:3, pod:3,cluster:3, requested
>>> cpu: 1000, requested ram: 1073741824
>>> 2015-11-26 20:21:58,046 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Is ROOT
>>> volume READY (pool already allocated)?: No
>>> 2015-11-26 20:21:58,046 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>> DeploymentPlan has host_id specified, choosing this host and making no
>>> checks on this host: 4
>>> 2015-11-26 20:21:58,046 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Looking for
>>> suitable pools for this host under zone: 3, pod: 3, cluster: 3
>>> 2015-11-26 20:21:58,048 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
>>> suitable pools for volume (Id, Type): (6,ROOT)
>>> 2015-11-26 20:21:58,048 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) We need to
>>> allocate new storagepool for this volume
>>> 2015-11-26 20:21:58,049 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Calling
>>> StoragePoolAllocators to find suitable pools
>>> 2015-11-26 20:21:58,049 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>> LocalStoragePoolAllocator trying to find storage pool to fit the vm
>>> 2015-11-26 20:21:58,049 DEBUG
>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>> ClusterScopeStoragePoolAllocator looking for storage pool
>>> 2015-11-26 20:21:58,049 DEBUG
>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Looking for
>>> pools in dc: 3 pod:3 cluster:3. Disabled pools will be ignored.
>>> 2015-11-26 20:21:58,049 DEBUG
>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found pools
>>> matching tags: [Pool[8|NetworkFilesystem]]
>>> 2015-11-26 20:21:58,050 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
>>> storage pool is suitable, name: null ,poolId: 8
>>> 2015-11-26 20:21:58,051 INFO [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Storage
>> pool
>>> null (8) does not supply IOPS capacity, assuming enough capacity
>>> 2015-11-26 20:21:58,052 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
>> pool
>>> 8 for storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
>>> 0.019253810234789077, disable threshold: 0.85
>>> 2015-11-26 20:21:58,054 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found
>> storage
>>> pool primary of type NetworkFilesystem with overprovisioning factor 2
>>> 2015-11-26 20:21:58,055 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total over
>>> provisioned capacity calculated is 2 * 526199291904
>>> 2015-11-26 20:21:58,055 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total
>>> capacity of the pool primary id: 8 is 1052398583808
>>> 2015-11-26 20:21:58,055 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
>>> pool: 8 for volume allocation [Vol[6|vm=5|ROOT]], maxSize :
>> 1052398583808,
>>> totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
>>> disable threshold: 0.85
>>> 2015-11-26 20:21:58,055 DEBUG
>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>> ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
>>> 2015-11-26 20:21:58,055 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
>>> suitable pools for volume (Id, Type): (7,DATADISK)
>>> 2015-11-26 20:21:58,055 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) We need to
>>> allocate new storagepool for this volume
>>> 2015-11-26 20:21:58,055 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Calling
>>> StoragePoolAllocators to find suitable pools
>>> 2015-11-26 20:21:58,055 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>> LocalStoragePoolAllocator trying to find storage pool to fit the vm
>>> 2015-11-26 20:21:58,055 DEBUG
>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>> ClusterScopeStoragePoolAllocator looking for storage pool
>>> 2015-11-26 20:21:58,055 DEBUG
>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Looking for
>>> pools in dc: 3 pod:3 cluster:3. Disabled pools will be ignored.
>>> 2015-11-26 20:21:58,056 DEBUG
>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found pools
>>> matching tags: [Pool[8|NetworkFilesystem]]
>>> 2015-11-26 20:21:58,056 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
>>> storage pool is suitable, name: null ,poolId: 8
>>> 2015-11-26 20:21:58,057 INFO [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Storage
>> pool
>>> null (8) does not supply IOPS capacity, assuming enough capacity
>>> 2015-11-26 20:21:58,057 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
>> pool
>>> 8 for storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
>>> 0.019253810234789077, disable threshold: 0.85
>>> 2015-11-26 20:21:58,059 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found
>> storage
>>> pool primary of type NetworkFilesystem with overprovisioning factor 2
>>> 2015-11-26 20:21:58,059 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total over
>>> provisioned capacity calculated is 2 * 526199291904
>>> 2015-11-26 20:21:58,059 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total
>>> capacity of the pool primary id: 8 is 1052398583808
>>> 2015-11-26 20:21:58,060 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
>>> pool: 8 for volume allocation [Vol[7|vm=5|DATADISK]], maxSize :
>>> 1052398583808, totalAllocatedSize : 12156207104, askingSize :
>> 21474836480,
>>> allocated disable threshold: 0.85
>>> 2015-11-26 20:21:58,060 DEBUG
>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>> ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
>>> 2015-11-26 20:21:58,060 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
>>> find a potenial host and associated storage pools from the suitable
>>> host/pool lists for this VM
>>> 2015-11-26 20:21:58,060 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
>>> host: 4 can access any suitable storage pool for volume: DATADISK
>>> 2015-11-26 20:21:58,060 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Host: 4 can
>>> access pool: 8
>>> 2015-11-26 20:21:58,061 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
>> pool
>>> 8 for storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
>>> 0.019253810234789077, disable threshold: 0.85
>>> 2015-11-26 20:21:58,062 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found
>> storage
>>> pool primary of type NetworkFilesystem with overprovisioning factor 2
>>> 2015-11-26 20:21:58,062 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total over
>>> provisioned capacity calculated is 2 * 526199291904
>>> 2015-11-26 20:21:58,062 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total
>>> capacity of the pool primary id: 8 is 1052398583808
>>> 2015-11-26 20:21:58,063 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
>>> pool: 8 for volume allocation [Vol[7|vm=5|DATADISK]], maxSize :
>>> 1052398583808, totalAllocatedSize : 12156207104, askingSize :
>> 21474836480,
>>> allocated disable threshold: 0.85
>>> 2015-11-26 20:21:58,063 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
>>> host: 4 can access any suitable storage pool for volume: ROOT
>>> 2015-11-26 20:21:58,063 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Host: 4 can
>>> access pool: 8
>>> 2015-11-26 20:21:58,064 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
>> pool
>>> 8 for storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
>>> 0.019253810234789077, disable threshold: 0.85
>>> 2015-11-26 20:21:58,067 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found
>> storage
>>> pool primary of type NetworkFilesystem with overprovisioning factor 2
>>> 2015-11-26 20:21:58,067 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total over
>>> provisioned capacity calculated is 2 * 526199291904
>>> 2015-11-26 20:21:58,067 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total
>>> capacity of the pool primary id: 8 is 1052398583808
>>> 2015-11-26 20:21:58,067 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
>>> pool: 8 for volume allocation [Vol[6|vm=5|ROOT]], maxSize :
>> 1052398583808,
>>> totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
>>> disable threshold: 0.85
>>> 2015-11-26 20:21:58,067 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found a
>>> potential host id: 4 name: xenserver and associated storage pools for
>> this
>>> VM
>>> 2015-11-26 20:21:58,068 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Returning
>>> Deployment Destination:
>>>
>>>
>> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
>>> :
>>>
>>>
>> Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage(Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
>>> Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
>>> Volume(7|DATADISK-->Pool(8))]
>>> 2015-11-26 20:21:58,068 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deployment
>>> found - P0=VM[User|i-2-5-VM],
>>>
>>>
>> P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
>>> :
>>>
>>>
>> Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage(Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
>>> Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
>>> Volume(7|DATADISK-->Pool(8))]
>>> 2015-11-26 20:21:58,073 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM state
>>> transitted from :Starting to Starting with event: OperationRetryvm's
>>> original host id: null new host id: 4 host id before state transition:
>> null
>>> 2015-11-26 20:21:58,076 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Hosts's
>>> actual total CPU: 3399 and CPU after applying overprovisioning: 3399
>>> 2015-11-26 20:21:58,076 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) We are
>>> allocating VM, increasing the used capacity of this host:4
>>> 2015-11-26 20:21:58,076 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Current
>> Used
>>> CPU: 1000 , Free CPU:2399 ,Requested CPU: 1000
>>> 2015-11-26 20:21:58,076 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Current
>> Used
>>> RAM: 1610612736 , Free RAM:13743892480 ,Requested RAM: 1073741824
>>> 2015-11-26 20:21:58,076 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) CPU STATS
>>> after allocation: for host: 4, old used: 1000, old reserved: 0, actual
>>> total: 3399, total with overprovisioning: 3399; new used:2000,
>> reserved:0;
>>> requested cpu:1000,alloc_from_last:false
>>> 2015-11-26 20:21:58,076 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) RAM STATS
>>> after allocation: for host: 4, old used: 1610612736, old reserved: 0,
>>> total: 15354505216; new used: 2684354560, reserved: 0; requested mem:
>>> 1073741824,alloc_from_last:false
>>> 2015-11-26 20:21:58,094 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM is being
>>> created in podId: 3
>>> 2015-11-26 20:21:58,097 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Lock is
>>> acquired for network id 212 as a part of network implement
>>> 2015-11-26 20:21:58,097 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Asking
>>> ExternalGuestNetworkGuru to implement Ntwk[212|Guest|8]
>>> 2015-11-26 20:21:58,117 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Asking
>>> VirtualRouter to implemenet Ntwk[212|Guest|8]
>>> 2015-11-26 20:21:58,120 DEBUG [c.c.n.r.NetworkHelperImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Starting
>>> router VM[DomainRouter|r-4-VM]
>>> 2015-11-26 20:21:58,127 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM state
>>> transitted from :Stopped to Starting with event: StartRequestedvm's
>>> original host id: 4 new host id: null host id before state transition:
>> null
>>> 2015-11-26 20:21:58,127 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>> Successfully
>>> transitioned to start state for VM[DomainRouter|r-4-VM] reservation id =
>>> 36f90bcc-1fad-40d8-b878-3996e5c69c0e
>>> 2015-11-26 20:21:58,130 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
>>> deploy VM, vm has dcId: 3 and podId: 3
>>> 2015-11-26 20:21:58,130 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deploy
>> avoids
>>> pods: null, clusters: null, hosts: null
>>> 2015-11-26 20:21:58,131 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Root volume
>>> is ready, need to place VM in volume's cluster
>>> 2015-11-26 20:21:58,131 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>> Vol[5|vm=4|ROOT] is READY, changing deployment plan to use this pool's
>>> dcId: 3 , podId: 3 , and clusterId: 3
>>> 2015-11-26 20:21:58,137 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deploy
>> avoids
>>> pods: [], clusters: [], hosts: []
>>> 2015-11-26 20:21:58,137 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>> DeploymentPlanner allocation algorithm:
>>> com.cloud.deploy.FirstFitPlanner@1136745
>>> 2015-11-26 20:21:58,137 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
>>> allocate a host and storage pools from dc:3, pod:3,cluster:3, requested
>>> cpu: 500, requested ram: 268435456
>>> 2015-11-26 20:21:58,137 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Is ROOT
>>> volume READY (pool already allocated)?: Yes
>>> 2015-11-26 20:21:58,137 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) This VM has
>>> last host_id specified, trying to choose the same host: 4
>>> 2015-11-26 20:21:58,141 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Host: 4 has
>>> cpu capability (cpu:1, speed:3399) to support requested CPU: 1 and
>>> requested speed: 500
>>> 2015-11-26 20:21:58,141 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
>>> host: 4 has enough capacity for requested CPU: 500 and requested RAM:
>>> 268435456 , cpuOverprovisioningFactor: 1.0
>>> 2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Hosts's
>>> actual total CPU: 3399 and CPU after applying overprovisioning: 3399
>>> 2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) We need to
>>> allocate to the last host again, so checking if there is enough reserved
>>> capacity
>>> 2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reserved
>> CPU:
>>> 0 , Requested CPU: 500
>>> 2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reserved
>> RAM:
>>> 0 , Requested RAM: 268435456
>>> 2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) STATS:
>> Failed
>>> to alloc resource from host: 4 reservedCpu: 0, requested cpu: 500,
>>> reservedMem: 0, requested mem: 268435456
>>> 2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Host does
>> not
>>> have enough reserved CPU available, cannot allocate to this host.
>>> 2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
>>> host: 4 has enough capacity for requested CPU: 500 and requested RAM:
>>> 268435456 , cpuOverprovisioningFactor: 1.0
>>> 2015-11-26 20:21:58,143 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Hosts's
>>> actual total CPU: 3399 and CPU after applying overprovisioning: 3399
>>> 2015-11-26 20:21:58,143 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Free CPU:
>>> 1399 , Requested CPU: 500
>>> 2015-11-26 20:21:58,143 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Free RAM:
>>> 12670150656 , Requested RAM: 268435456
>>> 2015-11-26 20:21:58,143 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Host has
>>> enough CPU and RAM available
>>> 2015-11-26 20:21:58,143 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) STATS: Can
>>> alloc CPU from host: 4, used: 2000, reserved: 0, actual total: 3399,
>> total
>>> with overprovisioning: 3399; requested
>> cpu:500,alloc_from_last_host?:false
>>> ,considerReservedCapacity?: true
>>> 2015-11-26 20:21:58,143 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) STATS: Can
>>> alloc MEM from host: 4, used: 2684354560, reserved: 0, total:
>> 15354505216;
>>> requested mem: 268435456,alloc_from_last_host?:false
>>> ,considerReservedCapacity?: true
>>> 2015-11-26 20:21:58,143 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) The last
>> host
>>> of this VM is UP and has enough capacity
>>> 2015-11-26 20:21:58,143 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Now
>> checking
>>> for suitable pools under zone: 3, pod: 3, cluster: 3
>>> 2015-11-26 20:21:58,145 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
>>> suitable pools for volume (Id, Type): (5,ROOT)
>>> 2015-11-26 20:21:58,145 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Volume has
>>> pool already allocated, checking if pool can be reused, poolId: 8
>>> 2015-11-26 20:21:58,145 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Planner
>> need
>>> not allocate a pool for this volume since its READY
>>> 2015-11-26 20:21:58,145 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
>>> find a potenial host and associated storage pools from the suitable
>>> host/pool lists for this VM
>>> 2015-11-26 20:21:58,145 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
>>> host: 4 can access any suitable storage pool for volume: ROOT
>>> 2015-11-26 20:21:58,146 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Host: 4 can
>>> access pool: 8
>>> 2015-11-26 20:21:58,146 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found a
>>> potential host id: 4 name: xenserver and associated storage pools for
>> this
>>> VM
>>> 2015-11-26 20:21:58,146 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Returning
>>> Deployment Destination:
>>>
>>>
>> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
>>> : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage()]
>>> 2015-11-26 20:21:58,146 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deployment
>>> found - P0=VM[DomainRouter|r-4-VM],
>>>
>>>
>> P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
>>> : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage()]
>>> 2015-11-26 20:21:58,153 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM state
>>> transitted from :Starting to Starting with event: OperationRetryvm's
>>> original host id: 4 new host id: 4 host id before state transition: null
>>> 2015-11-26 20:21:58,153 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM starting
>>> again on the last host it was stopped on
>>> 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Hosts's
>>> actual total CPU: 3399 and CPU after applying overprovisioning: 3399
>>> 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) We are
>>> allocating VM, increasing the used capacity of this host:4
>>> 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Current
>> Used
>>> CPU: 2000 , Free CPU:1399 ,Requested CPU: 500
>>> 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Current
>> Used
>>> RAM: 2684354560 , Free RAM:12670150656 ,Requested RAM: 268435456
>>> 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) We are
>>> allocating VM to the last host again, so adjusting the reserved capacity
>> if
>>> it is not less than required
>>> 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reserved
>> CPU:
>>> 0 , Requested CPU: 500
>>> 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reserved
>> RAM:
>>> 0 , Requested RAM: 268435456
>>> 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) CPU STATS
>>> after allocation: for host: 4, old used: 2000, old reserved: 0, actual
>>> total: 3399, total with overprovisioning: 3399; new used:2500,
>> reserved:0;
>>> requested cpu:500,alloc_from_last:true
>>> 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) RAM STATS
>>> after allocation: for host: 4, old used: 2684354560, old reserved: 0,
>>> total: 15354505216; new used: 2952790016, reserved: 0; requested mem:
>>> 268435456,alloc_from_last:true
>>> 2015-11-26 20:21:58,158 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM is being
>>> created in podId: 3
>>> 2015-11-26 20:21:58,173 DEBUG [c.c.n.NetworkModelImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
>>> SecurityGroup is not supported in the network id=212
>>> 2015-11-26 20:21:58,179 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Asking
>>> VirtualRouter to prepare for
>>> Nic[8-4-36f90bcc-1fad-40d8-b878-3996e5c69c0e-10.1.1.1]
>>> 2015-11-26 20:21:58,179 DEBUG [c.c.n.NetworkModelImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
>>> SecurityGroup is not supported in the network id=212
>>> 2015-11-26 20:21:58,193 DEBUG [o.a.c.e.o.VolumeOrchestrator]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
>>> we need to prepare 1 volumes for VM[DomainRouter|r-4-VM]
>>> 2015-11-26 20:21:58,193 DEBUG [o.a.c.e.o.VolumeOrchestrator]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) No need to
>>> recreate the volume: Vol[5|vm=4|ROOT], since it already has a pool
>>> assigned: 8, adding disk to VM
>>> 2015-11-26 20:21:58,207 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Boot Args
>> for
>>> VM[DomainRouter|r-4-VM]: template=domP name=r-4-VM eth2ip=10.0.0.174
>>> eth2mask=255.255.255.0 gateway=10.0.0.1 eth0ip=10.1.1.1
>>> eth0mask=255.255.255.0 domain=cs2cloud.internal cidrsize=24
>>> dhcprange=10.1.1.1 eth1ip=169.254.0.43 eth1mask=255.255.0.0 type=router
>>> disable_rp_filter=true dns1=8.8.8.8
>>>
>>>
>> baremetalnotificationsecuritykey=MD4bWVy5t0anMd4eq4UlKWj6cZTW4gFDMeDd0WR3H3BuAsrxVX28ShzvJgbd8RR5eMRZ7rNYAsaF9RPXAZoCrQ
>>>
>>>
>> baremetalnotificationapikey=ZWNcizzJ0xXQE0Ubr6Sr_kN7xlMMMMtziuPTxHwZOyIN-Lo2f2CzvPhNw0o01LkNP3X4bp61YiZu0EWF-Mbfew
>>> host=10.0.0.170 port=8080
>>> 2015-11-26 20:21:58,229 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 1
>> ip(s)
>>> to apply as a part of domR VM[DomainRouter|r-4-VM] start.
>>> 2015-11-26 20:21:58,237 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Resending
>>> ipAssoc, port forwarding, load balancing rules as a part of Virtual
>> router
>>> start
>>> 2015-11-26 20:21:58,241 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Egress
>> policy
>>> for the Network 212 is already defined as Deny. So, no need to default
>> the
>>> rule to Allow.
>>> 2015-11-26 20:21:58,241 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
>>> firewall Egress rule(s) to apply as a part of domR
>> VM[DomainRouter|r-4-VM]
>>> start.
>>> 2015-11-26 20:21:58,243 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
>>> static nat(s) to apply as a part of domR VM[DomainRouter|r-4-VM] start.
>>> 2015-11-26 20:21:58,243 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
>>> firewall Ingress rule(s) to apply as a part of domR
>> VM[DomainRouter|r-4-VM]
>>> start.
>>> 2015-11-26 20:21:58,243 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
>> port
>>> forwarding rule(s) to apply as a part of domR VM[DomainRouter|r-4-VM]
>>> start.
>>> 2015-11-26 20:21:58,243 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
>>> static nat rule(s) to apply as a part of domR VM[DomainRouter|r-4-VM]
>>> start.
>>> 2015-11-26 20:21:58,243 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
>>> vpn(s) to apply as a part of domR VM[DomainRouter|r-4-VM] start.
>>> 2015-11-26 20:21:58,244 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
>> load
>>> balancing rule(s) to apply as a part of domR VM[DomainRouter|r-4-VM]
>> start.
>>> 2015-11-26 20:21:58,245 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Creating
>>> monitoring services on VM[DomainRouter|r-4-VM] start...
>>> 2015-11-26 20:21:58,248 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reapplying
>>> dhcp entries as a part of domR VM[DomainRouter|r-4-VM] start...
>>> 2015-11-26 20:21:58,249 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reapplying
>> vm
>>> data (userData and metaData) entries as a part of domR
>>> VM[DomainRouter|r-4-VM] start...
>>> 2015-11-26 20:21:58,254 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>> 4-8612571337392652838: Sending { Cmd , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>
>>>
>> [{"com.cloud.agent.api.StartCommand":{"vm":{"id":4,"name":"r-4-VM","bootloader":"PyGrub","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":268435456,"maxRam":268435456,"arch":"x86_64","os":"Debian
>>> GNU/Linux 7(64-bit)","platformEmulator":"Debian Wheezy 7.0
>>> (64-bit)","bootArgs":" template=domP name=r-4-VM eth2ip=10.0.0.174
>>> eth2mask=255.255.255.0 gateway=10.0.0.1 eth0ip=10.1.1.1
>>> eth0mask=255.255.255.0 domain=cs2cloud.internal cidrsize=24
>>> dhcprange=10.1.1.1 eth1ip=169.254.0.43 eth1mask=255.255.0.0 type=router
>>> disable_rp_filter=true dns1=8.8.8.8
>>>
>>>
>> baremetalnotificationsecuritykey=MD4bWVy5t0anMd4eq4UlKWj6cZTW4gFDMeDd0WR3H3BuAsrxVX28ShzvJgbd8RR5eMRZ7rNYAsaF9RPXAZoCrQ
>>>
>>>
>> baremetalnotificationapikey=ZWNcizzJ0xXQE0Ubr6Sr_kN7xlMMMMtziuPTxHwZOyIN-Lo2f2CzvPhNw0o01LkNP3X4bp61YiZu0EWF-Mbfew
>>> host=10.0.0.170
>>>
>>>
>> port=8080","enableHA":true,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"SlzaiXi9iLi3YpfQ7v3kZw","params":{},"uuid":"27157005-7e89-4251-89e4-2c53ff43bb70","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"9478a811-8b96-4cfa-b6bf-1e09c3fecd39","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
>>>
>>>
>> 10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc
>>>
>>>
>> "}},"name":"ROOT-4","size":3145728000,"path":"dcc1ce80-4cd5-4f59-b063-34e2a93ed99a","volumeId":5,"vmName":"r-4-VM","accountId":2,"format":"VHD","provisioningType":"THIN","id":5,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"dcc1ce80-4cd5-4f59-b063-34e2a93ed99a","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"10.0.0.170","volumeSize":"3145728000"}}],"nics":[{"deviceId":2,"networkRateMbps":200,"defaultNic":true,"pxeDisable":true,"nicUuid":"9fbc00ea-599c-4455-a416-8e66986d9454","uuid":"8872476c-2fd1-4ed3-bfb1-c62efe2b6eab","ip":"10.0.0.174","netmask":"255.255.255.0","gateway":"10.0.0.1","mac":"06:a0:8a:00:00:09","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"mgmt"},{"deviceId":0,"networkRateMbps":200,"defaultNic":false,"pxeDisable":true,"nicUuid":"f38511fa-d2e8-4935-9fc4-74b2eea7621b","uuid":"2e97fcee-3d01-40d2-a624-376661747d0c","ip":"10.1.1.1","netmask":"255.255.255.0","mac":"02:00:4d:27:00:02","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://500","isolationUri":"vlan://500","isSecurityGroupEnabled":false,"name":"mgmt"},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"pxeDisable":true,"nicUuid":"5c6cd3fa-fddb-4ee0-bff2-87e5c04f8d81","uuid":"914b3b0d-541c-4c63-b331-3377672a824d","ip":"169.254.0.43","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:00:2b","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.0.0.171","executeInSequence":false,"wait":0}},{"com.cloud.agent.api.check.CheckSshCommand":{"ip":"169.254.0.43","port":3922,"interval":6,"retries":100,"name":"r-4-VM","wait":0}},{"com.cloud.agent.api.GetDomRVersionCmd":{"accessDetails":{"
>>> router.name
>>>
>>>
>> ":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}},{},{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Start","accessDetails":{"router.guest.ip":"10.1.1.1","
>>> router.name
>>>
>>>
>> ":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}},{"com.cloud.agent.api.routing.IpAssocCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.0.0.174","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":true,"broadcastUri":"vlan://untagged","vlanGateway":"10.0.0.1","vlanNetmask":"255.255.255.0","vifMacAddress":"06:35:62:00:00:09","networkRate":200,"trafficType":"Public","networkName":"mgmt","newNic":false}],"accessDetails":{"zone.network.type":"Advanced","
>>> router.name
>>>
>>>
>> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.SetMonitorServiceCommand":{"services":[{"id":0,"service":"dhcp","processname":"dnsmasq","serviceName":"dnsmasq","servicePath":"/var/run/dnsmasq/dnsmasq.pid","pidFile":"/var/run/dnsmasq/dnsmasq.pid","isDefault":false},{"id":0,"service":"loadbalancing","processname":"haproxy","serviceName":"haproxy","servicePath":"/var/run/haproxy.pid","pidFile":"/var/run/haproxy.pid","isDefault":false},{"id":0,"service":"ssh","processname":"sshd","serviceName":"ssh","servicePath":"/var/run/sshd.pid","pidFile":"/var/run/sshd.pid","isDefault":true},{"id":0,"service":"webserver","processname":"apache2","serviceName":"apache2","servicePath":"/var/run/apache2.pid","pidFile":"/var/run/apache2.pid","isDefault":true}],"accessDetails":{"
>>> router.name
>>>
>>>
>> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Finish","accessDetails":{"router.guest.ip":"10.1.1.1","
>>> router.name":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}}] }
>>> 2015-11-26 20:21:58,255 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>> 4-8612571337392652838: Executing: { Cmd , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>
>>>
>> [{"com.cloud.agent.api.StartCommand":{"vm":{"id":4,"name":"r-4-VM","bootloader":"PyGrub","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":268435456,"maxRam":268435456,"arch":"x86_64","os":"Debian
>>> GNU/Linux 7(64-bit)","platformEmulator":"Debian Wheezy 7.0
>>> (64-bit)","bootArgs":" template=domP name=r-4-VM eth2ip=10.0.0.174
>>> eth2mask=255.255.255.0 gateway=10.0.0.1 eth0ip=10.1.1.1
>>> eth0mask=255.255.255.0 domain=cs2cloud.internal cidrsize=24
>>> dhcprange=10.1.1.1 eth1ip=169.254.0.43 eth1mask=255.255.0.0 type=router
>>> disable_rp_filter=true dns1=8.8.8.8
>>>
>>>
>> baremetalnotificationsecuritykey=MD4bWVy5t0anMd4eq4UlKWj6cZTW4gFDMeDd0WR3H3BuAsrxVX28ShzvJgbd8RR5eMRZ7rNYAsaF9RPXAZoCrQ
>>>
>>>
>> baremetalnotificationapikey=ZWNcizzJ0xXQE0Ubr6Sr_kN7xlMMMMtziuPTxHwZOyIN-Lo2f2CzvPhNw0o01LkNP3X4bp61YiZu0EWF-Mbfew
>>> host=10.0.0.170
>>>
>>>
>> port=8080","enableHA":true,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"SlzaiXi9iLi3YpfQ7v3kZw","params":{},"uuid":"27157005-7e89-4251-89e4-2c53ff43bb70","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"9478a811-8b96-4cfa-b6bf-1e09c3fecd39","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
>>>
>>>
>> 10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc
>>>
>>>
>> "}},"name":"ROOT-4","size":3145728000,"path":"dcc1ce80-4cd5-4f59-b063-34e2a93ed99a","volumeId":5,"vmName":"r-4-VM","accountId":2,"format":"VHD","provisioningType":"THIN","id":5,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"dcc1ce80-4cd5-4f59-b063-34e2a93ed99a","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"10.0.0.170","volumeSize":"3145728000"}}],"nics":[{"deviceId":2,"networkRateMbps":200,"defaultNic":true,"pxeDisable":true,"nicUuid":"9fbc00ea-599c-4455-a416-8e66986d9454","uuid":"8872476c-2fd1-4ed3-bfb1-c62efe2b6eab","ip":"10.0.0.174","netmask":"255.255.255.0","gateway":"10.0.0.1","mac":"06:a0:8a:00:00:09","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"mgmt"},{"deviceId":0,"networkRateMbps":200,"defaultNic":false,"pxeDisable":true,"nicUuid":"f38511fa-d2e8-4935-9fc4-74b2eea7621b","uuid":"2e97fcee-3d01-40d2-a624-376661747d0c","ip":"10.1.1.1","netmask":"255.255.255.0","mac":"02:00:4d:27:00:02","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://500","isolationUri":"vlan://500","isSecurityGroupEnabled":false,"name":"mgmt"},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"pxeDisable":true,"nicUuid":"5c6cd3fa-fddb-4ee0-bff2-87e5c04f8d81","uuid":"914b3b0d-541c-4c63-b331-3377672a824d","ip":"169.254.0.43","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:00:2b","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.0.0.171","executeInSequence":false,"wait":0}},{"com.cloud.agent.api.check.CheckSshCommand":{"ip":"169.254.0.43","port":3922,"interval":6,"retries":100,"name":"r-4-VM","wait":0}},{"com.cloud.agent.api.GetDomRVersionCmd":{"accessDetails":{"
>>> router.name
>>>
>>>
>> ":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}},{},{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Start","accessDetails":{"router.guest.ip":"10.1.1.1","
>>> router.name
>>>
>>>
>> ":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}},{"com.cloud.agent.api.routing.IpAssocCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.0.0.174","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":true,"broadcastUri":"vlan://untagged","vlanGateway":"10.0.0.1","vlanNetmask":"255.255.255.0","vifMacAddress":"06:35:62:00:00:09","networkRate":200,"trafficType":"Public","networkName":"mgmt","newNic":false}],"accessDetails":{"zone.network.type":"Advanced","
>>> router.name
>>>
>>>
>> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.SetMonitorServiceCommand":{"services":[{"id":0,"service":"dhcp","processname":"dnsmasq","serviceName":"dnsmasq","servicePath":"/var/run/dnsmasq/dnsmasq.pid","pidFile":"/var/run/dnsmasq/dnsmasq.pid","isDefault":false},{"id":0,"service":"loadbalancing","processname":"haproxy","serviceName":"haproxy","servicePath":"/var/run/haproxy.pid","pidFile":"/var/run/haproxy.pid","isDefault":false},{"id":0,"service":"ssh","processname":"sshd","serviceName":"ssh","servicePath":"/var/run/sshd.pid","pidFile":"/var/run/sshd.pid","isDefault":true},{"id":0,"service":"webserver","processname":"apache2","serviceName":"apache2","servicePath":"/var/run/apache2.pid","pidFile":"/var/run/apache2.pid","isDefault":true}],"accessDetails":{"
>>> router.name
>>>
>>>
>> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Finish","accessDetails":{"router.guest.ip":"10.1.1.1","
>>> router.name":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}}] }
>>> 2015-11-26 20:21:58,256 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-69:ctx-a18e64d5) Seq 4-8612571337392652838: Executing
>> request
>>> 2015-11-26 20:21:58,263 DEBUG [c.c.h.x.r.w.x.CitrixStartCommandWrapper]
>>> (DirectAgent-69:ctx-a18e64d5) 1. The VM r-4-VM is in Starting state.
>>> 2015-11-26 20:21:58,292 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-69:ctx-a18e64d5) Created VM
>>> 0d0fa28c-0513-b806-84fd-c528dfc1dbfb for r-4-VM
>>> 2015-11-26 20:21:58,298 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-69:ctx-a18e64d5) PV args are -- quiet
>>>
>>>
>> console=hvc0%template=domP%name=r-4-VM%eth2ip=10.0.0.174%eth2mask=255.255.255.0%gateway=10.0.0.1%eth0ip=10.1.1.1%eth0mask=255.255.255.0%domain=cs2cloud.internal%cidrsize=24%dhcprange=10.1.1.1%eth1ip=169.254.0.43%eth1mask=255.255.0.0%type=router%disable_rp_filter=true%dns1=8.8.8.8%baremetalnotificationsecuritykey=MD4bWVy5t0anMd4eq4UlKWj6cZTW4gFDMeDd0WR3H3BuAsrxVX28ShzvJgbd8RR5eMRZ7rNYAsaF9RPXAZoCrQ%baremetalnotificationapikey=ZWNcizzJ0xXQE0Ubr6Sr_kN7xlMMMMtziuPTxHwZOyIN-Lo2f2CzvPhNw0o01LkNP3X4bp61YiZu0EWF-Mbfew%host=10.0.0.170%port=8080
>>> 2015-11-26 20:21:58,325 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-69:ctx-a18e64d5) VBD 11a8fbfd-fd97-18bc-1490-e088576f26e7
>>> created for com.cloud.agent.api.to.DiskTO@2578f349
>>> 2015-11-26 20:21:58,325 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-69:ctx-a18e64d5) Creating VIF for r-4-VM on nic
>>> [Nic:Public-10.0.0.174-vlan://untagged]
>>> 2015-11-26 20:21:58,327 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-69:ctx-a18e64d5) Looking for network named mgmt
>>> 2015-11-26 20:21:58,334 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-69:ctx-a18e64d5) Created a vif
>>> b7ad658b-483c-a442-cb04-02b2a54bfbc8 on 2
>>> 2015-11-26 20:21:58,334 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-69:ctx-a18e64d5) Creating VIF for r-4-VM on nic
>>> [Nic:Guest-10.1.1.1-vlan://500]
>>> 2015-11-26 20:21:58,335 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-69:ctx-a18e64d5) Looking for network named mgmt
>>> 2015-11-26 20:21:58,341 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-69:ctx-a18e64d5) Couldn't find vlan network with the new
>> name
>>> so trying old name: VLAN500
>>> 2015-11-26 20:21:58,342 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-69:ctx-a18e64d5) Creating VLAN network for 500 on host
>>> 10.0.0.171
>>> 2015-11-26 20:21:58,349 DEBUG [c.c.h.x.r.XsLocalNetwork]
>>> (DirectAgent-69:ctx-a18e64d5) Found a network called mgmt on
>>> host=10.0.0.171; Network=1a561762-42f8-4907-9cc2-c90e69fc3a4d;
>>> pif=ebede886-b90c-4605-dcef-5b24824b154b
>>> 2015-11-26 20:21:58,352 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-69:ctx-a18e64d5) Creating VLAN 500 on host 10.0.0.171 on
>>> device eth0
>>> 2015-11-26 20:21:58,664 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-69:ctx-a18e64d5) VLAN is created for 500. The uuid is
>>> 4cf68d23-f831-273a-27a6-7639dadf3d04
>>> 2015-11-26 20:21:58,669 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-69:ctx-a18e64d5) Created a vif
>>> c21979e3-f425-6c92-24cb-356cfbdd3320 on 0
>>> 2015-11-26 20:21:58,669 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-69:ctx-a18e64d5) Creating VIF for r-4-VM on nic
>>> [Nic:Control-169.254.0.43-null]
>>> 2015-11-26 20:21:58,683 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-69:ctx-a18e64d5) already have a vif on dom0 for link local
>>> network
>>> 2015-11-26 20:21:58,787 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-69:ctx-a18e64d5) Created a vif
>>> 990f4458-ecb6-434f-2930-73b1e6d42e8c on 1
>>> 2015-11-26 20:21:59,092 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-13:ctx-2798b9c4) ===START=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549584411
>>> 2015-11-26 20:21:59,103 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-13:ctx-2798b9c4 ctx-c2ce3a57) ===END=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549584411
>>> 2015-11-26 20:22:02,111 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-14:ctx-38676bd6) ===START=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549587414
>>> 2015-11-26 20:22:02,124 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-14:ctx-38676bd6 ctx-947b14ea) ===END=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549587414
>>> 2015-11-26 20:22:02,803 DEBUG [c.c.h.x.r.w.x.CitrixStartCommandWrapper]
>>> (DirectAgent-69:ctx-a18e64d5) 2. The VM r-4-VM is in Running state.
>>> 2015-11-26 20:22:02,807 DEBUG
>> [c.c.h.x.r.w.x.CitrixCheckSshCommandWrapper]
>>> (DirectAgent-69:ctx-a18e64d5) Ping command port, 169.254.0.43:3922
>>> 2015-11-26 20:22:02,809 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-69:ctx-a18e64d5) Trying to connect to 169.254.0.43 attempt 0
>>> of 100
>>> 2015-11-26 20:22:04,361 DEBUG [o.a.c.s.SecondaryStorageManagerImpl]
>>> (secstorage-1:ctx-2215d989) Zone 3 is ready to launch secondary storage
>> VM
>>> 2015-11-26 20:22:04,681 DEBUG [c.c.c.ConsoleProxyManagerImpl]
>>> (consoleproxy-1:ctx-2ce987bc) Zone 3 is ready to launch console proxy
>>> 2015-11-26 20:22:05,104 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-15:ctx-4fa06d24) ===START=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549590422
>>> 2015-11-26 20:22:05,116 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-15:ctx-4fa06d24 ctx-19dff864) ===END=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549590422
>>> 2015-11-26 20:22:06,962 DEBUG [c.c.a.m.AgentManagerImpl]
>>> (AgentManager-Handler-14:null) SeqA 5-1783: Processing Seq 5-1783: {
>> Cmd ,
>>> MgmtId: -1, via: 5, Ver: v1, Flags: 11,
>>>
>>>
>> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
>>> \"connections\": []\n}","wait":0}}] }
>>> 2015-11-26 20:22:06,968 DEBUG [c.c.a.m.AgentManagerImpl]
>>> (AgentManager-Handler-14:null) SeqA 5-1783: Sending Seq 5-1783: { Ans: ,
>>> MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
>>> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
>>> 2015-11-26 20:22:08,018 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (AsyncJobMgr-Heartbeat-1:ctx-5e29ee49) Begin cleanup expired async-jobs
>>> 2015-11-26 20:22:08,022 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (AsyncJobMgr-Heartbeat-1:ctx-5e29ee49) End cleanup expired async-jobs
>>> 2015-11-26 20:22:08,103 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-17:ctx-9917fe4e) ===START=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549593422
>>> 2015-11-26 20:22:08,114 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-17:ctx-9917fe4e ctx-bfd32cd5) ===END=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549593422
>>> 2015-11-26 20:22:11,103 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-12:ctx-88343d26) ===START=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549596422
>>> 2015-11-26 20:22:11,113 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-12:ctx-88343d26 ctx-6f3d43d4) ===END=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549596422
>>> 2015-11-26 20:22:14,215 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-16:ctx-725778e3) ===START=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549599535
>>> 2015-11-26 20:22:14,234 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-16:ctx-725778e3 ctx-dd88dc8f) ===END=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549599535
>>> 2015-11-26 20:22:15,885 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-69:ctx-a18e64d5) Trying to connect to 169.254.0.43 attempt 1
>>> of 100
>>> 2015-11-26 20:22:16,964 DEBUG [c.c.a.m.AgentManagerImpl]
>>> (AgentManager-Handler-3:null) SeqA 5-1784: Processing Seq 5-1784: { Cmd
>> ,
>>> MgmtId: -1, via: 5, Ver: v1, Flags: 11,
>>>
>>>
>> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
>>> \"connections\": []\n}","wait":0}}] }
>>> 2015-11-26 20:22:16,967 DEBUG [c.c.a.m.AgentManagerImpl]
>>> (AgentManager-Handler-3:null) SeqA 5-1784: Sending Seq 5-1784: { Ans: ,
>>> MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
>>> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
>>> 2015-11-26 20:22:17,215 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-18:ctx-60f98a31) ===START=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549602535
>>> 2015-11-26 20:22:17,225 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-18:ctx-60f98a31 ctx-d1134f47) ===END=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549602535
>>> 2015-11-26 20:22:17,995 DEBUG [c.c.s.StatsCollector]
>>> (StatsCollector-3:ctx-98795072) StorageCollector is running...
>>> 2015-11-26 20:22:18,018 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (AsyncJobMgr-Heartbeat-1:ctx-d66f35e7) Begin cleanup expired async-jobs
>>> 2015-11-26 20:22:18,020 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (AsyncJobMgr-Heartbeat-1:ctx-d66f35e7) End cleanup expired async-jobs
>>> 2015-11-26 20:22:18,050 DEBUG [c.c.a.t.Request]
>>> (StatsCollector-3:ctx-98795072) Seq 6-2074470578357534957: Received: {
>>> Ans: , MgmtId: 52229922654, via: 6(s-2-VM), Ver: v1, Flags: 10, {
>>> GetStorageStatsAnswer } }
>>> 2015-11-26 20:22:18,051 DEBUG [c.c.h.XenServerGuru]
>>> (StatsCollector-3:ctx-98795072) getCommandHostDelegation: class
>>> com.cloud.agent.api.GetStorageStatsCommand
>>> 2015-11-26 20:22:18,052 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-275:ctx-69cd6660) Seq 4-8612571337392652839: Executing
>> request
>>> 2015-11-26 20:22:18,210 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (RouterStatusMonitor-1:ctx-e533ad2d) Found 1 routers to update status.
>>> 2015-11-26 20:22:18,212 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (RouterStatusMonitor-1:ctx-e533ad2d) Found 0 VPC networks to update
>>> Redundant State.
>>> 2015-11-26 20:22:18,213 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (RouterStatusMonitor-1:ctx-e533ad2d) Found 0 networks to update RvR
>> status.
>>> 2015-11-26 20:22:18,223 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (RouterStatusMonitor-1:ctx-ce59a463) Found 1 routers to update status.
>>> 2015-11-26 20:22:18,224 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (RouterStatusMonitor-1:ctx-ce59a463) Found 0 VPC networks to update
>>> Redundant State.
>>> 2015-11-26 20:22:18,225 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (RouterStatusMonitor-1:ctx-ce59a463) Found 0 networks to update RvR
>> status.
>>> 2015-11-26 20:22:18,378 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-275:ctx-69cd6660) Seq 4-8612571337392652839: Response
>>> Received:
>>> 2015-11-26 20:22:18,379 DEBUG [c.c.a.t.Request]
>>> (StatsCollector-3:ctx-98795072) Seq 4-8612571337392652839: Received: {
>>> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10, {
>>> GetStorageStatsAnswer } }
>>> 2015-11-26 20:22:20,215 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-22:ctx-c6c73f9b) ===START=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549605535
>>> 2015-11-26 20:22:20,225 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-22:ctx-c6c73f9b ctx-135e3cc8) ===END=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549605535
>>> 2015-11-26 20:22:21,593 DEBUG [c.c.a.m.AgentManagerImpl]
>>> (AgentManager-Handler-2:null) Ping from 6
>>> 2015-11-26 20:22:21,679 DEBUG [c.c.a.m.AgentManagerImpl]
>>> (AgentManager-Handler-5:null) Ping from 5
>>> 2015-11-26 20:22:23,216 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-19:ctx-db19c3ed) ===START=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549608535
>>> 2015-11-26 20:22:23,227 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-19:ctx-db19c3ed ctx-846db858) ===END=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549608535
>>> 2015-11-26 20:22:24,782 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgentCronJob-79:ctx-8c839142) Ping from 4(xenserver)
>>> 2015-11-26 20:22:24,782 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
>>> (DirectAgentCronJob-79:ctx-8c839142) Process host VM state report from
>> ping
>>> process. host: 4
>>> 2015-11-26 20:22:24,785 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
>>> (DirectAgentCronJob-79:ctx-8c839142) Process VM state report. host: 4,
>>> number of records in report: 3
>>> 2015-11-26 20:22:24,785 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
>>> (DirectAgentCronJob-79:ctx-8c839142) VM state report. host: 4, vm id: 1,
>>> power state: PowerOn
>>> 2015-11-26 20:22:24,786 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
>>> (DirectAgentCronJob-79:ctx-8c839142) VM power state does not change, skip
>>> DB writing. vm id: 1
>>> 2015-11-26 20:22:24,786 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
>>> (DirectAgentCronJob-79:ctx-8c839142) VM state report. host: 4, vm id: 2,
>>> power state: PowerOn
>>> 2015-11-26 20:22:24,787 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
>>> (DirectAgentCronJob-79:ctx-8c839142) VM power state does not change, skip
>>> DB writing. vm id: 2
>>> 2015-11-26 20:22:24,787 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
>>> (DirectAgentCronJob-79:ctx-8c839142) VM state report. host: 4, vm id: 4,
>>> power state: PowerOn
>>> 2015-11-26 20:22:24,788 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
>>> (DirectAgentCronJob-79:ctx-8c839142) VM power state does not change, skip
>>> DB writing. vm id: 4
>>> 2015-11-26 20:22:24,790 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
>>> (DirectAgentCronJob-79:ctx-8c839142) Run missing VM report. current time:
>>> 1448549544790
>>> 2015-11-26 20:22:24,791 WARN [c.c.v.VirtualMachinePowerStateSyncImpl]
>>> (DirectAgentCronJob-79:ctx-8c839142) VM state was updated but update time
>>> is null?! vm id: 5
>>> 2015-11-26 20:22:24,794 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
>>> (DirectAgentCronJob-79:ctx-8c839142) Detected missing VM. host: 4, vm id:
>>> 5, power state: PowerReportMissing, last state update: 1448549544790
>>> 2015-11-26 20:22:24,794 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
>>> (DirectAgentCronJob-79:ctx-8c839142) vm id: 5 - time since last state
>>> update(0ms) has not passed graceful period yet
>>> 2015-11-26 20:22:24,794 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
>>> (DirectAgentCronJob-79:ctx-8c839142) Done with process of VM state
>> report.
>>> host: 4
>>> 2015-11-26 20:22:25,994 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-69:ctx-a18e64d5) Trying to connect to 169.254.0.43 attempt 2
>>> of 100
>>> 2015-11-26 20:22:26,110 DEBUG
>> [c.c.h.x.r.w.x.CitrixCheckSshCommandWrapper]
>>> (DirectAgent-69:ctx-a18e64d5) Ping command port succeeded for vm r-4-VM
>>> 2015-11-26 20:22:26,111 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-69:ctx-a18e64d5) Executing command in VR:
>>> /opt/cloud/bin/router_proxy.sh get_template_version.sh 169.254.0.43 null
>>> 2015-11-26 20:22:26,246 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-20:ctx-06bd0169) ===START=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549611535
>>> 2015-11-26 20:22:26,271 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-20:ctx-06bd0169 ctx-3118df18) ===END=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549611535
>>> 2015-11-26 20:22:26,389 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-69:ctx-a18e64d5) Executing command in VR:
>>> /opt/cloud/bin/router_proxy.sh netusage.sh 169.254.0.43 -c
>>> 2015-11-26 20:22:26,677 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-69:ctx-a18e64d5) Looking for network named mgmt
>>> 2015-11-26 20:22:26,692 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>> (DirectAgent-69:ctx-a18e64d5) Transforming
>>> com.cloud.agent.api.routing.IpAssocCommand to ConfigItems
>>> 2015-11-26 20:22:26,692 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>> (DirectAgent-69:ctx-a18e64d5) Transforming
>>> com.cloud.agent.api.routing.SetMonitorServiceCommand to ConfigItems
>>> 2015-11-26 20:22:26,695 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-69:ctx-a18e64d5) Copying VR with ip 169.254.0.43 config file
>>> into host 10.0.0.171
>>> 2015-11-26 20:22:26,964 DEBUG [c.c.a.m.AgentManagerImpl]
>>> (AgentManager-Handler-6:null) SeqA 5-1786: Processing Seq 5-1786: { Cmd
>> ,
>>> MgmtId: -1, via: 5, Ver: v1, Flags: 11,
>>>
>>>
>> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
>>> \"connections\": []\n}","wait":0}}] }
>>> 2015-11-26 20:22:26,966 DEBUG [c.c.a.m.AgentManagerImpl]
>>> (AgentManager-Handler-6:null) SeqA 5-1786: Sending Seq 5-1786: { Ans: ,
>>> MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
>>> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
>>> 2015-11-26 20:22:27,075 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-69:ctx-a18e64d5) VR Config file
>>> VR-d0244a1d-2334-4771-868b-2910b7a8c359.cfg got created in VR, ip
>>> 169.254.0.43 with content
>>> #Apache CloudStack Virtual Router Config File
>>> <version>
>>> 1.0
>>> </version>
>>> <file>
>>> /var/cache/cloud/ip_associations.json
>>>
>>>
>> {"ip_address":[{"public_ip":"10.0.0.174","source_nat":true,"add":true,"one_to_one_nat":false,"first_i_p":true,"gateway":"10.0.0.1","netmask":"255.255.255.0","vif_mac_address":"06:35:62:00:00:09","nic_dev_id":2,"new_nic":false}],"type":"ips"}
>>> </file>
>>> <script>
>>> /opt/cloud/bin/update_config.py ip_associations.json
>>> </script>
>>> <file>
>>> /var/cache/cloud/monitor_service.json
>>>
>>>
>> {"config":"[dhcp]:processname=dnsmasq:servicename=dnsmasq:pidfile=/var/run/dnsmasq/dnsmasq.pid:,[loadbalancing]:processname=haproxy:servicename=haproxy:pidfile=/var/run/haproxy.pid:,[ssh]:processname=sshd:servicename=ssh:pidfile=/var/run/sshd.pid:,[webserver]:processname=apache2:servicename=apache2:pidfile=/var/run/apache2.pid:,","type":"monitorservice"}
>>> </file>
>>> <script>
>>> /opt/cloud/bin/update_config.py monitor_service.json
>>> </script>
>>>
>>> 2015-11-26 20:22:27,075 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-69:ctx-a18e64d5) Executing command in VR:
>>> /opt/cloud/bin/router_proxy.sh vr_cfg.sh 169.254.0.43 -c
>>> /var/cache/cloud/VR-d0244a1d-2334-4771-868b-2910b7a8c359.cfg
>>> 2015-11-26 20:22:28,018 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (AsyncJobMgr-Heartbeat-1:ctx-ed233495) Begin cleanup expired async-jobs
>>> 2015-11-26 20:22:28,021 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (AsyncJobMgr-Heartbeat-1:ctx-ed233495) End cleanup expired async-jobs
>>> 2015-11-26 20:22:29,218 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-21:ctx-1da30083) ===START=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549614535
>>> 2015-11-26 20:22:29,235 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-21:ctx-1da30083 ctx-605fe303) ===END=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549614535
>>> 2015-11-26 20:22:32,250 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-7:ctx-63ad70cb) ===START=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549617569
>>> 2015-11-26 20:22:32,277 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-7:ctx-63ad70cb ctx-3f0ef7d5) ===END=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549617569
>>> 2015-11-26 20:22:32,387 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-69:ctx-a18e64d5) Seq 4-8612571337392652838: Response
>> Received:
>>> 2015-11-26 20:22:32,388 DEBUG [c.c.a.t.Request]
>>> (DirectAgent-69:ctx-a18e64d5) Seq 4-8612571337392652838: Processing: {
>>> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
>>>
>>>
>> [{"com.cloud.agent.api.StartAnswer":{"vm":{"id":4,"name":"r-4-VM","bootloader":"PyGrub","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":268435456,"maxRam":268435456,"arch":"x86_64","os":"Debian
>>> GNU/Linux 7(64-bit)","platformEmulator":"Debian Wheezy 7.0
>>> (64-bit)","bootArgs":" template=domP name=r-4-VM eth2ip=10.0.0.174
>>> eth2mask=255.255.255.0 gateway=10.0.0.1 eth0ip=10.1.1.1
>>> eth0mask=255.255.255.0 domain=cs2cloud.internal cidrsize=24
>>> dhcprange=10.1.1.1 eth1ip=169.254.0.43 eth1mask=255.255.0.0 type=router
>>> disable_rp_filter=true dns1=8.8.8.8
>>>
>>>
>> baremetalnotificationsecuritykey=MD4bWVy5t0anMd4eq4UlKWj6cZTW4gFDMeDd0WR3H3BuAsrxVX28ShzvJgbd8RR5eMRZ7rNYAsaF9RPXAZoCrQ
>>>
>>>
>> baremetalnotificationapikey=ZWNcizzJ0xXQE0Ubr6Sr_kN7xlMMMMtziuPTxHwZOyIN-Lo2f2CzvPhNw0o01LkNP3X4bp61YiZu0EWF-Mbfew
>>> host=10.0.0.170
>>>
>>>
>> port=8080","enableHA":true,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"SlzaiXi9iLi3YpfQ7v3kZw","params":{},"uuid":"27157005-7e89-4251-89e4-2c53ff43bb70","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"9478a811-8b96-4cfa-b6bf-1e09c3fecd39","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
>>>
>>>
>> 10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc
>>>
>> "}},"name":"ROOT-4","size":3145728000,"path":"dcc1ce80-4cd5-4f59-b063-34e2a93ed99a","volumeId":5,"vmName":"r-4-VM","accountId":2,"format":"VHD","provisioningType":"THIN","id":5,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"dcc1ce80-4cd5-4f59-b063-34e2a93ed99a","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"10.0.0.170","volumeSize":"3145728000"}}],"nics":[{"deviceId":2,"networkRateMbps":200,"defaultNic":true,"pxeDisable":true,"nicUuid":"9fbc00ea-599c-4455-a416-8e66986d9454","uuid":"8872476c-2fd1-4ed3-bfb1-c62efe2b6eab","ip":"10.0.0.174","netmask":"255.255.255.0","gateway":"10.0.0.1","mac":"06:a0:8a:00:00:09","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"mgmt"},{"deviceId":0,"networkRateMbps":200,"defaultNic":false,"pxeDisable":true,"nicUuid":"f38511fa-d2e8-4935-9fc4-74b2eea7621b","uuid":"2e97fcee-3d01-40d2-a624-376661747d0c","ip":"10.1.1.1","netmask":"255.255.255.0","mac":"02:00:4d:27:00:02","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://500","isolationUri":"vlan://500","isSecurityGroupEnabled":false,"name":"mgmt"},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"pxeDisable":true,"nicUuid":"5c6cd3fa-fddb-4ee0-bff2-87e5c04f8d81","uuid":"914b3b0d-541c-4c63-b331-3377672a824d","ip":"169.254.0.43","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:00:2b","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"_iqnToPath":{},"result":true,"wait":0}},{"com.cloud.agent.api.check.CheckSshAnswer":{"result":true,"wait":0}},{"com.cloud.agent.api.GetDomRVersionAnswer":{"templateVersion":"Cloudstack
>>> Release 4.6.0 Mon Nov 9 11:21:06 UTC
>>>
>>>
>> 2015","scriptsVersion":"4042f3d5b3337372cf94955f2ae8a149\n","result":true,"details":"Cloudstack
>>> Release 4.6.0 Mon Nov 9 11:21:06 UTC
>>>
>>>
>> 2015&4042f3d5b3337372cf94955f2ae8a149\n","wait":0}},{"com.cloud.agent.api.NetworkUsageAnswer":{"routerName":"r-4-VM","bytesSent":0,"bytesReceived":0,"result":true,"details":"","wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"details":"Command
>>> aggregation
>>>
>>>
>> started","wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"details":"Command
>>> aggregation finished","wait":0}}] }
>>> 2015-11-26 20:22:32,389 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>> 4-8612571337392652838: Received: { Ans: , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 10, { StartAnswer, CheckSshAnswer,
>>> GetDomRVersionAnswer, NetworkUsageAnswer, Answer, Answer, Answer, Answer
>> }
>>> }
>>> 2015-11-26 20:22:32,405 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM state
>>> transitted from :Starting to Running with event: OperationSucceededvm's
>>> original host id: 4 new host id: 4 host id before state transition: 4
>>> 2015-11-26 20:22:32,408 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Start
>>> completed for VM VM[DomainRouter|r-4-VM]
>>> 2015-11-26 20:22:32,412 DEBUG [c.c.n.NetworkModelImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
>>> SecurityGroup is not supported in the network id=212
>>> 2015-11-26 20:22:32,417 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>> 4-8612571337392652840: Sending { Cmd , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>
>>>
>> [{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Start","accessDetails":{"router.guest.ip":"10.1.1.1","
>>> router.name":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}}] }
>>> 2015-11-26 20:22:32,418 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>> 4-8612571337392652840: Executing: { Cmd , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>
>>>
>> [{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Start","accessDetails":{"router.guest.ip":"10.1.1.1","
>>> router.name":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}}] }
>>> 2015-11-26 20:22:32,418 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-138:ctx-d5c945c8) Seq 4-8612571337392652840: Executing
>> request
>>> 2015-11-26 20:22:32,418 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-138:ctx-d5c945c8) Seq 4-8612571337392652840: Response
>>> Received:
>>> 2015-11-26 20:22:32,418 DEBUG [c.c.a.t.Request]
>>> (DirectAgent-138:ctx-d5c945c8) Seq 4-8612571337392652840: Processing: {
>>> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
>>> [{"com.cloud.agent.api.Answer":{"result":true,"details":"Command
>>> aggregation started","wait":0}}] }
>>> 2015-11-26 20:22:32,418 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>> 4-8612571337392652840: Received: { Ans: , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 10, { Answer } }
>>> 2015-11-26 20:22:32,418 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>> Reprogramming
>>> network Ntwk[212|Guest|8] as a part of network implement
>>> 2015-11-26 20:22:32,419 DEBUG [c.c.n.f.FirewallManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) applying
>>> default firewall egress rules
>>> 2015-11-26 20:22:32,425 DEBUG [o.a.c.n.t.BasicNetworkTopology]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) APPLYING
>>> FIREWALL RULES
>>> 2015-11-26 20:22:32,425 DEBUG [o.a.c.n.t.BasicNetworkTopology]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Applying
>>> firewall rules in network Ntwk[212|Guest|8]
>>> 2015-11-26 20:22:32,430 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>> 4-8612571337392652841: Sending { Cmd , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 100001,
>>>
>>>
>> [{"com.cloud.agent.api.routing.SetFirewallRulesCommand":{"rules":[{"id":0,"srcIp":"","protocol":"all","revoked":false,"alreadyAdded":false,"sourceCidrList":[],"purpose":"Firewall","trafficType":"Egress","defaultEgressPolicy":false}],"accessDetails":{"router.guest.ip":"10.1.1.1","firewall.egress.default":"System","zone.network.type":"Advanced","router.ip":"169.254.0.43","
>>> router.name":"r-4-VM"},"wait":0}}] }
>>> 2015-11-26 20:22:32,430 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>> 4-8612571337392652841: Executing: { Cmd , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 100001,
>>>
>>>
>> [{"com.cloud.agent.api.routing.SetFirewallRulesCommand":{"rules":[{"id":0,"srcIp":"","protocol":"all","revoked":false,"alreadyAdded":false,"sourceCidrList":[],"purpose":"Firewall","trafficType":"Egress","defaultEgressPolicy":false}],"accessDetails":{"router.guest.ip":"10.1.1.1","firewall.egress.default":"System","zone.network.type":"Advanced","router.ip":"169.254.0.43","
>>> router.name":"r-4-VM"},"wait":0}}] }
>>> 2015-11-26 20:22:32,430 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-276:ctx-9bb810d3) Seq 4-8612571337392652841: Executing
>> request
>>> 2015-11-26 20:22:32,430 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-276:ctx-9bb810d3) Seq 4-8612571337392652841: Response
>>> Received:
>>> 2015-11-26 20:22:32,430 DEBUG [c.c.a.t.Request]
>>> (DirectAgent-276:ctx-9bb810d3) Seq 4-8612571337392652841: Processing: {
>>> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 0,
>>> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
>>> 2015-11-26 20:22:32,430 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>> 4-8612571337392652841: Received: { Ans: , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 0, { Answer } }
>>> 2015-11-26 20:22:32,432 DEBUG [c.c.n.f.FirewallManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are
>> no
>>> firewall rules to apply
>>> 2015-11-26 20:22:32,432 DEBUG [c.c.n.r.RulesManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are
>> no
>>> static nat to apply for network id=212
>>> 2015-11-26 20:22:32,432 DEBUG [c.c.n.f.FirewallManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are
>> no
>>> firewall rules to apply
>>> 2015-11-26 20:22:32,433 DEBUG [c.c.n.r.RulesManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are
>> no
>>> port forwarding rules to apply for network id=212
>>> 2015-11-26 20:22:32,433 DEBUG [c.c.n.r.RulesManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are
>> no
>>> static nat rules to apply for network id=212
>>> 2015-11-26 20:22:32,433 DEBUG [c.c.n.l.LoadBalancingRulesManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Applying
>> load
>>> balancer rules of scheme Public in network id=212
>>> 2015-11-26 20:22:32,434 DEBUG [c.c.n.l.LoadBalancingRulesManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are
>> no
>>> Load Balancing Rules to forward to the network elements
>>> 2015-11-26 20:22:32,434 DEBUG [c.c.n.l.LoadBalancingRulesManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Applying
>> load
>>> balancer rules of scheme Internal in network id=212
>>> 2015-11-26 20:22:32,434 DEBUG [c.c.n.l.LoadBalancingRulesManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are
>> no
>>> Load Balancing Rules to forward to the network elements
>>> 2015-11-26 20:22:32,435 DEBUG [c.c.n.NetworkModelImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
>>> SecurityGroup is not supported in the network id=212
>>> 2015-11-26 20:22:32,439 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>> 4-8612571337392652842: Sending { Cmd , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>
>>>
>> [{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Finish","accessDetails":{"router.guest.ip":"10.1.1.1","
>>> router.name":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}}] }
>>> 2015-11-26 20:22:32,439 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>> 4-8612571337392652842: Executing: { Cmd , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>
>>>
>> [{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Finish","accessDetails":{"router.guest.ip":"10.1.1.1","
>>> router.name":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}}] }
>>> 2015-11-26 20:22:32,439 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-70:ctx-436aff22) Seq 4-8612571337392652842: Executing
>> request
>>> 2015-11-26 20:22:32,439 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>> (DirectAgent-70:ctx-436aff22) Transforming
>>> com.cloud.agent.api.routing.SetFirewallRulesCommand to ConfigItems
>>> 2015-11-26 20:22:32,445 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-70:ctx-436aff22) Copying VR with ip 169.254.0.43 config file
>>> into host 10.0.0.171
>>> 2015-11-26 20:22:32,848 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-70:ctx-436aff22) VR Config file
>>> VR-a8dcb409-d150-4d21-b2c7-53b76dccedb3.cfg got created in VR, ip
>>> 169.254.0.43 with content
>>> #Apache CloudStack Virtual Router Config File
>>> <version>
>>> 1.0
>>> </version>
>>> <file>
>>> /var/cache/cloud/firewall_rules.json
>>>
>>>
>> {"rules":[{"id":0,"src_ip":"","protocol":"all","revoked":false,"already_added":false,"source_cidr_list":[],"purpose":"Firewall","traffic_type":"Egress","default_egress_policy":false}],"type":"firewallrules"}
>>> </file>
>>> <script>
>>> /opt/cloud/bin/update_config.py firewall_rules.json
>>> </script>
>>>
>>> 2015-11-26 20:22:32,849 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-70:ctx-436aff22) Executing command in VR:
>>> /opt/cloud/bin/router_proxy.sh vr_cfg.sh 169.254.0.43 -c
>>> /var/cache/cloud/VR-a8dcb409-d150-4d21-b2c7-53b76dccedb3.cfg
>>> 2015-11-26 20:22:33,458 DEBUG [c.c.s.StatsCollector]
>>> (StatsCollector-4:ctx-f3f3d8c7) AutoScaling Monitor is running...
>>> 2015-11-26 20:22:33,734 DEBUG [c.c.s.StatsCollector]
>>> (StatsCollector-2:ctx-bc3ff1c1) VmStatsCollector is running...
>>> 2015-11-26 20:22:34,354 DEBUG [o.a.c.s.SecondaryStorageManagerImpl]
>>> (secstorage-1:ctx-7f9c4728) Zone 3 is ready to launch secondary storage
>> VM
>>> 2015-11-26 20:22:34,681 DEBUG [c.c.c.ConsoleProxyManagerImpl]
>>> (consoleproxy-1:ctx-7ffdffac) Zone 3 is ready to launch console proxy
>>> 2015-11-26 20:22:35,261 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-23:ctx-032600be) ===START=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549620578
>>> 2015-11-26 20:22:35,273 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-23:ctx-032600be ctx-30e2f925) ===END=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549620578
>>> 2015-11-26 20:22:35,601 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-70:ctx-436aff22) Seq 4-8612571337392652842: Response
>> Received:
>>> 2015-11-26 20:22:35,601 DEBUG [c.c.a.t.Request]
>>> (DirectAgent-70:ctx-436aff22) Seq 4-8612571337392652842: Processing: {
>>> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
>>> [{"com.cloud.agent.api.Answer":{"result":true,"details":"Command
>>> aggregation finished","wait":0}}] }
>>> 2015-11-26 20:22:35,601 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>> 4-8612571337392652842: Received: { Ans: , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 10, { Answer } }
>>> 2015-11-26 20:22:35,609 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Lock is
>>> released for network id 212 as a part of network implement
>>> 2015-11-26 20:22:35,616 DEBUG [c.c.n.NetworkModelImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
>>> SecurityGroup is not supported in the network id=212
>>> 2015-11-26 20:22:35,618 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Changing
>>> active number of nics for network id=212 on 1
>>> 2015-11-26 20:22:35,621 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Asking
>>> VirtualRouter to prepare for
>>> Nic[11-5-2a4a184a-eac9-4609-8a70-4d230ee3a37d-10.1.1.88]
>>> 2015-11-26 20:22:35,630 DEBUG [c.c.n.NetworkModelImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
>>> SecurityGroup is not supported in the network id=212
>>> 2015-11-26 20:22:35,631 DEBUG [o.a.c.n.t.BasicNetworkTopology]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) CONFIG DHCP
>>> FOR SUBNETS RULES
>>> 2015-11-26 20:22:35,636 DEBUG [c.c.n.NetworkModelImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
>>> SecurityGroup is not supported in the network id=212
>>> 2015-11-26 20:22:35,637 DEBUG [o.a.c.n.t.AdvancedNetworkTopology]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) APPLYING
>> VPC
>>> DHCP ENTRY RULES
>>> 2015-11-26 20:22:35,637 DEBUG [o.a.c.n.t.BasicNetworkTopology]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Applying
>> dhcp
>>> entry in network Ntwk[212|Guest|8]
>>> 2015-11-26 20:22:35,665 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>> 4-8612571337392652843: Sending { Cmd , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>
>>>
>> [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:71:ff:00:03","vmIpAddress":"10.1.1.88","vmName":"Test002","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:71:ff:00:03","isDefault":true,"executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","router.guest.ip":"10.1.1.1","router.ip":"169.254.0.43","
>>> router.name":"r-4-VM"},"wait":0}}] }
>>> 2015-11-26 20:22:35,667 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>> 4-8612571337392652843: Executing: { Cmd , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>
>>>
>> [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:71:ff:00:03","vmIpAddress":"10.1.1.88","vmName":"Test002","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:71:ff:00:03","isDefault":true,"executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","router.guest.ip":"10.1.1.1","router.ip":"169.254.0.43","
>>> router.name":"r-4-VM"},"wait":0}}] }
>>> 2015-11-26 20:22:35,667 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-277:ctx-490bf746) Seq 4-8612571337392652843: Executing
>> request
>>> 2015-11-26 20:22:35,667 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>> (DirectAgent-277:ctx-490bf746) Transforming
>>> com.cloud.agent.api.routing.DhcpEntryCommand to ConfigItems
>>> 2015-11-26 20:22:35,672 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-277:ctx-490bf746) Copying VR with ip 169.254.0.43 config
>> file
>>> into host 10.0.0.171
>>> 2015-11-26 20:22:36,054 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-277:ctx-490bf746) VR Config file vm_dhcp_entry.json got
>>> created in VR, ip 169.254.0.43 with content
>>>
>>>
>> {"host_name":"Test002","mac_address":"02:00:71:ff:00:03","ipv4_adress":"10.1.1.88","ipv6_duid":"00:03:00:01:02:00:71:ff:00:03","dns_adresses":"10.1.1.1","default_gateway":"10.1.1.1","default_entry":true,"type":"dhcpentry"}
>>> 2015-11-26 20:22:36,054 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>> (DirectAgent-277:ctx-490bf746) Processing FileConfigItem, copying 222
>>> characters to vm_dhcp_entry.json took 387ms
>>> 2015-11-26 20:22:36,054 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-277:ctx-490bf746) Executing command in VR:
>>> /opt/cloud/bin/router_proxy.sh update_config.py 169.254.0.43
>>> vm_dhcp_entry.json
>>> 2015-11-26 20:22:36,965 DEBUG [c.c.a.m.AgentManagerImpl]
>>> (AgentManager-Handler-9:null) SeqA 5-1787: Processing Seq 5-1787: { Cmd
>> ,
>>> MgmtId: -1, via: 5, Ver: v1, Flags: 11,
>>>
>>>
>> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
>>> \"connections\": []\n}","wait":0}}] }
>>> 2015-11-26 20:22:36,969 DEBUG [c.c.a.m.AgentManagerImpl]
>>> (AgentManager-Handler-9:null) SeqA 5-1787: Sending Seq 5-1787: { Ans: ,
>>> MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
>>> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
>>> 2015-11-26 20:22:38,021 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (AsyncJobMgr-Heartbeat-1:ctx-a7e1fd79) Begin cleanup expired async-jobs
>>> 2015-11-26 20:22:38,023 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (AsyncJobMgr-Heartbeat-1:ctx-a7e1fd79) End cleanup expired async-jobs
>>> 2015-11-26 20:22:38,275 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-6:ctx-d344515b) ===START=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549623593
>>> 2015-11-26 20:22:38,288 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-6:ctx-d344515b ctx-ff44d35a) ===END=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549623593
>>> 2015-11-26 20:22:38,760 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>> (DirectAgent-277:ctx-490bf746) Processing ScriptConfigItem, executing
>>> update_config.py vm_dhcp_entry.json took 2706ms
>>> 2015-11-26 20:22:38,760 WARN [c.c.a.r.v.VirtualRoutingResource]
>>> (DirectAgent-277:ctx-490bf746) Expected 1 answers while executing
>>> DhcpEntryCommand but received 2
>>> 2015-11-26 20:22:38,760 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-277:ctx-490bf746) Seq 4-8612571337392652843: Response
>>> Received:
>>> 2015-11-26 20:22:38,760 DEBUG [c.c.a.t.Request]
>>> (DirectAgent-277:ctx-490bf746) Seq 4-8612571337392652843: Processing: {
>>> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
>>> [{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null - success:
>>> ","null - success: RTNETLINK answers: File exists\nRTNETLINK answers:
>> File
>>> exists\nRTNETLINK answers: File exists\n[INFO] update_config.py ::
>>> Processing incoming file => vm_dhcp_entry.json\n[INFO] Processing JSON
>> file
>>> vm_dhcp_entry.json\nTest01 Test002\n"],"result":true,"wait":0}}] }
>>> 2015-11-26 20:22:38,760 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>> 4-8612571337392652843: Received: { Ans: , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 10, { GroupAnswer } }
>>> 2015-11-26 20:22:38,766 DEBUG [c.c.n.NetworkModelImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
>>> SecurityGroup is not supported in the network id=212
>>> 2015-11-26 20:22:38,768 DEBUG [o.a.c.n.t.AdvancedNetworkTopology]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) APPLYING
>> VPC
>>> USERDATA RULES
>>> 2015-11-26 20:22:38,768 DEBUG [o.a.c.n.t.BasicNetworkTopology]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Applying
>>> userdata and password entry in network Ntwk[212|Guest|8]
>>> 2015-11-26 20:22:38,778 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>> 4-8612571337392652844: Sending { Cmd , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>
>>>
>> [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
>>> router.name
>>>
>>>
>> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
>>> router.name
>>>
>> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}}]
>>> }
>>> 2015-11-26 20:22:38,779 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>> 4-8612571337392652844: Executing: { Cmd , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>
>>>
>> [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
>>> router.name
>>>
>>>
>> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
>>> router.name
>>>
>> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}}]
>>> }
>>> 2015-11-26 20:22:38,779 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-139:ctx-69673506) Seq 4-8612571337392652844: Executing
>> request
>>> 2015-11-26 20:22:38,779 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>> (DirectAgent-139:ctx-69673506) Transforming
>>> com.cloud.agent.api.routing.SavePasswordCommand to ConfigItems
>>> 2015-11-26 20:22:38,787 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-139:ctx-69673506) Copying VR with ip 169.254.0.43 config
>> file
>>> into host 10.0.0.171
>>> 2015-11-26 20:22:39,199 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-139:ctx-69673506) VR Config file vm_password.json got
>> created
>>> in VR, ip 169.254.0.43 with content
>>>
>> {"ip_address":"10.1.1.88","password":"saved_password","type":"vmpassword"}
>>> 2015-11-26 20:22:39,199 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>> (DirectAgent-139:ctx-69673506) Processing FileConfigItem, copying 74
>>> characters to vm_password.json took 420ms
>>> 2015-11-26 20:22:39,199 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-139:ctx-69673506) Executing command in VR:
>>> /opt/cloud/bin/router_proxy.sh update_config.py 169.254.0.43
>>> vm_password.json
>>> 2015-11-26 20:22:40,237 DEBUG [c.c.s.StatsCollector]
>>> (StatsCollector-1:ctx-32277352) HostStatsCollector is running...
>>> 2015-11-26 20:22:40,245 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-278:ctx-dc01444e) Seq 4-8612571337392652845: Executing
>> request
>>> 2015-11-26 20:22:40,260 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-278:ctx-dc01444e) Seq 4-8612571337392652845: Response
>>> Received:
>>> 2015-11-26 20:22:40,260 DEBUG [c.c.a.t.Request]
>>> (StatsCollector-1:ctx-32277352) Seq 4-8612571337392652845: Received: {
>>> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10, {
>>> GetHostStatsAnswer } }
>>> 2015-11-26 20:22:40,263 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-18:ctx-53bf8c75) Seq 4-8612571337392652846: Executing
>> request
>>> 2015-11-26 20:22:40,273 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-18:ctx-53bf8c75) Seq 4-8612571337392652846: Response
>> Received:
>>> 2015-11-26 20:22:40,274 DEBUG [c.c.a.t.Request]
>>> (StatsCollector-1:ctx-32277352) Seq 4-8612571337392652846: Received: {
>>> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10, {
>>> GetGPUStatsAnswer } }
>>> 2015-11-26 20:22:41,275 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-4:ctx-f2410d29) ===START=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549626594
>>> 2015-11-26 20:22:41,287 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-4:ctx-f2410d29 ctx-f6f4a185) ===END=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549626594
>>> 2015-11-26 20:22:41,959 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>> (DirectAgent-139:ctx-69673506) Processing ScriptConfigItem, executing
>>> update_config.py vm_password.json took 2760ms
>>> 2015-11-26 20:22:41,959 WARN [c.c.a.r.v.VirtualRoutingResource]
>>> (DirectAgent-139:ctx-69673506) Expected 1 answers while executing
>>> SavePasswordCommand but received 2
>>> 2015-11-26 20:22:41,960 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>> (DirectAgent-139:ctx-69673506) Transforming
>>> com.cloud.agent.api.routing.VmDataCommand to ConfigItems
>>> 2015-11-26 20:22:41,964 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-139:ctx-69673506) Copying VR with ip 169.254.0.43 config
>> file
>>> into host 10.0.0.171
>>> 2015-11-26 20:22:42,370 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-139:ctx-69673506) VR Config file vm_metadata.json got
>> created
>>> in VR, ip 169.254.0.43 with content
>>>
>>>
>> {"vm_ip_address":"10.1.1.88","vm_metadata":[["userdata","user-data",null],["metadata","service-offering","Medium
>>>
>>>
>> Instance"],["metadata","availability-zone","TestZone"],["metadata","local-ipv4","10.1.1.88"],["metadata","local-hostname","Test002"],["metadata","public-ipv4","10.0.0.174"],["metadata","public-hostname","10.0.0.174"],["metadata","instance-id","4ce4731f-22a7-42ac-8e78-093d5f2e9a34"],["metadata","vm-id","4ce4731f-22a7-42ac-8e78-093d5f2e9a34"],["metadata","public-keys",null],["metadata","cloud-identifier","CloudStack-{de65e551-2e87-423b-90e6-03cd3eb706bb}"]],"type":"vmdata"}
>>> 2015-11-26 20:22:42,371 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>> (DirectAgent-139:ctx-69673506) Processing FileConfigItem, copying 589
>>> characters to vm_metadata.json took 411ms
>>> 2015-11-26 20:22:42,371 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-139:ctx-69673506) Executing command in VR:
>>> /opt/cloud/bin/router_proxy.sh update_config.py 169.254.0.43
>>> vm_metadata.json
>>> 2015-11-26 20:22:44,606 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-25:ctx-128f2f7a) ===START=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549629925
>>> 2015-11-26 20:22:44,619 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-25:ctx-128f2f7a ctx-291bcd97) ===END=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549629925
>>> 2015-11-26 20:22:45,153 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>> (DirectAgent-139:ctx-69673506) Processing ScriptConfigItem, executing
>>> update_config.py vm_metadata.json took 2782ms
>>> 2015-11-26 20:22:45,153 WARN [c.c.a.r.v.VirtualRoutingResource]
>>> (DirectAgent-139:ctx-69673506) Expected 1 answers while executing
>>> VmDataCommand but received 2
>>> 2015-11-26 20:22:45,153 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-139:ctx-69673506) Seq 4-8612571337392652844: Response
>>> Received:
>>> 2015-11-26 20:22:45,163 DEBUG [c.c.a.t.Request]
>>> (DirectAgent-139:ctx-69673506) Seq 4-8612571337392652844: Processing: {
>>> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
>>> [{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null - success:
>>> ","null - success: RTNETLINK answers: File exists\nRTNETLINK answers:
>> File
>>> exists\nRTNETLINK answers: File exists\n[INFO] update_config.py ::
>>> Processing incoming file => vm_password.json\n[INFO] Processing JSON file
>>>
>>>
>> vm_password.json\n"],"result":true,"wait":0}},{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null
>>> - success: ","null - success: RTNETLINK answers: File exists\nRTNETLINK
>>> answers: File exists\nRTNETLINK answers: File exists\n[INFO]
>>> update_config.py :: Processing incoming file => vm_metadata.json\n[INFO]
>>> Processing JSON file vm_metadata.json\n"],"result":true,"wait":0}}] }
>>> 2015-11-26 20:22:45,163 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>> 4-8612571337392652844: Received: { Ans: , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 10, { GroupAnswer, GroupAnswer } }
>>> 2015-11-26 20:22:45,164 DEBUG [c.c.n.NetworkModelImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
>>> SecurityGroup is not supported in the network id=212
>>> 2015-11-26 20:22:45,165 DEBUG [o.a.c.e.o.VolumeOrchestrator]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
>>> we need to prepare 2 volumes for VM[User|i-2-5-VM]
>>> 2015-11-26 20:22:45,168 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) template 5
>> is
>>> already in store:1, type:Image
>>> 2015-11-26 20:22:45,169 DEBUG [o.a.c.s.d.PrimaryDataStoreImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Not found
>>> (templateId:5poolId:8) in template_spool_ref, persisting it
>>> 2015-11-26 20:22:45,173 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) template 5
>> is
>>> already in store:8, type:Primary
>>> 2015-11-26 20:22:45,174 DEBUG [o.a.c.s.v.VolumeServiceImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found
>>> template centos56-x86_64-xen in storage pool 8 with VMTemplateStoragePool
>>> id: 3
>>> 2015-11-26 20:22:45,174 DEBUG [o.a.c.s.v.VolumeServiceImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Acquire
>> lock
>>> on VMTemplateStoragePool 3 with timeout 3600 seconds
>>> 2015-11-26 20:22:45,175 INFO [o.a.c.s.v.VolumeServiceImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) lock is
>>> acquired for VMTemplateStoragePool 3
>>> 2015-11-26 20:22:45,179 DEBUG [o.a.c.s.m.AncientDataMotionStrategy]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) copyAsync
>>> inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE
>>> 2015-11-26 20:22:45,182 DEBUG [c.c.h.XenServerGuru]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>> getCommandHostDelegation: class
>>> org.apache.cloudstack.storage.command.CopyCommand
>>> 2015-11-26 20:22:45,183 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>> 4-8612571337392652847: Sending { Cmd , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 100111,
>>>
>>>
>> [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/5/3986df71-b1d0-3e20-a655-7e42dd144370.vhd","origUrl":"
>>> http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
>>>
>> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
>>> 5.6(64-bit) no GUI
>>>
>>>
>> (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://
>>> 10.0.0.170/export/secondary
>>>
>>>
>> ","_role":"Image"}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"
>>> http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
>>>
>> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
>>> 5.6(64-bit) no GUI
>>>
>>>
>> (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
>>>
>>>
>> 10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc
>>>
>> "}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"executeInSequence":true,"options":{},"options2":{},"wait":10800}}]
>>> }
>>> 2015-11-26 20:22:45,184 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>> 4-8612571337392652847: Executing: { Cmd , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 100111,
>>>
>>>
>> [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/5/3986df71-b1d0-3e20-a655-7e42dd144370.vhd","origUrl":"
>>> http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
>>>
>> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
>>> 5.6(64-bit) no GUI
>>>
>>>
>> (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://
>>> 10.0.0.170/export/secondary
>>>
>>>
>> ","_role":"Image"}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"
>>> http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
>>>
>> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
>>> 5.6(64-bit) no GUI
>>>
>>>
>> (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
>>>
>>>
>> 10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc
>>>
>> "}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"executeInSequence":true,"options":{},"options2":{},"wait":10800}}]
>>> }
>>> 2015-11-26 20:22:45,184 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-279:ctx-532427fb) Seq 4-8612571337392652847: Executing
>> request
>>> 2015-11-26 20:22:46,489 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-279:ctx-532427fb) Host 10.0.0.171
>>> OpaqueRef:53354999-bf25-32b9-01df-a695a039ba8d: Removing SR
>>> 2015-11-26 20:22:46,500 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-279:ctx-532427fb) Host 10.0.0.171
>>> OpaqueRef:f33f27b6-88c3-8c94-c8b3-40c094d9e66d: Unplugging pbd
>>> 2015-11-26 20:22:46,598 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-279:ctx-532427fb) Host 10.0.0.171
>>> OpaqueRef:53354999-bf25-32b9-01df-a695a039ba8d: Forgetting
>>> 2015-11-26 20:22:46,601 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-279:ctx-532427fb) Seq 4-8612571337392652847: Response
>>> Received:
>>> 2015-11-26 20:22:46,602 DEBUG [c.c.a.t.Request]
>>> (DirectAgent-279:ctx-532427fb) Seq 4-8612571337392652847: Processing: {
>>> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 110,
>>>
>>>
>> [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Expected
>>> 1 VDI template but found 2 VDI template(s) on:
>>> 10.0.0.170:/export/secondary/template/tmpl/1/5","wait":0}}]
>>> }
>>> 2015-11-26 20:22:46,602 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>> 4-8612571337392652847: Received: { Ans: , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 110, { CopyCmdAnswer } }
>>> 2015-11-26 20:22:46,603 DEBUG [c.c.a.m.AgentAttache]
>>> (DirectAgent-279:ctx-532427fb) Seq 4-8612571337392652847: No more
>> commands
>>> found
>>> 2015-11-26 20:22:46,607 INFO [o.a.c.s.v.VolumeServiceImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) releasing
>>> lock for VMTemplateStoragePool 3
>>> 2015-11-26 20:22:46,608 DEBUG [o.a.c.e.o.VolumeOrchestrator]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Unable to
>>> create Vol[6|vm=5|ROOT]:Expected 1 VDI template but found 2 VDI
>> template(s)
>>> on: 10.0.0.170:/export/secondary/template/tmpl/1/5
>>> 2015-11-26 20:22:46,608 INFO [c.c.v.VirtualMachineManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Unable to
>>> contact resource.
>>> com.cloud.exception.StorageUnavailableException: Resource [StoragePool:8]
>>> is unreachable: Unable to create Vol[6|vm=5|ROOT]:Expected 1 VDI template
>>> but found 2 VDI template(s) on: 10.0.0.170:
>>> /export/secondary/template/tmpl/1/5
>>> at
>>>
>>>
>> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1278)
>>> at
>>>
>>>
>> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1336)
>>> at
>>>
>>>
>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1000)
>>> at
>>>
>>>
>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4580)
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> at
>>>
>>>
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>> at
>>>
>>>
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>> at java.lang.reflect.Method.invoke(Method.java:606)
>>> at
>>>
>>>
>> com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
>>> at
>>>
>>>
>> com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4736)
>>> at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
>>> at
>>>
>>>
>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
>>> at
>>>
>>>
>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>>> at
>>>
>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>>> at
>>>
>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>>> at
>>>
>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>>> at
>>>
>>>
>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>>> at
>>>
>>>
>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
>>> at
>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>>> at
>>>
>>>
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>> at
>>>
>>>
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>> at java.lang.Thread.run(Thread.java:745)
>>> 2015-11-26 20:22:46,611 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Cleaning up
>>> resources for the vm VM[User|i-2-5-VM] in Starting state
>>> 2015-11-26 20:22:46,612 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>> 4-8612571337392652848: Sending { Cmd , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>
>>>
>> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"checkBeforeCleanup":false,"vmName":"i-2-5-VM","wait":0}}]
>>> }
>>> 2015-11-26 20:22:46,612 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>> 4-8612571337392652848: Executing: { Cmd , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>
>>>
>> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"checkBeforeCleanup":false,"vmName":"i-2-5-VM","wait":0}}]
>>> }
>>> 2015-11-26 20:22:46,613 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-140:ctx-7f6d3e96) Seq 4-8612571337392652848: Executing
>> request
>>> 2015-11-26 20:22:46,618 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-140:ctx-7f6d3e96) Seq 4-8612571337392652848: Response
>>> Received:
>>> 2015-11-26 20:22:46,618 DEBUG [c.c.a.t.Request]
>>> (DirectAgent-140:ctx-7f6d3e96) Seq 4-8612571337392652848: Processing: {
>>> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
>>> [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not
>>> exist","wait":0}}] }
>>> 2015-11-26 20:22:46,618 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
>>> 4-8612571337392652848: Received: { Ans: , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 10, { StopAnswer } }
>>> 2015-11-26 20:22:46,623 DEBUG [c.c.n.NetworkModelImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
>>> SecurityGroup is not supported in the network id=212
>>> 2015-11-26 20:22:46,625 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Changing
>>> active number of nics for network id=212 on -1
>>> 2015-11-26 20:22:46,630 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Asking
>>> VirtualRouter to release
>>> NicProfile[11-5-2a4a184a-eac9-4609-8a70-4d230ee3a37d-10.1.1.88-null
>>> 2015-11-26 20:22:46,630 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>> Successfully
>>> released network resources for the vm VM[User|i-2-5-VM]
>>> 2015-11-26 20:22:46,630 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>> Successfully
>>> cleanued up resources for the vm VM[User|i-2-5-VM] in Starting state
>>> 2015-11-26 20:22:46,635 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deploy
>> avoids
>>> pods: [], clusters: [], hosts: [4]
>>> 2015-11-26 20:22:46,636 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>> DeploymentPlanner allocation algorithm:
>>> com.cloud.deploy.FirstFitPlanner@1136745
>>> 2015-11-26 20:22:46,636 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
>>> allocate a host and storage pools from dc:3, pod:3,cluster:3, requested
>>> cpu: 1000, requested ram: 1073741824
>>> 2015-11-26 20:22:46,636 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Is ROOT
>>> volume READY (pool already allocated)?: No
>>> 2015-11-26 20:22:46,636 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
>>> DeploymentPlan has host_id specified, choosing this host and making no
>>> checks on this host: 4
>>> 2015-11-26 20:22:46,636 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) The
>> specified
>>> host is in avoid set
>>> 2015-11-26 20:22:46,636 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Cannot
>> deploy
>>> to specified host, returning.
>>> 2015-11-26 20:22:46,645 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM state
>>> transitted from :Starting to Stopped with event: OperationFailedvm's
>>> original host id: null new host id: null host id before state
>> transition: 4
>>> 2015-11-26 20:22:46,648 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Hosts's
>>> actual total CPU: 3399 and CPU after applying overprovisioning: 3399
>>> 2015-11-26 20:22:46,649 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Hosts's
>>> actual total RAM: 15354505344 and RAM after applying overprovisioning:
>>> 15354505216
>>> 2015-11-26 20:22:46,649 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) release cpu
>>> from host: 4, old used: 2500,reserved: 0, actual total: 3399, total with
>>> overprovisioning: 3399; new used: 1500,reserved:0; movedfromreserved:
>>> false,moveToReserveredfalse
>>> 2015-11-26 20:22:46,649 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) release mem
>>> from host: 4, old used: 2952790016,reserved: 0, total: 15354505216; new
>>> used: 1879048192,reserved:0; movedfromreserved:
>> false,moveToReserveredfalse
>>> 2015-11-26 20:22:46,654 ERROR [c.c.v.VmWorkJobHandlerProxy]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Invocation
>>> exception, caused by:
>>> com.cloud.exception.InsufficientServerCapacityException: Unable to
>> create a
>>> deployment for VM[User|i-2-5-VM]Scope=interface com.cloud.dc.DataCenter;
>>> id=3
>>> 2015-11-26 20:22:46,654 INFO [c.c.v.VmWorkJobHandlerProxy]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Rethrow
>>> exception com.cloud.exception.InsufficientServerCapacityException: Unable
>>> to create a deployment for VM[User|i-2-5-VM]Scope=interface
>>> com.cloud.dc.DataCenter; id=3
>>> 2015-11-26 20:22:46,654 DEBUG [c.c.v.VmWorkJobDispatcher]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Done with run of VM work
>>> job: com.cloud.vm.VmWorkStart for VM 5, job origin: 68
>>> 2015-11-26 20:22:46,654 ERROR [c.c.v.VmWorkJobDispatcher]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Unable to complete
>>> AsyncJobVO {id:69, userId: 2, accountId: 2, instanceType: null,
>> instanceId:
>>> null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
>>>
>>>
>> rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAABXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAA3BzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHIAEGphdmEubGFuZy5OdW1iZXKGrJUdC5TgiwIAAHhwAAAAAAAAAANzcQB-AAgAAAAAAAAABHBwcHEAfgAKcHNyABFqYXZhLnV0aWwuSGFzaE1hcAUH2sHDFmDRAwACRgAKbG9hZEZhY3RvckkACXRocmVzaG9sZHhwP0AAAAAAAAx3CAAAABAAAAABdAAKVm1QYXNzd29yZHQAHHJPMEFCWFFBRG5OaGRtVmtYM0JoYzNOM2IzSmt4cA,
>>> cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
>>> result: null, initMsid: 52229922654, completeMsid: null, lastUpdated:
>> null,
>>> lastPolled: null, created: Thu Nov 26 20:21:56 IST 2015}, job origin:68
>>> com.cloud.exception.InsufficientServerCapacityException: Unable to
>> create a
>>> deployment for VM[User|i-2-5-VM]Scope=interface com.cloud.dc.DataCenter;
>>> id=3
>>> at
>>>
>>>
>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:959)
>>> at
>>>
>>>
>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4580)
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> at
>>>
>>>
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>> at
>>>
>>>
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>> at java.lang.reflect.Method.invoke(Method.java:606)
>>> at
>>>
>>>
>> com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
>>> at
>>>
>>>
>> com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4736)
>>> at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
>>> at
>>>
>>>
>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
>>> at
>>>
>>>
>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>>> at
>>>
>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>>> at
>>>
>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>>> at
>>>
>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>>> at
>>>
>>>
>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>>> at
>>>
>>>
>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
>>> at
>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>>> at
>>>
>>>
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>> at
>>>
>>>
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>> at java.lang.Thread.run(Thread.java:745)
>>> 2015-11-26 20:22:46,662 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Complete async job-69,
>>> jobStatus: FAILED, resultCode: 0, result:
>>>
>>>
>> rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAAzVW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1VzZXJ8aS0yLTUtVk1ddXIAHltMamF2YS5sYW5nLlN0YWNrVHJhY2VFbGVtZW50OwJGKjw8_SI5AgAAeHAAAAAVc3IAG2phdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudGEJxZomNt2FAgAESQAKbGluZU51bWJlckwADmRlY2xhcmluZ0NsYXNzcQB-AApMAAhmaWxlTmFtZXEAfgAKTAAKbWV0aG9kTmFtZXEAfgAKeHAAAAO_dAAmY29tLmNsb3VkLnZtLlZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGx0AB5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsLmphdmF0ABBvcmNoZXN0cmF0ZVN0YXJ0c3EAfgARAAAR5HEAfgATcQB-ABRxAH4AFXNxAH4AEf____50ACRzdW4ucmVmbGVjdC5OYXRpdmVNZXRob2RBY2Nlc3NvckltcGx0AB1OYXRpdmVNZXRob2RBY2Nlc3NvckltcGwuamF2YXQAB2ludm9rZTBzcQB-ABEAAAA5cQB-ABhxAH4AGXQABmludm9rZXNxAH4AEQAAACt0AChzdW4ucmVmbGVjdC5EZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsdAAhRGVsZWdhdGluZ01ldGhvZEFjY2Vzc29ySW1wbC5qYXZhcQB-ABxzcQB-ABEAAAJedAAYamF2YS5sYW5nLnJlZmxlY3QuTWV0aG9kdAALTWV0aG9kLmphdmFxAH4AHHNxAH4AEQAAAGt0ACJjb20uY2xvdWQudm0uVm1Xb3JrSm9iSGFuZGxlclByb3h5dAAaVm1Xb3JrSm9iSGFuZGxlclByb3h5LmphdmF0AA9oYW5kbGVWbVdvcmtKb2JzcQB-ABEAABKAcQB-ABNxAH4AFHEAfgAmc3EAfgARAAAAZnQAIGNvbS5jbG91ZC52bS5WbVdvcmtKb2JEaXNwYXRjaGVydAAYVm1Xb3JrSm9iRGlzcGF0Y2hlci5qYXZhdAAGcnVuSm9ic3EAfgARAAACGXQAP29yZy5hcGFjaGUuY2xvdWRzdGFjay5mcmFtZXdvcmsuam9icy5pbXBsLkFzeW5jSm9iTWFuYWdlckltcGwkNXQAGEFzeW5jSm9iTWFuYWdlckltcGwuamF2YXQADHJ1bkluQ29udGV4dHNxAH4AEQAAADF0AD5vcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGUkMXQAG01hbmFnZWRDb250ZXh0UnVubmFibGUuamF2YXQAA3J1bnNxAH4AEQAAADh0AEJvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0JDF0ABpEZWZhdWx0TWFuYWdlZENvbnRleHQuamF2YXQABGNhbGxzcQB-ABEAAABndABAb3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5pbXBsLkRlZmF1bHRNYW5hZ2VkQ29udGV4dHEAfgA2dAAPY2FsbFdpdGhDb250ZXh0c3EAfgARAAAANXEAfgA5cQB-ADZ0AA5ydW5XaXRoQ29udGV4dHNxAH4AEQAAAC50ADxvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGVxAH4AMnEAfgAzc3EAfgARAAAB7nEAfgAtcQB-AC5xAH4AM3NxAH4AEQAAAdd0AC5qYXZhLnV0aWwuY29uY3VycmVudC5FeGVjdXRvcnMkUnVubmFibGVBZGFwdGVydAAORXhlY3V0b3JzLmphdmFxAH4AN3NxAH4AEQAAAQZ0AB9qYXZhLnV0aWwuY29uY3VycmVudC5GdXR1cmVUYXNrdAAPRnV0dXJlVGFzay5qYXZhcQB-ADNzcQB-ABEAAAR5dAAnamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9ydAAXVGhyZWFkUG9vbEV4ZWN1dG9yLmphdmF0AAlydW5Xb3JrZXJzcQB-ABEAAAJndAAuamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9yJFdvcmtlcnEAfgBIcQB-ADNzcQB-ABEAAALpdAAQamF2YS5sYW5nLlRocmVhZHQAC1RocmVhZC5qYXZhcQB-ADNzcgAmamF2YS51dGlsLkNvbGxlY3Rpb25zJFVubW9kaWZpYWJsZUxpc3T8DyUxteyOEAIAAUwABGxpc3RxAH4ADHhyACxqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlQ29sbGVjdGlvbhlCAIDLXvceAgABTAABY3QAFkxqYXZhL3V0aWwvQ29sbGVjdGlvbjt4cHNyABNqYXZhLnV0aWwuQXJyYXlMaXN0eIHSHZnHYZ0DAAFJAARzaXpleHAAAAAAdwQAAAAAeHEAfgBUeHNyABFqYXZhLmxhbmcuSW50ZWdlchLioKT3gYc4AgABSQAFdmFsdWV4cgAQamF2YS5sYW5nLk51bWJlcoaslR0LlOCLAgAAeHAAABDvc3EAfgBTAAAAAHcEAAAAAHhzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHEAfgBWAAAAAAAAAAN2cgAXY29tLmNsb3VkLmRjLkRhdGFDZW50ZXKy8Qrrp-d4vgIAAHhwAA
>>> 2015-11-26 20:22:46,663 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Publish async job-69
>>> complete on message bus
>>> 2015-11-26 20:22:46,663 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Wake up jobs related to
>>> job-69
>>> 2015-11-26 20:22:46,663 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Update db status for
>>> job-69
>>> 2015-11-26 20:22:46,664 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Wake up jobs joined with
>>> job-69 and disjoin all subjobs created from job- 69
>>> 2015-11-26 20:22:46,671 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Done executing
>>> com.cloud.vm.VmWorkStart for job-69
>>> 2015-11-26 20:22:46,672 INFO [o.a.c.f.j.i.AsyncJobMonitor]
>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Remove job-69 from job
>>> monitoring
>>> 2015-11-26 20:22:46,680 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Sync job-71
>> execution
>>> on object VmWorkJobQueue.5
>>> 2015-11-26 20:22:46,966 DEBUG [c.c.a.m.AgentManagerImpl]
>>> (AgentManager-Handler-7:null) SeqA 5-1788: Processing Seq 5-1788: { Cmd
>> ,
>>> MgmtId: -1, via: 5, Ver: v1, Flags: 11,
>>>
>>>
>> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
>>> \"connections\": []\n}","wait":0}}] }
>>> 2015-11-26 20:22:46,971 DEBUG [c.c.a.m.AgentManagerImpl]
>>> (AgentManager-Handler-7:null) SeqA 5-1788: Sending Seq 5-1788: { Ans: ,
>>> MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
>>> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
>>> 2015-11-26 20:22:48,032 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (AsyncJobMgr-Heartbeat-1:ctx-a78c3581) Execute sync-queue item:
>>> SyncQueueItemVO {id:10, queueId: 9, contentType: AsyncJob, contentId: 71,
>>> lastProcessMsid: 52229922654, lastprocessNumber: 2, lastProcessTime: Thu
>>> Nov 26 20:22:48 IST 2015, created: Thu Nov 26 20:22:46 IST 2015}
>>> 2015-11-26 20:22:48,033 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (AsyncJobMgr-Heartbeat-1:ctx-a78c3581) Schedule queued job-71
>>> 2015-11-26 20:22:48,038 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (AsyncJobMgr-Heartbeat-1:ctx-5936202f) Begin cleanup expired async-jobs
>>> 2015-11-26 20:22:48,041 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (AsyncJobMgr-Heartbeat-1:ctx-5936202f) End cleanup expired async-jobs
>>> 2015-11-26 20:22:48,041 INFO [o.a.c.f.j.i.AsyncJobMonitor]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Add job-71 into job
>>> monitoring
>>> 2015-11-26 20:22:48,045 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Executing AsyncJobVO
>>> {id:71, userId: 2, accountId: 2, instanceType: null, instanceId: null,
>> cmd:
>>> com.cloud.vm.VmWorkStart, cmdInfo:
>>>
>>>
>> rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAABXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwc3IAEWphdmEudXRpbC5IYXNoTWFwBQfawcMWYNEDAAJGAApsb2FkRmFjdG9ySQAJdGhyZXNob2xkeHA_QAAAAAAADHcIAAAAEAAAAAF0AApWbVBhc3N3b3JkdAAcck8wQUJYUUFEbk5oZG1Wa1gzQmhjM04zYjNKa3hw,
>>> cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
>>> result: null, initMsid: 52229922654, completeMsid: null, lastUpdated:
>> null,
>>> lastPolled: null, created: Thu Nov 26 20:22:46 IST 2015}
>>> 2015-11-26 20:22:48,046 DEBUG [c.c.v.VmWorkJobDispatcher]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Run VM work job:
>>> com.cloud.vm.VmWorkStart for VM 5, job origin: 68
>>> 2015-11-26 20:22:48,046 DEBUG [c.c.v.VmWorkJobHandlerProxy]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Execute VM
>>> work job:
>>>
>>>
>> com.cloud.vm.VmWorkStart{"dcId":0,"rawParams":{"VmPassword":"rO0ABXQADnNhdmVkX3Bhc3N3b3Jk"},"userId":2,"accountId":2,"vmId":5,"handlerName":"VirtualMachineManagerImpl"}
>>> 2015-11-26 20:22:48,050 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) VM state
>>> transitted from :Stopped to Starting with event: StartRequestedvm's
>>> original host id: null new host id: null host id before state transition:
>>> null
>>> 2015-11-26 20:22:48,050 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
>> Successfully
>>> transitioned to start state for VM[User|i-2-5-VM] reservation id =
>>> 718d2456-bf61-48ad-9663-22ccfd4556f1
>>> 2015-11-26 20:22:48,052 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Trying to
>>> deploy VM, vm has dcId: 3 and podId: 3
>>> 2015-11-26 20:22:48,052 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Deploy
>> avoids
>>> pods: null, clusters: null, hosts: null
>>> 2015-11-26 20:22:48,057 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Deploy
>> avoids
>>> pods: [], clusters: [], hosts: []
>>> 2015-11-26 20:22:48,057 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
>>> DeploymentPlanner allocation algorithm:
>>> com.cloud.deploy.FirstFitPlanner@1136745
>>> 2015-11-26 20:22:48,057 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Trying to
>>> allocate a host and storage pools from dc:3, pod:3,cluster:null,
>> requested
>>> cpu: 1000, requested ram: 1073741824
>>> 2015-11-26 20:22:48,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Is ROOT
>>> volume READY (pool already allocated)?: No
>>> 2015-11-26 20:22:48,058 DEBUG [c.c.d.FirstFitPlanner]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Searching
>>> resources only under specified Pod: 3
>>> 2015-11-26 20:22:48,058 DEBUG [c.c.d.FirstFitPlanner]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Listing
>>> clusters in order of aggregate capacity, that have (atleast one host
>> with)
>>> enough CPU and RAM capacity under this Pod: 3
>>> 2015-11-26 20:22:48,059 DEBUG [c.c.d.FirstFitPlanner]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Removing
>> from
>>> the clusterId list these clusters from avoid set: []
>>> 2015-11-26 20:22:48,063 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
>>> resources in Cluster: 3 under Pod: 3
>>> 2015-11-26 20:22:48,063 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
>>> FirstFitRoutingAllocator) Looking for hosts in dc: 3 pod:3 cluster:3
>>> 2015-11-26 20:22:48,065 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
>>> FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for
>>> allocation: [Host[-4-Routing]]
>>> 2015-11-26 20:22:48,067 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
>>> FirstFitRoutingAllocator) Found 1 hosts for allocation after
>>> prioritization: [Host[-4-Routing]]
>>> 2015-11-26 20:22:48,067 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
>>> FirstFitRoutingAllocator) Looking for speed=1000Mhz, Ram=1024
>>> 2015-11-26 20:22:48,070 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
>>> FirstFitRoutingAllocator) Host: 4 has cpu capability (cpu:1, speed:3399)
>> to
>>> support requested CPU: 1 and requested speed: 1000
>>> 2015-11-26 20:22:48,070 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
>>> FirstFitRoutingAllocator) Checking if host: 4 has enough capacity for
>>> requested CPU: 1000 and requested RAM: 1073741824 ,
>>> cpuOverprovisioningFactor: 1.0
>>> 2015-11-26 20:22:48,071 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
>>> FirstFitRoutingAllocator) Hosts's actual total CPU: 3399 and CPU after
>>> applying overprovisioning: 3399
>>> 2015-11-26 20:22:48,071 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
>>> FirstFitRoutingAllocator) Free CPU: 1899 , Requested CPU: 1000
>>> 2015-11-26 20:22:48,071 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
>>> FirstFitRoutingAllocator) Free RAM: 13475457024 , Requested RAM:
>> 1073741824
>>> 2015-11-26 20:22:48,071 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
>>> FirstFitRoutingAllocator) Host has enough CPU and RAM available
>>> 2015-11-26 20:22:48,071 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
>>> FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 4, used: 1500,
>>> reserved: 0, actual total: 3399, total with overprovisioning: 3399;
>>> requested cpu:1000,alloc_from_last_host?:false
>> ,considerReservedCapacity?:
>>> true
>>> 2015-11-26 20:22:48,071 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
>>> FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 4, used:
>>> 1879048192, reserved: 0, total: 15354505216; requested mem:
>>> 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
>>> 2015-11-26 20:22:48,071 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
>>> FirstFitRoutingAllocator) Found a suitable host, adding to list: 4
>>> 2015-11-26 20:22:48,071 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
>>> FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts
>>> 2015-11-26 20:22:48,072 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
>>> suitable pools for volume (Id, Type): (6,ROOT)
>>> 2015-11-26 20:22:48,072 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) We need to
>>> allocate new storagepool for this volume
>>> 2015-11-26 20:22:48,073 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Calling
>>> StoragePoolAllocators to find suitable pools
>>> 2015-11-26 20:22:48,073 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
>>> LocalStoragePoolAllocator trying to find storage pool to fit the vm
>>> 2015-11-26 20:22:48,073 DEBUG
>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
>>> ClusterScopeStoragePoolAllocator looking for storage pool
>>> 2015-11-26 20:22:48,073 DEBUG
>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Looking for
>>> pools in dc: 3 pod:3 cluster:3. Disabled pools will be ignored.
>>> 2015-11-26 20:22:48,073 DEBUG
>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found pools
>>> matching tags: [Pool[8|NetworkFilesystem]]
>>> 2015-11-26 20:22:48,074 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking if
>>> storage pool is suitable, name: null ,poolId: 8
>>> 2015-11-26 20:22:48,075 INFO [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Storage
>> pool
>>> null (8) does not supply IOPS capacity, assuming enough capacity
>>> 2015-11-26 20:22:48,076 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
>> pool
>>> 8 for storage, totalSize: 526199291904, usedBytes: 10131603456, usedPct:
>>> 0.019254308418659775, disable threshold: 0.85
>>> 2015-11-26 20:22:48,078 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found
>> storage
>>> pool primary of type NetworkFilesystem with overprovisioning factor 2
>>> 2015-11-26 20:22:48,078 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total over
>>> provisioned capacity calculated is 2 * 526199291904
>>> 2015-11-26 20:22:48,079 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total
>>> capacity of the pool primary id: 8 is 1052398583808
>>> 2015-11-26 20:22:48,079 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
>>> pool: 8 for volume allocation [Vol[6|vm=5|ROOT]], maxSize :
>> 1052398583808,
>>> totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
>>> disable threshold: 0.85
>>> 2015-11-26 20:22:48,079 DEBUG
>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
>>> ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
>>> 2015-11-26 20:22:48,079 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
>>> suitable pools for volume (Id, Type): (7,DATADISK)
>>> 2015-11-26 20:22:48,079 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) We need to
>>> allocate new storagepool for this volume
>>> 2015-11-26 20:22:48,079 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Calling
>>> StoragePoolAllocators to find suitable pools
>>> 2015-11-26 20:22:48,079 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
>>> LocalStoragePoolAllocator trying to find storage pool to fit the vm
>>> 2015-11-26 20:22:48,079 DEBUG
>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
>>> ClusterScopeStoragePoolAllocator looking for storage pool
>>> 2015-11-26 20:22:48,079 DEBUG
>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Looking for
>>> pools in dc: 3 pod:3 cluster:3. Disabled pools will be ignored.
>>> 2015-11-26 20:22:48,080 DEBUG
>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found pools
>>> matching tags: [Pool[8|NetworkFilesystem]]
>>> 2015-11-26 20:22:48,080 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking if
>>> storage pool is suitable, name: null ,poolId: 8
>>> 2015-11-26 20:22:48,081 INFO [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Storage
>> pool
>>> null (8) does not supply IOPS capacity, assuming enough capacity
>>> 2015-11-26 20:22:48,081 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
>> pool
>>> 8 for storage, totalSize: 526199291904, usedBytes: 10131603456, usedPct:
>>> 0.019254308418659775, disable threshold: 0.85
>>> 2015-11-26 20:22:48,083 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found
>> storage
>>> pool primary of type NetworkFilesystem with overprovisioning factor 2
>>> 2015-11-26 20:22:48,083 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total over
>>> provisioned capacity calculated is 2 * 526199291904
>>> 2015-11-26 20:22:48,083 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total
>>> capacity of the pool primary id: 8 is 1052398583808
>>> 2015-11-26 20:22:48,083 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
>>> pool: 8 for volume allocation [Vol[7|vm=5|DATADISK]], maxSize :
>>> 1052398583808, totalAllocatedSize : 12156207104, askingSize :
>> 21474836480,
>>> allocated disable threshold: 0.85
>>> 2015-11-26 20:22:48,083 DEBUG
>> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
>>> ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
>>> 2015-11-26 20:22:48,083 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Trying to
>>> find a potenial host and associated storage pools from the suitable
>>> host/pool lists for this VM
>>> 2015-11-26 20:22:48,083 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking if
>>> host: 4 can access any suitable storage pool for volume: DATADISK
>>> 2015-11-26 20:22:48,084 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Host: 4 can
>>> access pool: 8
>>> 2015-11-26 20:22:48,084 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
>> pool
>>> 8 for storage, totalSize: 526199291904, usedBytes: 10131603456, usedPct:
>>> 0.019254308418659775, disable threshold: 0.85
>>> 2015-11-26 20:22:48,086 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found
>> storage
>>> pool primary of type NetworkFilesystem with overprovisioning factor 2
>>> 2015-11-26 20:22:48,086 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total over
>>> provisioned capacity calculated is 2 * 526199291904
>>> 2015-11-26 20:22:48,086 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total
>>> capacity of the pool primary id: 8 is 1052398583808
>>> 2015-11-26 20:22:48,086 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
>>> pool: 8 for volume allocation [Vol[7|vm=5|DATADISK]], maxSize :
>>> 1052398583808, totalAllocatedSize : 12156207104, askingSize :
>> 21474836480,
>>> allocated disable threshold: 0.85
>>> 2015-11-26 20:22:48,086 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking if
>>> host: 4 can access any suitable storage pool for volume: ROOT
>>> 2015-11-26 20:22:48,087 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Host: 4 can
>>> access pool: 8
>>> 2015-11-26 20:22:48,087 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
>> pool
>>> 8 for storage, totalSize: 526199291904, usedBytes: 10131603456, usedPct:
>>> 0.019254308418659775, disable threshold: 0.85
>>> 2015-11-26 20:22:48,090 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found
>> storage
>>> pool primary of type NetworkFilesystem with overprovisioning factor 2
>>> 2015-11-26 20:22:48,090 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total over
>>> provisioned capacity calculated is 2 * 526199291904
>>> 2015-11-26 20:22:48,090 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total
>>> capacity of the pool primary id: 8 is 1052398583808
>>> 2015-11-26 20:22:48,090 DEBUG [c.c.s.StorageManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
>>> pool: 8 for volume allocation [Vol[6|vm=5|ROOT]], maxSize :
>> 1052398583808,
>>> totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
>>> disable threshold: 0.85
>>> 2015-11-26 20:22:48,090 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found a
>>> potential host id: 4 name: xenserver and associated storage pools for
>> this
>>> VM
>>> 2015-11-26 20:22:48,091 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Returning
>>> Deployment Destination:
>>>
>>>
>> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
>>> :
>>>
>>>
>> Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage(Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
>>> Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
>>> Volume(7|DATADISK-->Pool(8))]
>>> 2015-11-26 20:22:48,091 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Deployment
>>> found - P0=VM[User|i-2-5-VM],
>>>
>>>
>> P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
>>> :
>>>
>>>
>> Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage(Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
>>> Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
>>> Volume(7|DATADISK-->Pool(8))]
>>> 2015-11-26 20:22:48,097 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) VM state
>>> transitted from :Starting to Starting with event: OperationRetryvm's
>>> original host id: null new host id: 4 host id before state transition:
>> null
>>> 2015-11-26 20:22:48,100 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Hosts's
>>> actual total CPU: 3399 and CPU after applying overprovisioning: 3399
>>> 2015-11-26 20:22:48,100 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) We are
>>> allocating VM, increasing the used capacity of this host:4
>>> 2015-11-26 20:22:48,100 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Current
>> Used
>>> CPU: 1500 , Free CPU:1899 ,Requested CPU: 1000
>>> 2015-11-26 20:22:48,100 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Current
>> Used
>>> RAM: 1879048192 , Free RAM:13475457024 ,Requested RAM: 1073741824
>>> 2015-11-26 20:22:48,100 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) CPU STATS
>>> after allocation: for host: 4, old used: 1500, old reserved: 0, actual
>>> total: 3399, total with overprovisioning: 3399; new used:2500,
>> reserved:0;
>>> requested cpu:1000,alloc_from_last:false
>>> 2015-11-26 20:22:48,100 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) RAM STATS
>>> after allocation: for host: 4, old used: 1879048192, old reserved: 0,
>>> total: 15354505216; new used: 2952790016, reserved: 0; requested mem:
>>> 1073741824,alloc_from_last:false
>>> 2015-11-26 20:22:48,102 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) VM is being
>>> created in podId: 3
>>> 2015-11-26 20:22:48,103 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Network
>>> id=212 is already implemented
>>> 2015-11-26 20:22:48,109 DEBUG [c.c.n.NetworkModelImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Service
>>> SecurityGroup is not supported in the network id=212
>>> 2015-11-26 20:22:48,111 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Changing
>>> active number of nics for network id=212 on 1
>>> 2015-11-26 20:22:48,114 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Asking
>>> VirtualRouter to prepare for
>>> Nic[11-5-718d2456-bf61-48ad-9663-22ccfd4556f1-10.1.1.88]
>>> 2015-11-26 20:22:48,123 DEBUG [c.c.n.NetworkModelImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Service
>>> SecurityGroup is not supported in the network id=212
>>> 2015-11-26 20:22:48,125 DEBUG [o.a.c.n.t.BasicNetworkTopology]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) CONFIG DHCP
>>> FOR SUBNETS RULES
>>> 2015-11-26 20:22:48,129 DEBUG [c.c.n.NetworkModelImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Service
>>> SecurityGroup is not supported in the network id=212
>>> 2015-11-26 20:22:48,130 DEBUG [o.a.c.n.t.AdvancedNetworkTopology]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) APPLYING
>> VPC
>>> DHCP ENTRY RULES
>>> 2015-11-26 20:22:48,130 DEBUG [o.a.c.n.t.BasicNetworkTopology]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Applying
>> dhcp
>>> entry in network Ntwk[212|Guest|8]
>>> 2015-11-26 20:22:48,138 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
>>> 4-8612571337392652849: Sending { Cmd , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>
>>>
>> [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:71:ff:00:03","vmIpAddress":"10.1.1.88","vmName":"Test002","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:71:ff:00:03","isDefault":true,"executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","router.guest.ip":"10.1.1.1","router.ip":"169.254.0.43","
>>> router.name":"r-4-VM"},"wait":0}}] }
>>> 2015-11-26 20:22:48,139 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
>>> 4-8612571337392652849: Executing: { Cmd , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>
>>>
>> [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:71:ff:00:03","vmIpAddress":"10.1.1.88","vmName":"Test002","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:71:ff:00:03","isDefault":true,"executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","router.guest.ip":"10.1.1.1","router.ip":"169.254.0.43","
>>> router.name":"r-4-VM"},"wait":0}}] }
>>> 2015-11-26 20:22:48,139 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-280:ctx-eb580854) Seq 4-8612571337392652849: Executing
>> request
>>> 2015-11-26 20:22:48,139 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>> (DirectAgent-280:ctx-eb580854) Transforming
>>> com.cloud.agent.api.routing.DhcpEntryCommand to ConfigItems
>>> 2015-11-26 20:22:48,144 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-280:ctx-eb580854) Copying VR with ip 169.254.0.43 config
>> file
>>> into host 10.0.0.171
>>> 2015-11-26 20:22:48,211 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (RouterStatusMonitor-1:ctx-8884e0d0) Found 1 routers to update status.
>>> 2015-11-26 20:22:48,213 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (RouterStatusMonitor-1:ctx-8884e0d0) Found 0 VPC networks to update
>>> Redundant State.
>>> 2015-11-26 20:22:48,214 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (RouterStatusMonitor-1:ctx-8884e0d0) Found 0 networks to update RvR
>> status.
>>> 2015-11-26 20:22:48,222 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (RouterStatusMonitor-1:ctx-7dc158f2) Found 1 routers to update status.
>>> 2015-11-26 20:22:48,223 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (RouterStatusMonitor-1:ctx-7dc158f2) Found 0 VPC networks to update
>>> Redundant State.
>>> 2015-11-26 20:22:48,223 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (RouterStatusMonitor-1:ctx-7dc158f2) Found 0 networks to update RvR
>> status.
>>> 2015-11-26 20:22:48,509 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-280:ctx-eb580854) VR Config file vm_dhcp_entry.json got
>>> created in VR, ip 169.254.0.43 with content
>>>
>>>
>> {"host_name":"Test002","mac_address":"02:00:71:ff:00:03","ipv4_adress":"10.1.1.88","ipv6_duid":"00:03:00:01:02:00:71:ff:00:03","dns_adresses":"10.1.1.1","default_gateway":"10.1.1.1","default_entry":true,"type":"dhcpentry"}
>>> 2015-11-26 20:22:48,509 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>> (DirectAgent-280:ctx-eb580854) Processing FileConfigItem, copying 222
>>> characters to vm_dhcp_entry.json took 370ms
>>> 2015-11-26 20:22:48,510 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-280:ctx-eb580854) Executing command in VR:
>>> /opt/cloud/bin/router_proxy.sh update_config.py 169.254.0.43
>>> vm_dhcp_entry.json
>>> 2015-11-26 20:22:48,606 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-5:ctx-6424a9fc) ===START=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549633925
>>> 2015-11-26 20:22:48,618 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-5:ctx-6424a9fc ctx-7c6e9282) ===END=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549633925
>>> 2015-11-26 20:22:51,265 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>> (DirectAgent-280:ctx-eb580854) Processing ScriptConfigItem, executing
>>> update_config.py vm_dhcp_entry.json took 2756ms
>>> 2015-11-26 20:22:51,265 WARN [c.c.a.r.v.VirtualRoutingResource]
>>> (DirectAgent-280:ctx-eb580854) Expected 1 answers while executing
>>> DhcpEntryCommand but received 2
>>> 2015-11-26 20:22:51,265 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-280:ctx-eb580854) Seq 4-8612571337392652849: Response
>>> Received:
>>> 2015-11-26 20:22:51,266 DEBUG [c.c.a.t.Request]
>>> (DirectAgent-280:ctx-eb580854) Seq 4-8612571337392652849: Processing: {
>>> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
>>> [{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null - success:
>>> ","null - success: RTNETLINK answers: File exists\nRTNETLINK answers:
>> File
>>> exists\nRTNETLINK answers: File exists\n[INFO] update_config.py ::
>>> Processing incoming file => vm_dhcp_entry.json\n[INFO] Processing JSON
>> file
>>> vm_dhcp_entry.json\nTest002 Test002\nTest01
>>> Test002\n"],"result":true,"wait":0}}] }
>>> 2015-11-26 20:22:51,266 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
>>> 4-8612571337392652849: Received: { Ans: , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 10, { GroupAnswer } }
>>> 2015-11-26 20:22:51,268 DEBUG [c.c.n.NetworkModelImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Service
>>> SecurityGroup is not supported in the network id=212
>>> 2015-11-26 20:22:51,269 DEBUG [o.a.c.n.t.AdvancedNetworkTopology]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) APPLYING
>> VPC
>>> USERDATA RULES
>>> 2015-11-26 20:22:51,269 DEBUG [o.a.c.n.t.BasicNetworkTopology]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Applying
>>> userdata and password entry in network Ntwk[212|Guest|8]
>>> 2015-11-26 20:22:51,278 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
>>> 4-8612571337392652850: Sending { Cmd , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>
>>>
>> [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
>>> router.name
>>>
>>>
>> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
>>> router.name
>>>
>> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}}]
>>> }
>>> 2015-11-26 20:22:51,279 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
>>> 4-8612571337392652850: Executing: { Cmd , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>
>>>
>> [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
>>> router.name
>>>
>>>
>> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
>>> router.name
>>>
>> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}}]
>>> }
>>> 2015-11-26 20:22:51,279 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-71:ctx-0080bc2a) Seq 4-8612571337392652850: Executing
>> request
>>> 2015-11-26 20:22:51,279 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>> (DirectAgent-71:ctx-0080bc2a) Transforming
>>> com.cloud.agent.api.routing.SavePasswordCommand to ConfigItems
>>> 2015-11-26 20:22:51,282 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-71:ctx-0080bc2a) Copying VR with ip 169.254.0.43 config file
>>> into host 10.0.0.171
>>> 2015-11-26 20:22:51,662 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-71:ctx-0080bc2a) VR Config file vm_password.json got created
>>> in VR, ip 169.254.0.43 with content
>>>
>> {"ip_address":"10.1.1.88","password":"saved_password","type":"vmpassword"}
>>> 2015-11-26 20:22:51,662 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>> (DirectAgent-71:ctx-0080bc2a) Processing FileConfigItem, copying 74
>>> characters to vm_password.json took 383ms
>>> 2015-11-26 20:22:51,662 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-71:ctx-0080bc2a) Executing command in VR:
>>> /opt/cloud/bin/router_proxy.sh update_config.py 169.254.0.43
>>> vm_password.json
>>> 2015-11-26 20:22:51,966 DEBUG [c.c.a.m.AgentManagerImpl]
>>> (AgentManager-Handler-8:null) SeqA 5-1789: Processing Seq 5-1789: { Cmd
>> ,
>>> MgmtId: -1, via: 5, Ver: v1, Flags: 11,
>>>
>>>
>> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
>>> \"connections\": []\n}","wait":0}}] }
>>> 2015-11-26 20:22:51,969 DEBUG [c.c.a.m.AgentManagerImpl]
>>> (AgentManager-Handler-8:null) SeqA 5-1789: Sending Seq 5-1789: { Ans: ,
>>> MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
>>> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
>>> 2015-11-26 20:22:52,954 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-24:ctx-bcef2c6d) ===START=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549638271
>>> 2015-11-26 20:22:52,968 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-24:ctx-bcef2c6d ctx-2fd0c6b9) ===END=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549638271
>>> 2015-11-26 20:22:54,399 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>> (DirectAgent-71:ctx-0080bc2a) Processing ScriptConfigItem, executing
>>> update_config.py vm_password.json took 2737ms
>>> 2015-11-26 20:22:54,399 WARN [c.c.a.r.v.VirtualRoutingResource]
>>> (DirectAgent-71:ctx-0080bc2a) Expected 1 answers while executing
>>> SavePasswordCommand but received 2
>>> 2015-11-26 20:22:54,401 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>> (DirectAgent-71:ctx-0080bc2a) Transforming
>>> com.cloud.agent.api.routing.VmDataCommand to ConfigItems
>>> 2015-11-26 20:22:54,404 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-71:ctx-0080bc2a) Copying VR with ip 169.254.0.43 config file
>>> into host 10.0.0.171
>>> 2015-11-26 20:22:54,786 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-71:ctx-0080bc2a) VR Config file vm_metadata.json got created
>>> in VR, ip 169.254.0.43 with content
>>>
>>>
>> {"vm_ip_address":"10.1.1.88","vm_metadata":[["userdata","user-data",null],["metadata","service-offering","Medium
>>>
>>>
>> Instance"],["metadata","availability-zone","TestZone"],["metadata","local-ipv4","10.1.1.88"],["metadata","local-hostname","Test002"],["metadata","public-ipv4","10.0.0.174"],["metadata","public-hostname","10.0.0.174"],["metadata","instance-id","4ce4731f-22a7-42ac-8e78-093d5f2e9a34"],["metadata","vm-id","4ce4731f-22a7-42ac-8e78-093d5f2e9a34"],["metadata","public-keys",null],["metadata","cloud-identifier","CloudStack-{de65e551-2e87-423b-90e6-03cd3eb706bb}"]],"type":"vmdata"}
>>> 2015-11-26 20:22:54,786 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>> (DirectAgent-71:ctx-0080bc2a) Processing FileConfigItem, copying 589
>>> characters to vm_metadata.json took 385ms
>>> 2015-11-26 20:22:54,786 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-71:ctx-0080bc2a) Executing command in VR:
>>> /opt/cloud/bin/router_proxy.sh update_config.py 169.254.0.43
>>> vm_metadata.json
>>> 2015-11-26 20:22:56,607 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-3:ctx-060754d7) ===START=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549641926
>>> 2015-11-26 20:22:56,624 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-3:ctx-060754d7 ctx-a1cce698) ===END=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549641926
>>> 2015-11-26 20:22:57,514 DEBUG [c.c.a.r.v.VirtualRoutingResource]
>>> (DirectAgent-71:ctx-0080bc2a) Processing ScriptConfigItem, executing
>>> update_config.py vm_metadata.json took 2728ms
>>> 2015-11-26 20:22:57,514 WARN [c.c.a.r.v.VirtualRoutingResource]
>>> (DirectAgent-71:ctx-0080bc2a) Expected 1 answers while executing
>>> VmDataCommand but received 2
>>> 2015-11-26 20:22:57,515 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-71:ctx-0080bc2a) Seq 4-8612571337392652850: Response
>> Received:
>>> 2015-11-26 20:22:57,523 DEBUG [c.c.a.t.Request]
>>> (DirectAgent-71:ctx-0080bc2a) Seq 4-8612571337392652850: Processing: {
>>> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
>>> [{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null - success:
>>> ","null - success: RTNETLINK answers: File exists\nRTNETLINK answers:
>> File
>>> exists\nRTNETLINK answers: File exists\n[INFO] update_config.py ::
>>> Processing incoming file => vm_password.json\n[INFO] Processing JSON file
>>>
>>>
>> vm_password.json\n"],"result":true,"wait":0}},{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null
>>> - success: ","null - success: RTNETLINK answers: File exists\nRTNETLINK
>>> answers: File exists\nRTNETLINK answers: File exists\n[INFO]
>>> update_config.py :: Processing incoming file => vm_metadata.json\n[INFO]
>>> Processing JSON file vm_metadata.json\n"],"result":true,"wait":0}}] }
>>> 2015-11-26 20:22:57,523 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
>>> 4-8612571337392652850: Received: { Ans: , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 10, { GroupAnswer, GroupAnswer } }
>>> 2015-11-26 20:22:57,524 DEBUG [c.c.n.NetworkModelImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Service
>>> SecurityGroup is not supported in the network id=212
>>> 2015-11-26 20:22:57,525 DEBUG [o.a.c.e.o.VolumeOrchestrator]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking if
>>> we need to prepare 2 volumes for VM[User|i-2-5-VM]
>>> 2015-11-26 20:22:57,529 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) template 5
>> is
>>> already in store:1, type:Image
>>> 2015-11-26 20:22:57,530 DEBUG [o.a.c.s.d.PrimaryDataStoreImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Not found
>>> (templateId:5poolId:8) in template_spool_ref, persisting it
>>> 2015-11-26 20:22:57,533 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) template 5
>> is
>>> already in store:8, type:Primary
>>> 2015-11-26 20:22:57,533 DEBUG [o.a.c.s.v.VolumeServiceImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found
>>> template centos56-x86_64-xen in storage pool 8 with VMTemplateStoragePool
>>> id: 4
>>> 2015-11-26 20:22:57,534 DEBUG [o.a.c.s.v.VolumeServiceImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Acquire
>> lock
>>> on VMTemplateStoragePool 4 with timeout 3600 seconds
>>> 2015-11-26 20:22:57,535 INFO [o.a.c.s.v.VolumeServiceImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) lock is
>>> acquired for VMTemplateStoragePool 4
>>> 2015-11-26 20:22:57,537 DEBUG [o.a.c.s.m.AncientDataMotionStrategy]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) copyAsync
>>> inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE
>>> 2015-11-26 20:22:57,541 DEBUG [c.c.h.XenServerGuru]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
>>> getCommandHostDelegation: class
>>> org.apache.cloudstack.storage.command.CopyCommand
>>> 2015-11-26 20:22:57,542 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
>>> 4-8612571337392652851: Sending { Cmd , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 100111,
>>>
>>>
>> [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/5/3986df71-b1d0-3e20-a655-7e42dd144370.vhd","origUrl":"
>>> http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
>>>
>> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
>>> 5.6(64-bit) no GUI
>>>
>>>
>> (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://
>>> 10.0.0.170/export/secondary
>>>
>>>
>> ","_role":"Image"}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"
>>> http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
>>>
>> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
>>> 5.6(64-bit) no GUI
>>>
>>>
>> (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
>>>
>>>
>> 10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc
>>>
>> "}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"executeInSequence":true,"options":{},"options2":{},"wait":10800}}]
>>> }
>>> 2015-11-26 20:22:57,542 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
>>> 4-8612571337392652851: Executing: { Cmd , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 100111,
>>>
>>>
>> [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/5/3986df71-b1d0-3e20-a655-7e42dd144370.vhd","origUrl":"
>>> http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
>>>
>> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
>>> 5.6(64-bit) no GUI
>>>
>>>
>> (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://
>>> 10.0.0.170/export/secondary
>>>
>>>
>> ","_role":"Image"}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"
>>> http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
>>>
>> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
>>> 5.6(64-bit) no GUI
>>>
>>>
>> (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
>>>
>>>
>> 10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc
>>>
>> "}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"executeInSequence":true,"options":{},"options2":{},"wait":10800}}]
>>> }
>>> 2015-11-26 20:22:57,542 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-281:ctx-03a8f398) Seq 4-8612571337392652851: Executing
>> request
>>> 2015-11-26 20:22:58,021 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (AsyncJobMgr-Heartbeat-1:ctx-92cf866f) Begin cleanup expired async-jobs
>>> 2015-11-26 20:22:58,023 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (AsyncJobMgr-Heartbeat-1:ctx-92cf866f) End cleanup expired async-jobs
>>> 2015-11-26 20:22:58,833 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-281:ctx-03a8f398) Host 10.0.0.171
>>> OpaqueRef:b0284c5b-613d-0522-5c44-797be269d661: Removing SR
>>> 2015-11-26 20:22:58,843 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-281:ctx-03a8f398) Host 10.0.0.171
>>> OpaqueRef:bfb2ccc2-135c-4f9a-bc84-143021c71bae: Unplugging pbd
>>> 2015-11-26 20:22:58,950 DEBUG [c.c.h.x.r.CitrixResourceBase]
>>> (DirectAgent-281:ctx-03a8f398) Host 10.0.0.171
>>> OpaqueRef:b0284c5b-613d-0522-5c44-797be269d661: Forgetting
>>> 2015-11-26 20:22:58,953 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-281:ctx-03a8f398) Seq 4-8612571337392652851: Response
>>> Received:
>>> 2015-11-26 20:22:58,953 DEBUG [c.c.a.t.Request]
>>> (DirectAgent-281:ctx-03a8f398) Seq 4-8612571337392652851: Processing: {
>>> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 110,
>>>
>>>
>> [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Expected
>>> 1 VDI template but found 2 VDI template(s) on:
>>> 10.0.0.170:/export/secondary/template/tmpl/1/5","wait":0}}]
>>> }
>>> 2015-11-26 20:22:58,953 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
>>> 4-8612571337392652851: Received: { Ans: , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 110, { CopyCmdAnswer } }
>>> 2015-11-26 20:22:58,955 DEBUG [c.c.a.m.AgentAttache]
>>> (DirectAgent-281:ctx-03a8f398) Seq 4-8612571337392652851: No more
>> commands
>>> found
>>> 2015-11-26 20:22:58,959 INFO [o.a.c.s.v.VolumeServiceImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) releasing
>>> lock for VMTemplateStoragePool 4
>>> 2015-11-26 20:22:58,959 DEBUG [o.a.c.e.o.VolumeOrchestrator]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Unable to
>>> create Vol[6|vm=5|ROOT]:Expected 1 VDI template but found 2 VDI
>> template(s)
>>> on: 10.0.0.170:/export/secondary/template/tmpl/1/5
>>> 2015-11-26 20:22:58,959 INFO [c.c.v.VirtualMachineManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Unable to
>>> contact resource.
>>> com.cloud.exception.StorageUnavailableException: Resource [StoragePool:8]
>>> is unreachable: Unable to create Vol[6|vm=5|ROOT]:Expected 1 VDI template
>>> but found 2 VDI template(s) on: 10.0.0.170:
>>> /export/secondary/template/tmpl/1/5
>>> at
>>>
>>>
>> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1278)
>>> at
>>>
>>>
>> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1336)
>>> at
>>>
>>>
>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1000)
>>> at
>>>
>>>
>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4580)
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> at
>>>
>>>
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>> at
>>>
>>>
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>> at java.lang.reflect.Method.invoke(Method.java:606)
>>> at
>>>
>>>
>> com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
>>> at
>>>
>>>
>> com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4736)
>>> at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
>>> at
>>>
>>>
>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
>>> at
>>>
>>>
>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>>> at
>>>
>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>>> at
>>>
>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>>> at
>>>
>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>>> at
>>>
>>>
>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>>> at
>>>
>>>
>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
>>> at
>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>>> at
>>>
>>>
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>> at
>>>
>>>
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>> at java.lang.Thread.run(Thread.java:745)
>>> 2015-11-26 20:22:58,962 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Cleaning up
>>> resources for the vm VM[User|i-2-5-VM] in Starting state
>>> 2015-11-26 20:22:58,964 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
>>> 4-8612571337392652852: Sending { Cmd , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>
>>>
>> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"checkBeforeCleanup":false,"vmName":"i-2-5-VM","wait":0}}]
>>> }
>>> 2015-11-26 20:22:58,964 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
>>> 4-8612571337392652852: Executing: { Cmd , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 100011,
>>>
>>>
>> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"checkBeforeCleanup":false,"vmName":"i-2-5-VM","wait":0}}]
>>> }
>>> 2015-11-26 20:22:58,964 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-141:ctx-62326db5) Seq 4-8612571337392652852: Executing
>> request
>>> 2015-11-26 20:22:58,971 DEBUG [c.c.a.m.DirectAgentAttache]
>>> (DirectAgent-141:ctx-62326db5) Seq 4-8612571337392652852: Response
>>> Received:
>>> 2015-11-26 20:22:58,971 DEBUG [c.c.a.t.Request]
>>> (DirectAgent-141:ctx-62326db5) Seq 4-8612571337392652852: Processing: {
>>> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
>>> [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not
>>> exist","wait":0}}] }
>>> 2015-11-26 20:22:58,971 DEBUG [c.c.a.t.Request]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
>>> 4-8612571337392652852: Received: { Ans: , MgmtId: 52229922654, via:
>>> 4(xenserver), Ver: v1, Flags: 10, { StopAnswer } }
>>> 2015-11-26 20:22:58,976 DEBUG [c.c.n.NetworkModelImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Service
>>> SecurityGroup is not supported in the network id=212
>>> 2015-11-26 20:22:58,977 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Changing
>>> active number of nics for network id=212 on -1
>>> 2015-11-26 20:22:58,982 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Asking
>>> VirtualRouter to release
>>> NicProfile[11-5-718d2456-bf61-48ad-9663-22ccfd4556f1-10.1.1.88-null
>>> 2015-11-26 20:22:58,982 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
>> Successfully
>>> released network resources for the vm VM[User|i-2-5-VM]
>>> 2015-11-26 20:22:58,982 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
>> Successfully
>>> cleanued up resources for the vm VM[User|i-2-5-VM] in Starting state
>>> 2015-11-26 20:22:58,986 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Deploy
>> avoids
>>> pods: [], clusters: [], hosts: [4]
>>> 2015-11-26 20:22:58,987 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
>>> DeploymentPlanner allocation algorithm:
>>> com.cloud.deploy.FirstFitPlanner@1136745
>>> 2015-11-26 20:22:58,987 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Trying to
>>> allocate a host and storage pools from dc:3, pod:3,cluster:null,
>> requested
>>> cpu: 1000, requested ram: 1073741824
>>> 2015-11-26 20:22:58,987 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Is ROOT
>>> volume READY (pool already allocated)?: No
>>> 2015-11-26 20:22:58,987 DEBUG [c.c.d.FirstFitPlanner]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Searching
>>> resources only under specified Pod: 3
>>> 2015-11-26 20:22:58,987 DEBUG [c.c.d.FirstFitPlanner]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Listing
>>> clusters in order of aggregate capacity, that have (atleast one host
>> with)
>>> enough CPU and RAM capacity under this Pod: 3
>>> 2015-11-26 20:22:58,988 DEBUG [c.c.d.FirstFitPlanner]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) No clusters
>>> found having a host with enough capacity, returning.
>>> 2015-11-26 20:22:58,995 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) VM state
>>> transitted from :Starting to Stopped with event: OperationFailedvm's
>>> original host id: null new host id: null host id before state
>> transition: 4
>>> 2015-11-26 20:22:58,998 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Hosts's
>>> actual total CPU: 3399 and CPU after applying overprovisioning: 3399
>>> 2015-11-26 20:22:58,998 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Hosts's
>>> actual total RAM: 15354505344 and RAM after applying overprovisioning:
>>> 15354505216
>>> 2015-11-26 20:22:58,998 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) release cpu
>>> from host: 4, old used: 2500,reserved: 0, actual total: 3399, total with
>>> overprovisioning: 3399; new used: 1500,reserved:0; movedfromreserved:
>>> false,moveToReserveredfalse
>>> 2015-11-26 20:22:58,998 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) release mem
>>> from host: 4, old used: 2952790016,reserved: 0, total: 15354505216; new
>>> used: 1879048192,reserved:0; movedfromreserved:
>> false,moveToReserveredfalse
>>> 2015-11-26 20:22:59,004 ERROR [c.c.v.VmWorkJobHandlerProxy]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Invocation
>>> exception, caused by:
>>> com.cloud.exception.InsufficientServerCapacityException: Unable to
>> create a
>>> deployment for VM[User|i-2-5-VM]Scope=interface com.cloud.dc.DataCenter;
>>> id=3
>>> 2015-11-26 20:22:59,004 INFO [c.c.v.VmWorkJobHandlerProxy]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Rethrow
>>> exception com.cloud.exception.InsufficientServerCapacityException: Unable
>>> to create a deployment for VM[User|i-2-5-VM]Scope=interface
>>> com.cloud.dc.DataCenter; id=3
>>> 2015-11-26 20:22:59,004 DEBUG [c.c.v.VmWorkJobDispatcher]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Done with run of VM work
>>> job: com.cloud.vm.VmWorkStart for VM 5, job origin: 68
>>> 2015-11-26 20:22:59,004 ERROR [c.c.v.VmWorkJobDispatcher]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Unable to complete
>>> AsyncJobVO {id:71, userId: 2, accountId: 2, instanceType: null,
>> instanceId:
>>> null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
>>>
>>>
>> rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAABXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwc3IAEWphdmEudXRpbC5IYXNoTWFwBQfawcMWYNEDAAJGAApsb2FkRmFjdG9ySQAJdGhyZXNob2xkeHA_QAAAAAAADHcIAAAAEAAAAAF0AApWbVBhc3N3b3JkdAAcck8wQUJYUUFEbk5oZG1Wa1gzQmhjM04zYjNKa3hw,
>>> cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
>>> result: null, initMsid: 52229922654, completeMsid: null, lastUpdated:
>> null,
>>> lastPolled: null, created: Thu Nov 26 20:22:46 IST 2015}, job origin:68
>>> com.cloud.exception.InsufficientServerCapacityException: Unable to
>> create a
>>> deployment for VM[User|i-2-5-VM]Scope=interface com.cloud.dc.DataCenter;
>>> id=3
>>> at
>>>
>>>
>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:959)
>>> at
>>>
>>>
>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4580)
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> at
>>>
>>>
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>> at
>>>
>>>
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>> at java.lang.reflect.Method.invoke(Method.java:606)
>>> at
>>>
>>>
>> com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
>>> at
>>>
>>>
>> com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4736)
>>> at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
>>> at
>>>
>>>
>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
>>> at
>>>
>>>
>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>>> at
>>>
>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>>> at
>>>
>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>>> at
>>>
>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>>> at
>>>
>>>
>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>>> at
>>>
>>>
>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
>>> at
>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>>> at
>>>
>>>
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>> at
>>>
>>>
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>> at java.lang.Thread.run(Thread.java:745)
>>> 2015-11-26 20:22:59,013 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Complete async job-71,
>>> jobStatus: FAILED, resultCode: 0, result:
>>>
>>>
>> rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAAzVW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1VzZXJ8aS0yLTUtVk1ddXIAHltMamF2YS5sYW5nLlN0YWNrVHJhY2VFbGVtZW50OwJGKjw8_SI5AgAAeHAAAAAVc3IAG2phdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudGEJxZomNt2FAgAESQAKbGluZU51bWJlckwADmRlY2xhcmluZ0NsYXNzcQB-AApMAAhmaWxlTmFtZXEAfgAKTAAKbWV0aG9kTmFtZXEAfgAKeHAAAAO_dAAmY29tLmNsb3VkLnZtLlZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGx0AB5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsLmphdmF0ABBvcmNoZXN0cmF0ZVN0YXJ0c3EAfgARAAAR5HEAfgATcQB-ABRxAH4AFXNxAH4AEf____50ACRzdW4ucmVmbGVjdC5OYXRpdmVNZXRob2RBY2Nlc3NvckltcGx0AB1OYXRpdmVNZXRob2RBY2Nlc3NvckltcGwuamF2YXQAB2ludm9rZTBzcQB-ABEAAAA5cQB-ABhxAH4AGXQABmludm9rZXNxAH4AEQAAACt0AChzdW4ucmVmbGVjdC5EZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsdAAhRGVsZWdhdGluZ01ldGhvZEFjY2Vzc29ySW1wbC5qYXZhcQB-ABxzcQB-ABEAAAJedAAYamF2YS5sYW5nLnJlZmxlY3QuTWV0aG9kdAALTWV0aG9kLmphdmFxAH4AHHNxAH4AEQAAAGt0ACJjb20uY2xvdWQudm0uVm1Xb3JrSm9iSGFuZGxlclByb3h5dAAaVm1Xb3JrSm9iSGFuZGxlclByb3h5LmphdmF0AA9oYW5kbGVWbVdvcmtKb2JzcQB-ABEAABKAcQB-ABNxAH4AFHEAfgAmc3EAfgARAAAAZnQAIGNvbS5jbG91ZC52bS5WbVdvcmtKb2JEaXNwYXRjaGVydAAYVm1Xb3JrSm9iRGlzcGF0Y2hlci5qYXZhdAAGcnVuSm9ic3EAfgARAAACGXQAP29yZy5hcGFjaGUuY2xvdWRzdGFjay5mcmFtZXdvcmsuam9icy5pbXBsLkFzeW5jSm9iTWFuYWdlckltcGwkNXQAGEFzeW5jSm9iTWFuYWdlckltcGwuamF2YXQADHJ1bkluQ29udGV4dHNxAH4AEQAAADF0AD5vcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGUkMXQAG01hbmFnZWRDb250ZXh0UnVubmFibGUuamF2YXQAA3J1bnNxAH4AEQAAADh0AEJvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0JDF0ABpEZWZhdWx0TWFuYWdlZENvbnRleHQuamF2YXQABGNhbGxzcQB-ABEAAABndABAb3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5pbXBsLkRlZmF1bHRNYW5hZ2VkQ29udGV4dHEAfgA2dAAPY2FsbFdpdGhDb250ZXh0c3EAfgARAAAANXEAfgA5cQB-ADZ0AA5ydW5XaXRoQ29udGV4dHNxAH4AEQAAAC50ADxvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGVxAH4AMnEAfgAzc3EAfgARAAAB7nEAfgAtcQB-AC5xAH4AM3NxAH4AEQAAAdd0AC5qYXZhLnV0aWwuY29uY3VycmVudC5FeGVjdXRvcnMkUnVubmFibGVBZGFwdGVydAAORXhlY3V0b3JzLmphdmFxAH4AN3NxAH4AEQAAAQZ0AB9qYXZhLnV0aWwuY29uY3VycmVudC5GdXR1cmVUYXNrdAAPRnV0dXJlVGFzay5qYXZhcQB-ADNzcQB-ABEAAAR5dAAnamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9ydAAXVGhyZWFkUG9vbEV4ZWN1dG9yLmphdmF0AAlydW5Xb3JrZXJzcQB-ABEAAAJndAAuamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9yJFdvcmtlcnEAfgBIcQB-ADNzcQB-ABEAAALpdAAQamF2YS5sYW5nLlRocmVhZHQAC1RocmVhZC5qYXZhcQB-ADNzcgAmamF2YS51dGlsLkNvbGxlY3Rpb25zJFVubW9kaWZpYWJsZUxpc3T8DyUxteyOEAIAAUwABGxpc3RxAH4ADHhyACxqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlQ29sbGVjdGlvbhlCAIDLXvceAgABTAABY3QAFkxqYXZhL3V0aWwvQ29sbGVjdGlvbjt4cHNyABNqYXZhLnV0aWwuQXJyYXlMaXN0eIHSHZnHYZ0DAAFJAARzaXpleHAAAAAAdwQAAAAAeHEAfgBUeHNyABFqYXZhLmxhbmcuSW50ZWdlchLioKT3gYc4AgABSQAFdmFsdWV4cgAQamF2YS5sYW5nLk51bWJlcoaslR0LlOCLAgAAeHAAABDvc3EAfgBTAAAAAHcEAAAAAHhzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHEAfgBWAAAAAAAAAAN2cgAXY29tLmNsb3VkLmRjLkRhdGFDZW50ZXKy8Qrrp-d4vgIAAHhwAA
>>> 2015-11-26 20:22:59,015 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Publish async job-71
>>> complete on message bus
>>> 2015-11-26 20:22:59,015 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Wake up jobs related to
>>> job-71
>>> 2015-11-26 20:22:59,016 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Update db status for
>>> job-71
>>> 2015-11-26 20:22:59,016 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Wake up jobs joined with
>>> job-71 and disjoin all subjobs created from job- 71
>>> 2015-11-26 20:22:59,022 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Done executing
>>> com.cloud.vm.VmWorkStart for job-71
>>> 2015-11-26 20:22:59,022 INFO [o.a.c.f.j.i.AsyncJobMonitor]
>>> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Remove job-71 from job
>>> monitoring
>>> 2015-11-26 20:22:59,032 DEBUG [c.c.v.UserVmManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Destroying vm
>>> VM[User|i-2-5-VM] as it failed to create on Host with Id:null
>>> 2015-11-26 20:22:59,040 DEBUG [c.c.c.CapacityManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) VM state transitted
>>> from :Stopped to Error with event: OperationFailedToErrorvm's original
>> host
>>> id: null new host id: null host id before state transition: null
>>> 2015-11-26 20:22:59,051 DEBUG [c.c.u.AccountManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Access granted to
>>> Acct[20064ffe-9415-11e5-a790-000c29255f5e-admin] to Domain:1/ by
>>> AffinityGroupAccessChecker
>>> 2015-11-26 20:22:59,076 DEBUG [c.c.u.AccountManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Access granted to
>>> Acct[20064ffe-9415-11e5-a790-000c29255f5e-admin] to Domain:1/ by
>>> AffinityGroupAccessChecker
>>> 2015-11-26 20:22:59,080 WARN [o.a.c.alerts]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) alertType:: 8 //
>>> dataCenterId:: 3 // podId:: 3 // clusterId:: null // message:: Failed to
>>> deploy Vm with Id: 5, on Host with Id: null
>>> 2015-11-26 20:22:59,095 ERROR [c.c.a.ApiAsyncJobDispatcher]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68) Unexpected exception while
>>> executing org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin
>>> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due
>>> to insufficient capacity
>>> at
>>>
>>>
>> com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:622)
>>> at
>>>
>>>
>> org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:242)
>>> at
>>>
>>>
>> org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:212)
>>> at
>>>
>>>
>> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3870)
>>> at
>>>
>>>
>> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3488)
>>> at
>>>
>>>
>> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3476)
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> at
>>>
>>>
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>> at
>>>
>>>
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>> at java.lang.reflect.Method.invoke(Method.java:606)
>>> at
>>>
>>>
>> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
>>> at
>>>
>>>
>> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
>>> at
>>>
>>>
>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
>>> at
>>>
>>>
>> org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:106)
>>> at
>>>
>>>
>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
>>> at
>>>
>>>
>> com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
>>> at
>>>
>>>
>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
>>> at
>>>
>>>
>> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
>>> at
>>>
>>>
>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
>>> at
>>>
>>>
>> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
>>> at com.sun.proxy.$Proxy202.startVirtualMachine(Unknown Source)
>>> at
>>>
>>>
>> org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin.execute(DeployVMCmdByAdmin.java:50)
>>> at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
>>> at
>>>
>> com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
>>> at
>>>
>>>
>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
>>> at
>>>
>>>
>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>>> at
>>>
>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>>> at
>>>
>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>>> at
>>>
>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>>> at
>>>
>>>
>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>>> at
>>>
>>>
>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
>>> at
>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>>> at
>>>
>>>
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>> at
>>>
>>>
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>> at java.lang.Thread.run(Thread.java:745)
>>> Caused by: com.cloud.exception.InsufficientServerCapacityException:
>> Unable
>>> to create a deployment for VM[User|i-2-5-VM]Scope=interface
>>> com.cloud.dc.DataCenter; id=3
>>> at
>>>
>>>
>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:959)
>>> at
>>>
>>>
>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4580)
>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>> ... 18 more
>>> 2015-11-26 20:22:59,097 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68) Complete async job-68,
>> jobStatus:
>>> FAILED, resultCode: 530, result:
>>>
>>>
>> org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable
>>> to start a VM due to insufficient capacity"}
>>> 2015-11-26 20:22:59,097 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68) Publish async job-68 complete on
>>> message bus
>>> 2015-11-26 20:22:59,097 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68) Wake up jobs related to job-68
>>> 2015-11-26 20:22:59,097 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68) Update db status for job-68
>>> 2015-11-26 20:22:59,098 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68) Wake up jobs joined with job-68
>>> and disjoin all subjobs created from job- 68
>>> 2015-11-26 20:22:59,100 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68) Done executing
>>> org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin for job-68
>>> 2015-11-26 20:22:59,100 INFO [o.a.c.f.j.i.AsyncJobMonitor]
>>> (API-Job-Executor-3:ctx-a2ed53c6 job-68) Remove job-68 from job
>> monitoring
>>> 2015-11-26 20:22:59,608 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-8:ctx-dd95e514) ===START=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549644927
>>> 2015-11-26 20:22:59,619 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-8:ctx-dd95e514 ctx-3583ca96) ===END=== 10.0.0.93 -- GET
>>>
>>>
>> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549644927
>>> 2015-11-26 20:22:59,623 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-9:ctx-c94acc67) ===START=== 10.0.0.93 -- GET
>>>
>>>
>> command=listVirtualMachines&id=4ce4731f-22a7-42ac-8e78-093d5f2e9a34&response=json&_=1448549644944
>>> 2015-11-26 20:22:59,639 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-9:ctx-c94acc67 ctx-b3ea1be2) ===END=== 10.0.0.93 -- GET
>>>
>>>
>> command=listVirtualMachines&id=4ce4731f-22a7-42ac-8e78-093d5f2e9a34&response=json&_=1448549644944
>>> 2015-11-26 20:23:01,968 DEBUG [c.c.a.m.AgentManagerImpl]
>>> (AgentManager-Handler-10:null) SeqA 5-1790: Processing Seq 5-1790: {
>> Cmd ,
>>> MgmtId: -1, via: 5, Ver: v1, Flags: 11,
>>>
>>>
>> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
>>> \"connections\": []\n}","wait":0}}] }
>>> 2015-11-26 20:23:01,972 DEBUG [c.c.a.m.AgentManagerImpl]
>>> (AgentManager-Handler-10:null) SeqA 5-1790: Sending Seq 5-1790: { Ans: ,
>>> MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
>>> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
>>> 2015-11-26 20:23:04,354 DEBUG [o.a.c.s.SecondaryStorageManagerImpl]
>>> (secstorage-1:ctx-e4c5abdc) Zone 3 is ready to launch secondary storage
>> VM
>>> 2015-11-26 20:23:04,680 DEBUG [c.c.c.ConsoleProxyManagerImpl]
>>> (consoleproxy-1:ctx-f87cf64e) Zone 3 is ready to launch console proxy
>>> 2015-11-26 20:23:08,020 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (AsyncJobMgr-Heartbeat-1:ctx-39ec59bb) Begin cleanup expired async-jobs
>>> 2015-11-26 20:23:08,023 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (AsyncJobMgr-Heartbeat-1:ctx-39ec59bb) End cleanup expired async-jobs
>>>
>>> Regards,
>>> Venkatesh.k
>>>
>>>
>>> On Thu, Nov 26, 2015 at 9:04 PM, kotipalli venkatesh <
>>> venkateshcloudtest@gmail.com> wrote:
>>>
>>>> Hi Erik,
>>>>
>>>> We found the error log, Please look in to this below error log,
>>>>
>>>> 2015-11-26 20:22:46,603 DEBUG [c.c.a.m.AgentAttache]
>>>> (DirectAgent-279:ctx-532427fb) Seq 4-8612571337392652847: No more
>>> commands
>>>> found
>>>> 2015-11-26 20:22:46,607 INFO [o.a.c.s.v.VolumeServiceImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) releasing
>>>> lock for VMTemplateStoragePool 3
>>>> 2015-11-26 20:22:46,608 DEBUG [o.a.c.e.o.VolumeOrchestrator]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Unable to
>>>> create Vol[6|vm=5|ROOT]:Expected 1 VDI template but found 2 VDI
>>> template(s)
>>>> on: 10.0.0.170:/export/secondary/template/tmpl/1/5
>>>> 2015-11-26 20:22:46,608 INFO [c.c.v.VirtualMachineManagerImpl]
>>>> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Unable to
>>>> contact resource.
>>>> com.cloud.exception.StorageUnavailableException: Resource
>> [StoragePool:8]
>>>> is unreachable: Unable to create Vol[6|vm=5|ROOT]:Expected 1 VDI
>> template
>>>> but found 2 VDI template(s) on: 10.0.0.170:
>>>> /export/secondary/template/tmpl/1/5
>>>>
>>>>
>>>> /export/secondary/template/tmpl/1/5 Inside the 2 .vhd files and one
>>>> template properties file is there please look in to the below files;
>>>>
>>>> 3986df71-b1d0-3e20-a655-7e42dd144370.vhd
>>>> 429d6340-6a5f-31ce-a581-cc05618500ab.vhd template.properties
>>>>
>>>> Which one is remove?
>>>>
>>>> Could you please suggest.
>>>>
>>>> Regards,
>>>> Venkatesh.k
>>>>
>>>> On Thu, Nov 26, 2015 at 6:11 PM, Erik Weber <te...@gmail.com>
>> wrote:
>>>>
>>>>> You need to paste more of your logs, in particular the (a lot of)
>> lines
>>>>> before the exception where all the resource allocations happen.
>>>>>
>>>>> --
>>>>> Erik
>>>>>
>>>>> On Thu, Nov 26, 2015 at 1:38 PM, kotipalli venkatesh <
>>>>> venkateshcloudtest@gmail.com> wrote:
>>>>>
>>>>>> Hi All,
>>>>>>
>>>>>> I have successfully installed Cloudstack 4.6.0 setup
>>>>>> hypervisor is xenserver 6.5
>>>>>>
>>>>>> Successfully up and running SSVM and CPVM and Default templates
>>>>> downloaded.
>>>>>>
>>>>>> When i am spin the new instance it 's troughs *insufficient memory
>>>>> error*.
>>>>>> But i have *sufficient place* *RAM* and *STORAGE* also.
>>>>>>
>>>>>> Please look in to this Management server log:
>>>>>>
>>>>>> 2015-11-26 17:49:10,572 WARN [o.a.c.alerts]
>>>>>> (API-Job-Executor-1:ctx-801f0a96 job-56 ctx-63dfadf9) alertType:: 8
>>> //
>>>>>> dataCenterId:: 3 // podId:: 3 // clusterId:: null // message::
>> Failed
>>> to
>>>>>> deploy Vm with Id: 3, on Host with Id: null
>>>>>> 2015-11-26 17:49:10,601 ERROR [c.c.a.ApiAsyncJobDispatcher]
>>>>>> (API-Job-Executor-1:ctx-801f0a96 job-56) Unexpected exception while
>>>>>> executing
>>> org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin
>>>>>> com.cloud.utils.exception.CloudRuntimeException: Unable to start a
>> VM
>>>>> due
>>>>>> to insufficient capacity
>>>>>> at
>>>>>>
>>>>>>
>>>>>
>>>
>> com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:622)
>>>>>> at
>>>>>>
>>>>>>
>>>>>
>>>
>> org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:242)
>>>>>> at
>>>>>>
>>>>>>
>>>>>
>>>
>> org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:212)
>>>>>> at
>>>>>>
>>>>>>
>>>>>
>>>
>> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3870)
>>>>>> at
>>>>>>
>>>>>>
>>>>>
>>>
>> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3488)
>>>>>> at
>>>>>>
>>>>>>
>>>>>
>>>
>> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3476)
>>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
>> Method)
>>>>>> at
>>>>>>
>>>>>>
>>>>>
>>>
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>>>>> at
>>>>>>
>>>>>>
>>>>>
>>>
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>>>>> at java.lang.reflect.Method.invoke(Method.java:606)
>>>>>> at
>>>>>>
>>>>>>
>>>>>
>>>
>> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
>>>>>> at
>>>>>>
>>>>>>
>>>>>
>>>
>> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
>>>>>> at
>>>>>>
>>>>>>
>>>>>
>>>
>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
>>>>>> at
>>>>>>
>>>>>>
>>>>>
>>>
>> org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:106)
>>>>>> at
>>>>>>
>>>>>>
>>>>>
>>>
>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
>>>>>> at
>>>>>>
>>>>>>
>>>>>
>>>
>> com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
>>>>>> at
>>>>>>
>>>>>>
>>>>>
>>>
>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
>>>>>> at
>>>>>>
>>>>>>
>>>>>
>>>
>> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
>>>>>> at
>>>>>>
>>>>>>
>>>>>
>>>
>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
>>>>>> at
>>>>>>
>>>>>>
>>>>>
>>>
>> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
>>>>>> at com.sun.proxy.$Proxy202.startVirtualMachine(Unknown
>> Source)
>>>>>> at
>>>>>>
>>>>>>
>>>>>
>>>
>> org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin.execute(DeployVMCmdByAdmin.java:50)
>>>>>> at
>>> com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
>>>>>> at
>>>>>>
>>>>>
>>>
>> com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
>>>>>> at
>>>>>>
>>>>>>
>>>>>
>>>
>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
>>>>>> at
>>>>>>
>>>>>>
>>>>>
>>>
>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>>>>>> at
>>>>>>
>>>>>>
>>>>>
>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>>>>>> at
>>>>>>
>>>>>>
>>>>>
>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>>>>>> at
>>>>>>
>>>>>>
>>>>>
>>>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>>>>>> at
>>>>>>
>>>>>>
>>>>>
>>>
>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>>>>>> at
>>>>>>
>>>>>>
>>>>>
>>>
>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
>>>>>> at
>>>>>>
>>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>>>>> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>>>>>> at
>>>>>>
>>>>>>
>>>>>
>>>
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>>>>> at
>>>>>>
>>>>>>
>>>>>
>>>
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>>>>> at java.lang.Thread.run(Thread.java:745)
>>>>>> Caused by: com.cloud.exception.InsufficientServerCapacityException:
>>>>> Unable
>>>>>> to create a deployment for VM[User|i-2-3-VM]Scope=interface
>>>>>> com.cloud.dc.DataCenter; id=3
>>>>>> at
>>>>>>
>>>>>>
>>>>>
>>>
>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:959)
>>>>>>
>>>>>> Please any suggestion....
>>>>>>
>>>>>> Warm Regards,
>>>>>> Venkatesh.k
>>>>>>
>>>>>
>>>>
>>>>
>>>
>>
>>
>>
>> --
>> Rafael Weingärtner
>>
Re: Insufficient Memory error
Posted by kotipalli venkatesh <ve...@gmail.com>.
Hi Weingärtner,
Yes, storage server is available on host and Sufficient place in RAM also.
Could you please help me guys..
Regards,
Venkatesh.k
On Fri, Nov 27, 2015 at 4:01 AM, Rafael Weingärtner <
rafaelweingartner@gmail.com> wrote:
> is the storage server available on your hosts ?
> I notice that on your log files:
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Unable to
> contact resource.
> com.cloud.exception.StorageUnavailableException: Resource [StoragePool:8]
> is unreachable: Unable to create Vol[6|vm=5|ROOT]:Expected 1 VDI template
> but found 2 VDI template(s) on: 10.0.0.170:
> /export/secondary/template/tmpl/1/5
> at
>
> On Thu, Nov 26, 2015 at 1:49 PM, kotipalli venkatesh <
> venkateshcloudtest@gmail.com> wrote:
>
> > Hi Erik,
> >
> > Please look in to this full log:
> >
> >
> > 2015-11-26 20:21:46,959 DEBUG [c.c.a.m.AgentManagerImpl]
> > (AgentManager-Handler-15:null) SeqA 5-1781: Processing Seq 5-1781: {
> Cmd ,
> > MgmtId: -1, via: 5, Ver: v1, Flags: 11,
> >
> >
> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
> > \"connections\": []\n}","wait":0}}] }
> > 2015-11-26 20:21:46,962 DEBUG [c.c.a.m.AgentManagerImpl]
> > (AgentManager-Handler-15:null) SeqA 5-1781: Sending Seq 5-1781: { Ans: ,
> > MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
> > [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
> > 2015-11-26 20:21:48,018 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (AsyncJobMgr-Heartbeat-1:ctx-0bf05867) Begin cleanup expired async-jobs
> > 2015-11-26 20:21:48,020 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (AsyncJobMgr-Heartbeat-1:ctx-0bf05867) End cleanup expired async-jobs
> > 2015-11-26 20:21:48,210 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (RouterStatusMonitor-1:ctx-0e1a35ca) Found 1 routers to update status.
> > 2015-11-26 20:21:48,210 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (RouterStatusMonitor-1:ctx-0e1a35ca) Found 0 VPC networks to update
> > Redundant State.
> > 2015-11-26 20:21:48,211 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (RouterStatusMonitor-1:ctx-0e1a35ca) Found 0 networks to update RvR
> status.
> > 2015-11-26 20:21:48,222 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (RouterStatusMonitor-1:ctx-71753b97) Found 1 routers to update status.
> > 2015-11-26 20:21:48,222 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (RouterStatusMonitor-1:ctx-71753b97) Found 0 VPC networks to update
> > Redundant State.
> > 2015-11-26 20:21:48,223 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (RouterStatusMonitor-1:ctx-71753b97) Found 0 networks to update RvR
> status.
> > 2015-11-26 20:21:53,165 DEBUG [c.c.h.d.HostDaoImpl]
> (ClusteredAgentManager
> > Timer:ctx-3ab0cd7f) Resetting hosts suitable for reconnect
> > 2015-11-26 20:21:53,166 DEBUG [c.c.h.d.HostDaoImpl]
> (ClusteredAgentManager
> > Timer:ctx-3ab0cd7f) Completed resetting hosts suitable for reconnect
> > 2015-11-26 20:21:53,166 DEBUG [c.c.h.d.HostDaoImpl]
> (ClusteredAgentManager
> > Timer:ctx-3ab0cd7f) Acquiring hosts for clusters already owned by this
> > management server
> > 2015-11-26 20:21:53,168 DEBUG [c.c.h.d.HostDaoImpl]
> (ClusteredAgentManager
> > Timer:ctx-3ab0cd7f) Completed acquiring hosts for clusters already owned
> by
> > this management server
> > 2015-11-26 20:21:53,168 DEBUG [c.c.h.d.HostDaoImpl]
> (ClusteredAgentManager
> > Timer:ctx-3ab0cd7f) Acquiring hosts for clusters not owned by any
> > management server
> > 2015-11-26 20:21:53,168 DEBUG [c.c.h.d.HostDaoImpl]
> (ClusteredAgentManager
> > Timer:ctx-3ab0cd7f) Completed acquiring hosts for clusters not owned by
> any
> > management server
> > 2015-11-26 20:21:55,958 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-2:ctx-5db7a86d) ===START=== 10.0.0.93 -- GET
> >
> >
> command=deployVirtualMachine&response=json&zoneid=5b752672-2ac9-4ec0-86a6-103cae8217d1&templateid=900a5634-9414-11e5-ae19-000c29255f5e&hypervisor=XenServer&serviceofferingid=94b83ad1-406c-44d5-86c0-d4dbb82a50a1&diskofferingid=30f3f1fa-76b2-4bcb-82c5-449ce7d9a4c8&iptonetworklist%5B0%5D.networkid=2e97fcee-3d01-40d2-a624-376661747d0c&displayname=Test002&name=Test002&_=1448549581263
> > 2015-11-26 20:21:55,969 DEBUG [c.c.u.AccountManagerImpl]
> > (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Access granted to
> > Acct[20064ffe-9415-11e5-a790-000c29255f5e-admin] to
> > com.cloud.service.ServiceOfferingVO$$EnhancerByCGLIB$$8b588241@5020f5b3
> by
> > AffinityGroupAccessChecker
> > 2015-11-26 20:21:55,969 DEBUG [c.c.u.AccountManagerImpl]
> > (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Access granted to
> > Acct[20064ffe-9415-11e5-a790-000c29255f5e-admin] to
> > com.cloud.storage.DiskOfferingVO$$EnhancerByCGLIB$$a160ea41@45e982eb by
> > AffinityGroupAccessChecker
> > 2015-11-26 20:21:55,976 DEBUG [c.c.n.NetworkModelImpl]
> > (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Service SecurityGroup is not
> > supported in the network id=212
> > 2015-11-26 20:21:55,982 DEBUG [c.c.v.UserVmManagerImpl]
> > (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Allocating in the DB for vm
> > 2015-11-26 20:21:55,988 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Allocating entries for VM:
> > VM[User|i-2-5-VM]
> > 2015-11-26 20:21:55,988 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Allocating nics for
> > VM[User|i-2-5-VM]
> > 2015-11-26 20:21:55,989 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Allocating nic for vm
> > VM[User|i-2-5-VM] in network Ntwk[212|Guest|8] with requested profile
> > NicProfile[0-0-null-null-null
> > 2015-11-26 20:21:55,996 DEBUG [c.c.n.NetworkModelImpl]
> > (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Service SecurityGroup is not
> > supported in the network id=212
> > 2015-11-26 20:21:55,997 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Allocating disks for
> > VM[User|i-2-5-VM]
> > 2015-11-26 20:21:56,008 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Allocation completed for VM:
> > VM[User|i-2-5-VM]
> > 2015-11-26 20:21:56,009 DEBUG [c.c.v.UserVmManagerImpl]
> > (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Successfully allocated DB
> entry
> > for VM[User|i-2-5-VM]
> > 2015-11-26 20:21:56,034 DEBUG [c.c.n.NetworkModelImpl]
> > (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Service SecurityGroup is not
> > supported in the network id=212
> > 2015-11-26 20:21:56,037 DEBUG [c.c.n.NetworkModelImpl]
> > (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Service SecurityGroup is not
> > supported in the network id=212
> > 2015-11-26 20:21:56,053 INFO [o.a.c.f.j.i.AsyncJobMonitor]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68) Add job-68 into job monitoring
> > 2015-11-26 20:21:56,054 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) submit async job-68, details:
> > AsyncJobVO {id:68, userId: 2, accountId: 2, instanceType: VirtualMachine,
> > instanceId: 5, cmd:
> > org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin, cmdInfo:
> >
> >
> {"serviceofferingid":"94b83ad1-406c-44d5-86c0-d4dbb82a50a1","cmdEventType":"VM.CREATE","ctxUserId":"2","zoneid":"5b752672-2ac9-4ec0-86a6-103cae8217d1","httpmethod":"GET","templateid":"900a5634-9414-11e5-ae19-000c29255f5e","response":"json","id":"5","ctxDetails":"{\"interface
> >
> >
> com.cloud.template.VirtualMachineTemplate\":\"900a5634-9414-11e5-ae19-000c29255f5e\",\"interface
> >
> >
> com.cloud.offering.DiskOffering\":\"30f3f1fa-76b2-4bcb-82c5-449ce7d9a4c8\",\"interface
> >
> >
> com.cloud.offering.ServiceOffering\":\"94b83ad1-406c-44d5-86c0-d4dbb82a50a1\",\"interface
> >
> >
> com.cloud.vm.VirtualMachine\":\"4ce4731f-22a7-42ac-8e78-093d5f2e9a34\",\"interface
> >
> >
> com.cloud.dc.DataCenter\":\"5b752672-2ac9-4ec0-86a6-103cae8217d1\"}","hypervisor":"XenServer","name":"Test002","iptonetworklist[0].networkid":"2e97fcee-3d01-40d2-a624-376661747d0c","_":"1448549581263","uuid":"4ce4731f-22a7-42ac-8e78-093d5f2e9a34","ctxAccountId":"2","diskofferingid":"30f3f1fa-76b2-4bcb-82c5-449ce7d9a4c8","ctxStartEventId":"168","displayname":"Test002"},
> > cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
> > result: null, initMsid: 52229922654, completeMsid: null, lastUpdated:
> null,
> > lastPolled: null, created: null}
> > 2015-11-26 20:21:56,058 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) ===END=== 10.0.0.93 -- GET
> >
> >
> command=deployVirtualMachine&response=json&zoneid=5b752672-2ac9-4ec0-86a6-103cae8217d1&templateid=900a5634-9414-11e5-ae19-000c29255f5e&hypervisor=XenServer&serviceofferingid=94b83ad1-406c-44d5-86c0-d4dbb82a50a1&diskofferingid=30f3f1fa-76b2-4bcb-82c5-449ce7d9a4c8&iptonetworklist%5B0%5D.networkid=2e97fcee-3d01-40d2-a624-376661747d0c&displayname=Test002&name=Test002&_=1448549581263
> > 2015-11-26 20:21:56,061 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68) Executing AsyncJobVO {id:68,
> > userId: 2, accountId: 2, instanceType: VirtualMachine, instanceId: 5,
> cmd:
> > org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin, cmdInfo:
> >
> >
> {"serviceofferingid":"94b83ad1-406c-44d5-86c0-d4dbb82a50a1","cmdEventType":"VM.CREATE","ctxUserId":"2","zoneid":"5b752672-2ac9-4ec0-86a6-103cae8217d1","httpmethod":"GET","templateid":"900a5634-9414-11e5-ae19-000c29255f5e","response":"json","id":"5","ctxDetails":"{\"interface
> >
> >
> com.cloud.template.VirtualMachineTemplate\":\"900a5634-9414-11e5-ae19-000c29255f5e\",\"interface
> >
> >
> com.cloud.offering.DiskOffering\":\"30f3f1fa-76b2-4bcb-82c5-449ce7d9a4c8\",\"interface
> >
> >
> com.cloud.offering.ServiceOffering\":\"94b83ad1-406c-44d5-86c0-d4dbb82a50a1\",\"interface
> >
> >
> com.cloud.vm.VirtualMachine\":\"4ce4731f-22a7-42ac-8e78-093d5f2e9a34\",\"interface
> >
> >
> com.cloud.dc.DataCenter\":\"5b752672-2ac9-4ec0-86a6-103cae8217d1\"}","hypervisor":"XenServer","name":"Test002","iptonetworklist[0].networkid":"2e97fcee-3d01-40d2-a624-376661747d0c","_":"1448549581263","uuid":"4ce4731f-22a7-42ac-8e78-093d5f2e9a34","ctxAccountId":"2","diskofferingid":"30f3f1fa-76b2-4bcb-82c5-449ce7d9a4c8","ctxStartEventId":"168","displayname":"Test002"},
> > cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
> > result: null, initMsid: 52229922654, completeMsid: null, lastUpdated:
> null,
> > lastPolled: null, created: null}
> > 2015-11-26 20:21:56,085 DEBUG [c.c.n.NetworkModelImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Service
> SecurityGroup
> > is not supported in the network id=212
> > 2015-11-26 20:21:56,087 DEBUG [c.c.n.NetworkModelImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Service
> SecurityGroup
> > is not supported in the network id=212
> > 2015-11-26 20:21:56,094 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Deploy avoids pods:
> > [], clusters: [], hosts: []
> > 2015-11-26 20:21:56,095 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) DeploymentPlanner
> > allocation algorithm: com.cloud.deploy.FirstFitPlanner@1136745
> > 2015-11-26 20:21:56,095 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Trying to allocate
> a
> > host and storage pools from dc:3, pod:null,cluster:null, requested cpu:
> > 1000, requested ram: 1073741824
> > 2015-11-26 20:21:56,095 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Is ROOT volume
> READY
> > (pool already allocated)?: No
> > 2015-11-26 20:21:56,095 DEBUG [c.c.d.FirstFitPlanner]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Searching all
> > possible resources under this Zone: 3
> > 2015-11-26 20:21:56,096 DEBUG [c.c.d.FirstFitPlanner]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Listing clusters in
> > order of aggregate capacity, that have (atleast one host with) enough CPU
> > and RAM capacity under this Zone: 3
> > 2015-11-26 20:21:56,097 DEBUG [c.c.d.FirstFitPlanner]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Removing from the
> > clusterId list these clusters from avoid set: []
> > 2015-11-26 20:21:56,103 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking resources
> in
> > Cluster: 3 under Pod: 3
> > 2015-11-26 20:21:56,104 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
> > FirstFitRoutingAllocator) Looking for hosts in dc: 3 pod:3 cluster:3
> > 2015-11-26 20:21:56,105 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
> > FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for
> > allocation: [Host[-4-Routing]]
> > 2015-11-26 20:21:56,108 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
> > FirstFitRoutingAllocator) Found 1 hosts for allocation after
> > prioritization: [Host[-4-Routing]]
> > 2015-11-26 20:21:56,108 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
> > FirstFitRoutingAllocator) Looking for speed=1000Mhz, Ram=1024
> > 2015-11-26 20:21:56,111 DEBUG [c.c.c.CapacityManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
> > FirstFitRoutingAllocator) Host: 4 has cpu capability (cpu:1, speed:3399)
> to
> > support requested CPU: 1 and requested speed: 1000
> > 2015-11-26 20:21:56,111 DEBUG [c.c.c.CapacityManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
> > FirstFitRoutingAllocator) Checking if host: 4 has enough capacity for
> > requested CPU: 1000 and requested RAM: 1073741824 ,
> > cpuOverprovisioningFactor: 1.0
> > 2015-11-26 20:21:56,113 DEBUG [c.c.c.CapacityManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
> > FirstFitRoutingAllocator) Hosts's actual total CPU: 3399 and CPU after
> > applying overprovisioning: 3399
> > 2015-11-26 20:21:56,113 DEBUG [c.c.c.CapacityManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
> > FirstFitRoutingAllocator) Free CPU: 2399 , Requested CPU: 1000
> > 2015-11-26 20:21:56,113 DEBUG [c.c.c.CapacityManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
> > FirstFitRoutingAllocator) Free RAM: 13743892480 , Requested RAM:
> 1073741824
> > 2015-11-26 20:21:56,113 DEBUG [c.c.c.CapacityManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
> > FirstFitRoutingAllocator) Host has enough CPU and RAM available
> > 2015-11-26 20:21:56,113 DEBUG [c.c.c.CapacityManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
> > FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 4, used: 1000,
> > reserved: 0, actual total: 3399, total with overprovisioning: 3399;
> > requested cpu:1000,alloc_from_last_host?:false
> ,considerReservedCapacity?:
> > true
> > 2015-11-26 20:21:56,113 DEBUG [c.c.c.CapacityManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
> > FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 4, used:
> > 1610612736, reserved: 0, total: 15354505216; requested mem:
> > 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
> > 2015-11-26 20:21:56,113 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
> > FirstFitRoutingAllocator) Found a suitable host, adding to list: 4
> > 2015-11-26 20:21:56,113 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
> > FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts
> > 2015-11-26 20:21:56,115 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking suitable
> > pools for volume (Id, Type): (6,ROOT)
> > 2015-11-26 20:21:56,115 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) We need to allocate
> > new storagepool for this volume
> > 2015-11-26 20:21:56,115 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Calling
> > StoragePoolAllocators to find suitable pools
> > 2015-11-26 20:21:56,116 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e)
> > LocalStoragePoolAllocator trying to find storage pool to fit the vm
> > 2015-11-26 20:21:56,116 DEBUG
> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e)
> > ClusterScopeStoragePoolAllocator looking for storage pool
> > 2015-11-26 20:21:56,116 DEBUG
> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Looking for pools
> in
> > dc: 3 pod:3 cluster:3. Disabled pools will be ignored.
> > 2015-11-26 20:21:56,117 DEBUG
> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found pools
> matching
> > tags: [Pool[8|NetworkFilesystem]]
> > 2015-11-26 20:21:56,118 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking if storage
> > pool is suitable, name: null ,poolId: 8
> > 2015-11-26 20:21:56,119 INFO [c.c.s.StorageManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Storage pool null
> (8)
> > does not supply IOPS capacity, assuming enough capacity
> > 2015-11-26 20:21:56,120 DEBUG [c.c.s.StorageManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool 8 for
> > storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
> > 0.019253810234789077, disable threshold: 0.85
> > 2015-11-26 20:21:56,130 DEBUG [c.c.s.StorageManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found storage pool
> > primary of type NetworkFilesystem with overprovisioning factor 2
> > 2015-11-26 20:21:56,130 DEBUG [c.c.s.StorageManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total over
> > provisioned capacity calculated is 2 * 526199291904
> > 2015-11-26 20:21:56,130 DEBUG [c.c.s.StorageManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total capacity of
> the
> > pool primary id: 8 is 1052398583808
> > 2015-11-26 20:21:56,130 DEBUG [c.c.s.StorageManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool: 8
> for
> > volume allocation [Vol[6|vm=5|ROOT]], maxSize : 1052398583808,
> > totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
> > disable threshold: 0.85
> > 2015-11-26 20:21:56,130 DEBUG
> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e)
> > ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
> > 2015-11-26 20:21:56,130 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking suitable
> > pools for volume (Id, Type): (7,DATADISK)
> > 2015-11-26 20:21:56,130 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) We need to allocate
> > new storagepool for this volume
> > 2015-11-26 20:21:56,131 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Calling
> > StoragePoolAllocators to find suitable pools
> > 2015-11-26 20:21:56,131 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e)
> > LocalStoragePoolAllocator trying to find storage pool to fit the vm
> > 2015-11-26 20:21:56,131 DEBUG
> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e)
> > ClusterScopeStoragePoolAllocator looking for storage pool
> > 2015-11-26 20:21:56,131 DEBUG
> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Looking for pools
> in
> > dc: 3 pod:3 cluster:3. Disabled pools will be ignored.
> > 2015-11-26 20:21:56,131 DEBUG
> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found pools
> matching
> > tags: [Pool[8|NetworkFilesystem]]
> > 2015-11-26 20:21:56,132 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking if storage
> > pool is suitable, name: null ,poolId: 8
> > 2015-11-26 20:21:56,132 INFO [c.c.s.StorageManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Storage pool null
> (8)
> > does not supply IOPS capacity, assuming enough capacity
> > 2015-11-26 20:21:56,133 DEBUG [c.c.s.StorageManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool 8 for
> > storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
> > 0.019253810234789077, disable threshold: 0.85
> > 2015-11-26 20:21:56,139 DEBUG [c.c.s.StorageManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found storage pool
> > primary of type NetworkFilesystem with overprovisioning factor 2
> > 2015-11-26 20:21:56,139 DEBUG [c.c.s.StorageManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total over
> > provisioned capacity calculated is 2 * 526199291904
> > 2015-11-26 20:21:56,139 DEBUG [c.c.s.StorageManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total capacity of
> the
> > pool primary id: 8 is 1052398583808
> > 2015-11-26 20:21:56,140 DEBUG [c.c.s.StorageManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool: 8
> for
> > volume allocation [Vol[7|vm=5|DATADISK]], maxSize : 1052398583808,
> > totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
> > disable threshold: 0.85
> > 2015-11-26 20:21:56,140 DEBUG
> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e)
> > ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
> > 2015-11-26 20:21:56,140 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Trying to find a
> > potenial host and associated storage pools from the suitable host/pool
> > lists for this VM
> > 2015-11-26 20:21:56,140 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking if host: 4
> > can access any suitable storage pool for volume: DATADISK
> > 2015-11-26 20:21:56,140 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Host: 4 can access
> > pool: 8
> > 2015-11-26 20:21:56,141 DEBUG [c.c.s.StorageManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool 8 for
> > storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
> > 0.019253810234789077, disable threshold: 0.85
> > 2015-11-26 20:21:56,142 DEBUG [c.c.s.StorageManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found storage pool
> > primary of type NetworkFilesystem with overprovisioning factor 2
> > 2015-11-26 20:21:56,142 DEBUG [c.c.s.StorageManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total over
> > provisioned capacity calculated is 2 * 526199291904
> > 2015-11-26 20:21:56,143 DEBUG [c.c.s.StorageManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total capacity of
> the
> > pool primary id: 8 is 1052398583808
> > 2015-11-26 20:21:56,143 DEBUG [c.c.s.StorageManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool: 8
> for
> > volume allocation [Vol[7|vm=5|DATADISK]], maxSize : 1052398583808,
> > totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
> > disable threshold: 0.85
> > 2015-11-26 20:21:56,143 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking if host: 4
> > can access any suitable storage pool for volume: ROOT
> > 2015-11-26 20:21:56,143 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Host: 4 can access
> > pool: 8
> > 2015-11-26 20:21:56,144 DEBUG [c.c.s.StorageManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool 8 for
> > storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
> > 0.019253810234789077, disable threshold: 0.85
> > 2015-11-26 20:21:56,146 DEBUG [c.c.s.StorageManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found storage pool
> > primary of type NetworkFilesystem with overprovisioning factor 2
> > 2015-11-26 20:21:56,146 DEBUG [c.c.s.StorageManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total over
> > provisioned capacity calculated is 2 * 526199291904
> > 2015-11-26 20:21:56,146 DEBUG [c.c.s.StorageManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total capacity of
> the
> > pool primary id: 8 is 1052398583808
> > 2015-11-26 20:21:56,147 DEBUG [c.c.s.StorageManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool: 8
> for
> > volume allocation [Vol[6|vm=5|ROOT]], maxSize : 1052398583808,
> > totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
> > disable threshold: 0.85
> > 2015-11-26 20:21:56,147 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found a potential
> > host id: 4 name: xenserver and associated storage pools for this VM
> > 2015-11-26 20:21:56,148 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Returning
> Deployment
> > Destination:
> >
> >
> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
> > :
> >
> >
> Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage(Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
> > Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
> > Volume(7|DATADISK-->Pool(8))]
> > 2015-11-26 20:21:56,155 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Sync job-69
> execution
> > on object VmWorkJobQueue.5
> > 2015-11-26 20:21:56,961 DEBUG [c.c.a.m.AgentManagerImpl]
> > (AgentManager-Handler-1:null) SeqA 5-1782: Processing Seq 5-1782: { Cmd
> ,
> > MgmtId: -1, via: 5, Ver: v1, Flags: 11,
> >
> >
> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
> > \"connections\": []\n}","wait":0}}] }
> > 2015-11-26 20:21:56,966 DEBUG [c.c.a.m.AgentManagerImpl]
> > (AgentManager-Handler-1:null) SeqA 5-1782: Sending Seq 5-1782: { Ans: ,
> > MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
> > [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
> > 2015-11-26 20:21:58,022 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (AsyncJobMgr-Heartbeat-1:ctx-7d4d1e50) Execute sync-queue item:
> > SyncQueueItemVO {id:9, queueId: 9, contentType: AsyncJob, contentId: 69,
> > lastProcessMsid: 52229922654, lastprocessNumber: 1, lastProcessTime: Thu
> > Nov 26 20:21:58 IST 2015, created: Thu Nov 26 20:21:56 IST 2015}
> > 2015-11-26 20:21:58,022 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (AsyncJobMgr-Heartbeat-1:ctx-7d4d1e50) Schedule queued job-69
> > 2015-11-26 20:21:58,026 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (AsyncJobMgr-Heartbeat-1:ctx-05b26563) Begin cleanup expired async-jobs
> > 2015-11-26 20:21:58,029 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (AsyncJobMgr-Heartbeat-1:ctx-05b26563) End cleanup expired async-jobs
> > 2015-11-26 20:21:58,029 INFO [o.a.c.f.j.i.AsyncJobMonitor]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Add job-69 into job
> > monitoring
> > 2015-11-26 20:21:58,033 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Executing AsyncJobVO
> > {id:69, userId: 2, accountId: 2, instanceType: null, instanceId: null,
> cmd:
> > com.cloud.vm.VmWorkStart, cmdInfo:
> >
> >
> rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAABXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAA3BzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHIAEGphdmEubGFuZy5OdW1iZXKGrJUdC5TgiwIAAHhwAAAAAAAAAANzcQB-AAgAAAAAAAAABHBwcHEAfgAKcHNyABFqYXZhLnV0aWwuSGFzaE1hcAUH2sHDFmDRAwACRgAKbG9hZEZhY3RvckkACXRocmVzaG9sZHhwP0AAAAAAAAx3CAAAABAAAAABdAAKVm1QYXNzd29yZHQAHHJPMEFCWFFBRG5OaGRtVmtYM0JoYzNOM2IzSmt4cA,
> > cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
> > result: null, initMsid: 52229922654, completeMsid: null, lastUpdated:
> null,
> > lastPolled: null, created: Thu Nov 26 20:21:56 IST 2015}
> > 2015-11-26 20:21:58,033 DEBUG [c.c.v.VmWorkJobDispatcher]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Run VM work job:
> > com.cloud.vm.VmWorkStart for VM 5, job origin: 68
> > 2015-11-26 20:21:58,034 DEBUG [c.c.v.VmWorkJobHandlerProxy]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Execute VM
> > work job:
> >
> >
> com.cloud.vm.VmWorkStart{"dcId":3,"podId":3,"clusterId":3,"hostId":4,"rawParams":{"VmPassword":"rO0ABXQADnNhdmVkX3Bhc3N3b3Jk"},"userId":2,"accountId":2,"vmId":5,"handlerName":"VirtualMachineManagerImpl"}
> > 2015-11-26 20:21:58,038 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM state
> > transitted from :Stopped to Starting with event: StartRequestedvm's
> > original host id: null new host id: null host id before state transition:
> > null
> > 2015-11-26 20:21:58,038 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> Successfully
> > transitioned to start state for VM[User|i-2-5-VM] reservation id =
> > 2a4a184a-eac9-4609-8a70-4d230ee3a37d
> > 2015-11-26 20:21:58,040 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
> > deploy VM, vm has dcId: 3 and podId: null
> > 2015-11-26 20:21:58,041 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> advanceStart:
> > DeploymentPlan is provided, using dcId:3, podId: 3, clusterId: 3, hostId:
> > 4, poolId: null
> > 2015-11-26 20:21:58,041 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deploy
> avoids
> > pods: null, clusters: null, hosts: null
> > 2015-11-26 20:21:58,045 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deploy
> avoids
> > pods: [], clusters: [], hosts: []
> > 2015-11-26 20:21:58,046 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> > DeploymentPlanner allocation algorithm:
> > com.cloud.deploy.FirstFitPlanner@1136745
> > 2015-11-26 20:21:58,046 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
> > allocate a host and storage pools from dc:3, pod:3,cluster:3, requested
> > cpu: 1000, requested ram: 1073741824
> > 2015-11-26 20:21:58,046 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Is ROOT
> > volume READY (pool already allocated)?: No
> > 2015-11-26 20:21:58,046 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> > DeploymentPlan has host_id specified, choosing this host and making no
> > checks on this host: 4
> > 2015-11-26 20:21:58,046 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Looking for
> > suitable pools for this host under zone: 3, pod: 3, cluster: 3
> > 2015-11-26 20:21:58,048 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
> > suitable pools for volume (Id, Type): (6,ROOT)
> > 2015-11-26 20:21:58,048 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) We need to
> > allocate new storagepool for this volume
> > 2015-11-26 20:21:58,049 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Calling
> > StoragePoolAllocators to find suitable pools
> > 2015-11-26 20:21:58,049 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> > LocalStoragePoolAllocator trying to find storage pool to fit the vm
> > 2015-11-26 20:21:58,049 DEBUG
> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> > ClusterScopeStoragePoolAllocator looking for storage pool
> > 2015-11-26 20:21:58,049 DEBUG
> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Looking for
> > pools in dc: 3 pod:3 cluster:3. Disabled pools will be ignored.
> > 2015-11-26 20:21:58,049 DEBUG
> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found pools
> > matching tags: [Pool[8|NetworkFilesystem]]
> > 2015-11-26 20:21:58,050 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
> > storage pool is suitable, name: null ,poolId: 8
> > 2015-11-26 20:21:58,051 INFO [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Storage
> pool
> > null (8) does not supply IOPS capacity, assuming enough capacity
> > 2015-11-26 20:21:58,052 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
> pool
> > 8 for storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
> > 0.019253810234789077, disable threshold: 0.85
> > 2015-11-26 20:21:58,054 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found
> storage
> > pool primary of type NetworkFilesystem with overprovisioning factor 2
> > 2015-11-26 20:21:58,055 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total over
> > provisioned capacity calculated is 2 * 526199291904
> > 2015-11-26 20:21:58,055 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total
> > capacity of the pool primary id: 8 is 1052398583808
> > 2015-11-26 20:21:58,055 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
> > pool: 8 for volume allocation [Vol[6|vm=5|ROOT]], maxSize :
> 1052398583808,
> > totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
> > disable threshold: 0.85
> > 2015-11-26 20:21:58,055 DEBUG
> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> > ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
> > 2015-11-26 20:21:58,055 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
> > suitable pools for volume (Id, Type): (7,DATADISK)
> > 2015-11-26 20:21:58,055 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) We need to
> > allocate new storagepool for this volume
> > 2015-11-26 20:21:58,055 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Calling
> > StoragePoolAllocators to find suitable pools
> > 2015-11-26 20:21:58,055 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> > LocalStoragePoolAllocator trying to find storage pool to fit the vm
> > 2015-11-26 20:21:58,055 DEBUG
> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> > ClusterScopeStoragePoolAllocator looking for storage pool
> > 2015-11-26 20:21:58,055 DEBUG
> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Looking for
> > pools in dc: 3 pod:3 cluster:3. Disabled pools will be ignored.
> > 2015-11-26 20:21:58,056 DEBUG
> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found pools
> > matching tags: [Pool[8|NetworkFilesystem]]
> > 2015-11-26 20:21:58,056 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
> > storage pool is suitable, name: null ,poolId: 8
> > 2015-11-26 20:21:58,057 INFO [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Storage
> pool
> > null (8) does not supply IOPS capacity, assuming enough capacity
> > 2015-11-26 20:21:58,057 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
> pool
> > 8 for storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
> > 0.019253810234789077, disable threshold: 0.85
> > 2015-11-26 20:21:58,059 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found
> storage
> > pool primary of type NetworkFilesystem with overprovisioning factor 2
> > 2015-11-26 20:21:58,059 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total over
> > provisioned capacity calculated is 2 * 526199291904
> > 2015-11-26 20:21:58,059 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total
> > capacity of the pool primary id: 8 is 1052398583808
> > 2015-11-26 20:21:58,060 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
> > pool: 8 for volume allocation [Vol[7|vm=5|DATADISK]], maxSize :
> > 1052398583808, totalAllocatedSize : 12156207104, askingSize :
> 21474836480,
> > allocated disable threshold: 0.85
> > 2015-11-26 20:21:58,060 DEBUG
> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> > ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
> > 2015-11-26 20:21:58,060 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
> > find a potenial host and associated storage pools from the suitable
> > host/pool lists for this VM
> > 2015-11-26 20:21:58,060 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
> > host: 4 can access any suitable storage pool for volume: DATADISK
> > 2015-11-26 20:21:58,060 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Host: 4 can
> > access pool: 8
> > 2015-11-26 20:21:58,061 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
> pool
> > 8 for storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
> > 0.019253810234789077, disable threshold: 0.85
> > 2015-11-26 20:21:58,062 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found
> storage
> > pool primary of type NetworkFilesystem with overprovisioning factor 2
> > 2015-11-26 20:21:58,062 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total over
> > provisioned capacity calculated is 2 * 526199291904
> > 2015-11-26 20:21:58,062 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total
> > capacity of the pool primary id: 8 is 1052398583808
> > 2015-11-26 20:21:58,063 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
> > pool: 8 for volume allocation [Vol[7|vm=5|DATADISK]], maxSize :
> > 1052398583808, totalAllocatedSize : 12156207104, askingSize :
> 21474836480,
> > allocated disable threshold: 0.85
> > 2015-11-26 20:21:58,063 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
> > host: 4 can access any suitable storage pool for volume: ROOT
> > 2015-11-26 20:21:58,063 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Host: 4 can
> > access pool: 8
> > 2015-11-26 20:21:58,064 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
> pool
> > 8 for storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
> > 0.019253810234789077, disable threshold: 0.85
> > 2015-11-26 20:21:58,067 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found
> storage
> > pool primary of type NetworkFilesystem with overprovisioning factor 2
> > 2015-11-26 20:21:58,067 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total over
> > provisioned capacity calculated is 2 * 526199291904
> > 2015-11-26 20:21:58,067 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total
> > capacity of the pool primary id: 8 is 1052398583808
> > 2015-11-26 20:21:58,067 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
> > pool: 8 for volume allocation [Vol[6|vm=5|ROOT]], maxSize :
> 1052398583808,
> > totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
> > disable threshold: 0.85
> > 2015-11-26 20:21:58,067 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found a
> > potential host id: 4 name: xenserver and associated storage pools for
> this
> > VM
> > 2015-11-26 20:21:58,068 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Returning
> > Deployment Destination:
> >
> >
> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
> > :
> >
> >
> Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage(Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
> > Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
> > Volume(7|DATADISK-->Pool(8))]
> > 2015-11-26 20:21:58,068 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deployment
> > found - P0=VM[User|i-2-5-VM],
> >
> >
> P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
> > :
> >
> >
> Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage(Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
> > Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
> > Volume(7|DATADISK-->Pool(8))]
> > 2015-11-26 20:21:58,073 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM state
> > transitted from :Starting to Starting with event: OperationRetryvm's
> > original host id: null new host id: 4 host id before state transition:
> null
> > 2015-11-26 20:21:58,076 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Hosts's
> > actual total CPU: 3399 and CPU after applying overprovisioning: 3399
> > 2015-11-26 20:21:58,076 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) We are
> > allocating VM, increasing the used capacity of this host:4
> > 2015-11-26 20:21:58,076 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Current
> Used
> > CPU: 1000 , Free CPU:2399 ,Requested CPU: 1000
> > 2015-11-26 20:21:58,076 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Current
> Used
> > RAM: 1610612736 , Free RAM:13743892480 ,Requested RAM: 1073741824
> > 2015-11-26 20:21:58,076 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) CPU STATS
> > after allocation: for host: 4, old used: 1000, old reserved: 0, actual
> > total: 3399, total with overprovisioning: 3399; new used:2000,
> reserved:0;
> > requested cpu:1000,alloc_from_last:false
> > 2015-11-26 20:21:58,076 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) RAM STATS
> > after allocation: for host: 4, old used: 1610612736, old reserved: 0,
> > total: 15354505216; new used: 2684354560, reserved: 0; requested mem:
> > 1073741824,alloc_from_last:false
> > 2015-11-26 20:21:58,094 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM is being
> > created in podId: 3
> > 2015-11-26 20:21:58,097 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Lock is
> > acquired for network id 212 as a part of network implement
> > 2015-11-26 20:21:58,097 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Asking
> > ExternalGuestNetworkGuru to implement Ntwk[212|Guest|8]
> > 2015-11-26 20:21:58,117 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Asking
> > VirtualRouter to implemenet Ntwk[212|Guest|8]
> > 2015-11-26 20:21:58,120 DEBUG [c.c.n.r.NetworkHelperImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Starting
> > router VM[DomainRouter|r-4-VM]
> > 2015-11-26 20:21:58,127 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM state
> > transitted from :Stopped to Starting with event: StartRequestedvm's
> > original host id: 4 new host id: null host id before state transition:
> null
> > 2015-11-26 20:21:58,127 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> Successfully
> > transitioned to start state for VM[DomainRouter|r-4-VM] reservation id =
> > 36f90bcc-1fad-40d8-b878-3996e5c69c0e
> > 2015-11-26 20:21:58,130 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
> > deploy VM, vm has dcId: 3 and podId: 3
> > 2015-11-26 20:21:58,130 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deploy
> avoids
> > pods: null, clusters: null, hosts: null
> > 2015-11-26 20:21:58,131 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Root volume
> > is ready, need to place VM in volume's cluster
> > 2015-11-26 20:21:58,131 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> > Vol[5|vm=4|ROOT] is READY, changing deployment plan to use this pool's
> > dcId: 3 , podId: 3 , and clusterId: 3
> > 2015-11-26 20:21:58,137 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deploy
> avoids
> > pods: [], clusters: [], hosts: []
> > 2015-11-26 20:21:58,137 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> > DeploymentPlanner allocation algorithm:
> > com.cloud.deploy.FirstFitPlanner@1136745
> > 2015-11-26 20:21:58,137 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
> > allocate a host and storage pools from dc:3, pod:3,cluster:3, requested
> > cpu: 500, requested ram: 268435456
> > 2015-11-26 20:21:58,137 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Is ROOT
> > volume READY (pool already allocated)?: Yes
> > 2015-11-26 20:21:58,137 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) This VM has
> > last host_id specified, trying to choose the same host: 4
> > 2015-11-26 20:21:58,141 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Host: 4 has
> > cpu capability (cpu:1, speed:3399) to support requested CPU: 1 and
> > requested speed: 500
> > 2015-11-26 20:21:58,141 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
> > host: 4 has enough capacity for requested CPU: 500 and requested RAM:
> > 268435456 , cpuOverprovisioningFactor: 1.0
> > 2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Hosts's
> > actual total CPU: 3399 and CPU after applying overprovisioning: 3399
> > 2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) We need to
> > allocate to the last host again, so checking if there is enough reserved
> > capacity
> > 2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reserved
> CPU:
> > 0 , Requested CPU: 500
> > 2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reserved
> RAM:
> > 0 , Requested RAM: 268435456
> > 2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) STATS:
> Failed
> > to alloc resource from host: 4 reservedCpu: 0, requested cpu: 500,
> > reservedMem: 0, requested mem: 268435456
> > 2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Host does
> not
> > have enough reserved CPU available, cannot allocate to this host.
> > 2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
> > host: 4 has enough capacity for requested CPU: 500 and requested RAM:
> > 268435456 , cpuOverprovisioningFactor: 1.0
> > 2015-11-26 20:21:58,143 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Hosts's
> > actual total CPU: 3399 and CPU after applying overprovisioning: 3399
> > 2015-11-26 20:21:58,143 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Free CPU:
> > 1399 , Requested CPU: 500
> > 2015-11-26 20:21:58,143 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Free RAM:
> > 12670150656 , Requested RAM: 268435456
> > 2015-11-26 20:21:58,143 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Host has
> > enough CPU and RAM available
> > 2015-11-26 20:21:58,143 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) STATS: Can
> > alloc CPU from host: 4, used: 2000, reserved: 0, actual total: 3399,
> total
> > with overprovisioning: 3399; requested
> cpu:500,alloc_from_last_host?:false
> > ,considerReservedCapacity?: true
> > 2015-11-26 20:21:58,143 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) STATS: Can
> > alloc MEM from host: 4, used: 2684354560, reserved: 0, total:
> 15354505216;
> > requested mem: 268435456,alloc_from_last_host?:false
> > ,considerReservedCapacity?: true
> > 2015-11-26 20:21:58,143 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) The last
> host
> > of this VM is UP and has enough capacity
> > 2015-11-26 20:21:58,143 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Now
> checking
> > for suitable pools under zone: 3, pod: 3, cluster: 3
> > 2015-11-26 20:21:58,145 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
> > suitable pools for volume (Id, Type): (5,ROOT)
> > 2015-11-26 20:21:58,145 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Volume has
> > pool already allocated, checking if pool can be reused, poolId: 8
> > 2015-11-26 20:21:58,145 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Planner
> need
> > not allocate a pool for this volume since its READY
> > 2015-11-26 20:21:58,145 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
> > find a potenial host and associated storage pools from the suitable
> > host/pool lists for this VM
> > 2015-11-26 20:21:58,145 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
> > host: 4 can access any suitable storage pool for volume: ROOT
> > 2015-11-26 20:21:58,146 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Host: 4 can
> > access pool: 8
> > 2015-11-26 20:21:58,146 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found a
> > potential host id: 4 name: xenserver and associated storage pools for
> this
> > VM
> > 2015-11-26 20:21:58,146 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Returning
> > Deployment Destination:
> >
> >
> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
> > : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage()]
> > 2015-11-26 20:21:58,146 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deployment
> > found - P0=VM[DomainRouter|r-4-VM],
> >
> >
> P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
> > : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage()]
> > 2015-11-26 20:21:58,153 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM state
> > transitted from :Starting to Starting with event: OperationRetryvm's
> > original host id: 4 new host id: 4 host id before state transition: null
> > 2015-11-26 20:21:58,153 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM starting
> > again on the last host it was stopped on
> > 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Hosts's
> > actual total CPU: 3399 and CPU after applying overprovisioning: 3399
> > 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) We are
> > allocating VM, increasing the used capacity of this host:4
> > 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Current
> Used
> > CPU: 2000 , Free CPU:1399 ,Requested CPU: 500
> > 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Current
> Used
> > RAM: 2684354560 , Free RAM:12670150656 ,Requested RAM: 268435456
> > 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) We are
> > allocating VM to the last host again, so adjusting the reserved capacity
> if
> > it is not less than required
> > 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reserved
> CPU:
> > 0 , Requested CPU: 500
> > 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reserved
> RAM:
> > 0 , Requested RAM: 268435456
> > 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) CPU STATS
> > after allocation: for host: 4, old used: 2000, old reserved: 0, actual
> > total: 3399, total with overprovisioning: 3399; new used:2500,
> reserved:0;
> > requested cpu:500,alloc_from_last:true
> > 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) RAM STATS
> > after allocation: for host: 4, old used: 2684354560, old reserved: 0,
> > total: 15354505216; new used: 2952790016, reserved: 0; requested mem:
> > 268435456,alloc_from_last:true
> > 2015-11-26 20:21:58,158 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM is being
> > created in podId: 3
> > 2015-11-26 20:21:58,173 DEBUG [c.c.n.NetworkModelImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
> > SecurityGroup is not supported in the network id=212
> > 2015-11-26 20:21:58,179 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Asking
> > VirtualRouter to prepare for
> > Nic[8-4-36f90bcc-1fad-40d8-b878-3996e5c69c0e-10.1.1.1]
> > 2015-11-26 20:21:58,179 DEBUG [c.c.n.NetworkModelImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
> > SecurityGroup is not supported in the network id=212
> > 2015-11-26 20:21:58,193 DEBUG [o.a.c.e.o.VolumeOrchestrator]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
> > we need to prepare 1 volumes for VM[DomainRouter|r-4-VM]
> > 2015-11-26 20:21:58,193 DEBUG [o.a.c.e.o.VolumeOrchestrator]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) No need to
> > recreate the volume: Vol[5|vm=4|ROOT], since it already has a pool
> > assigned: 8, adding disk to VM
> > 2015-11-26 20:21:58,207 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Boot Args
> for
> > VM[DomainRouter|r-4-VM]: template=domP name=r-4-VM eth2ip=10.0.0.174
> > eth2mask=255.255.255.0 gateway=10.0.0.1 eth0ip=10.1.1.1
> > eth0mask=255.255.255.0 domain=cs2cloud.internal cidrsize=24
> > dhcprange=10.1.1.1 eth1ip=169.254.0.43 eth1mask=255.255.0.0 type=router
> > disable_rp_filter=true dns1=8.8.8.8
> >
> >
> baremetalnotificationsecuritykey=MD4bWVy5t0anMd4eq4UlKWj6cZTW4gFDMeDd0WR3H3BuAsrxVX28ShzvJgbd8RR5eMRZ7rNYAsaF9RPXAZoCrQ
> >
> >
> baremetalnotificationapikey=ZWNcizzJ0xXQE0Ubr6Sr_kN7xlMMMMtziuPTxHwZOyIN-Lo2f2CzvPhNw0o01LkNP3X4bp61YiZu0EWF-Mbfew
> > host=10.0.0.170 port=8080
> > 2015-11-26 20:21:58,229 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 1
> ip(s)
> > to apply as a part of domR VM[DomainRouter|r-4-VM] start.
> > 2015-11-26 20:21:58,237 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Resending
> > ipAssoc, port forwarding, load balancing rules as a part of Virtual
> router
> > start
> > 2015-11-26 20:21:58,241 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Egress
> policy
> > for the Network 212 is already defined as Deny. So, no need to default
> the
> > rule to Allow.
> > 2015-11-26 20:21:58,241 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
> > firewall Egress rule(s) to apply as a part of domR
> VM[DomainRouter|r-4-VM]
> > start.
> > 2015-11-26 20:21:58,243 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
> > static nat(s) to apply as a part of domR VM[DomainRouter|r-4-VM] start.
> > 2015-11-26 20:21:58,243 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
> > firewall Ingress rule(s) to apply as a part of domR
> VM[DomainRouter|r-4-VM]
> > start.
> > 2015-11-26 20:21:58,243 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
> port
> > forwarding rule(s) to apply as a part of domR VM[DomainRouter|r-4-VM]
> > start.
> > 2015-11-26 20:21:58,243 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
> > static nat rule(s) to apply as a part of domR VM[DomainRouter|r-4-VM]
> > start.
> > 2015-11-26 20:21:58,243 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
> > vpn(s) to apply as a part of domR VM[DomainRouter|r-4-VM] start.
> > 2015-11-26 20:21:58,244 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
> load
> > balancing rule(s) to apply as a part of domR VM[DomainRouter|r-4-VM]
> start.
> > 2015-11-26 20:21:58,245 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Creating
> > monitoring services on VM[DomainRouter|r-4-VM] start...
> > 2015-11-26 20:21:58,248 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reapplying
> > dhcp entries as a part of domR VM[DomainRouter|r-4-VM] start...
> > 2015-11-26 20:21:58,249 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reapplying
> vm
> > data (userData and metaData) entries as a part of domR
> > VM[DomainRouter|r-4-VM] start...
> > 2015-11-26 20:21:58,254 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> > 4-8612571337392652838: Sending { Cmd , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 100011,
> >
> >
> [{"com.cloud.agent.api.StartCommand":{"vm":{"id":4,"name":"r-4-VM","bootloader":"PyGrub","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":268435456,"maxRam":268435456,"arch":"x86_64","os":"Debian
> > GNU/Linux 7(64-bit)","platformEmulator":"Debian Wheezy 7.0
> > (64-bit)","bootArgs":" template=domP name=r-4-VM eth2ip=10.0.0.174
> > eth2mask=255.255.255.0 gateway=10.0.0.1 eth0ip=10.1.1.1
> > eth0mask=255.255.255.0 domain=cs2cloud.internal cidrsize=24
> > dhcprange=10.1.1.1 eth1ip=169.254.0.43 eth1mask=255.255.0.0 type=router
> > disable_rp_filter=true dns1=8.8.8.8
> >
> >
> baremetalnotificationsecuritykey=MD4bWVy5t0anMd4eq4UlKWj6cZTW4gFDMeDd0WR3H3BuAsrxVX28ShzvJgbd8RR5eMRZ7rNYAsaF9RPXAZoCrQ
> >
> >
> baremetalnotificationapikey=ZWNcizzJ0xXQE0Ubr6Sr_kN7xlMMMMtziuPTxHwZOyIN-Lo2f2CzvPhNw0o01LkNP3X4bp61YiZu0EWF-Mbfew
> > host=10.0.0.170
> >
> >
> port=8080","enableHA":true,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"SlzaiXi9iLi3YpfQ7v3kZw","params":{},"uuid":"27157005-7e89-4251-89e4-2c53ff43bb70","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"9478a811-8b96-4cfa-b6bf-1e09c3fecd39","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
> >
> >
> 10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc
> >
> >
> "}},"name":"ROOT-4","size":3145728000,"path":"dcc1ce80-4cd5-4f59-b063-34e2a93ed99a","volumeId":5,"vmName":"r-4-VM","accountId":2,"format":"VHD","provisioningType":"THIN","id":5,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"dcc1ce80-4cd5-4f59-b063-34e2a93ed99a","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"10.0.0.170","volumeSize":"3145728000"}}],"nics":[{"deviceId":2,"networkRateMbps":200,"defaultNic":true,"pxeDisable":true,"nicUuid":"9fbc00ea-599c-4455-a416-8e66986d9454","uuid":"8872476c-2fd1-4ed3-bfb1-c62efe2b6eab","ip":"10.0.0.174","netmask":"255.255.255.0","gateway":"10.0.0.1","mac":"06:a0:8a:00:00:09","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"mgmt"},{"deviceId":0,"networkRateMbps":200,"defaultNic":false,"pxeDisable":true,"nicUuid":"f38511fa-d2e8-4935-9fc4-74b2eea7621b","uuid":"2e97fcee-3d01-40d2-a624-376661747d0c","ip":"10.1.1.1","netmask":"255.255.255.0","mac":"02:00:4d:27:00:02","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://500","isolationUri":"vlan://500","isSecurityGroupEnabled":false,"name":"mgmt"},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"pxeDisable":true,"nicUuid":"5c6cd3fa-fddb-4ee0-bff2-87e5c04f8d81","uuid":"914b3b0d-541c-4c63-b331-3377672a824d","ip":"169.254.0.43","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:00:2b","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.0.0.171","executeInSequence":false,"wait":0}},{"com.cloud.agent.api.check.CheckSshCommand":{"ip":"169.254.0.43","port":3922,"interval":6,"retries":100,"name":"r-4-VM","wait":0}},{"com.cloud.agent.api.GetDomRVersionCmd":{"accessDetails":{"
> > router.name
> >
> >
> ":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}},{},{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Start","accessDetails":{"router.guest.ip":"10.1.1.1","
> > router.name
> >
> >
> ":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}},{"com.cloud.agent.api.routing.IpAssocCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.0.0.174","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":true,"broadcastUri":"vlan://untagged","vlanGateway":"10.0.0.1","vlanNetmask":"255.255.255.0","vifMacAddress":"06:35:62:00:00:09","networkRate":200,"trafficType":"Public","networkName":"mgmt","newNic":false}],"accessDetails":{"zone.network.type":"Advanced","
> > router.name
> >
> >
> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.SetMonitorServiceCommand":{"services":[{"id":0,"service":"dhcp","processname":"dnsmasq","serviceName":"dnsmasq","servicePath":"/var/run/dnsmasq/dnsmasq.pid","pidFile":"/var/run/dnsmasq/dnsmasq.pid","isDefault":false},{"id":0,"service":"loadbalancing","processname":"haproxy","serviceName":"haproxy","servicePath":"/var/run/haproxy.pid","pidFile":"/var/run/haproxy.pid","isDefault":false},{"id":0,"service":"ssh","processname":"sshd","serviceName":"ssh","servicePath":"/var/run/sshd.pid","pidFile":"/var/run/sshd.pid","isDefault":true},{"id":0,"service":"webserver","processname":"apache2","serviceName":"apache2","servicePath":"/var/run/apache2.pid","pidFile":"/var/run/apache2.pid","isDefault":true}],"accessDetails":{"
> > router.name
> >
> >
> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Finish","accessDetails":{"router.guest.ip":"10.1.1.1","
> > router.name":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}}] }
> > 2015-11-26 20:21:58,255 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> > 4-8612571337392652838: Executing: { Cmd , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 100011,
> >
> >
> [{"com.cloud.agent.api.StartCommand":{"vm":{"id":4,"name":"r-4-VM","bootloader":"PyGrub","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":268435456,"maxRam":268435456,"arch":"x86_64","os":"Debian
> > GNU/Linux 7(64-bit)","platformEmulator":"Debian Wheezy 7.0
> > (64-bit)","bootArgs":" template=domP name=r-4-VM eth2ip=10.0.0.174
> > eth2mask=255.255.255.0 gateway=10.0.0.1 eth0ip=10.1.1.1
> > eth0mask=255.255.255.0 domain=cs2cloud.internal cidrsize=24
> > dhcprange=10.1.1.1 eth1ip=169.254.0.43 eth1mask=255.255.0.0 type=router
> > disable_rp_filter=true dns1=8.8.8.8
> >
> >
> baremetalnotificationsecuritykey=MD4bWVy5t0anMd4eq4UlKWj6cZTW4gFDMeDd0WR3H3BuAsrxVX28ShzvJgbd8RR5eMRZ7rNYAsaF9RPXAZoCrQ
> >
> >
> baremetalnotificationapikey=ZWNcizzJ0xXQE0Ubr6Sr_kN7xlMMMMtziuPTxHwZOyIN-Lo2f2CzvPhNw0o01LkNP3X4bp61YiZu0EWF-Mbfew
> > host=10.0.0.170
> >
> >
> port=8080","enableHA":true,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"SlzaiXi9iLi3YpfQ7v3kZw","params":{},"uuid":"27157005-7e89-4251-89e4-2c53ff43bb70","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"9478a811-8b96-4cfa-b6bf-1e09c3fecd39","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
> >
> >
> 10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc
> >
> >
> "}},"name":"ROOT-4","size":3145728000,"path":"dcc1ce80-4cd5-4f59-b063-34e2a93ed99a","volumeId":5,"vmName":"r-4-VM","accountId":2,"format":"VHD","provisioningType":"THIN","id":5,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"dcc1ce80-4cd5-4f59-b063-34e2a93ed99a","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"10.0.0.170","volumeSize":"3145728000"}}],"nics":[{"deviceId":2,"networkRateMbps":200,"defaultNic":true,"pxeDisable":true,"nicUuid":"9fbc00ea-599c-4455-a416-8e66986d9454","uuid":"8872476c-2fd1-4ed3-bfb1-c62efe2b6eab","ip":"10.0.0.174","netmask":"255.255.255.0","gateway":"10.0.0.1","mac":"06:a0:8a:00:00:09","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"mgmt"},{"deviceId":0,"networkRateMbps":200,"defaultNic":false,"pxeDisable":true,"nicUuid":"f38511fa-d2e8-4935-9fc4-74b2eea7621b","uuid":"2e97fcee-3d01-40d2-a624-376661747d0c","ip":"10.1.1.1","netmask":"255.255.255.0","mac":"02:00:4d:27:00:02","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://500","isolationUri":"vlan://500","isSecurityGroupEnabled":false,"name":"mgmt"},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"pxeDisable":true,"nicUuid":"5c6cd3fa-fddb-4ee0-bff2-87e5c04f8d81","uuid":"914b3b0d-541c-4c63-b331-3377672a824d","ip":"169.254.0.43","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:00:2b","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.0.0.171","executeInSequence":false,"wait":0}},{"com.cloud.agent.api.check.CheckSshCommand":{"ip":"169.254.0.43","port":3922,"interval":6,"retries":100,"name":"r-4-VM","wait":0}},{"com.cloud.agent.api.GetDomRVersionCmd":{"accessDetails":{"
> > router.name
> >
> >
> ":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}},{},{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Start","accessDetails":{"router.guest.ip":"10.1.1.1","
> > router.name
> >
> >
> ":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}},{"com.cloud.agent.api.routing.IpAssocCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.0.0.174","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":true,"broadcastUri":"vlan://untagged","vlanGateway":"10.0.0.1","vlanNetmask":"255.255.255.0","vifMacAddress":"06:35:62:00:00:09","networkRate":200,"trafficType":"Public","networkName":"mgmt","newNic":false}],"accessDetails":{"zone.network.type":"Advanced","
> > router.name
> >
> >
> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.SetMonitorServiceCommand":{"services":[{"id":0,"service":"dhcp","processname":"dnsmasq","serviceName":"dnsmasq","servicePath":"/var/run/dnsmasq/dnsmasq.pid","pidFile":"/var/run/dnsmasq/dnsmasq.pid","isDefault":false},{"id":0,"service":"loadbalancing","processname":"haproxy","serviceName":"haproxy","servicePath":"/var/run/haproxy.pid","pidFile":"/var/run/haproxy.pid","isDefault":false},{"id":0,"service":"ssh","processname":"sshd","serviceName":"ssh","servicePath":"/var/run/sshd.pid","pidFile":"/var/run/sshd.pid","isDefault":true},{"id":0,"service":"webserver","processname":"apache2","serviceName":"apache2","servicePath":"/var/run/apache2.pid","pidFile":"/var/run/apache2.pid","isDefault":true}],"accessDetails":{"
> > router.name
> >
> >
> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Finish","accessDetails":{"router.guest.ip":"10.1.1.1","
> > router.name":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}}] }
> > 2015-11-26 20:21:58,256 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-69:ctx-a18e64d5) Seq 4-8612571337392652838: Executing
> request
> > 2015-11-26 20:21:58,263 DEBUG [c.c.h.x.r.w.x.CitrixStartCommandWrapper]
> > (DirectAgent-69:ctx-a18e64d5) 1. The VM r-4-VM is in Starting state.
> > 2015-11-26 20:21:58,292 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-69:ctx-a18e64d5) Created VM
> > 0d0fa28c-0513-b806-84fd-c528dfc1dbfb for r-4-VM
> > 2015-11-26 20:21:58,298 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-69:ctx-a18e64d5) PV args are -- quiet
> >
> >
> console=hvc0%template=domP%name=r-4-VM%eth2ip=10.0.0.174%eth2mask=255.255.255.0%gateway=10.0.0.1%eth0ip=10.1.1.1%eth0mask=255.255.255.0%domain=cs2cloud.internal%cidrsize=24%dhcprange=10.1.1.1%eth1ip=169.254.0.43%eth1mask=255.255.0.0%type=router%disable_rp_filter=true%dns1=8.8.8.8%baremetalnotificationsecuritykey=MD4bWVy5t0anMd4eq4UlKWj6cZTW4gFDMeDd0WR3H3BuAsrxVX28ShzvJgbd8RR5eMRZ7rNYAsaF9RPXAZoCrQ%baremetalnotificationapikey=ZWNcizzJ0xXQE0Ubr6Sr_kN7xlMMMMtziuPTxHwZOyIN-Lo2f2CzvPhNw0o01LkNP3X4bp61YiZu0EWF-Mbfew%host=10.0.0.170%port=8080
> > 2015-11-26 20:21:58,325 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-69:ctx-a18e64d5) VBD 11a8fbfd-fd97-18bc-1490-e088576f26e7
> > created for com.cloud.agent.api.to.DiskTO@2578f349
> > 2015-11-26 20:21:58,325 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-69:ctx-a18e64d5) Creating VIF for r-4-VM on nic
> > [Nic:Public-10.0.0.174-vlan://untagged]
> > 2015-11-26 20:21:58,327 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-69:ctx-a18e64d5) Looking for network named mgmt
> > 2015-11-26 20:21:58,334 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-69:ctx-a18e64d5) Created a vif
> > b7ad658b-483c-a442-cb04-02b2a54bfbc8 on 2
> > 2015-11-26 20:21:58,334 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-69:ctx-a18e64d5) Creating VIF for r-4-VM on nic
> > [Nic:Guest-10.1.1.1-vlan://500]
> > 2015-11-26 20:21:58,335 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-69:ctx-a18e64d5) Looking for network named mgmt
> > 2015-11-26 20:21:58,341 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-69:ctx-a18e64d5) Couldn't find vlan network with the new
> name
> > so trying old name: VLAN500
> > 2015-11-26 20:21:58,342 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-69:ctx-a18e64d5) Creating VLAN network for 500 on host
> > 10.0.0.171
> > 2015-11-26 20:21:58,349 DEBUG [c.c.h.x.r.XsLocalNetwork]
> > (DirectAgent-69:ctx-a18e64d5) Found a network called mgmt on
> > host=10.0.0.171; Network=1a561762-42f8-4907-9cc2-c90e69fc3a4d;
> > pif=ebede886-b90c-4605-dcef-5b24824b154b
> > 2015-11-26 20:21:58,352 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-69:ctx-a18e64d5) Creating VLAN 500 on host 10.0.0.171 on
> > device eth0
> > 2015-11-26 20:21:58,664 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-69:ctx-a18e64d5) VLAN is created for 500. The uuid is
> > 4cf68d23-f831-273a-27a6-7639dadf3d04
> > 2015-11-26 20:21:58,669 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-69:ctx-a18e64d5) Created a vif
> > c21979e3-f425-6c92-24cb-356cfbdd3320 on 0
> > 2015-11-26 20:21:58,669 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-69:ctx-a18e64d5) Creating VIF for r-4-VM on nic
> > [Nic:Control-169.254.0.43-null]
> > 2015-11-26 20:21:58,683 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-69:ctx-a18e64d5) already have a vif on dom0 for link local
> > network
> > 2015-11-26 20:21:58,787 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-69:ctx-a18e64d5) Created a vif
> > 990f4458-ecb6-434f-2930-73b1e6d42e8c on 1
> > 2015-11-26 20:21:59,092 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-13:ctx-2798b9c4) ===START=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549584411
> > 2015-11-26 20:21:59,103 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-13:ctx-2798b9c4 ctx-c2ce3a57) ===END=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549584411
> > 2015-11-26 20:22:02,111 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-14:ctx-38676bd6) ===START=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549587414
> > 2015-11-26 20:22:02,124 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-14:ctx-38676bd6 ctx-947b14ea) ===END=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549587414
> > 2015-11-26 20:22:02,803 DEBUG [c.c.h.x.r.w.x.CitrixStartCommandWrapper]
> > (DirectAgent-69:ctx-a18e64d5) 2. The VM r-4-VM is in Running state.
> > 2015-11-26 20:22:02,807 DEBUG
> [c.c.h.x.r.w.x.CitrixCheckSshCommandWrapper]
> > (DirectAgent-69:ctx-a18e64d5) Ping command port, 169.254.0.43:3922
> > 2015-11-26 20:22:02,809 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-69:ctx-a18e64d5) Trying to connect to 169.254.0.43 attempt 0
> > of 100
> > 2015-11-26 20:22:04,361 DEBUG [o.a.c.s.SecondaryStorageManagerImpl]
> > (secstorage-1:ctx-2215d989) Zone 3 is ready to launch secondary storage
> VM
> > 2015-11-26 20:22:04,681 DEBUG [c.c.c.ConsoleProxyManagerImpl]
> > (consoleproxy-1:ctx-2ce987bc) Zone 3 is ready to launch console proxy
> > 2015-11-26 20:22:05,104 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-15:ctx-4fa06d24) ===START=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549590422
> > 2015-11-26 20:22:05,116 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-15:ctx-4fa06d24 ctx-19dff864) ===END=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549590422
> > 2015-11-26 20:22:06,962 DEBUG [c.c.a.m.AgentManagerImpl]
> > (AgentManager-Handler-14:null) SeqA 5-1783: Processing Seq 5-1783: {
> Cmd ,
> > MgmtId: -1, via: 5, Ver: v1, Flags: 11,
> >
> >
> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
> > \"connections\": []\n}","wait":0}}] }
> > 2015-11-26 20:22:06,968 DEBUG [c.c.a.m.AgentManagerImpl]
> > (AgentManager-Handler-14:null) SeqA 5-1783: Sending Seq 5-1783: { Ans: ,
> > MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
> > [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
> > 2015-11-26 20:22:08,018 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (AsyncJobMgr-Heartbeat-1:ctx-5e29ee49) Begin cleanup expired async-jobs
> > 2015-11-26 20:22:08,022 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (AsyncJobMgr-Heartbeat-1:ctx-5e29ee49) End cleanup expired async-jobs
> > 2015-11-26 20:22:08,103 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-17:ctx-9917fe4e) ===START=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549593422
> > 2015-11-26 20:22:08,114 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-17:ctx-9917fe4e ctx-bfd32cd5) ===END=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549593422
> > 2015-11-26 20:22:11,103 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-12:ctx-88343d26) ===START=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549596422
> > 2015-11-26 20:22:11,113 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-12:ctx-88343d26 ctx-6f3d43d4) ===END=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549596422
> > 2015-11-26 20:22:14,215 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-16:ctx-725778e3) ===START=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549599535
> > 2015-11-26 20:22:14,234 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-16:ctx-725778e3 ctx-dd88dc8f) ===END=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549599535
> > 2015-11-26 20:22:15,885 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-69:ctx-a18e64d5) Trying to connect to 169.254.0.43 attempt 1
> > of 100
> > 2015-11-26 20:22:16,964 DEBUG [c.c.a.m.AgentManagerImpl]
> > (AgentManager-Handler-3:null) SeqA 5-1784: Processing Seq 5-1784: { Cmd
> ,
> > MgmtId: -1, via: 5, Ver: v1, Flags: 11,
> >
> >
> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
> > \"connections\": []\n}","wait":0}}] }
> > 2015-11-26 20:22:16,967 DEBUG [c.c.a.m.AgentManagerImpl]
> > (AgentManager-Handler-3:null) SeqA 5-1784: Sending Seq 5-1784: { Ans: ,
> > MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
> > [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
> > 2015-11-26 20:22:17,215 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-18:ctx-60f98a31) ===START=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549602535
> > 2015-11-26 20:22:17,225 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-18:ctx-60f98a31 ctx-d1134f47) ===END=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549602535
> > 2015-11-26 20:22:17,995 DEBUG [c.c.s.StatsCollector]
> > (StatsCollector-3:ctx-98795072) StorageCollector is running...
> > 2015-11-26 20:22:18,018 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (AsyncJobMgr-Heartbeat-1:ctx-d66f35e7) Begin cleanup expired async-jobs
> > 2015-11-26 20:22:18,020 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (AsyncJobMgr-Heartbeat-1:ctx-d66f35e7) End cleanup expired async-jobs
> > 2015-11-26 20:22:18,050 DEBUG [c.c.a.t.Request]
> > (StatsCollector-3:ctx-98795072) Seq 6-2074470578357534957: Received: {
> > Ans: , MgmtId: 52229922654, via: 6(s-2-VM), Ver: v1, Flags: 10, {
> > GetStorageStatsAnswer } }
> > 2015-11-26 20:22:18,051 DEBUG [c.c.h.XenServerGuru]
> > (StatsCollector-3:ctx-98795072) getCommandHostDelegation: class
> > com.cloud.agent.api.GetStorageStatsCommand
> > 2015-11-26 20:22:18,052 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-275:ctx-69cd6660) Seq 4-8612571337392652839: Executing
> request
> > 2015-11-26 20:22:18,210 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (RouterStatusMonitor-1:ctx-e533ad2d) Found 1 routers to update status.
> > 2015-11-26 20:22:18,212 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (RouterStatusMonitor-1:ctx-e533ad2d) Found 0 VPC networks to update
> > Redundant State.
> > 2015-11-26 20:22:18,213 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (RouterStatusMonitor-1:ctx-e533ad2d) Found 0 networks to update RvR
> status.
> > 2015-11-26 20:22:18,223 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (RouterStatusMonitor-1:ctx-ce59a463) Found 1 routers to update status.
> > 2015-11-26 20:22:18,224 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (RouterStatusMonitor-1:ctx-ce59a463) Found 0 VPC networks to update
> > Redundant State.
> > 2015-11-26 20:22:18,225 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (RouterStatusMonitor-1:ctx-ce59a463) Found 0 networks to update RvR
> status.
> > 2015-11-26 20:22:18,378 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-275:ctx-69cd6660) Seq 4-8612571337392652839: Response
> > Received:
> > 2015-11-26 20:22:18,379 DEBUG [c.c.a.t.Request]
> > (StatsCollector-3:ctx-98795072) Seq 4-8612571337392652839: Received: {
> > Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10, {
> > GetStorageStatsAnswer } }
> > 2015-11-26 20:22:20,215 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-22:ctx-c6c73f9b) ===START=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549605535
> > 2015-11-26 20:22:20,225 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-22:ctx-c6c73f9b ctx-135e3cc8) ===END=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549605535
> > 2015-11-26 20:22:21,593 DEBUG [c.c.a.m.AgentManagerImpl]
> > (AgentManager-Handler-2:null) Ping from 6
> > 2015-11-26 20:22:21,679 DEBUG [c.c.a.m.AgentManagerImpl]
> > (AgentManager-Handler-5:null) Ping from 5
> > 2015-11-26 20:22:23,216 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-19:ctx-db19c3ed) ===START=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549608535
> > 2015-11-26 20:22:23,227 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-19:ctx-db19c3ed ctx-846db858) ===END=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549608535
> > 2015-11-26 20:22:24,782 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgentCronJob-79:ctx-8c839142) Ping from 4(xenserver)
> > 2015-11-26 20:22:24,782 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> > (DirectAgentCronJob-79:ctx-8c839142) Process host VM state report from
> ping
> > process. host: 4
> > 2015-11-26 20:22:24,785 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> > (DirectAgentCronJob-79:ctx-8c839142) Process VM state report. host: 4,
> > number of records in report: 3
> > 2015-11-26 20:22:24,785 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> > (DirectAgentCronJob-79:ctx-8c839142) VM state report. host: 4, vm id: 1,
> > power state: PowerOn
> > 2015-11-26 20:22:24,786 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> > (DirectAgentCronJob-79:ctx-8c839142) VM power state does not change, skip
> > DB writing. vm id: 1
> > 2015-11-26 20:22:24,786 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> > (DirectAgentCronJob-79:ctx-8c839142) VM state report. host: 4, vm id: 2,
> > power state: PowerOn
> > 2015-11-26 20:22:24,787 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> > (DirectAgentCronJob-79:ctx-8c839142) VM power state does not change, skip
> > DB writing. vm id: 2
> > 2015-11-26 20:22:24,787 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> > (DirectAgentCronJob-79:ctx-8c839142) VM state report. host: 4, vm id: 4,
> > power state: PowerOn
> > 2015-11-26 20:22:24,788 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> > (DirectAgentCronJob-79:ctx-8c839142) VM power state does not change, skip
> > DB writing. vm id: 4
> > 2015-11-26 20:22:24,790 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> > (DirectAgentCronJob-79:ctx-8c839142) Run missing VM report. current time:
> > 1448549544790
> > 2015-11-26 20:22:24,791 WARN [c.c.v.VirtualMachinePowerStateSyncImpl]
> > (DirectAgentCronJob-79:ctx-8c839142) VM state was updated but update time
> > is null?! vm id: 5
> > 2015-11-26 20:22:24,794 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> > (DirectAgentCronJob-79:ctx-8c839142) Detected missing VM. host: 4, vm id:
> > 5, power state: PowerReportMissing, last state update: 1448549544790
> > 2015-11-26 20:22:24,794 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> > (DirectAgentCronJob-79:ctx-8c839142) vm id: 5 - time since last state
> > update(0ms) has not passed graceful period yet
> > 2015-11-26 20:22:24,794 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> > (DirectAgentCronJob-79:ctx-8c839142) Done with process of VM state
> report.
> > host: 4
> > 2015-11-26 20:22:25,994 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-69:ctx-a18e64d5) Trying to connect to 169.254.0.43 attempt 2
> > of 100
> > 2015-11-26 20:22:26,110 DEBUG
> [c.c.h.x.r.w.x.CitrixCheckSshCommandWrapper]
> > (DirectAgent-69:ctx-a18e64d5) Ping command port succeeded for vm r-4-VM
> > 2015-11-26 20:22:26,111 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-69:ctx-a18e64d5) Executing command in VR:
> > /opt/cloud/bin/router_proxy.sh get_template_version.sh 169.254.0.43 null
> > 2015-11-26 20:22:26,246 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-20:ctx-06bd0169) ===START=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549611535
> > 2015-11-26 20:22:26,271 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-20:ctx-06bd0169 ctx-3118df18) ===END=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549611535
> > 2015-11-26 20:22:26,389 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-69:ctx-a18e64d5) Executing command in VR:
> > /opt/cloud/bin/router_proxy.sh netusage.sh 169.254.0.43 -c
> > 2015-11-26 20:22:26,677 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-69:ctx-a18e64d5) Looking for network named mgmt
> > 2015-11-26 20:22:26,692 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> > (DirectAgent-69:ctx-a18e64d5) Transforming
> > com.cloud.agent.api.routing.IpAssocCommand to ConfigItems
> > 2015-11-26 20:22:26,692 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> > (DirectAgent-69:ctx-a18e64d5) Transforming
> > com.cloud.agent.api.routing.SetMonitorServiceCommand to ConfigItems
> > 2015-11-26 20:22:26,695 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-69:ctx-a18e64d5) Copying VR with ip 169.254.0.43 config file
> > into host 10.0.0.171
> > 2015-11-26 20:22:26,964 DEBUG [c.c.a.m.AgentManagerImpl]
> > (AgentManager-Handler-6:null) SeqA 5-1786: Processing Seq 5-1786: { Cmd
> ,
> > MgmtId: -1, via: 5, Ver: v1, Flags: 11,
> >
> >
> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
> > \"connections\": []\n}","wait":0}}] }
> > 2015-11-26 20:22:26,966 DEBUG [c.c.a.m.AgentManagerImpl]
> > (AgentManager-Handler-6:null) SeqA 5-1786: Sending Seq 5-1786: { Ans: ,
> > MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
> > [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
> > 2015-11-26 20:22:27,075 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-69:ctx-a18e64d5) VR Config file
> > VR-d0244a1d-2334-4771-868b-2910b7a8c359.cfg got created in VR, ip
> > 169.254.0.43 with content
> > #Apache CloudStack Virtual Router Config File
> > <version>
> > 1.0
> > </version>
> > <file>
> > /var/cache/cloud/ip_associations.json
> >
> >
> {"ip_address":[{"public_ip":"10.0.0.174","source_nat":true,"add":true,"one_to_one_nat":false,"first_i_p":true,"gateway":"10.0.0.1","netmask":"255.255.255.0","vif_mac_address":"06:35:62:00:00:09","nic_dev_id":2,"new_nic":false}],"type":"ips"}
> > </file>
> > <script>
> > /opt/cloud/bin/update_config.py ip_associations.json
> > </script>
> > <file>
> > /var/cache/cloud/monitor_service.json
> >
> >
> {"config":"[dhcp]:processname=dnsmasq:servicename=dnsmasq:pidfile=/var/run/dnsmasq/dnsmasq.pid:,[loadbalancing]:processname=haproxy:servicename=haproxy:pidfile=/var/run/haproxy.pid:,[ssh]:processname=sshd:servicename=ssh:pidfile=/var/run/sshd.pid:,[webserver]:processname=apache2:servicename=apache2:pidfile=/var/run/apache2.pid:,","type":"monitorservice"}
> > </file>
> > <script>
> > /opt/cloud/bin/update_config.py monitor_service.json
> > </script>
> >
> > 2015-11-26 20:22:27,075 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-69:ctx-a18e64d5) Executing command in VR:
> > /opt/cloud/bin/router_proxy.sh vr_cfg.sh 169.254.0.43 -c
> > /var/cache/cloud/VR-d0244a1d-2334-4771-868b-2910b7a8c359.cfg
> > 2015-11-26 20:22:28,018 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (AsyncJobMgr-Heartbeat-1:ctx-ed233495) Begin cleanup expired async-jobs
> > 2015-11-26 20:22:28,021 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (AsyncJobMgr-Heartbeat-1:ctx-ed233495) End cleanup expired async-jobs
> > 2015-11-26 20:22:29,218 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-21:ctx-1da30083) ===START=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549614535
> > 2015-11-26 20:22:29,235 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-21:ctx-1da30083 ctx-605fe303) ===END=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549614535
> > 2015-11-26 20:22:32,250 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-7:ctx-63ad70cb) ===START=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549617569
> > 2015-11-26 20:22:32,277 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-7:ctx-63ad70cb ctx-3f0ef7d5) ===END=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549617569
> > 2015-11-26 20:22:32,387 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-69:ctx-a18e64d5) Seq 4-8612571337392652838: Response
> Received:
> > 2015-11-26 20:22:32,388 DEBUG [c.c.a.t.Request]
> > (DirectAgent-69:ctx-a18e64d5) Seq 4-8612571337392652838: Processing: {
> > Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
> >
> >
> [{"com.cloud.agent.api.StartAnswer":{"vm":{"id":4,"name":"r-4-VM","bootloader":"PyGrub","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":268435456,"maxRam":268435456,"arch":"x86_64","os":"Debian
> > GNU/Linux 7(64-bit)","platformEmulator":"Debian Wheezy 7.0
> > (64-bit)","bootArgs":" template=domP name=r-4-VM eth2ip=10.0.0.174
> > eth2mask=255.255.255.0 gateway=10.0.0.1 eth0ip=10.1.1.1
> > eth0mask=255.255.255.0 domain=cs2cloud.internal cidrsize=24
> > dhcprange=10.1.1.1 eth1ip=169.254.0.43 eth1mask=255.255.0.0 type=router
> > disable_rp_filter=true dns1=8.8.8.8
> >
> >
> baremetalnotificationsecuritykey=MD4bWVy5t0anMd4eq4UlKWj6cZTW4gFDMeDd0WR3H3BuAsrxVX28ShzvJgbd8RR5eMRZ7rNYAsaF9RPXAZoCrQ
> >
> >
> baremetalnotificationapikey=ZWNcizzJ0xXQE0Ubr6Sr_kN7xlMMMMtziuPTxHwZOyIN-Lo2f2CzvPhNw0o01LkNP3X4bp61YiZu0EWF-Mbfew
> > host=10.0.0.170
> >
> >
> port=8080","enableHA":true,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"SlzaiXi9iLi3YpfQ7v3kZw","params":{},"uuid":"27157005-7e89-4251-89e4-2c53ff43bb70","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"9478a811-8b96-4cfa-b6bf-1e09c3fecd39","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
> >
> >
> 10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc
> >
> "}},"name":"ROOT-4","size":3145728000,"path":"dcc1ce80-4cd5-4f59-b063-34e2a93ed99a","volumeId":5,"vmName":"r-4-VM","accountId":2,"format":"VHD","provisioningType":"THIN","id":5,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"dcc1ce80-4cd5-4f59-b063-34e2a93ed99a","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"10.0.0.170","volumeSize":"3145728000"}}],"nics":[{"deviceId":2,"networkRateMbps":200,"defaultNic":true,"pxeDisable":true,"nicUuid":"9fbc00ea-599c-4455-a416-8e66986d9454","uuid":"8872476c-2fd1-4ed3-bfb1-c62efe2b6eab","ip":"10.0.0.174","netmask":"255.255.255.0","gateway":"10.0.0.1","mac":"06:a0:8a:00:00:09","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"mgmt"},{"deviceId":0,"networkRateMbps":200,"defaultNic":false,"pxeDisable":true,"nicUuid":"f38511fa-d2e8-4935-9fc4-74b2eea7621b","uuid":"2e97fcee-3d01-40d2-a624-376661747d0c","ip":"10.1.1.1","netmask":"255.255.255.0","mac":"02:00:4d:27:00:02","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://500","isolationUri":"vlan://500","isSecurityGroupEnabled":false,"name":"mgmt"},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"pxeDisable":true,"nicUuid":"5c6cd3fa-fddb-4ee0-bff2-87e5c04f8d81","uuid":"914b3b0d-541c-4c63-b331-3377672a824d","ip":"169.254.0.43","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:00:2b","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"_iqnToPath":{},"result":true,"wait":0}},{"com.cloud.agent.api.check.CheckSshAnswer":{"result":true,"wait":0}},{"com.cloud.agent.api.GetDomRVersionAnswer":{"templateVersion":"Cloudstack
> > Release 4.6.0 Mon Nov 9 11:21:06 UTC
> >
> >
> 2015","scriptsVersion":"4042f3d5b3337372cf94955f2ae8a149\n","result":true,"details":"Cloudstack
> > Release 4.6.0 Mon Nov 9 11:21:06 UTC
> >
> >
> 2015&4042f3d5b3337372cf94955f2ae8a149\n","wait":0}},{"com.cloud.agent.api.NetworkUsageAnswer":{"routerName":"r-4-VM","bytesSent":0,"bytesReceived":0,"result":true,"details":"","wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"details":"Command
> > aggregation
> >
> >
> started","wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"details":"Command
> > aggregation finished","wait":0}}] }
> > 2015-11-26 20:22:32,389 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> > 4-8612571337392652838: Received: { Ans: , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 10, { StartAnswer, CheckSshAnswer,
> > GetDomRVersionAnswer, NetworkUsageAnswer, Answer, Answer, Answer, Answer
> }
> > }
> > 2015-11-26 20:22:32,405 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM state
> > transitted from :Starting to Running with event: OperationSucceededvm's
> > original host id: 4 new host id: 4 host id before state transition: 4
> > 2015-11-26 20:22:32,408 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Start
> > completed for VM VM[DomainRouter|r-4-VM]
> > 2015-11-26 20:22:32,412 DEBUG [c.c.n.NetworkModelImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
> > SecurityGroup is not supported in the network id=212
> > 2015-11-26 20:22:32,417 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> > 4-8612571337392652840: Sending { Cmd , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 100011,
> >
> >
> [{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Start","accessDetails":{"router.guest.ip":"10.1.1.1","
> > router.name":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}}] }
> > 2015-11-26 20:22:32,418 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> > 4-8612571337392652840: Executing: { Cmd , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 100011,
> >
> >
> [{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Start","accessDetails":{"router.guest.ip":"10.1.1.1","
> > router.name":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}}] }
> > 2015-11-26 20:22:32,418 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-138:ctx-d5c945c8) Seq 4-8612571337392652840: Executing
> request
> > 2015-11-26 20:22:32,418 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-138:ctx-d5c945c8) Seq 4-8612571337392652840: Response
> > Received:
> > 2015-11-26 20:22:32,418 DEBUG [c.c.a.t.Request]
> > (DirectAgent-138:ctx-d5c945c8) Seq 4-8612571337392652840: Processing: {
> > Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
> > [{"com.cloud.agent.api.Answer":{"result":true,"details":"Command
> > aggregation started","wait":0}}] }
> > 2015-11-26 20:22:32,418 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> > 4-8612571337392652840: Received: { Ans: , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 10, { Answer } }
> > 2015-11-26 20:22:32,418 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> Reprogramming
> > network Ntwk[212|Guest|8] as a part of network implement
> > 2015-11-26 20:22:32,419 DEBUG [c.c.n.f.FirewallManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) applying
> > default firewall egress rules
> > 2015-11-26 20:22:32,425 DEBUG [o.a.c.n.t.BasicNetworkTopology]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) APPLYING
> > FIREWALL RULES
> > 2015-11-26 20:22:32,425 DEBUG [o.a.c.n.t.BasicNetworkTopology]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Applying
> > firewall rules in network Ntwk[212|Guest|8]
> > 2015-11-26 20:22:32,430 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> > 4-8612571337392652841: Sending { Cmd , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 100001,
> >
> >
> [{"com.cloud.agent.api.routing.SetFirewallRulesCommand":{"rules":[{"id":0,"srcIp":"","protocol":"all","revoked":false,"alreadyAdded":false,"sourceCidrList":[],"purpose":"Firewall","trafficType":"Egress","defaultEgressPolicy":false}],"accessDetails":{"router.guest.ip":"10.1.1.1","firewall.egress.default":"System","zone.network.type":"Advanced","router.ip":"169.254.0.43","
> > router.name":"r-4-VM"},"wait":0}}] }
> > 2015-11-26 20:22:32,430 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> > 4-8612571337392652841: Executing: { Cmd , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 100001,
> >
> >
> [{"com.cloud.agent.api.routing.SetFirewallRulesCommand":{"rules":[{"id":0,"srcIp":"","protocol":"all","revoked":false,"alreadyAdded":false,"sourceCidrList":[],"purpose":"Firewall","trafficType":"Egress","defaultEgressPolicy":false}],"accessDetails":{"router.guest.ip":"10.1.1.1","firewall.egress.default":"System","zone.network.type":"Advanced","router.ip":"169.254.0.43","
> > router.name":"r-4-VM"},"wait":0}}] }
> > 2015-11-26 20:22:32,430 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-276:ctx-9bb810d3) Seq 4-8612571337392652841: Executing
> request
> > 2015-11-26 20:22:32,430 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-276:ctx-9bb810d3) Seq 4-8612571337392652841: Response
> > Received:
> > 2015-11-26 20:22:32,430 DEBUG [c.c.a.t.Request]
> > (DirectAgent-276:ctx-9bb810d3) Seq 4-8612571337392652841: Processing: {
> > Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 0,
> > [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
> > 2015-11-26 20:22:32,430 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> > 4-8612571337392652841: Received: { Ans: , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 0, { Answer } }
> > 2015-11-26 20:22:32,432 DEBUG [c.c.n.f.FirewallManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are
> no
> > firewall rules to apply
> > 2015-11-26 20:22:32,432 DEBUG [c.c.n.r.RulesManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are
> no
> > static nat to apply for network id=212
> > 2015-11-26 20:22:32,432 DEBUG [c.c.n.f.FirewallManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are
> no
> > firewall rules to apply
> > 2015-11-26 20:22:32,433 DEBUG [c.c.n.r.RulesManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are
> no
> > port forwarding rules to apply for network id=212
> > 2015-11-26 20:22:32,433 DEBUG [c.c.n.r.RulesManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are
> no
> > static nat rules to apply for network id=212
> > 2015-11-26 20:22:32,433 DEBUG [c.c.n.l.LoadBalancingRulesManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Applying
> load
> > balancer rules of scheme Public in network id=212
> > 2015-11-26 20:22:32,434 DEBUG [c.c.n.l.LoadBalancingRulesManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are
> no
> > Load Balancing Rules to forward to the network elements
> > 2015-11-26 20:22:32,434 DEBUG [c.c.n.l.LoadBalancingRulesManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Applying
> load
> > balancer rules of scheme Internal in network id=212
> > 2015-11-26 20:22:32,434 DEBUG [c.c.n.l.LoadBalancingRulesManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are
> no
> > Load Balancing Rules to forward to the network elements
> > 2015-11-26 20:22:32,435 DEBUG [c.c.n.NetworkModelImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
> > SecurityGroup is not supported in the network id=212
> > 2015-11-26 20:22:32,439 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> > 4-8612571337392652842: Sending { Cmd , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 100011,
> >
> >
> [{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Finish","accessDetails":{"router.guest.ip":"10.1.1.1","
> > router.name":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}}] }
> > 2015-11-26 20:22:32,439 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> > 4-8612571337392652842: Executing: { Cmd , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 100011,
> >
> >
> [{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Finish","accessDetails":{"router.guest.ip":"10.1.1.1","
> > router.name":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}}] }
> > 2015-11-26 20:22:32,439 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-70:ctx-436aff22) Seq 4-8612571337392652842: Executing
> request
> > 2015-11-26 20:22:32,439 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> > (DirectAgent-70:ctx-436aff22) Transforming
> > com.cloud.agent.api.routing.SetFirewallRulesCommand to ConfigItems
> > 2015-11-26 20:22:32,445 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-70:ctx-436aff22) Copying VR with ip 169.254.0.43 config file
> > into host 10.0.0.171
> > 2015-11-26 20:22:32,848 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-70:ctx-436aff22) VR Config file
> > VR-a8dcb409-d150-4d21-b2c7-53b76dccedb3.cfg got created in VR, ip
> > 169.254.0.43 with content
> > #Apache CloudStack Virtual Router Config File
> > <version>
> > 1.0
> > </version>
> > <file>
> > /var/cache/cloud/firewall_rules.json
> >
> >
> {"rules":[{"id":0,"src_ip":"","protocol":"all","revoked":false,"already_added":false,"source_cidr_list":[],"purpose":"Firewall","traffic_type":"Egress","default_egress_policy":false}],"type":"firewallrules"}
> > </file>
> > <script>
> > /opt/cloud/bin/update_config.py firewall_rules.json
> > </script>
> >
> > 2015-11-26 20:22:32,849 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-70:ctx-436aff22) Executing command in VR:
> > /opt/cloud/bin/router_proxy.sh vr_cfg.sh 169.254.0.43 -c
> > /var/cache/cloud/VR-a8dcb409-d150-4d21-b2c7-53b76dccedb3.cfg
> > 2015-11-26 20:22:33,458 DEBUG [c.c.s.StatsCollector]
> > (StatsCollector-4:ctx-f3f3d8c7) AutoScaling Monitor is running...
> > 2015-11-26 20:22:33,734 DEBUG [c.c.s.StatsCollector]
> > (StatsCollector-2:ctx-bc3ff1c1) VmStatsCollector is running...
> > 2015-11-26 20:22:34,354 DEBUG [o.a.c.s.SecondaryStorageManagerImpl]
> > (secstorage-1:ctx-7f9c4728) Zone 3 is ready to launch secondary storage
> VM
> > 2015-11-26 20:22:34,681 DEBUG [c.c.c.ConsoleProxyManagerImpl]
> > (consoleproxy-1:ctx-7ffdffac) Zone 3 is ready to launch console proxy
> > 2015-11-26 20:22:35,261 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-23:ctx-032600be) ===START=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549620578
> > 2015-11-26 20:22:35,273 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-23:ctx-032600be ctx-30e2f925) ===END=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549620578
> > 2015-11-26 20:22:35,601 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-70:ctx-436aff22) Seq 4-8612571337392652842: Response
> Received:
> > 2015-11-26 20:22:35,601 DEBUG [c.c.a.t.Request]
> > (DirectAgent-70:ctx-436aff22) Seq 4-8612571337392652842: Processing: {
> > Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
> > [{"com.cloud.agent.api.Answer":{"result":true,"details":"Command
> > aggregation finished","wait":0}}] }
> > 2015-11-26 20:22:35,601 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> > 4-8612571337392652842: Received: { Ans: , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 10, { Answer } }
> > 2015-11-26 20:22:35,609 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Lock is
> > released for network id 212 as a part of network implement
> > 2015-11-26 20:22:35,616 DEBUG [c.c.n.NetworkModelImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
> > SecurityGroup is not supported in the network id=212
> > 2015-11-26 20:22:35,618 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Changing
> > active number of nics for network id=212 on 1
> > 2015-11-26 20:22:35,621 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Asking
> > VirtualRouter to prepare for
> > Nic[11-5-2a4a184a-eac9-4609-8a70-4d230ee3a37d-10.1.1.88]
> > 2015-11-26 20:22:35,630 DEBUG [c.c.n.NetworkModelImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
> > SecurityGroup is not supported in the network id=212
> > 2015-11-26 20:22:35,631 DEBUG [o.a.c.n.t.BasicNetworkTopology]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) CONFIG DHCP
> > FOR SUBNETS RULES
> > 2015-11-26 20:22:35,636 DEBUG [c.c.n.NetworkModelImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
> > SecurityGroup is not supported in the network id=212
> > 2015-11-26 20:22:35,637 DEBUG [o.a.c.n.t.AdvancedNetworkTopology]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) APPLYING
> VPC
> > DHCP ENTRY RULES
> > 2015-11-26 20:22:35,637 DEBUG [o.a.c.n.t.BasicNetworkTopology]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Applying
> dhcp
> > entry in network Ntwk[212|Guest|8]
> > 2015-11-26 20:22:35,665 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> > 4-8612571337392652843: Sending { Cmd , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 100011,
> >
> >
> [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:71:ff:00:03","vmIpAddress":"10.1.1.88","vmName":"Test002","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:71:ff:00:03","isDefault":true,"executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","router.guest.ip":"10.1.1.1","router.ip":"169.254.0.43","
> > router.name":"r-4-VM"},"wait":0}}] }
> > 2015-11-26 20:22:35,667 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> > 4-8612571337392652843: Executing: { Cmd , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 100011,
> >
> >
> [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:71:ff:00:03","vmIpAddress":"10.1.1.88","vmName":"Test002","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:71:ff:00:03","isDefault":true,"executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","router.guest.ip":"10.1.1.1","router.ip":"169.254.0.43","
> > router.name":"r-4-VM"},"wait":0}}] }
> > 2015-11-26 20:22:35,667 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-277:ctx-490bf746) Seq 4-8612571337392652843: Executing
> request
> > 2015-11-26 20:22:35,667 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> > (DirectAgent-277:ctx-490bf746) Transforming
> > com.cloud.agent.api.routing.DhcpEntryCommand to ConfigItems
> > 2015-11-26 20:22:35,672 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-277:ctx-490bf746) Copying VR with ip 169.254.0.43 config
> file
> > into host 10.0.0.171
> > 2015-11-26 20:22:36,054 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-277:ctx-490bf746) VR Config file vm_dhcp_entry.json got
> > created in VR, ip 169.254.0.43 with content
> >
> >
> {"host_name":"Test002","mac_address":"02:00:71:ff:00:03","ipv4_adress":"10.1.1.88","ipv6_duid":"00:03:00:01:02:00:71:ff:00:03","dns_adresses":"10.1.1.1","default_gateway":"10.1.1.1","default_entry":true,"type":"dhcpentry"}
> > 2015-11-26 20:22:36,054 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> > (DirectAgent-277:ctx-490bf746) Processing FileConfigItem, copying 222
> > characters to vm_dhcp_entry.json took 387ms
> > 2015-11-26 20:22:36,054 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-277:ctx-490bf746) Executing command in VR:
> > /opt/cloud/bin/router_proxy.sh update_config.py 169.254.0.43
> > vm_dhcp_entry.json
> > 2015-11-26 20:22:36,965 DEBUG [c.c.a.m.AgentManagerImpl]
> > (AgentManager-Handler-9:null) SeqA 5-1787: Processing Seq 5-1787: { Cmd
> ,
> > MgmtId: -1, via: 5, Ver: v1, Flags: 11,
> >
> >
> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
> > \"connections\": []\n}","wait":0}}] }
> > 2015-11-26 20:22:36,969 DEBUG [c.c.a.m.AgentManagerImpl]
> > (AgentManager-Handler-9:null) SeqA 5-1787: Sending Seq 5-1787: { Ans: ,
> > MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
> > [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
> > 2015-11-26 20:22:38,021 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (AsyncJobMgr-Heartbeat-1:ctx-a7e1fd79) Begin cleanup expired async-jobs
> > 2015-11-26 20:22:38,023 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (AsyncJobMgr-Heartbeat-1:ctx-a7e1fd79) End cleanup expired async-jobs
> > 2015-11-26 20:22:38,275 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-6:ctx-d344515b) ===START=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549623593
> > 2015-11-26 20:22:38,288 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-6:ctx-d344515b ctx-ff44d35a) ===END=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549623593
> > 2015-11-26 20:22:38,760 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> > (DirectAgent-277:ctx-490bf746) Processing ScriptConfigItem, executing
> > update_config.py vm_dhcp_entry.json took 2706ms
> > 2015-11-26 20:22:38,760 WARN [c.c.a.r.v.VirtualRoutingResource]
> > (DirectAgent-277:ctx-490bf746) Expected 1 answers while executing
> > DhcpEntryCommand but received 2
> > 2015-11-26 20:22:38,760 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-277:ctx-490bf746) Seq 4-8612571337392652843: Response
> > Received:
> > 2015-11-26 20:22:38,760 DEBUG [c.c.a.t.Request]
> > (DirectAgent-277:ctx-490bf746) Seq 4-8612571337392652843: Processing: {
> > Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
> > [{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null - success:
> > ","null - success: RTNETLINK answers: File exists\nRTNETLINK answers:
> File
> > exists\nRTNETLINK answers: File exists\n[INFO] update_config.py ::
> > Processing incoming file => vm_dhcp_entry.json\n[INFO] Processing JSON
> file
> > vm_dhcp_entry.json\nTest01 Test002\n"],"result":true,"wait":0}}] }
> > 2015-11-26 20:22:38,760 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> > 4-8612571337392652843: Received: { Ans: , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 10, { GroupAnswer } }
> > 2015-11-26 20:22:38,766 DEBUG [c.c.n.NetworkModelImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
> > SecurityGroup is not supported in the network id=212
> > 2015-11-26 20:22:38,768 DEBUG [o.a.c.n.t.AdvancedNetworkTopology]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) APPLYING
> VPC
> > USERDATA RULES
> > 2015-11-26 20:22:38,768 DEBUG [o.a.c.n.t.BasicNetworkTopology]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Applying
> > userdata and password entry in network Ntwk[212|Guest|8]
> > 2015-11-26 20:22:38,778 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> > 4-8612571337392652844: Sending { Cmd , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 100011,
> >
> >
> [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
> > router.name
> >
> >
> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
> > router.name
> >
> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}}]
> > }
> > 2015-11-26 20:22:38,779 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> > 4-8612571337392652844: Executing: { Cmd , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 100011,
> >
> >
> [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
> > router.name
> >
> >
> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
> > router.name
> >
> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}}]
> > }
> > 2015-11-26 20:22:38,779 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-139:ctx-69673506) Seq 4-8612571337392652844: Executing
> request
> > 2015-11-26 20:22:38,779 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> > (DirectAgent-139:ctx-69673506) Transforming
> > com.cloud.agent.api.routing.SavePasswordCommand to ConfigItems
> > 2015-11-26 20:22:38,787 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-139:ctx-69673506) Copying VR with ip 169.254.0.43 config
> file
> > into host 10.0.0.171
> > 2015-11-26 20:22:39,199 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-139:ctx-69673506) VR Config file vm_password.json got
> created
> > in VR, ip 169.254.0.43 with content
> >
> {"ip_address":"10.1.1.88","password":"saved_password","type":"vmpassword"}
> > 2015-11-26 20:22:39,199 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> > (DirectAgent-139:ctx-69673506) Processing FileConfigItem, copying 74
> > characters to vm_password.json took 420ms
> > 2015-11-26 20:22:39,199 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-139:ctx-69673506) Executing command in VR:
> > /opt/cloud/bin/router_proxy.sh update_config.py 169.254.0.43
> > vm_password.json
> > 2015-11-26 20:22:40,237 DEBUG [c.c.s.StatsCollector]
> > (StatsCollector-1:ctx-32277352) HostStatsCollector is running...
> > 2015-11-26 20:22:40,245 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-278:ctx-dc01444e) Seq 4-8612571337392652845: Executing
> request
> > 2015-11-26 20:22:40,260 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-278:ctx-dc01444e) Seq 4-8612571337392652845: Response
> > Received:
> > 2015-11-26 20:22:40,260 DEBUG [c.c.a.t.Request]
> > (StatsCollector-1:ctx-32277352) Seq 4-8612571337392652845: Received: {
> > Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10, {
> > GetHostStatsAnswer } }
> > 2015-11-26 20:22:40,263 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-18:ctx-53bf8c75) Seq 4-8612571337392652846: Executing
> request
> > 2015-11-26 20:22:40,273 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-18:ctx-53bf8c75) Seq 4-8612571337392652846: Response
> Received:
> > 2015-11-26 20:22:40,274 DEBUG [c.c.a.t.Request]
> > (StatsCollector-1:ctx-32277352) Seq 4-8612571337392652846: Received: {
> > Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10, {
> > GetGPUStatsAnswer } }
> > 2015-11-26 20:22:41,275 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-4:ctx-f2410d29) ===START=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549626594
> > 2015-11-26 20:22:41,287 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-4:ctx-f2410d29 ctx-f6f4a185) ===END=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549626594
> > 2015-11-26 20:22:41,959 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> > (DirectAgent-139:ctx-69673506) Processing ScriptConfigItem, executing
> > update_config.py vm_password.json took 2760ms
> > 2015-11-26 20:22:41,959 WARN [c.c.a.r.v.VirtualRoutingResource]
> > (DirectAgent-139:ctx-69673506) Expected 1 answers while executing
> > SavePasswordCommand but received 2
> > 2015-11-26 20:22:41,960 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> > (DirectAgent-139:ctx-69673506) Transforming
> > com.cloud.agent.api.routing.VmDataCommand to ConfigItems
> > 2015-11-26 20:22:41,964 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-139:ctx-69673506) Copying VR with ip 169.254.0.43 config
> file
> > into host 10.0.0.171
> > 2015-11-26 20:22:42,370 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-139:ctx-69673506) VR Config file vm_metadata.json got
> created
> > in VR, ip 169.254.0.43 with content
> >
> >
> {"vm_ip_address":"10.1.1.88","vm_metadata":[["userdata","user-data",null],["metadata","service-offering","Medium
> >
> >
> Instance"],["metadata","availability-zone","TestZone"],["metadata","local-ipv4","10.1.1.88"],["metadata","local-hostname","Test002"],["metadata","public-ipv4","10.0.0.174"],["metadata","public-hostname","10.0.0.174"],["metadata","instance-id","4ce4731f-22a7-42ac-8e78-093d5f2e9a34"],["metadata","vm-id","4ce4731f-22a7-42ac-8e78-093d5f2e9a34"],["metadata","public-keys",null],["metadata","cloud-identifier","CloudStack-{de65e551-2e87-423b-90e6-03cd3eb706bb}"]],"type":"vmdata"}
> > 2015-11-26 20:22:42,371 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> > (DirectAgent-139:ctx-69673506) Processing FileConfigItem, copying 589
> > characters to vm_metadata.json took 411ms
> > 2015-11-26 20:22:42,371 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-139:ctx-69673506) Executing command in VR:
> > /opt/cloud/bin/router_proxy.sh update_config.py 169.254.0.43
> > vm_metadata.json
> > 2015-11-26 20:22:44,606 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-25:ctx-128f2f7a) ===START=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549629925
> > 2015-11-26 20:22:44,619 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-25:ctx-128f2f7a ctx-291bcd97) ===END=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549629925
> > 2015-11-26 20:22:45,153 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> > (DirectAgent-139:ctx-69673506) Processing ScriptConfigItem, executing
> > update_config.py vm_metadata.json took 2782ms
> > 2015-11-26 20:22:45,153 WARN [c.c.a.r.v.VirtualRoutingResource]
> > (DirectAgent-139:ctx-69673506) Expected 1 answers while executing
> > VmDataCommand but received 2
> > 2015-11-26 20:22:45,153 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-139:ctx-69673506) Seq 4-8612571337392652844: Response
> > Received:
> > 2015-11-26 20:22:45,163 DEBUG [c.c.a.t.Request]
> > (DirectAgent-139:ctx-69673506) Seq 4-8612571337392652844: Processing: {
> > Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
> > [{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null - success:
> > ","null - success: RTNETLINK answers: File exists\nRTNETLINK answers:
> File
> > exists\nRTNETLINK answers: File exists\n[INFO] update_config.py ::
> > Processing incoming file => vm_password.json\n[INFO] Processing JSON file
> >
> >
> vm_password.json\n"],"result":true,"wait":0}},{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null
> > - success: ","null - success: RTNETLINK answers: File exists\nRTNETLINK
> > answers: File exists\nRTNETLINK answers: File exists\n[INFO]
> > update_config.py :: Processing incoming file => vm_metadata.json\n[INFO]
> > Processing JSON file vm_metadata.json\n"],"result":true,"wait":0}}] }
> > 2015-11-26 20:22:45,163 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> > 4-8612571337392652844: Received: { Ans: , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 10, { GroupAnswer, GroupAnswer } }
> > 2015-11-26 20:22:45,164 DEBUG [c.c.n.NetworkModelImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
> > SecurityGroup is not supported in the network id=212
> > 2015-11-26 20:22:45,165 DEBUG [o.a.c.e.o.VolumeOrchestrator]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
> > we need to prepare 2 volumes for VM[User|i-2-5-VM]
> > 2015-11-26 20:22:45,168 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) template 5
> is
> > already in store:1, type:Image
> > 2015-11-26 20:22:45,169 DEBUG [o.a.c.s.d.PrimaryDataStoreImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Not found
> > (templateId:5poolId:8) in template_spool_ref, persisting it
> > 2015-11-26 20:22:45,173 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) template 5
> is
> > already in store:8, type:Primary
> > 2015-11-26 20:22:45,174 DEBUG [o.a.c.s.v.VolumeServiceImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found
> > template centos56-x86_64-xen in storage pool 8 with VMTemplateStoragePool
> > id: 3
> > 2015-11-26 20:22:45,174 DEBUG [o.a.c.s.v.VolumeServiceImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Acquire
> lock
> > on VMTemplateStoragePool 3 with timeout 3600 seconds
> > 2015-11-26 20:22:45,175 INFO [o.a.c.s.v.VolumeServiceImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) lock is
> > acquired for VMTemplateStoragePool 3
> > 2015-11-26 20:22:45,179 DEBUG [o.a.c.s.m.AncientDataMotionStrategy]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) copyAsync
> > inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE
> > 2015-11-26 20:22:45,182 DEBUG [c.c.h.XenServerGuru]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> > getCommandHostDelegation: class
> > org.apache.cloudstack.storage.command.CopyCommand
> > 2015-11-26 20:22:45,183 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> > 4-8612571337392652847: Sending { Cmd , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 100111,
> >
> >
> [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/5/3986df71-b1d0-3e20-a655-7e42dd144370.vhd","origUrl":"
> > http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
> >
> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
> > 5.6(64-bit) no GUI
> >
> >
> (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://
> > 10.0.0.170/export/secondary
> >
> >
> ","_role":"Image"}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"
> > http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
> >
> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
> > 5.6(64-bit) no GUI
> >
> >
> (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
> >
> >
> 10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc
> >
> "}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"executeInSequence":true,"options":{},"options2":{},"wait":10800}}]
> > }
> > 2015-11-26 20:22:45,184 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> > 4-8612571337392652847: Executing: { Cmd , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 100111,
> >
> >
> [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/5/3986df71-b1d0-3e20-a655-7e42dd144370.vhd","origUrl":"
> > http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
> >
> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
> > 5.6(64-bit) no GUI
> >
> >
> (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://
> > 10.0.0.170/export/secondary
> >
> >
> ","_role":"Image"}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"
> > http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
> >
> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
> > 5.6(64-bit) no GUI
> >
> >
> (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
> >
> >
> 10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc
> >
> "}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"executeInSequence":true,"options":{},"options2":{},"wait":10800}}]
> > }
> > 2015-11-26 20:22:45,184 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-279:ctx-532427fb) Seq 4-8612571337392652847: Executing
> request
> > 2015-11-26 20:22:46,489 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-279:ctx-532427fb) Host 10.0.0.171
> > OpaqueRef:53354999-bf25-32b9-01df-a695a039ba8d: Removing SR
> > 2015-11-26 20:22:46,500 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-279:ctx-532427fb) Host 10.0.0.171
> > OpaqueRef:f33f27b6-88c3-8c94-c8b3-40c094d9e66d: Unplugging pbd
> > 2015-11-26 20:22:46,598 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-279:ctx-532427fb) Host 10.0.0.171
> > OpaqueRef:53354999-bf25-32b9-01df-a695a039ba8d: Forgetting
> > 2015-11-26 20:22:46,601 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-279:ctx-532427fb) Seq 4-8612571337392652847: Response
> > Received:
> > 2015-11-26 20:22:46,602 DEBUG [c.c.a.t.Request]
> > (DirectAgent-279:ctx-532427fb) Seq 4-8612571337392652847: Processing: {
> > Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 110,
> >
> >
> [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Expected
> > 1 VDI template but found 2 VDI template(s) on:
> > 10.0.0.170:/export/secondary/template/tmpl/1/5","wait":0}}]
> > }
> > 2015-11-26 20:22:46,602 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> > 4-8612571337392652847: Received: { Ans: , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 110, { CopyCmdAnswer } }
> > 2015-11-26 20:22:46,603 DEBUG [c.c.a.m.AgentAttache]
> > (DirectAgent-279:ctx-532427fb) Seq 4-8612571337392652847: No more
> commands
> > found
> > 2015-11-26 20:22:46,607 INFO [o.a.c.s.v.VolumeServiceImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) releasing
> > lock for VMTemplateStoragePool 3
> > 2015-11-26 20:22:46,608 DEBUG [o.a.c.e.o.VolumeOrchestrator]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Unable to
> > create Vol[6|vm=5|ROOT]:Expected 1 VDI template but found 2 VDI
> template(s)
> > on: 10.0.0.170:/export/secondary/template/tmpl/1/5
> > 2015-11-26 20:22:46,608 INFO [c.c.v.VirtualMachineManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Unable to
> > contact resource.
> > com.cloud.exception.StorageUnavailableException: Resource [StoragePool:8]
> > is unreachable: Unable to create Vol[6|vm=5|ROOT]:Expected 1 VDI template
> > but found 2 VDI template(s) on: 10.0.0.170:
> > /export/secondary/template/tmpl/1/5
> > at
> >
> >
> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1278)
> > at
> >
> >
> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1336)
> > at
> >
> >
> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1000)
> > at
> >
> >
> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4580)
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at
> >
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> > at
> >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > at java.lang.reflect.Method.invoke(Method.java:606)
> > at
> >
> >
> com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
> > at
> >
> >
> com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4736)
> > at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
> > at
> >
> >
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
> > at
> >
> >
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
> > at
> >
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
> > at
> >
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
> > at
> >
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
> > at
> >
> >
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
> > at
> >
> >
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
> > at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> > at
> >
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > at
> >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > at java.lang.Thread.run(Thread.java:745)
> > 2015-11-26 20:22:46,611 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Cleaning up
> > resources for the vm VM[User|i-2-5-VM] in Starting state
> > 2015-11-26 20:22:46,612 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> > 4-8612571337392652848: Sending { Cmd , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 100011,
> >
> >
> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"checkBeforeCleanup":false,"vmName":"i-2-5-VM","wait":0}}]
> > }
> > 2015-11-26 20:22:46,612 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> > 4-8612571337392652848: Executing: { Cmd , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 100011,
> >
> >
> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"checkBeforeCleanup":false,"vmName":"i-2-5-VM","wait":0}}]
> > }
> > 2015-11-26 20:22:46,613 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-140:ctx-7f6d3e96) Seq 4-8612571337392652848: Executing
> request
> > 2015-11-26 20:22:46,618 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-140:ctx-7f6d3e96) Seq 4-8612571337392652848: Response
> > Received:
> > 2015-11-26 20:22:46,618 DEBUG [c.c.a.t.Request]
> > (DirectAgent-140:ctx-7f6d3e96) Seq 4-8612571337392652848: Processing: {
> > Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
> > [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not
> > exist","wait":0}}] }
> > 2015-11-26 20:22:46,618 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> > 4-8612571337392652848: Received: { Ans: , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 10, { StopAnswer } }
> > 2015-11-26 20:22:46,623 DEBUG [c.c.n.NetworkModelImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
> > SecurityGroup is not supported in the network id=212
> > 2015-11-26 20:22:46,625 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Changing
> > active number of nics for network id=212 on -1
> > 2015-11-26 20:22:46,630 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Asking
> > VirtualRouter to release
> > NicProfile[11-5-2a4a184a-eac9-4609-8a70-4d230ee3a37d-10.1.1.88-null
> > 2015-11-26 20:22:46,630 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> Successfully
> > released network resources for the vm VM[User|i-2-5-VM]
> > 2015-11-26 20:22:46,630 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> Successfully
> > cleanued up resources for the vm VM[User|i-2-5-VM] in Starting state
> > 2015-11-26 20:22:46,635 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deploy
> avoids
> > pods: [], clusters: [], hosts: [4]
> > 2015-11-26 20:22:46,636 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> > DeploymentPlanner allocation algorithm:
> > com.cloud.deploy.FirstFitPlanner@1136745
> > 2015-11-26 20:22:46,636 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
> > allocate a host and storage pools from dc:3, pod:3,cluster:3, requested
> > cpu: 1000, requested ram: 1073741824
> > 2015-11-26 20:22:46,636 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Is ROOT
> > volume READY (pool already allocated)?: No
> > 2015-11-26 20:22:46,636 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> > DeploymentPlan has host_id specified, choosing this host and making no
> > checks on this host: 4
> > 2015-11-26 20:22:46,636 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) The
> specified
> > host is in avoid set
> > 2015-11-26 20:22:46,636 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Cannot
> deploy
> > to specified host, returning.
> > 2015-11-26 20:22:46,645 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM state
> > transitted from :Starting to Stopped with event: OperationFailedvm's
> > original host id: null new host id: null host id before state
> transition: 4
> > 2015-11-26 20:22:46,648 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Hosts's
> > actual total CPU: 3399 and CPU after applying overprovisioning: 3399
> > 2015-11-26 20:22:46,649 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Hosts's
> > actual total RAM: 15354505344 and RAM after applying overprovisioning:
> > 15354505216
> > 2015-11-26 20:22:46,649 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) release cpu
> > from host: 4, old used: 2500,reserved: 0, actual total: 3399, total with
> > overprovisioning: 3399; new used: 1500,reserved:0; movedfromreserved:
> > false,moveToReserveredfalse
> > 2015-11-26 20:22:46,649 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) release mem
> > from host: 4, old used: 2952790016,reserved: 0, total: 15354505216; new
> > used: 1879048192,reserved:0; movedfromreserved:
> false,moveToReserveredfalse
> > 2015-11-26 20:22:46,654 ERROR [c.c.v.VmWorkJobHandlerProxy]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Invocation
> > exception, caused by:
> > com.cloud.exception.InsufficientServerCapacityException: Unable to
> create a
> > deployment for VM[User|i-2-5-VM]Scope=interface com.cloud.dc.DataCenter;
> > id=3
> > 2015-11-26 20:22:46,654 INFO [c.c.v.VmWorkJobHandlerProxy]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Rethrow
> > exception com.cloud.exception.InsufficientServerCapacityException: Unable
> > to create a deployment for VM[User|i-2-5-VM]Scope=interface
> > com.cloud.dc.DataCenter; id=3
> > 2015-11-26 20:22:46,654 DEBUG [c.c.v.VmWorkJobDispatcher]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Done with run of VM work
> > job: com.cloud.vm.VmWorkStart for VM 5, job origin: 68
> > 2015-11-26 20:22:46,654 ERROR [c.c.v.VmWorkJobDispatcher]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Unable to complete
> > AsyncJobVO {id:69, userId: 2, accountId: 2, instanceType: null,
> instanceId:
> > null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
> >
> >
> rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAABXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAA3BzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHIAEGphdmEubGFuZy5OdW1iZXKGrJUdC5TgiwIAAHhwAAAAAAAAAANzcQB-AAgAAAAAAAAABHBwcHEAfgAKcHNyABFqYXZhLnV0aWwuSGFzaE1hcAUH2sHDFmDRAwACRgAKbG9hZEZhY3RvckkACXRocmVzaG9sZHhwP0AAAAAAAAx3CAAAABAAAAABdAAKVm1QYXNzd29yZHQAHHJPMEFCWFFBRG5OaGRtVmtYM0JoYzNOM2IzSmt4cA,
> > cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
> > result: null, initMsid: 52229922654, completeMsid: null, lastUpdated:
> null,
> > lastPolled: null, created: Thu Nov 26 20:21:56 IST 2015}, job origin:68
> > com.cloud.exception.InsufficientServerCapacityException: Unable to
> create a
> > deployment for VM[User|i-2-5-VM]Scope=interface com.cloud.dc.DataCenter;
> > id=3
> > at
> >
> >
> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:959)
> > at
> >
> >
> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4580)
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at
> >
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> > at
> >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > at java.lang.reflect.Method.invoke(Method.java:606)
> > at
> >
> >
> com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
> > at
> >
> >
> com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4736)
> > at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
> > at
> >
> >
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
> > at
> >
> >
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
> > at
> >
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
> > at
> >
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
> > at
> >
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
> > at
> >
> >
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
> > at
> >
> >
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
> > at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> > at
> >
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > at
> >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > at java.lang.Thread.run(Thread.java:745)
> > 2015-11-26 20:22:46,662 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Complete async job-69,
> > jobStatus: FAILED, resultCode: 0, result:
> >
> >
> rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAAzVW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1VzZXJ8aS0yLTUtVk1ddXIAHltMamF2YS5sYW5nLlN0YWNrVHJhY2VFbGVtZW50OwJGKjw8_SI5AgAAeHAAAAAVc3IAG2phdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudGEJxZomNt2FAgAESQAKbGluZU51bWJlckwADmRlY2xhcmluZ0NsYXNzcQB-AApMAAhmaWxlTmFtZXEAfgAKTAAKbWV0aG9kTmFtZXEAfgAKeHAAAAO_dAAmY29tLmNsb3VkLnZtLlZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGx0AB5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsLmphdmF0ABBvcmNoZXN0cmF0ZVN0YXJ0c3EAfgARAAAR5HEAfgATcQB-ABRxAH4AFXNxAH4AEf____50ACRzdW4ucmVmbGVjdC5OYXRpdmVNZXRob2RBY2Nlc3NvckltcGx0AB1OYXRpdmVNZXRob2RBY2Nlc3NvckltcGwuamF2YXQAB2ludm9rZTBzcQB-ABEAAAA5cQB-ABhxAH4AGXQABmludm9rZXNxAH4AEQAAACt0AChzdW4ucmVmbGVjdC5EZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsdAAhRGVsZWdhdGluZ01ldGhvZEFjY2Vzc29ySW1wbC5qYXZhcQB-ABxzcQB-ABEAAAJedAAYamF2YS5sYW5nLnJlZmxlY3QuTWV0aG9kdAALTWV0aG9kLmphdmFxAH4AHHNxAH4AEQAAAGt0ACJjb20uY2xvdWQudm0uVm1Xb3JrSm9iSGFuZGxlclByb3h5dAAaVm1Xb3JrSm9iSGFuZGxlclByb3h5LmphdmF0AA9oYW5kbGVWbVdvcmtKb2JzcQB-ABEAABKAcQB-ABNxAH4AFHEAfgAmc3EAfgARAAAAZnQAIGNvbS5jbG91ZC52bS5WbVdvcmtKb2JEaXNwYXRjaGVydAAYVm1Xb3JrSm9iRGlzcGF0Y2hlci5qYXZhdAAGcnVuSm9ic3EAfgARAAACGXQAP29yZy5hcGFjaGUuY2xvdWRzdGFjay5mcmFtZXdvcmsuam9icy5pbXBsLkFzeW5jSm9iTWFuYWdlckltcGwkNXQAGEFzeW5jSm9iTWFuYWdlckltcGwuamF2YXQADHJ1bkluQ29udGV4dHNxAH4AEQAAADF0AD5vcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGUkMXQAG01hbmFnZWRDb250ZXh0UnVubmFibGUuamF2YXQAA3J1bnNxAH4AEQAAADh0AEJvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0JDF0ABpEZWZhdWx0TWFuYWdlZENvbnRleHQuamF2YXQABGNhbGxzcQB-ABEAAABndABAb3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5pbXBsLkRlZmF1bHRNYW5hZ2VkQ29udGV4dHEAfgA2dAAPY2FsbFdpdGhDb250ZXh0c3EAfgARAAAANXEAfgA5cQB-ADZ0AA5ydW5XaXRoQ29udGV4dHNxAH4AEQAAAC50ADxvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGVxAH4AMnEAfgAzc3EAfgARAAAB7nEAfgAtcQB-AC5xAH4AM3NxAH4AEQAAAdd0AC5qYXZhLnV0aWwuY29uY3VycmVudC5FeGVjdXRvcnMkUnVubmFibGVBZGFwdGVydAAORXhlY3V0b3JzLmphdmFxAH4AN3NxAH4AEQAAAQZ0AB9qYXZhLnV0aWwuY29uY3VycmVudC5GdXR1cmVUYXNrdAAPRnV0dXJlVGFzay5qYXZhcQB-ADNzcQB-ABEAAAR5dAAnamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9ydAAXVGhyZWFkUG9vbEV4ZWN1dG9yLmphdmF0AAlydW5Xb3JrZXJzcQB-ABEAAAJndAAuamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9yJFdvcmtlcnEAfgBIcQB-ADNzcQB-ABEAAALpdAAQamF2YS5sYW5nLlRocmVhZHQAC1RocmVhZC5qYXZhcQB-ADNzcgAmamF2YS51dGlsLkNvbGxlY3Rpb25zJFVubW9kaWZpYWJsZUxpc3T8DyUxteyOEAIAAUwABGxpc3RxAH4ADHhyACxqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlQ29sbGVjdGlvbhlCAIDLXvceAgABTAABY3QAFkxqYXZhL3V0aWwvQ29sbGVjdGlvbjt4cHNyABNqYXZhLnV0aWwuQXJyYXlMaXN0eIHSHZnHYZ0DAAFJAARzaXpleHAAAAAAdwQAAAAAeHEAfgBUeHNyABFqYXZhLmxhbmcuSW50ZWdlchLioKT3gYc4AgABSQAFdmFsdWV4cgAQamF2YS5sYW5nLk51bWJlcoaslR0LlOCLAgAAeHAAABDvc3EAfgBTAAAAAHcEAAAAAHhzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHEAfgBWAAAAAAAAAAN2cgAXY29tLmNsb3VkLmRjLkRhdGFDZW50ZXKy8Qrrp-d4vgIAAHhwAA
> > 2015-11-26 20:22:46,663 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Publish async job-69
> > complete on message bus
> > 2015-11-26 20:22:46,663 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Wake up jobs related to
> > job-69
> > 2015-11-26 20:22:46,663 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Update db status for
> > job-69
> > 2015-11-26 20:22:46,664 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Wake up jobs joined with
> > job-69 and disjoin all subjobs created from job- 69
> > 2015-11-26 20:22:46,671 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Done executing
> > com.cloud.vm.VmWorkStart for job-69
> > 2015-11-26 20:22:46,672 INFO [o.a.c.f.j.i.AsyncJobMonitor]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Remove job-69 from job
> > monitoring
> > 2015-11-26 20:22:46,680 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Sync job-71
> execution
> > on object VmWorkJobQueue.5
> > 2015-11-26 20:22:46,966 DEBUG [c.c.a.m.AgentManagerImpl]
> > (AgentManager-Handler-7:null) SeqA 5-1788: Processing Seq 5-1788: { Cmd
> ,
> > MgmtId: -1, via: 5, Ver: v1, Flags: 11,
> >
> >
> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
> > \"connections\": []\n}","wait":0}}] }
> > 2015-11-26 20:22:46,971 DEBUG [c.c.a.m.AgentManagerImpl]
> > (AgentManager-Handler-7:null) SeqA 5-1788: Sending Seq 5-1788: { Ans: ,
> > MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
> > [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
> > 2015-11-26 20:22:48,032 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (AsyncJobMgr-Heartbeat-1:ctx-a78c3581) Execute sync-queue item:
> > SyncQueueItemVO {id:10, queueId: 9, contentType: AsyncJob, contentId: 71,
> > lastProcessMsid: 52229922654, lastprocessNumber: 2, lastProcessTime: Thu
> > Nov 26 20:22:48 IST 2015, created: Thu Nov 26 20:22:46 IST 2015}
> > 2015-11-26 20:22:48,033 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (AsyncJobMgr-Heartbeat-1:ctx-a78c3581) Schedule queued job-71
> > 2015-11-26 20:22:48,038 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (AsyncJobMgr-Heartbeat-1:ctx-5936202f) Begin cleanup expired async-jobs
> > 2015-11-26 20:22:48,041 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (AsyncJobMgr-Heartbeat-1:ctx-5936202f) End cleanup expired async-jobs
> > 2015-11-26 20:22:48,041 INFO [o.a.c.f.j.i.AsyncJobMonitor]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Add job-71 into job
> > monitoring
> > 2015-11-26 20:22:48,045 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Executing AsyncJobVO
> > {id:71, userId: 2, accountId: 2, instanceType: null, instanceId: null,
> cmd:
> > com.cloud.vm.VmWorkStart, cmdInfo:
> >
> >
> rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAABXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwc3IAEWphdmEudXRpbC5IYXNoTWFwBQfawcMWYNEDAAJGAApsb2FkRmFjdG9ySQAJdGhyZXNob2xkeHA_QAAAAAAADHcIAAAAEAAAAAF0AApWbVBhc3N3b3JkdAAcck8wQUJYUUFEbk5oZG1Wa1gzQmhjM04zYjNKa3hw,
> > cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
> > result: null, initMsid: 52229922654, completeMsid: null, lastUpdated:
> null,
> > lastPolled: null, created: Thu Nov 26 20:22:46 IST 2015}
> > 2015-11-26 20:22:48,046 DEBUG [c.c.v.VmWorkJobDispatcher]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Run VM work job:
> > com.cloud.vm.VmWorkStart for VM 5, job origin: 68
> > 2015-11-26 20:22:48,046 DEBUG [c.c.v.VmWorkJobHandlerProxy]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Execute VM
> > work job:
> >
> >
> com.cloud.vm.VmWorkStart{"dcId":0,"rawParams":{"VmPassword":"rO0ABXQADnNhdmVkX3Bhc3N3b3Jk"},"userId":2,"accountId":2,"vmId":5,"handlerName":"VirtualMachineManagerImpl"}
> > 2015-11-26 20:22:48,050 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) VM state
> > transitted from :Stopped to Starting with event: StartRequestedvm's
> > original host id: null new host id: null host id before state transition:
> > null
> > 2015-11-26 20:22:48,050 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
> Successfully
> > transitioned to start state for VM[User|i-2-5-VM] reservation id =
> > 718d2456-bf61-48ad-9663-22ccfd4556f1
> > 2015-11-26 20:22:48,052 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Trying to
> > deploy VM, vm has dcId: 3 and podId: 3
> > 2015-11-26 20:22:48,052 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Deploy
> avoids
> > pods: null, clusters: null, hosts: null
> > 2015-11-26 20:22:48,057 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Deploy
> avoids
> > pods: [], clusters: [], hosts: []
> > 2015-11-26 20:22:48,057 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
> > DeploymentPlanner allocation algorithm:
> > com.cloud.deploy.FirstFitPlanner@1136745
> > 2015-11-26 20:22:48,057 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Trying to
> > allocate a host and storage pools from dc:3, pod:3,cluster:null,
> requested
> > cpu: 1000, requested ram: 1073741824
> > 2015-11-26 20:22:48,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Is ROOT
> > volume READY (pool already allocated)?: No
> > 2015-11-26 20:22:48,058 DEBUG [c.c.d.FirstFitPlanner]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Searching
> > resources only under specified Pod: 3
> > 2015-11-26 20:22:48,058 DEBUG [c.c.d.FirstFitPlanner]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Listing
> > clusters in order of aggregate capacity, that have (atleast one host
> with)
> > enough CPU and RAM capacity under this Pod: 3
> > 2015-11-26 20:22:48,059 DEBUG [c.c.d.FirstFitPlanner]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Removing
> from
> > the clusterId list these clusters from avoid set: []
> > 2015-11-26 20:22:48,063 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
> > resources in Cluster: 3 under Pod: 3
> > 2015-11-26 20:22:48,063 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
> > FirstFitRoutingAllocator) Looking for hosts in dc: 3 pod:3 cluster:3
> > 2015-11-26 20:22:48,065 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
> > FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for
> > allocation: [Host[-4-Routing]]
> > 2015-11-26 20:22:48,067 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
> > FirstFitRoutingAllocator) Found 1 hosts for allocation after
> > prioritization: [Host[-4-Routing]]
> > 2015-11-26 20:22:48,067 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
> > FirstFitRoutingAllocator) Looking for speed=1000Mhz, Ram=1024
> > 2015-11-26 20:22:48,070 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
> > FirstFitRoutingAllocator) Host: 4 has cpu capability (cpu:1, speed:3399)
> to
> > support requested CPU: 1 and requested speed: 1000
> > 2015-11-26 20:22:48,070 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
> > FirstFitRoutingAllocator) Checking if host: 4 has enough capacity for
> > requested CPU: 1000 and requested RAM: 1073741824 ,
> > cpuOverprovisioningFactor: 1.0
> > 2015-11-26 20:22:48,071 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
> > FirstFitRoutingAllocator) Hosts's actual total CPU: 3399 and CPU after
> > applying overprovisioning: 3399
> > 2015-11-26 20:22:48,071 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
> > FirstFitRoutingAllocator) Free CPU: 1899 , Requested CPU: 1000
> > 2015-11-26 20:22:48,071 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
> > FirstFitRoutingAllocator) Free RAM: 13475457024 , Requested RAM:
> 1073741824
> > 2015-11-26 20:22:48,071 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
> > FirstFitRoutingAllocator) Host has enough CPU and RAM available
> > 2015-11-26 20:22:48,071 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
> > FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 4, used: 1500,
> > reserved: 0, actual total: 3399, total with overprovisioning: 3399;
> > requested cpu:1000,alloc_from_last_host?:false
> ,considerReservedCapacity?:
> > true
> > 2015-11-26 20:22:48,071 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
> > FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 4, used:
> > 1879048192, reserved: 0, total: 15354505216; requested mem:
> > 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
> > 2015-11-26 20:22:48,071 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
> > FirstFitRoutingAllocator) Found a suitable host, adding to list: 4
> > 2015-11-26 20:22:48,071 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
> > FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts
> > 2015-11-26 20:22:48,072 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
> > suitable pools for volume (Id, Type): (6,ROOT)
> > 2015-11-26 20:22:48,072 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) We need to
> > allocate new storagepool for this volume
> > 2015-11-26 20:22:48,073 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Calling
> > StoragePoolAllocators to find suitable pools
> > 2015-11-26 20:22:48,073 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
> > LocalStoragePoolAllocator trying to find storage pool to fit the vm
> > 2015-11-26 20:22:48,073 DEBUG
> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
> > ClusterScopeStoragePoolAllocator looking for storage pool
> > 2015-11-26 20:22:48,073 DEBUG
> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Looking for
> > pools in dc: 3 pod:3 cluster:3. Disabled pools will be ignored.
> > 2015-11-26 20:22:48,073 DEBUG
> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found pools
> > matching tags: [Pool[8|NetworkFilesystem]]
> > 2015-11-26 20:22:48,074 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking if
> > storage pool is suitable, name: null ,poolId: 8
> > 2015-11-26 20:22:48,075 INFO [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Storage
> pool
> > null (8) does not supply IOPS capacity, assuming enough capacity
> > 2015-11-26 20:22:48,076 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
> pool
> > 8 for storage, totalSize: 526199291904, usedBytes: 10131603456, usedPct:
> > 0.019254308418659775, disable threshold: 0.85
> > 2015-11-26 20:22:48,078 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found
> storage
> > pool primary of type NetworkFilesystem with overprovisioning factor 2
> > 2015-11-26 20:22:48,078 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total over
> > provisioned capacity calculated is 2 * 526199291904
> > 2015-11-26 20:22:48,079 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total
> > capacity of the pool primary id: 8 is 1052398583808
> > 2015-11-26 20:22:48,079 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
> > pool: 8 for volume allocation [Vol[6|vm=5|ROOT]], maxSize :
> 1052398583808,
> > totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
> > disable threshold: 0.85
> > 2015-11-26 20:22:48,079 DEBUG
> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
> > ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
> > 2015-11-26 20:22:48,079 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
> > suitable pools for volume (Id, Type): (7,DATADISK)
> > 2015-11-26 20:22:48,079 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) We need to
> > allocate new storagepool for this volume
> > 2015-11-26 20:22:48,079 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Calling
> > StoragePoolAllocators to find suitable pools
> > 2015-11-26 20:22:48,079 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
> > LocalStoragePoolAllocator trying to find storage pool to fit the vm
> > 2015-11-26 20:22:48,079 DEBUG
> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
> > ClusterScopeStoragePoolAllocator looking for storage pool
> > 2015-11-26 20:22:48,079 DEBUG
> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Looking for
> > pools in dc: 3 pod:3 cluster:3. Disabled pools will be ignored.
> > 2015-11-26 20:22:48,080 DEBUG
> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found pools
> > matching tags: [Pool[8|NetworkFilesystem]]
> > 2015-11-26 20:22:48,080 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking if
> > storage pool is suitable, name: null ,poolId: 8
> > 2015-11-26 20:22:48,081 INFO [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Storage
> pool
> > null (8) does not supply IOPS capacity, assuming enough capacity
> > 2015-11-26 20:22:48,081 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
> pool
> > 8 for storage, totalSize: 526199291904, usedBytes: 10131603456, usedPct:
> > 0.019254308418659775, disable threshold: 0.85
> > 2015-11-26 20:22:48,083 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found
> storage
> > pool primary of type NetworkFilesystem with overprovisioning factor 2
> > 2015-11-26 20:22:48,083 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total over
> > provisioned capacity calculated is 2 * 526199291904
> > 2015-11-26 20:22:48,083 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total
> > capacity of the pool primary id: 8 is 1052398583808
> > 2015-11-26 20:22:48,083 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
> > pool: 8 for volume allocation [Vol[7|vm=5|DATADISK]], maxSize :
> > 1052398583808, totalAllocatedSize : 12156207104, askingSize :
> 21474836480,
> > allocated disable threshold: 0.85
> > 2015-11-26 20:22:48,083 DEBUG
> [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
> > ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
> > 2015-11-26 20:22:48,083 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Trying to
> > find a potenial host and associated storage pools from the suitable
> > host/pool lists for this VM
> > 2015-11-26 20:22:48,083 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking if
> > host: 4 can access any suitable storage pool for volume: DATADISK
> > 2015-11-26 20:22:48,084 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Host: 4 can
> > access pool: 8
> > 2015-11-26 20:22:48,084 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
> pool
> > 8 for storage, totalSize: 526199291904, usedBytes: 10131603456, usedPct:
> > 0.019254308418659775, disable threshold: 0.85
> > 2015-11-26 20:22:48,086 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found
> storage
> > pool primary of type NetworkFilesystem with overprovisioning factor 2
> > 2015-11-26 20:22:48,086 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total over
> > provisioned capacity calculated is 2 * 526199291904
> > 2015-11-26 20:22:48,086 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total
> > capacity of the pool primary id: 8 is 1052398583808
> > 2015-11-26 20:22:48,086 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
> > pool: 8 for volume allocation [Vol[7|vm=5|DATADISK]], maxSize :
> > 1052398583808, totalAllocatedSize : 12156207104, askingSize :
> 21474836480,
> > allocated disable threshold: 0.85
> > 2015-11-26 20:22:48,086 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking if
> > host: 4 can access any suitable storage pool for volume: ROOT
> > 2015-11-26 20:22:48,087 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Host: 4 can
> > access pool: 8
> > 2015-11-26 20:22:48,087 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
> pool
> > 8 for storage, totalSize: 526199291904, usedBytes: 10131603456, usedPct:
> > 0.019254308418659775, disable threshold: 0.85
> > 2015-11-26 20:22:48,090 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found
> storage
> > pool primary of type NetworkFilesystem with overprovisioning factor 2
> > 2015-11-26 20:22:48,090 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total over
> > provisioned capacity calculated is 2 * 526199291904
> > 2015-11-26 20:22:48,090 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total
> > capacity of the pool primary id: 8 is 1052398583808
> > 2015-11-26 20:22:48,090 DEBUG [c.c.s.StorageManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
> > pool: 8 for volume allocation [Vol[6|vm=5|ROOT]], maxSize :
> 1052398583808,
> > totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
> > disable threshold: 0.85
> > 2015-11-26 20:22:48,090 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found a
> > potential host id: 4 name: xenserver and associated storage pools for
> this
> > VM
> > 2015-11-26 20:22:48,091 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Returning
> > Deployment Destination:
> >
> >
> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
> > :
> >
> >
> Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage(Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
> > Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
> > Volume(7|DATADISK-->Pool(8))]
> > 2015-11-26 20:22:48,091 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Deployment
> > found - P0=VM[User|i-2-5-VM],
> >
> >
> P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
> > :
> >
> >
> Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage(Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
> > Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
> > Volume(7|DATADISK-->Pool(8))]
> > 2015-11-26 20:22:48,097 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) VM state
> > transitted from :Starting to Starting with event: OperationRetryvm's
> > original host id: null new host id: 4 host id before state transition:
> null
> > 2015-11-26 20:22:48,100 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Hosts's
> > actual total CPU: 3399 and CPU after applying overprovisioning: 3399
> > 2015-11-26 20:22:48,100 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) We are
> > allocating VM, increasing the used capacity of this host:4
> > 2015-11-26 20:22:48,100 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Current
> Used
> > CPU: 1500 , Free CPU:1899 ,Requested CPU: 1000
> > 2015-11-26 20:22:48,100 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Current
> Used
> > RAM: 1879048192 , Free RAM:13475457024 ,Requested RAM: 1073741824
> > 2015-11-26 20:22:48,100 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) CPU STATS
> > after allocation: for host: 4, old used: 1500, old reserved: 0, actual
> > total: 3399, total with overprovisioning: 3399; new used:2500,
> reserved:0;
> > requested cpu:1000,alloc_from_last:false
> > 2015-11-26 20:22:48,100 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) RAM STATS
> > after allocation: for host: 4, old used: 1879048192, old reserved: 0,
> > total: 15354505216; new used: 2952790016, reserved: 0; requested mem:
> > 1073741824,alloc_from_last:false
> > 2015-11-26 20:22:48,102 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) VM is being
> > created in podId: 3
> > 2015-11-26 20:22:48,103 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Network
> > id=212 is already implemented
> > 2015-11-26 20:22:48,109 DEBUG [c.c.n.NetworkModelImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Service
> > SecurityGroup is not supported in the network id=212
> > 2015-11-26 20:22:48,111 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Changing
> > active number of nics for network id=212 on 1
> > 2015-11-26 20:22:48,114 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Asking
> > VirtualRouter to prepare for
> > Nic[11-5-718d2456-bf61-48ad-9663-22ccfd4556f1-10.1.1.88]
> > 2015-11-26 20:22:48,123 DEBUG [c.c.n.NetworkModelImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Service
> > SecurityGroup is not supported in the network id=212
> > 2015-11-26 20:22:48,125 DEBUG [o.a.c.n.t.BasicNetworkTopology]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) CONFIG DHCP
> > FOR SUBNETS RULES
> > 2015-11-26 20:22:48,129 DEBUG [c.c.n.NetworkModelImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Service
> > SecurityGroup is not supported in the network id=212
> > 2015-11-26 20:22:48,130 DEBUG [o.a.c.n.t.AdvancedNetworkTopology]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) APPLYING
> VPC
> > DHCP ENTRY RULES
> > 2015-11-26 20:22:48,130 DEBUG [o.a.c.n.t.BasicNetworkTopology]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Applying
> dhcp
> > entry in network Ntwk[212|Guest|8]
> > 2015-11-26 20:22:48,138 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
> > 4-8612571337392652849: Sending { Cmd , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 100011,
> >
> >
> [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:71:ff:00:03","vmIpAddress":"10.1.1.88","vmName":"Test002","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:71:ff:00:03","isDefault":true,"executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","router.guest.ip":"10.1.1.1","router.ip":"169.254.0.43","
> > router.name":"r-4-VM"},"wait":0}}] }
> > 2015-11-26 20:22:48,139 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
> > 4-8612571337392652849: Executing: { Cmd , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 100011,
> >
> >
> [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:71:ff:00:03","vmIpAddress":"10.1.1.88","vmName":"Test002","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:71:ff:00:03","isDefault":true,"executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","router.guest.ip":"10.1.1.1","router.ip":"169.254.0.43","
> > router.name":"r-4-VM"},"wait":0}}] }
> > 2015-11-26 20:22:48,139 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-280:ctx-eb580854) Seq 4-8612571337392652849: Executing
> request
> > 2015-11-26 20:22:48,139 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> > (DirectAgent-280:ctx-eb580854) Transforming
> > com.cloud.agent.api.routing.DhcpEntryCommand to ConfigItems
> > 2015-11-26 20:22:48,144 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-280:ctx-eb580854) Copying VR with ip 169.254.0.43 config
> file
> > into host 10.0.0.171
> > 2015-11-26 20:22:48,211 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (RouterStatusMonitor-1:ctx-8884e0d0) Found 1 routers to update status.
> > 2015-11-26 20:22:48,213 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (RouterStatusMonitor-1:ctx-8884e0d0) Found 0 VPC networks to update
> > Redundant State.
> > 2015-11-26 20:22:48,214 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (RouterStatusMonitor-1:ctx-8884e0d0) Found 0 networks to update RvR
> status.
> > 2015-11-26 20:22:48,222 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (RouterStatusMonitor-1:ctx-7dc158f2) Found 1 routers to update status.
> > 2015-11-26 20:22:48,223 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (RouterStatusMonitor-1:ctx-7dc158f2) Found 0 VPC networks to update
> > Redundant State.
> > 2015-11-26 20:22:48,223 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> > (RouterStatusMonitor-1:ctx-7dc158f2) Found 0 networks to update RvR
> status.
> > 2015-11-26 20:22:48,509 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-280:ctx-eb580854) VR Config file vm_dhcp_entry.json got
> > created in VR, ip 169.254.0.43 with content
> >
> >
> {"host_name":"Test002","mac_address":"02:00:71:ff:00:03","ipv4_adress":"10.1.1.88","ipv6_duid":"00:03:00:01:02:00:71:ff:00:03","dns_adresses":"10.1.1.1","default_gateway":"10.1.1.1","default_entry":true,"type":"dhcpentry"}
> > 2015-11-26 20:22:48,509 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> > (DirectAgent-280:ctx-eb580854) Processing FileConfigItem, copying 222
> > characters to vm_dhcp_entry.json took 370ms
> > 2015-11-26 20:22:48,510 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-280:ctx-eb580854) Executing command in VR:
> > /opt/cloud/bin/router_proxy.sh update_config.py 169.254.0.43
> > vm_dhcp_entry.json
> > 2015-11-26 20:22:48,606 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-5:ctx-6424a9fc) ===START=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549633925
> > 2015-11-26 20:22:48,618 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-5:ctx-6424a9fc ctx-7c6e9282) ===END=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549633925
> > 2015-11-26 20:22:51,265 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> > (DirectAgent-280:ctx-eb580854) Processing ScriptConfigItem, executing
> > update_config.py vm_dhcp_entry.json took 2756ms
> > 2015-11-26 20:22:51,265 WARN [c.c.a.r.v.VirtualRoutingResource]
> > (DirectAgent-280:ctx-eb580854) Expected 1 answers while executing
> > DhcpEntryCommand but received 2
> > 2015-11-26 20:22:51,265 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-280:ctx-eb580854) Seq 4-8612571337392652849: Response
> > Received:
> > 2015-11-26 20:22:51,266 DEBUG [c.c.a.t.Request]
> > (DirectAgent-280:ctx-eb580854) Seq 4-8612571337392652849: Processing: {
> > Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
> > [{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null - success:
> > ","null - success: RTNETLINK answers: File exists\nRTNETLINK answers:
> File
> > exists\nRTNETLINK answers: File exists\n[INFO] update_config.py ::
> > Processing incoming file => vm_dhcp_entry.json\n[INFO] Processing JSON
> file
> > vm_dhcp_entry.json\nTest002 Test002\nTest01
> > Test002\n"],"result":true,"wait":0}}] }
> > 2015-11-26 20:22:51,266 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
> > 4-8612571337392652849: Received: { Ans: , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 10, { GroupAnswer } }
> > 2015-11-26 20:22:51,268 DEBUG [c.c.n.NetworkModelImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Service
> > SecurityGroup is not supported in the network id=212
> > 2015-11-26 20:22:51,269 DEBUG [o.a.c.n.t.AdvancedNetworkTopology]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) APPLYING
> VPC
> > USERDATA RULES
> > 2015-11-26 20:22:51,269 DEBUG [o.a.c.n.t.BasicNetworkTopology]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Applying
> > userdata and password entry in network Ntwk[212|Guest|8]
> > 2015-11-26 20:22:51,278 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
> > 4-8612571337392652850: Sending { Cmd , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 100011,
> >
> >
> [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
> > router.name
> >
> >
> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
> > router.name
> >
> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}}]
> > }
> > 2015-11-26 20:22:51,279 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
> > 4-8612571337392652850: Executing: { Cmd , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 100011,
> >
> >
> [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
> > router.name
> >
> >
> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
> > router.name
> >
> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}}]
> > }
> > 2015-11-26 20:22:51,279 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-71:ctx-0080bc2a) Seq 4-8612571337392652850: Executing
> request
> > 2015-11-26 20:22:51,279 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> > (DirectAgent-71:ctx-0080bc2a) Transforming
> > com.cloud.agent.api.routing.SavePasswordCommand to ConfigItems
> > 2015-11-26 20:22:51,282 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-71:ctx-0080bc2a) Copying VR with ip 169.254.0.43 config file
> > into host 10.0.0.171
> > 2015-11-26 20:22:51,662 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-71:ctx-0080bc2a) VR Config file vm_password.json got created
> > in VR, ip 169.254.0.43 with content
> >
> {"ip_address":"10.1.1.88","password":"saved_password","type":"vmpassword"}
> > 2015-11-26 20:22:51,662 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> > (DirectAgent-71:ctx-0080bc2a) Processing FileConfigItem, copying 74
> > characters to vm_password.json took 383ms
> > 2015-11-26 20:22:51,662 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-71:ctx-0080bc2a) Executing command in VR:
> > /opt/cloud/bin/router_proxy.sh update_config.py 169.254.0.43
> > vm_password.json
> > 2015-11-26 20:22:51,966 DEBUG [c.c.a.m.AgentManagerImpl]
> > (AgentManager-Handler-8:null) SeqA 5-1789: Processing Seq 5-1789: { Cmd
> ,
> > MgmtId: -1, via: 5, Ver: v1, Flags: 11,
> >
> >
> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
> > \"connections\": []\n}","wait":0}}] }
> > 2015-11-26 20:22:51,969 DEBUG [c.c.a.m.AgentManagerImpl]
> > (AgentManager-Handler-8:null) SeqA 5-1789: Sending Seq 5-1789: { Ans: ,
> > MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
> > [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
> > 2015-11-26 20:22:52,954 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-24:ctx-bcef2c6d) ===START=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549638271
> > 2015-11-26 20:22:52,968 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-24:ctx-bcef2c6d ctx-2fd0c6b9) ===END=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549638271
> > 2015-11-26 20:22:54,399 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> > (DirectAgent-71:ctx-0080bc2a) Processing ScriptConfigItem, executing
> > update_config.py vm_password.json took 2737ms
> > 2015-11-26 20:22:54,399 WARN [c.c.a.r.v.VirtualRoutingResource]
> > (DirectAgent-71:ctx-0080bc2a) Expected 1 answers while executing
> > SavePasswordCommand but received 2
> > 2015-11-26 20:22:54,401 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> > (DirectAgent-71:ctx-0080bc2a) Transforming
> > com.cloud.agent.api.routing.VmDataCommand to ConfigItems
> > 2015-11-26 20:22:54,404 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-71:ctx-0080bc2a) Copying VR with ip 169.254.0.43 config file
> > into host 10.0.0.171
> > 2015-11-26 20:22:54,786 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-71:ctx-0080bc2a) VR Config file vm_metadata.json got created
> > in VR, ip 169.254.0.43 with content
> >
> >
> {"vm_ip_address":"10.1.1.88","vm_metadata":[["userdata","user-data",null],["metadata","service-offering","Medium
> >
> >
> Instance"],["metadata","availability-zone","TestZone"],["metadata","local-ipv4","10.1.1.88"],["metadata","local-hostname","Test002"],["metadata","public-ipv4","10.0.0.174"],["metadata","public-hostname","10.0.0.174"],["metadata","instance-id","4ce4731f-22a7-42ac-8e78-093d5f2e9a34"],["metadata","vm-id","4ce4731f-22a7-42ac-8e78-093d5f2e9a34"],["metadata","public-keys",null],["metadata","cloud-identifier","CloudStack-{de65e551-2e87-423b-90e6-03cd3eb706bb}"]],"type":"vmdata"}
> > 2015-11-26 20:22:54,786 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> > (DirectAgent-71:ctx-0080bc2a) Processing FileConfigItem, copying 589
> > characters to vm_metadata.json took 385ms
> > 2015-11-26 20:22:54,786 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-71:ctx-0080bc2a) Executing command in VR:
> > /opt/cloud/bin/router_proxy.sh update_config.py 169.254.0.43
> > vm_metadata.json
> > 2015-11-26 20:22:56,607 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-3:ctx-060754d7) ===START=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549641926
> > 2015-11-26 20:22:56,624 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-3:ctx-060754d7 ctx-a1cce698) ===END=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549641926
> > 2015-11-26 20:22:57,514 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> > (DirectAgent-71:ctx-0080bc2a) Processing ScriptConfigItem, executing
> > update_config.py vm_metadata.json took 2728ms
> > 2015-11-26 20:22:57,514 WARN [c.c.a.r.v.VirtualRoutingResource]
> > (DirectAgent-71:ctx-0080bc2a) Expected 1 answers while executing
> > VmDataCommand but received 2
> > 2015-11-26 20:22:57,515 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-71:ctx-0080bc2a) Seq 4-8612571337392652850: Response
> Received:
> > 2015-11-26 20:22:57,523 DEBUG [c.c.a.t.Request]
> > (DirectAgent-71:ctx-0080bc2a) Seq 4-8612571337392652850: Processing: {
> > Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
> > [{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null - success:
> > ","null - success: RTNETLINK answers: File exists\nRTNETLINK answers:
> File
> > exists\nRTNETLINK answers: File exists\n[INFO] update_config.py ::
> > Processing incoming file => vm_password.json\n[INFO] Processing JSON file
> >
> >
> vm_password.json\n"],"result":true,"wait":0}},{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null
> > - success: ","null - success: RTNETLINK answers: File exists\nRTNETLINK
> > answers: File exists\nRTNETLINK answers: File exists\n[INFO]
> > update_config.py :: Processing incoming file => vm_metadata.json\n[INFO]
> > Processing JSON file vm_metadata.json\n"],"result":true,"wait":0}}] }
> > 2015-11-26 20:22:57,523 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
> > 4-8612571337392652850: Received: { Ans: , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 10, { GroupAnswer, GroupAnswer } }
> > 2015-11-26 20:22:57,524 DEBUG [c.c.n.NetworkModelImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Service
> > SecurityGroup is not supported in the network id=212
> > 2015-11-26 20:22:57,525 DEBUG [o.a.c.e.o.VolumeOrchestrator]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking if
> > we need to prepare 2 volumes for VM[User|i-2-5-VM]
> > 2015-11-26 20:22:57,529 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) template 5
> is
> > already in store:1, type:Image
> > 2015-11-26 20:22:57,530 DEBUG [o.a.c.s.d.PrimaryDataStoreImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Not found
> > (templateId:5poolId:8) in template_spool_ref, persisting it
> > 2015-11-26 20:22:57,533 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) template 5
> is
> > already in store:8, type:Primary
> > 2015-11-26 20:22:57,533 DEBUG [o.a.c.s.v.VolumeServiceImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found
> > template centos56-x86_64-xen in storage pool 8 with VMTemplateStoragePool
> > id: 4
> > 2015-11-26 20:22:57,534 DEBUG [o.a.c.s.v.VolumeServiceImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Acquire
> lock
> > on VMTemplateStoragePool 4 with timeout 3600 seconds
> > 2015-11-26 20:22:57,535 INFO [o.a.c.s.v.VolumeServiceImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) lock is
> > acquired for VMTemplateStoragePool 4
> > 2015-11-26 20:22:57,537 DEBUG [o.a.c.s.m.AncientDataMotionStrategy]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) copyAsync
> > inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE
> > 2015-11-26 20:22:57,541 DEBUG [c.c.h.XenServerGuru]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
> > getCommandHostDelegation: class
> > org.apache.cloudstack.storage.command.CopyCommand
> > 2015-11-26 20:22:57,542 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
> > 4-8612571337392652851: Sending { Cmd , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 100111,
> >
> >
> [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/5/3986df71-b1d0-3e20-a655-7e42dd144370.vhd","origUrl":"
> > http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
> >
> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
> > 5.6(64-bit) no GUI
> >
> >
> (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://
> > 10.0.0.170/export/secondary
> >
> >
> ","_role":"Image"}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"
> > http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
> >
> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
> > 5.6(64-bit) no GUI
> >
> >
> (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
> >
> >
> 10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc
> >
> "}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"executeInSequence":true,"options":{},"options2":{},"wait":10800}}]
> > }
> > 2015-11-26 20:22:57,542 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
> > 4-8612571337392652851: Executing: { Cmd , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 100111,
> >
> >
> [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/5/3986df71-b1d0-3e20-a655-7e42dd144370.vhd","origUrl":"
> > http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
> >
> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
> > 5.6(64-bit) no GUI
> >
> >
> (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://
> > 10.0.0.170/export/secondary
> >
> >
> ","_role":"Image"}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"
> > http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
> >
> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
> > 5.6(64-bit) no GUI
> >
> >
> (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
> >
> >
> 10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc
> >
> "}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"executeInSequence":true,"options":{},"options2":{},"wait":10800}}]
> > }
> > 2015-11-26 20:22:57,542 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-281:ctx-03a8f398) Seq 4-8612571337392652851: Executing
> request
> > 2015-11-26 20:22:58,021 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (AsyncJobMgr-Heartbeat-1:ctx-92cf866f) Begin cleanup expired async-jobs
> > 2015-11-26 20:22:58,023 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (AsyncJobMgr-Heartbeat-1:ctx-92cf866f) End cleanup expired async-jobs
> > 2015-11-26 20:22:58,833 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-281:ctx-03a8f398) Host 10.0.0.171
> > OpaqueRef:b0284c5b-613d-0522-5c44-797be269d661: Removing SR
> > 2015-11-26 20:22:58,843 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-281:ctx-03a8f398) Host 10.0.0.171
> > OpaqueRef:bfb2ccc2-135c-4f9a-bc84-143021c71bae: Unplugging pbd
> > 2015-11-26 20:22:58,950 DEBUG [c.c.h.x.r.CitrixResourceBase]
> > (DirectAgent-281:ctx-03a8f398) Host 10.0.0.171
> > OpaqueRef:b0284c5b-613d-0522-5c44-797be269d661: Forgetting
> > 2015-11-26 20:22:58,953 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-281:ctx-03a8f398) Seq 4-8612571337392652851: Response
> > Received:
> > 2015-11-26 20:22:58,953 DEBUG [c.c.a.t.Request]
> > (DirectAgent-281:ctx-03a8f398) Seq 4-8612571337392652851: Processing: {
> > Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 110,
> >
> >
> [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Expected
> > 1 VDI template but found 2 VDI template(s) on:
> > 10.0.0.170:/export/secondary/template/tmpl/1/5","wait":0}}]
> > }
> > 2015-11-26 20:22:58,953 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
> > 4-8612571337392652851: Received: { Ans: , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 110, { CopyCmdAnswer } }
> > 2015-11-26 20:22:58,955 DEBUG [c.c.a.m.AgentAttache]
> > (DirectAgent-281:ctx-03a8f398) Seq 4-8612571337392652851: No more
> commands
> > found
> > 2015-11-26 20:22:58,959 INFO [o.a.c.s.v.VolumeServiceImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) releasing
> > lock for VMTemplateStoragePool 4
> > 2015-11-26 20:22:58,959 DEBUG [o.a.c.e.o.VolumeOrchestrator]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Unable to
> > create Vol[6|vm=5|ROOT]:Expected 1 VDI template but found 2 VDI
> template(s)
> > on: 10.0.0.170:/export/secondary/template/tmpl/1/5
> > 2015-11-26 20:22:58,959 INFO [c.c.v.VirtualMachineManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Unable to
> > contact resource.
> > com.cloud.exception.StorageUnavailableException: Resource [StoragePool:8]
> > is unreachable: Unable to create Vol[6|vm=5|ROOT]:Expected 1 VDI template
> > but found 2 VDI template(s) on: 10.0.0.170:
> > /export/secondary/template/tmpl/1/5
> > at
> >
> >
> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1278)
> > at
> >
> >
> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1336)
> > at
> >
> >
> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1000)
> > at
> >
> >
> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4580)
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at
> >
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> > at
> >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > at java.lang.reflect.Method.invoke(Method.java:606)
> > at
> >
> >
> com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
> > at
> >
> >
> com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4736)
> > at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
> > at
> >
> >
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
> > at
> >
> >
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
> > at
> >
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
> > at
> >
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
> > at
> >
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
> > at
> >
> >
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
> > at
> >
> >
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
> > at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> > at
> >
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > at
> >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > at java.lang.Thread.run(Thread.java:745)
> > 2015-11-26 20:22:58,962 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Cleaning up
> > resources for the vm VM[User|i-2-5-VM] in Starting state
> > 2015-11-26 20:22:58,964 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
> > 4-8612571337392652852: Sending { Cmd , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 100011,
> >
> >
> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"checkBeforeCleanup":false,"vmName":"i-2-5-VM","wait":0}}]
> > }
> > 2015-11-26 20:22:58,964 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
> > 4-8612571337392652852: Executing: { Cmd , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 100011,
> >
> >
> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"checkBeforeCleanup":false,"vmName":"i-2-5-VM","wait":0}}]
> > }
> > 2015-11-26 20:22:58,964 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-141:ctx-62326db5) Seq 4-8612571337392652852: Executing
> request
> > 2015-11-26 20:22:58,971 DEBUG [c.c.a.m.DirectAgentAttache]
> > (DirectAgent-141:ctx-62326db5) Seq 4-8612571337392652852: Response
> > Received:
> > 2015-11-26 20:22:58,971 DEBUG [c.c.a.t.Request]
> > (DirectAgent-141:ctx-62326db5) Seq 4-8612571337392652852: Processing: {
> > Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
> > [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not
> > exist","wait":0}}] }
> > 2015-11-26 20:22:58,971 DEBUG [c.c.a.t.Request]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
> > 4-8612571337392652852: Received: { Ans: , MgmtId: 52229922654, via:
> > 4(xenserver), Ver: v1, Flags: 10, { StopAnswer } }
> > 2015-11-26 20:22:58,976 DEBUG [c.c.n.NetworkModelImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Service
> > SecurityGroup is not supported in the network id=212
> > 2015-11-26 20:22:58,977 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Changing
> > active number of nics for network id=212 on -1
> > 2015-11-26 20:22:58,982 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Asking
> > VirtualRouter to release
> > NicProfile[11-5-718d2456-bf61-48ad-9663-22ccfd4556f1-10.1.1.88-null
> > 2015-11-26 20:22:58,982 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
> Successfully
> > released network resources for the vm VM[User|i-2-5-VM]
> > 2015-11-26 20:22:58,982 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
> Successfully
> > cleanued up resources for the vm VM[User|i-2-5-VM] in Starting state
> > 2015-11-26 20:22:58,986 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Deploy
> avoids
> > pods: [], clusters: [], hosts: [4]
> > 2015-11-26 20:22:58,987 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
> > DeploymentPlanner allocation algorithm:
> > com.cloud.deploy.FirstFitPlanner@1136745
> > 2015-11-26 20:22:58,987 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Trying to
> > allocate a host and storage pools from dc:3, pod:3,cluster:null,
> requested
> > cpu: 1000, requested ram: 1073741824
> > 2015-11-26 20:22:58,987 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Is ROOT
> > volume READY (pool already allocated)?: No
> > 2015-11-26 20:22:58,987 DEBUG [c.c.d.FirstFitPlanner]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Searching
> > resources only under specified Pod: 3
> > 2015-11-26 20:22:58,987 DEBUG [c.c.d.FirstFitPlanner]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Listing
> > clusters in order of aggregate capacity, that have (atleast one host
> with)
> > enough CPU and RAM capacity under this Pod: 3
> > 2015-11-26 20:22:58,988 DEBUG [c.c.d.FirstFitPlanner]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) No clusters
> > found having a host with enough capacity, returning.
> > 2015-11-26 20:22:58,995 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) VM state
> > transitted from :Starting to Stopped with event: OperationFailedvm's
> > original host id: null new host id: null host id before state
> transition: 4
> > 2015-11-26 20:22:58,998 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Hosts's
> > actual total CPU: 3399 and CPU after applying overprovisioning: 3399
> > 2015-11-26 20:22:58,998 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Hosts's
> > actual total RAM: 15354505344 and RAM after applying overprovisioning:
> > 15354505216
> > 2015-11-26 20:22:58,998 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) release cpu
> > from host: 4, old used: 2500,reserved: 0, actual total: 3399, total with
> > overprovisioning: 3399; new used: 1500,reserved:0; movedfromreserved:
> > false,moveToReserveredfalse
> > 2015-11-26 20:22:58,998 DEBUG [c.c.c.CapacityManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) release mem
> > from host: 4, old used: 2952790016,reserved: 0, total: 15354505216; new
> > used: 1879048192,reserved:0; movedfromreserved:
> false,moveToReserveredfalse
> > 2015-11-26 20:22:59,004 ERROR [c.c.v.VmWorkJobHandlerProxy]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Invocation
> > exception, caused by:
> > com.cloud.exception.InsufficientServerCapacityException: Unable to
> create a
> > deployment for VM[User|i-2-5-VM]Scope=interface com.cloud.dc.DataCenter;
> > id=3
> > 2015-11-26 20:22:59,004 INFO [c.c.v.VmWorkJobHandlerProxy]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Rethrow
> > exception com.cloud.exception.InsufficientServerCapacityException: Unable
> > to create a deployment for VM[User|i-2-5-VM]Scope=interface
> > com.cloud.dc.DataCenter; id=3
> > 2015-11-26 20:22:59,004 DEBUG [c.c.v.VmWorkJobDispatcher]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Done with run of VM work
> > job: com.cloud.vm.VmWorkStart for VM 5, job origin: 68
> > 2015-11-26 20:22:59,004 ERROR [c.c.v.VmWorkJobDispatcher]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Unable to complete
> > AsyncJobVO {id:71, userId: 2, accountId: 2, instanceType: null,
> instanceId:
> > null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
> >
> >
> rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAABXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwc3IAEWphdmEudXRpbC5IYXNoTWFwBQfawcMWYNEDAAJGAApsb2FkRmFjdG9ySQAJdGhyZXNob2xkeHA_QAAAAAAADHcIAAAAEAAAAAF0AApWbVBhc3N3b3JkdAAcck8wQUJYUUFEbk5oZG1Wa1gzQmhjM04zYjNKa3hw,
> > cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
> > result: null, initMsid: 52229922654, completeMsid: null, lastUpdated:
> null,
> > lastPolled: null, created: Thu Nov 26 20:22:46 IST 2015}, job origin:68
> > com.cloud.exception.InsufficientServerCapacityException: Unable to
> create a
> > deployment for VM[User|i-2-5-VM]Scope=interface com.cloud.dc.DataCenter;
> > id=3
> > at
> >
> >
> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:959)
> > at
> >
> >
> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4580)
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at
> >
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> > at
> >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > at java.lang.reflect.Method.invoke(Method.java:606)
> > at
> >
> >
> com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
> > at
> >
> >
> com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4736)
> > at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
> > at
> >
> >
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
> > at
> >
> >
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
> > at
> >
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
> > at
> >
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
> > at
> >
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
> > at
> >
> >
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
> > at
> >
> >
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
> > at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> > at
> >
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > at
> >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > at java.lang.Thread.run(Thread.java:745)
> > 2015-11-26 20:22:59,013 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Complete async job-71,
> > jobStatus: FAILED, resultCode: 0, result:
> >
> >
> rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAAzVW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1VzZXJ8aS0yLTUtVk1ddXIAHltMamF2YS5sYW5nLlN0YWNrVHJhY2VFbGVtZW50OwJGKjw8_SI5AgAAeHAAAAAVc3IAG2phdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudGEJxZomNt2FAgAESQAKbGluZU51bWJlckwADmRlY2xhcmluZ0NsYXNzcQB-AApMAAhmaWxlTmFtZXEAfgAKTAAKbWV0aG9kTmFtZXEAfgAKeHAAAAO_dAAmY29tLmNsb3VkLnZtLlZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGx0AB5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsLmphdmF0ABBvcmNoZXN0cmF0ZVN0YXJ0c3EAfgARAAAR5HEAfgATcQB-ABRxAH4AFXNxAH4AEf____50ACRzdW4ucmVmbGVjdC5OYXRpdmVNZXRob2RBY2Nlc3NvckltcGx0AB1OYXRpdmVNZXRob2RBY2Nlc3NvckltcGwuamF2YXQAB2ludm9rZTBzcQB-ABEAAAA5cQB-ABhxAH4AGXQABmludm9rZXNxAH4AEQAAACt0AChzdW4ucmVmbGVjdC5EZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsdAAhRGVsZWdhdGluZ01ldGhvZEFjY2Vzc29ySW1wbC5qYXZhcQB-ABxzcQB-ABEAAAJedAAYamF2YS5sYW5nLnJlZmxlY3QuTWV0aG9kdAALTWV0aG9kLmphdmFxAH4AHHNxAH4AEQAAAGt0ACJjb20uY2xvdWQudm0uVm1Xb3JrSm9iSGFuZGxlclByb3h5dAAaVm1Xb3JrSm9iSGFuZGxlclByb3h5LmphdmF0AA9oYW5kbGVWbVdvcmtKb2JzcQB-ABEAABKAcQB-ABNxAH4AFHEAfgAmc3EAfgARAAAAZnQAIGNvbS5jbG91ZC52bS5WbVdvcmtKb2JEaXNwYXRjaGVydAAYVm1Xb3JrSm9iRGlzcGF0Y2hlci5qYXZhdAAGcnVuSm9ic3EAfgARAAACGXQAP29yZy5hcGFjaGUuY2xvdWRzdGFjay5mcmFtZXdvcmsuam9icy5pbXBsLkFzeW5jSm9iTWFuYWdlckltcGwkNXQAGEFzeW5jSm9iTWFuYWdlckltcGwuamF2YXQADHJ1bkluQ29udGV4dHNxAH4AEQAAADF0AD5vcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGUkMXQAG01hbmFnZWRDb250ZXh0UnVubmFibGUuamF2YXQAA3J1bnNxAH4AEQAAADh0AEJvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0JDF0ABpEZWZhdWx0TWFuYWdlZENvbnRleHQuamF2YXQABGNhbGxzcQB-ABEAAABndABAb3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5pbXBsLkRlZmF1bHRNYW5hZ2VkQ29udGV4dHEAfgA2dAAPY2FsbFdpdGhDb250ZXh0c3EAfgARAAAANXEAfgA5cQB-ADZ0AA5ydW5XaXRoQ29udGV4dHNxAH4AEQAAAC50ADxvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGVxAH4AMnEAfgAzc3EAfgARAAAB7nEAfgAtcQB-AC5xAH4AM3NxAH4AEQAAAdd0AC5qYXZhLnV0aWwuY29uY3VycmVudC5FeGVjdXRvcnMkUnVubmFibGVBZGFwdGVydAAORXhlY3V0b3JzLmphdmFxAH4AN3NxAH4AEQAAAQZ0AB9qYXZhLnV0aWwuY29uY3VycmVudC5GdXR1cmVUYXNrdAAPRnV0dXJlVGFzay5qYXZhcQB-ADNzcQB-ABEAAAR5dAAnamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9ydAAXVGhyZWFkUG9vbEV4ZWN1dG9yLmphdmF0AAlydW5Xb3JrZXJzcQB-ABEAAAJndAAuamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9yJFdvcmtlcnEAfgBIcQB-ADNzcQB-ABEAAALpdAAQamF2YS5sYW5nLlRocmVhZHQAC1RocmVhZC5qYXZhcQB-ADNzcgAmamF2YS51dGlsLkNvbGxlY3Rpb25zJFVubW9kaWZpYWJsZUxpc3T8DyUxteyOEAIAAUwABGxpc3RxAH4ADHhyACxqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlQ29sbGVjdGlvbhlCAIDLXvceAgABTAABY3QAFkxqYXZhL3V0aWwvQ29sbGVjdGlvbjt4cHNyABNqYXZhLnV0aWwuQXJyYXlMaXN0eIHSHZnHYZ0DAAFJAARzaXpleHAAAAAAdwQAAAAAeHEAfgBUeHNyABFqYXZhLmxhbmcuSW50ZWdlchLioKT3gYc4AgABSQAFdmFsdWV4cgAQamF2YS5sYW5nLk51bWJlcoaslR0LlOCLAgAAeHAAABDvc3EAfgBTAAAAAHcEAAAAAHhzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHEAfgBWAAAAAAAAAAN2cgAXY29tLmNsb3VkLmRjLkRhdGFDZW50ZXKy8Qrrp-d4vgIAAHhwAA
> > 2015-11-26 20:22:59,015 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Publish async job-71
> > complete on message bus
> > 2015-11-26 20:22:59,015 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Wake up jobs related to
> > job-71
> > 2015-11-26 20:22:59,016 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Update db status for
> > job-71
> > 2015-11-26 20:22:59,016 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Wake up jobs joined with
> > job-71 and disjoin all subjobs created from job- 71
> > 2015-11-26 20:22:59,022 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Done executing
> > com.cloud.vm.VmWorkStart for job-71
> > 2015-11-26 20:22:59,022 INFO [o.a.c.f.j.i.AsyncJobMonitor]
> > (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Remove job-71 from job
> > monitoring
> > 2015-11-26 20:22:59,032 DEBUG [c.c.v.UserVmManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Destroying vm
> > VM[User|i-2-5-VM] as it failed to create on Host with Id:null
> > 2015-11-26 20:22:59,040 DEBUG [c.c.c.CapacityManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) VM state transitted
> > from :Stopped to Error with event: OperationFailedToErrorvm's original
> host
> > id: null new host id: null host id before state transition: null
> > 2015-11-26 20:22:59,051 DEBUG [c.c.u.AccountManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Access granted to
> > Acct[20064ffe-9415-11e5-a790-000c29255f5e-admin] to Domain:1/ by
> > AffinityGroupAccessChecker
> > 2015-11-26 20:22:59,076 DEBUG [c.c.u.AccountManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Access granted to
> > Acct[20064ffe-9415-11e5-a790-000c29255f5e-admin] to Domain:1/ by
> > AffinityGroupAccessChecker
> > 2015-11-26 20:22:59,080 WARN [o.a.c.alerts]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) alertType:: 8 //
> > dataCenterId:: 3 // podId:: 3 // clusterId:: null // message:: Failed to
> > deploy Vm with Id: 5, on Host with Id: null
> > 2015-11-26 20:22:59,095 ERROR [c.c.a.ApiAsyncJobDispatcher]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68) Unexpected exception while
> > executing org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin
> > com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due
> > to insufficient capacity
> > at
> >
> >
> com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:622)
> > at
> >
> >
> org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:242)
> > at
> >
> >
> org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:212)
> > at
> >
> >
> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3870)
> > at
> >
> >
> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3488)
> > at
> >
> >
> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3476)
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at
> >
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> > at
> >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > at java.lang.reflect.Method.invoke(Method.java:606)
> > at
> >
> >
> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
> > at
> >
> >
> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
> > at
> >
> >
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
> > at
> >
> >
> org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:106)
> > at
> >
> >
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
> > at
> >
> >
> com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
> > at
> >
> >
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
> > at
> >
> >
> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
> > at
> >
> >
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
> > at
> >
> >
> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
> > at com.sun.proxy.$Proxy202.startVirtualMachine(Unknown Source)
> > at
> >
> >
> org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin.execute(DeployVMCmdByAdmin.java:50)
> > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
> > at
> >
> com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
> > at
> >
> >
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
> > at
> >
> >
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
> > at
> >
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
> > at
> >
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
> > at
> >
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
> > at
> >
> >
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
> > at
> >
> >
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
> > at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> > at
> >
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > at
> >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > at java.lang.Thread.run(Thread.java:745)
> > Caused by: com.cloud.exception.InsufficientServerCapacityException:
> Unable
> > to create a deployment for VM[User|i-2-5-VM]Scope=interface
> > com.cloud.dc.DataCenter; id=3
> > at
> >
> >
> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:959)
> > at
> >
> >
> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4580)
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > ... 18 more
> > 2015-11-26 20:22:59,097 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68) Complete async job-68,
> jobStatus:
> > FAILED, resultCode: 530, result:
> >
> >
> org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable
> > to start a VM due to insufficient capacity"}
> > 2015-11-26 20:22:59,097 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68) Publish async job-68 complete on
> > message bus
> > 2015-11-26 20:22:59,097 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68) Wake up jobs related to job-68
> > 2015-11-26 20:22:59,097 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68) Update db status for job-68
> > 2015-11-26 20:22:59,098 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68) Wake up jobs joined with job-68
> > and disjoin all subjobs created from job- 68
> > 2015-11-26 20:22:59,100 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68) Done executing
> > org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin for job-68
> > 2015-11-26 20:22:59,100 INFO [o.a.c.f.j.i.AsyncJobMonitor]
> > (API-Job-Executor-3:ctx-a2ed53c6 job-68) Remove job-68 from job
> monitoring
> > 2015-11-26 20:22:59,608 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-8:ctx-dd95e514) ===START=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549644927
> > 2015-11-26 20:22:59,619 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-8:ctx-dd95e514 ctx-3583ca96) ===END=== 10.0.0.93 -- GET
> >
> >
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549644927
> > 2015-11-26 20:22:59,623 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-9:ctx-c94acc67) ===START=== 10.0.0.93 -- GET
> >
> >
> command=listVirtualMachines&id=4ce4731f-22a7-42ac-8e78-093d5f2e9a34&response=json&_=1448549644944
> > 2015-11-26 20:22:59,639 DEBUG [c.c.a.ApiServlet]
> > (catalina-exec-9:ctx-c94acc67 ctx-b3ea1be2) ===END=== 10.0.0.93 -- GET
> >
> >
> command=listVirtualMachines&id=4ce4731f-22a7-42ac-8e78-093d5f2e9a34&response=json&_=1448549644944
> > 2015-11-26 20:23:01,968 DEBUG [c.c.a.m.AgentManagerImpl]
> > (AgentManager-Handler-10:null) SeqA 5-1790: Processing Seq 5-1790: {
> Cmd ,
> > MgmtId: -1, via: 5, Ver: v1, Flags: 11,
> >
> >
> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
> > \"connections\": []\n}","wait":0}}] }
> > 2015-11-26 20:23:01,972 DEBUG [c.c.a.m.AgentManagerImpl]
> > (AgentManager-Handler-10:null) SeqA 5-1790: Sending Seq 5-1790: { Ans: ,
> > MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
> > [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
> > 2015-11-26 20:23:04,354 DEBUG [o.a.c.s.SecondaryStorageManagerImpl]
> > (secstorage-1:ctx-e4c5abdc) Zone 3 is ready to launch secondary storage
> VM
> > 2015-11-26 20:23:04,680 DEBUG [c.c.c.ConsoleProxyManagerImpl]
> > (consoleproxy-1:ctx-f87cf64e) Zone 3 is ready to launch console proxy
> > 2015-11-26 20:23:08,020 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (AsyncJobMgr-Heartbeat-1:ctx-39ec59bb) Begin cleanup expired async-jobs
> > 2015-11-26 20:23:08,023 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (AsyncJobMgr-Heartbeat-1:ctx-39ec59bb) End cleanup expired async-jobs
> >
> > Regards,
> > Venkatesh.k
> >
> >
> > On Thu, Nov 26, 2015 at 9:04 PM, kotipalli venkatesh <
> > venkateshcloudtest@gmail.com> wrote:
> >
> > > Hi Erik,
> > >
> > > We found the error log, Please look in to this below error log,
> > >
> > > 2015-11-26 20:22:46,603 DEBUG [c.c.a.m.AgentAttache]
> > > (DirectAgent-279:ctx-532427fb) Seq 4-8612571337392652847: No more
> > commands
> > > found
> > > 2015-11-26 20:22:46,607 INFO [o.a.c.s.v.VolumeServiceImpl]
> > > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) releasing
> > > lock for VMTemplateStoragePool 3
> > > 2015-11-26 20:22:46,608 DEBUG [o.a.c.e.o.VolumeOrchestrator]
> > > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Unable to
> > > create Vol[6|vm=5|ROOT]:Expected 1 VDI template but found 2 VDI
> > template(s)
> > > on: 10.0.0.170:/export/secondary/template/tmpl/1/5
> > > 2015-11-26 20:22:46,608 INFO [c.c.v.VirtualMachineManagerImpl]
> > > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Unable to
> > > contact resource.
> > > com.cloud.exception.StorageUnavailableException: Resource
> [StoragePool:8]
> > > is unreachable: Unable to create Vol[6|vm=5|ROOT]:Expected 1 VDI
> template
> > > but found 2 VDI template(s) on: 10.0.0.170:
> > > /export/secondary/template/tmpl/1/5
> > >
> > >
> > > /export/secondary/template/tmpl/1/5 Inside the 2 .vhd files and one
> > > template properties file is there please look in to the below files;
> > >
> > > 3986df71-b1d0-3e20-a655-7e42dd144370.vhd
> > > 429d6340-6a5f-31ce-a581-cc05618500ab.vhd template.properties
> > >
> > > Which one is remove?
> > >
> > > Could you please suggest.
> > >
> > > Regards,
> > > Venkatesh.k
> > >
> > > On Thu, Nov 26, 2015 at 6:11 PM, Erik Weber <te...@gmail.com>
> wrote:
> > >
> > >> You need to paste more of your logs, in particular the (a lot of)
> lines
> > >> before the exception where all the resource allocations happen.
> > >>
> > >> --
> > >> Erik
> > >>
> > >> On Thu, Nov 26, 2015 at 1:38 PM, kotipalli venkatesh <
> > >> venkateshcloudtest@gmail.com> wrote:
> > >>
> > >> > Hi All,
> > >> >
> > >> > I have successfully installed Cloudstack 4.6.0 setup
> > >> > hypervisor is xenserver 6.5
> > >> >
> > >> > Successfully up and running SSVM and CPVM and Default templates
> > >> downloaded.
> > >> >
> > >> > When i am spin the new instance it 's troughs *insufficient memory
> > >> error*.
> > >> > But i have *sufficient place* *RAM* and *STORAGE* also.
> > >> >
> > >> > Please look in to this Management server log:
> > >> >
> > >> > 2015-11-26 17:49:10,572 WARN [o.a.c.alerts]
> > >> > (API-Job-Executor-1:ctx-801f0a96 job-56 ctx-63dfadf9) alertType:: 8
> > //
> > >> > dataCenterId:: 3 // podId:: 3 // clusterId:: null // message::
> Failed
> > to
> > >> > deploy Vm with Id: 3, on Host with Id: null
> > >> > 2015-11-26 17:49:10,601 ERROR [c.c.a.ApiAsyncJobDispatcher]
> > >> > (API-Job-Executor-1:ctx-801f0a96 job-56) Unexpected exception while
> > >> > executing
> > org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin
> > >> > com.cloud.utils.exception.CloudRuntimeException: Unable to start a
> VM
> > >> due
> > >> > to insufficient capacity
> > >> > at
> > >> >
> > >> >
> > >>
> >
> com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:622)
> > >> > at
> > >> >
> > >> >
> > >>
> >
> org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:242)
> > >> > at
> > >> >
> > >> >
> > >>
> >
> org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:212)
> > >> > at
> > >> >
> > >> >
> > >>
> >
> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3870)
> > >> > at
> > >> >
> > >> >
> > >>
> >
> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3488)
> > >> > at
> > >> >
> > >> >
> > >>
> >
> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3476)
> > >> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
> > >> > at
> > >> >
> > >> >
> > >>
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> > >> > at
> > >> >
> > >> >
> > >>
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > >> > at java.lang.reflect.Method.invoke(Method.java:606)
> > >> > at
> > >> >
> > >> >
> > >>
> >
> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
> > >> > at
> > >> >
> > >> >
> > >>
> >
> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
> > >> > at
> > >> >
> > >> >
> > >>
> >
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
> > >> > at
> > >> >
> > >> >
> > >>
> >
> org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:106)
> > >> > at
> > >> >
> > >> >
> > >>
> >
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
> > >> > at
> > >> >
> > >> >
> > >>
> >
> com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
> > >> > at
> > >> >
> > >> >
> > >>
> >
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
> > >> > at
> > >> >
> > >> >
> > >>
> >
> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
> > >> > at
> > >> >
> > >> >
> > >>
> >
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
> > >> > at
> > >> >
> > >> >
> > >>
> >
> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
> > >> > at com.sun.proxy.$Proxy202.startVirtualMachine(Unknown
> Source)
> > >> > at
> > >> >
> > >> >
> > >>
> >
> org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin.execute(DeployVMCmdByAdmin.java:50)
> > >> > at
> > com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
> > >> > at
> > >> >
> > >>
> >
> com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
> > >> > at
> > >> >
> > >> >
> > >>
> >
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
> > >> > at
> > >> >
> > >> >
> > >>
> >
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
> > >> > at
> > >> >
> > >> >
> > >>
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
> > >> > at
> > >> >
> > >> >
> > >>
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
> > >> > at
> > >> >
> > >> >
> > >>
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
> > >> > at
> > >> >
> > >> >
> > >>
> >
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
> > >> > at
> > >> >
> > >> >
> > >>
> >
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
> > >> > at
> > >> >
> > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> > >> > at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> > >> > at
> > >> >
> > >> >
> > >>
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > >> > at
> > >> >
> > >> >
> > >>
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > >> > at java.lang.Thread.run(Thread.java:745)
> > >> > Caused by: com.cloud.exception.InsufficientServerCapacityException:
> > >> Unable
> > >> > to create a deployment for VM[User|i-2-3-VM]Scope=interface
> > >> > com.cloud.dc.DataCenter; id=3
> > >> > at
> > >> >
> > >> >
> > >>
> >
> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:959)
> > >> >
> > >> > Please any suggestion....
> > >> >
> > >> > Warm Regards,
> > >> > Venkatesh.k
> > >> >
> > >>
> > >
> > >
> >
>
>
>
> --
> Rafael Weingärtner
>
Re: Insufficient Memory error
Posted by Rafael Weingärtner <ra...@gmail.com>.
is the storage server available on your hosts ?
I notice that on your log files:
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Unable to
contact resource.
com.cloud.exception.StorageUnavailableException: Resource [StoragePool:8]
is unreachable: Unable to create Vol[6|vm=5|ROOT]:Expected 1 VDI template
but found 2 VDI template(s) on: 10.0.0.170:
/export/secondary/template/tmpl/1/5
at
On Thu, Nov 26, 2015 at 1:49 PM, kotipalli venkatesh <
venkateshcloudtest@gmail.com> wrote:
> Hi Erik,
>
> Please look in to this full log:
>
>
> 2015-11-26 20:21:46,959 DEBUG [c.c.a.m.AgentManagerImpl]
> (AgentManager-Handler-15:null) SeqA 5-1781: Processing Seq 5-1781: { Cmd ,
> MgmtId: -1, via: 5, Ver: v1, Flags: 11,
>
> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
> \"connections\": []\n}","wait":0}}] }
> 2015-11-26 20:21:46,962 DEBUG [c.c.a.m.AgentManagerImpl]
> (AgentManager-Handler-15:null) SeqA 5-1781: Sending Seq 5-1781: { Ans: ,
> MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
> 2015-11-26 20:21:48,018 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> (AsyncJobMgr-Heartbeat-1:ctx-0bf05867) Begin cleanup expired async-jobs
> 2015-11-26 20:21:48,020 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> (AsyncJobMgr-Heartbeat-1:ctx-0bf05867) End cleanup expired async-jobs
> 2015-11-26 20:21:48,210 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (RouterStatusMonitor-1:ctx-0e1a35ca) Found 1 routers to update status.
> 2015-11-26 20:21:48,210 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (RouterStatusMonitor-1:ctx-0e1a35ca) Found 0 VPC networks to update
> Redundant State.
> 2015-11-26 20:21:48,211 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (RouterStatusMonitor-1:ctx-0e1a35ca) Found 0 networks to update RvR status.
> 2015-11-26 20:21:48,222 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (RouterStatusMonitor-1:ctx-71753b97) Found 1 routers to update status.
> 2015-11-26 20:21:48,222 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (RouterStatusMonitor-1:ctx-71753b97) Found 0 VPC networks to update
> Redundant State.
> 2015-11-26 20:21:48,223 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (RouterStatusMonitor-1:ctx-71753b97) Found 0 networks to update RvR status.
> 2015-11-26 20:21:53,165 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager
> Timer:ctx-3ab0cd7f) Resetting hosts suitable for reconnect
> 2015-11-26 20:21:53,166 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager
> Timer:ctx-3ab0cd7f) Completed resetting hosts suitable for reconnect
> 2015-11-26 20:21:53,166 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager
> Timer:ctx-3ab0cd7f) Acquiring hosts for clusters already owned by this
> management server
> 2015-11-26 20:21:53,168 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager
> Timer:ctx-3ab0cd7f) Completed acquiring hosts for clusters already owned by
> this management server
> 2015-11-26 20:21:53,168 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager
> Timer:ctx-3ab0cd7f) Acquiring hosts for clusters not owned by any
> management server
> 2015-11-26 20:21:53,168 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager
> Timer:ctx-3ab0cd7f) Completed acquiring hosts for clusters not owned by any
> management server
> 2015-11-26 20:21:55,958 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-2:ctx-5db7a86d) ===START=== 10.0.0.93 -- GET
>
> command=deployVirtualMachine&response=json&zoneid=5b752672-2ac9-4ec0-86a6-103cae8217d1&templateid=900a5634-9414-11e5-ae19-000c29255f5e&hypervisor=XenServer&serviceofferingid=94b83ad1-406c-44d5-86c0-d4dbb82a50a1&diskofferingid=30f3f1fa-76b2-4bcb-82c5-449ce7d9a4c8&iptonetworklist%5B0%5D.networkid=2e97fcee-3d01-40d2-a624-376661747d0c&displayname=Test002&name=Test002&_=1448549581263
> 2015-11-26 20:21:55,969 DEBUG [c.c.u.AccountManagerImpl]
> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Access granted to
> Acct[20064ffe-9415-11e5-a790-000c29255f5e-admin] to
> com.cloud.service.ServiceOfferingVO$$EnhancerByCGLIB$$8b588241@5020f5b3 by
> AffinityGroupAccessChecker
> 2015-11-26 20:21:55,969 DEBUG [c.c.u.AccountManagerImpl]
> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Access granted to
> Acct[20064ffe-9415-11e5-a790-000c29255f5e-admin] to
> com.cloud.storage.DiskOfferingVO$$EnhancerByCGLIB$$a160ea41@45e982eb by
> AffinityGroupAccessChecker
> 2015-11-26 20:21:55,976 DEBUG [c.c.n.NetworkModelImpl]
> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Service SecurityGroup is not
> supported in the network id=212
> 2015-11-26 20:21:55,982 DEBUG [c.c.v.UserVmManagerImpl]
> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Allocating in the DB for vm
> 2015-11-26 20:21:55,988 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Allocating entries for VM:
> VM[User|i-2-5-VM]
> 2015-11-26 20:21:55,988 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Allocating nics for
> VM[User|i-2-5-VM]
> 2015-11-26 20:21:55,989 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Allocating nic for vm
> VM[User|i-2-5-VM] in network Ntwk[212|Guest|8] with requested profile
> NicProfile[0-0-null-null-null
> 2015-11-26 20:21:55,996 DEBUG [c.c.n.NetworkModelImpl]
> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Service SecurityGroup is not
> supported in the network id=212
> 2015-11-26 20:21:55,997 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Allocating disks for
> VM[User|i-2-5-VM]
> 2015-11-26 20:21:56,008 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Allocation completed for VM:
> VM[User|i-2-5-VM]
> 2015-11-26 20:21:56,009 DEBUG [c.c.v.UserVmManagerImpl]
> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Successfully allocated DB entry
> for VM[User|i-2-5-VM]
> 2015-11-26 20:21:56,034 DEBUG [c.c.n.NetworkModelImpl]
> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Service SecurityGroup is not
> supported in the network id=212
> 2015-11-26 20:21:56,037 DEBUG [c.c.n.NetworkModelImpl]
> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Service SecurityGroup is not
> supported in the network id=212
> 2015-11-26 20:21:56,053 INFO [o.a.c.f.j.i.AsyncJobMonitor]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68) Add job-68 into job monitoring
> 2015-11-26 20:21:56,054 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) submit async job-68, details:
> AsyncJobVO {id:68, userId: 2, accountId: 2, instanceType: VirtualMachine,
> instanceId: 5, cmd:
> org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin, cmdInfo:
>
> {"serviceofferingid":"94b83ad1-406c-44d5-86c0-d4dbb82a50a1","cmdEventType":"VM.CREATE","ctxUserId":"2","zoneid":"5b752672-2ac9-4ec0-86a6-103cae8217d1","httpmethod":"GET","templateid":"900a5634-9414-11e5-ae19-000c29255f5e","response":"json","id":"5","ctxDetails":"{\"interface
>
> com.cloud.template.VirtualMachineTemplate\":\"900a5634-9414-11e5-ae19-000c29255f5e\",\"interface
>
> com.cloud.offering.DiskOffering\":\"30f3f1fa-76b2-4bcb-82c5-449ce7d9a4c8\",\"interface
>
> com.cloud.offering.ServiceOffering\":\"94b83ad1-406c-44d5-86c0-d4dbb82a50a1\",\"interface
>
> com.cloud.vm.VirtualMachine\":\"4ce4731f-22a7-42ac-8e78-093d5f2e9a34\",\"interface
>
> com.cloud.dc.DataCenter\":\"5b752672-2ac9-4ec0-86a6-103cae8217d1\"}","hypervisor":"XenServer","name":"Test002","iptonetworklist[0].networkid":"2e97fcee-3d01-40d2-a624-376661747d0c","_":"1448549581263","uuid":"4ce4731f-22a7-42ac-8e78-093d5f2e9a34","ctxAccountId":"2","diskofferingid":"30f3f1fa-76b2-4bcb-82c5-449ce7d9a4c8","ctxStartEventId":"168","displayname":"Test002"},
> cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
> result: null, initMsid: 52229922654, completeMsid: null, lastUpdated: null,
> lastPolled: null, created: null}
> 2015-11-26 20:21:56,058 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) ===END=== 10.0.0.93 -- GET
>
> command=deployVirtualMachine&response=json&zoneid=5b752672-2ac9-4ec0-86a6-103cae8217d1&templateid=900a5634-9414-11e5-ae19-000c29255f5e&hypervisor=XenServer&serviceofferingid=94b83ad1-406c-44d5-86c0-d4dbb82a50a1&diskofferingid=30f3f1fa-76b2-4bcb-82c5-449ce7d9a4c8&iptonetworklist%5B0%5D.networkid=2e97fcee-3d01-40d2-a624-376661747d0c&displayname=Test002&name=Test002&_=1448549581263
> 2015-11-26 20:21:56,061 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68) Executing AsyncJobVO {id:68,
> userId: 2, accountId: 2, instanceType: VirtualMachine, instanceId: 5, cmd:
> org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin, cmdInfo:
>
> {"serviceofferingid":"94b83ad1-406c-44d5-86c0-d4dbb82a50a1","cmdEventType":"VM.CREATE","ctxUserId":"2","zoneid":"5b752672-2ac9-4ec0-86a6-103cae8217d1","httpmethod":"GET","templateid":"900a5634-9414-11e5-ae19-000c29255f5e","response":"json","id":"5","ctxDetails":"{\"interface
>
> com.cloud.template.VirtualMachineTemplate\":\"900a5634-9414-11e5-ae19-000c29255f5e\",\"interface
>
> com.cloud.offering.DiskOffering\":\"30f3f1fa-76b2-4bcb-82c5-449ce7d9a4c8\",\"interface
>
> com.cloud.offering.ServiceOffering\":\"94b83ad1-406c-44d5-86c0-d4dbb82a50a1\",\"interface
>
> com.cloud.vm.VirtualMachine\":\"4ce4731f-22a7-42ac-8e78-093d5f2e9a34\",\"interface
>
> com.cloud.dc.DataCenter\":\"5b752672-2ac9-4ec0-86a6-103cae8217d1\"}","hypervisor":"XenServer","name":"Test002","iptonetworklist[0].networkid":"2e97fcee-3d01-40d2-a624-376661747d0c","_":"1448549581263","uuid":"4ce4731f-22a7-42ac-8e78-093d5f2e9a34","ctxAccountId":"2","diskofferingid":"30f3f1fa-76b2-4bcb-82c5-449ce7d9a4c8","ctxStartEventId":"168","displayname":"Test002"},
> cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
> result: null, initMsid: 52229922654, completeMsid: null, lastUpdated: null,
> lastPolled: null, created: null}
> 2015-11-26 20:21:56,085 DEBUG [c.c.n.NetworkModelImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Service SecurityGroup
> is not supported in the network id=212
> 2015-11-26 20:21:56,087 DEBUG [c.c.n.NetworkModelImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Service SecurityGroup
> is not supported in the network id=212
> 2015-11-26 20:21:56,094 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Deploy avoids pods:
> [], clusters: [], hosts: []
> 2015-11-26 20:21:56,095 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) DeploymentPlanner
> allocation algorithm: com.cloud.deploy.FirstFitPlanner@1136745
> 2015-11-26 20:21:56,095 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Trying to allocate a
> host and storage pools from dc:3, pod:null,cluster:null, requested cpu:
> 1000, requested ram: 1073741824
> 2015-11-26 20:21:56,095 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Is ROOT volume READY
> (pool already allocated)?: No
> 2015-11-26 20:21:56,095 DEBUG [c.c.d.FirstFitPlanner]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Searching all
> possible resources under this Zone: 3
> 2015-11-26 20:21:56,096 DEBUG [c.c.d.FirstFitPlanner]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Listing clusters in
> order of aggregate capacity, that have (atleast one host with) enough CPU
> and RAM capacity under this Zone: 3
> 2015-11-26 20:21:56,097 DEBUG [c.c.d.FirstFitPlanner]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Removing from the
> clusterId list these clusters from avoid set: []
> 2015-11-26 20:21:56,103 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking resources in
> Cluster: 3 under Pod: 3
> 2015-11-26 20:21:56,104 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
> FirstFitRoutingAllocator) Looking for hosts in dc: 3 pod:3 cluster:3
> 2015-11-26 20:21:56,105 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
> FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for
> allocation: [Host[-4-Routing]]
> 2015-11-26 20:21:56,108 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
> FirstFitRoutingAllocator) Found 1 hosts for allocation after
> prioritization: [Host[-4-Routing]]
> 2015-11-26 20:21:56,108 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
> FirstFitRoutingAllocator) Looking for speed=1000Mhz, Ram=1024
> 2015-11-26 20:21:56,111 DEBUG [c.c.c.CapacityManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
> FirstFitRoutingAllocator) Host: 4 has cpu capability (cpu:1, speed:3399) to
> support requested CPU: 1 and requested speed: 1000
> 2015-11-26 20:21:56,111 DEBUG [c.c.c.CapacityManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
> FirstFitRoutingAllocator) Checking if host: 4 has enough capacity for
> requested CPU: 1000 and requested RAM: 1073741824 ,
> cpuOverprovisioningFactor: 1.0
> 2015-11-26 20:21:56,113 DEBUG [c.c.c.CapacityManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
> FirstFitRoutingAllocator) Hosts's actual total CPU: 3399 and CPU after
> applying overprovisioning: 3399
> 2015-11-26 20:21:56,113 DEBUG [c.c.c.CapacityManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
> FirstFitRoutingAllocator) Free CPU: 2399 , Requested CPU: 1000
> 2015-11-26 20:21:56,113 DEBUG [c.c.c.CapacityManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
> FirstFitRoutingAllocator) Free RAM: 13743892480 , Requested RAM: 1073741824
> 2015-11-26 20:21:56,113 DEBUG [c.c.c.CapacityManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
> FirstFitRoutingAllocator) Host has enough CPU and RAM available
> 2015-11-26 20:21:56,113 DEBUG [c.c.c.CapacityManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
> FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 4, used: 1000,
> reserved: 0, actual total: 3399, total with overprovisioning: 3399;
> requested cpu:1000,alloc_from_last_host?:false ,considerReservedCapacity?:
> true
> 2015-11-26 20:21:56,113 DEBUG [c.c.c.CapacityManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
> FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 4, used:
> 1610612736, reserved: 0, total: 15354505216; requested mem:
> 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
> 2015-11-26 20:21:56,113 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
> FirstFitRoutingAllocator) Found a suitable host, adding to list: 4
> 2015-11-26 20:21:56,113 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
> FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts
> 2015-11-26 20:21:56,115 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking suitable
> pools for volume (Id, Type): (6,ROOT)
> 2015-11-26 20:21:56,115 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) We need to allocate
> new storagepool for this volume
> 2015-11-26 20:21:56,115 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Calling
> StoragePoolAllocators to find suitable pools
> 2015-11-26 20:21:56,116 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e)
> LocalStoragePoolAllocator trying to find storage pool to fit the vm
> 2015-11-26 20:21:56,116 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e)
> ClusterScopeStoragePoolAllocator looking for storage pool
> 2015-11-26 20:21:56,116 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Looking for pools in
> dc: 3 pod:3 cluster:3. Disabled pools will be ignored.
> 2015-11-26 20:21:56,117 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found pools matching
> tags: [Pool[8|NetworkFilesystem]]
> 2015-11-26 20:21:56,118 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking if storage
> pool is suitable, name: null ,poolId: 8
> 2015-11-26 20:21:56,119 INFO [c.c.s.StorageManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Storage pool null (8)
> does not supply IOPS capacity, assuming enough capacity
> 2015-11-26 20:21:56,120 DEBUG [c.c.s.StorageManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool 8 for
> storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
> 0.019253810234789077, disable threshold: 0.85
> 2015-11-26 20:21:56,130 DEBUG [c.c.s.StorageManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found storage pool
> primary of type NetworkFilesystem with overprovisioning factor 2
> 2015-11-26 20:21:56,130 DEBUG [c.c.s.StorageManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total over
> provisioned capacity calculated is 2 * 526199291904
> 2015-11-26 20:21:56,130 DEBUG [c.c.s.StorageManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total capacity of the
> pool primary id: 8 is 1052398583808
> 2015-11-26 20:21:56,130 DEBUG [c.c.s.StorageManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool: 8 for
> volume allocation [Vol[6|vm=5|ROOT]], maxSize : 1052398583808,
> totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
> disable threshold: 0.85
> 2015-11-26 20:21:56,130 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e)
> ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
> 2015-11-26 20:21:56,130 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking suitable
> pools for volume (Id, Type): (7,DATADISK)
> 2015-11-26 20:21:56,130 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) We need to allocate
> new storagepool for this volume
> 2015-11-26 20:21:56,131 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Calling
> StoragePoolAllocators to find suitable pools
> 2015-11-26 20:21:56,131 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e)
> LocalStoragePoolAllocator trying to find storage pool to fit the vm
> 2015-11-26 20:21:56,131 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e)
> ClusterScopeStoragePoolAllocator looking for storage pool
> 2015-11-26 20:21:56,131 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Looking for pools in
> dc: 3 pod:3 cluster:3. Disabled pools will be ignored.
> 2015-11-26 20:21:56,131 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found pools matching
> tags: [Pool[8|NetworkFilesystem]]
> 2015-11-26 20:21:56,132 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking if storage
> pool is suitable, name: null ,poolId: 8
> 2015-11-26 20:21:56,132 INFO [c.c.s.StorageManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Storage pool null (8)
> does not supply IOPS capacity, assuming enough capacity
> 2015-11-26 20:21:56,133 DEBUG [c.c.s.StorageManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool 8 for
> storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
> 0.019253810234789077, disable threshold: 0.85
> 2015-11-26 20:21:56,139 DEBUG [c.c.s.StorageManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found storage pool
> primary of type NetworkFilesystem with overprovisioning factor 2
> 2015-11-26 20:21:56,139 DEBUG [c.c.s.StorageManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total over
> provisioned capacity calculated is 2 * 526199291904
> 2015-11-26 20:21:56,139 DEBUG [c.c.s.StorageManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total capacity of the
> pool primary id: 8 is 1052398583808
> 2015-11-26 20:21:56,140 DEBUG [c.c.s.StorageManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool: 8 for
> volume allocation [Vol[7|vm=5|DATADISK]], maxSize : 1052398583808,
> totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
> disable threshold: 0.85
> 2015-11-26 20:21:56,140 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e)
> ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
> 2015-11-26 20:21:56,140 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Trying to find a
> potenial host and associated storage pools from the suitable host/pool
> lists for this VM
> 2015-11-26 20:21:56,140 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking if host: 4
> can access any suitable storage pool for volume: DATADISK
> 2015-11-26 20:21:56,140 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Host: 4 can access
> pool: 8
> 2015-11-26 20:21:56,141 DEBUG [c.c.s.StorageManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool 8 for
> storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
> 0.019253810234789077, disable threshold: 0.85
> 2015-11-26 20:21:56,142 DEBUG [c.c.s.StorageManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found storage pool
> primary of type NetworkFilesystem with overprovisioning factor 2
> 2015-11-26 20:21:56,142 DEBUG [c.c.s.StorageManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total over
> provisioned capacity calculated is 2 * 526199291904
> 2015-11-26 20:21:56,143 DEBUG [c.c.s.StorageManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total capacity of the
> pool primary id: 8 is 1052398583808
> 2015-11-26 20:21:56,143 DEBUG [c.c.s.StorageManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool: 8 for
> volume allocation [Vol[7|vm=5|DATADISK]], maxSize : 1052398583808,
> totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
> disable threshold: 0.85
> 2015-11-26 20:21:56,143 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking if host: 4
> can access any suitable storage pool for volume: ROOT
> 2015-11-26 20:21:56,143 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Host: 4 can access
> pool: 8
> 2015-11-26 20:21:56,144 DEBUG [c.c.s.StorageManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool 8 for
> storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
> 0.019253810234789077, disable threshold: 0.85
> 2015-11-26 20:21:56,146 DEBUG [c.c.s.StorageManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found storage pool
> primary of type NetworkFilesystem with overprovisioning factor 2
> 2015-11-26 20:21:56,146 DEBUG [c.c.s.StorageManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total over
> provisioned capacity calculated is 2 * 526199291904
> 2015-11-26 20:21:56,146 DEBUG [c.c.s.StorageManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total capacity of the
> pool primary id: 8 is 1052398583808
> 2015-11-26 20:21:56,147 DEBUG [c.c.s.StorageManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool: 8 for
> volume allocation [Vol[6|vm=5|ROOT]], maxSize : 1052398583808,
> totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
> disable threshold: 0.85
> 2015-11-26 20:21:56,147 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found a potential
> host id: 4 name: xenserver and associated storage pools for this VM
> 2015-11-26 20:21:56,148 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Returning Deployment
> Destination:
>
> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
> :
>
> Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage(Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
> Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
> Volume(7|DATADISK-->Pool(8))]
> 2015-11-26 20:21:56,155 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Sync job-69 execution
> on object VmWorkJobQueue.5
> 2015-11-26 20:21:56,961 DEBUG [c.c.a.m.AgentManagerImpl]
> (AgentManager-Handler-1:null) SeqA 5-1782: Processing Seq 5-1782: { Cmd ,
> MgmtId: -1, via: 5, Ver: v1, Flags: 11,
>
> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
> \"connections\": []\n}","wait":0}}] }
> 2015-11-26 20:21:56,966 DEBUG [c.c.a.m.AgentManagerImpl]
> (AgentManager-Handler-1:null) SeqA 5-1782: Sending Seq 5-1782: { Ans: ,
> MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
> 2015-11-26 20:21:58,022 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (AsyncJobMgr-Heartbeat-1:ctx-7d4d1e50) Execute sync-queue item:
> SyncQueueItemVO {id:9, queueId: 9, contentType: AsyncJob, contentId: 69,
> lastProcessMsid: 52229922654, lastprocessNumber: 1, lastProcessTime: Thu
> Nov 26 20:21:58 IST 2015, created: Thu Nov 26 20:21:56 IST 2015}
> 2015-11-26 20:21:58,022 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (AsyncJobMgr-Heartbeat-1:ctx-7d4d1e50) Schedule queued job-69
> 2015-11-26 20:21:58,026 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> (AsyncJobMgr-Heartbeat-1:ctx-05b26563) Begin cleanup expired async-jobs
> 2015-11-26 20:21:58,029 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> (AsyncJobMgr-Heartbeat-1:ctx-05b26563) End cleanup expired async-jobs
> 2015-11-26 20:21:58,029 INFO [o.a.c.f.j.i.AsyncJobMonitor]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Add job-69 into job
> monitoring
> 2015-11-26 20:21:58,033 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Executing AsyncJobVO
> {id:69, userId: 2, accountId: 2, instanceType: null, instanceId: null, cmd:
> com.cloud.vm.VmWorkStart, cmdInfo:
>
> rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAABXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAA3BzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHIAEGphdmEubGFuZy5OdW1iZXKGrJUdC5TgiwIAAHhwAAAAAAAAAANzcQB-AAgAAAAAAAAABHBwcHEAfgAKcHNyABFqYXZhLnV0aWwuSGFzaE1hcAUH2sHDFmDRAwACRgAKbG9hZEZhY3RvckkACXRocmVzaG9sZHhwP0AAAAAAAAx3CAAAABAAAAABdAAKVm1QYXNzd29yZHQAHHJPMEFCWFFBRG5OaGRtVmtYM0JoYzNOM2IzSmt4cA,
> cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
> result: null, initMsid: 52229922654, completeMsid: null, lastUpdated: null,
> lastPolled: null, created: Thu Nov 26 20:21:56 IST 2015}
> 2015-11-26 20:21:58,033 DEBUG [c.c.v.VmWorkJobDispatcher]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Run VM work job:
> com.cloud.vm.VmWorkStart for VM 5, job origin: 68
> 2015-11-26 20:21:58,034 DEBUG [c.c.v.VmWorkJobHandlerProxy]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Execute VM
> work job:
>
> com.cloud.vm.VmWorkStart{"dcId":3,"podId":3,"clusterId":3,"hostId":4,"rawParams":{"VmPassword":"rO0ABXQADnNhdmVkX3Bhc3N3b3Jk"},"userId":2,"accountId":2,"vmId":5,"handlerName":"VirtualMachineManagerImpl"}
> 2015-11-26 20:21:58,038 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM state
> transitted from :Stopped to Starting with event: StartRequestedvm's
> original host id: null new host id: null host id before state transition:
> null
> 2015-11-26 20:21:58,038 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Successfully
> transitioned to start state for VM[User|i-2-5-VM] reservation id =
> 2a4a184a-eac9-4609-8a70-4d230ee3a37d
> 2015-11-26 20:21:58,040 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
> deploy VM, vm has dcId: 3 and podId: null
> 2015-11-26 20:21:58,041 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) advanceStart:
> DeploymentPlan is provided, using dcId:3, podId: 3, clusterId: 3, hostId:
> 4, poolId: null
> 2015-11-26 20:21:58,041 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deploy avoids
> pods: null, clusters: null, hosts: null
> 2015-11-26 20:21:58,045 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deploy avoids
> pods: [], clusters: [], hosts: []
> 2015-11-26 20:21:58,046 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> DeploymentPlanner allocation algorithm:
> com.cloud.deploy.FirstFitPlanner@1136745
> 2015-11-26 20:21:58,046 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
> allocate a host and storage pools from dc:3, pod:3,cluster:3, requested
> cpu: 1000, requested ram: 1073741824
> 2015-11-26 20:21:58,046 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Is ROOT
> volume READY (pool already allocated)?: No
> 2015-11-26 20:21:58,046 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> DeploymentPlan has host_id specified, choosing this host and making no
> checks on this host: 4
> 2015-11-26 20:21:58,046 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Looking for
> suitable pools for this host under zone: 3, pod: 3, cluster: 3
> 2015-11-26 20:21:58,048 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
> suitable pools for volume (Id, Type): (6,ROOT)
> 2015-11-26 20:21:58,048 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) We need to
> allocate new storagepool for this volume
> 2015-11-26 20:21:58,049 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Calling
> StoragePoolAllocators to find suitable pools
> 2015-11-26 20:21:58,049 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> LocalStoragePoolAllocator trying to find storage pool to fit the vm
> 2015-11-26 20:21:58,049 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> ClusterScopeStoragePoolAllocator looking for storage pool
> 2015-11-26 20:21:58,049 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Looking for
> pools in dc: 3 pod:3 cluster:3. Disabled pools will be ignored.
> 2015-11-26 20:21:58,049 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found pools
> matching tags: [Pool[8|NetworkFilesystem]]
> 2015-11-26 20:21:58,050 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
> storage pool is suitable, name: null ,poolId: 8
> 2015-11-26 20:21:58,051 INFO [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Storage pool
> null (8) does not supply IOPS capacity, assuming enough capacity
> 2015-11-26 20:21:58,052 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking pool
> 8 for storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
> 0.019253810234789077, disable threshold: 0.85
> 2015-11-26 20:21:58,054 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found storage
> pool primary of type NetworkFilesystem with overprovisioning factor 2
> 2015-11-26 20:21:58,055 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total over
> provisioned capacity calculated is 2 * 526199291904
> 2015-11-26 20:21:58,055 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total
> capacity of the pool primary id: 8 is 1052398583808
> 2015-11-26 20:21:58,055 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
> pool: 8 for volume allocation [Vol[6|vm=5|ROOT]], maxSize : 1052398583808,
> totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
> disable threshold: 0.85
> 2015-11-26 20:21:58,055 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
> 2015-11-26 20:21:58,055 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
> suitable pools for volume (Id, Type): (7,DATADISK)
> 2015-11-26 20:21:58,055 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) We need to
> allocate new storagepool for this volume
> 2015-11-26 20:21:58,055 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Calling
> StoragePoolAllocators to find suitable pools
> 2015-11-26 20:21:58,055 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> LocalStoragePoolAllocator trying to find storage pool to fit the vm
> 2015-11-26 20:21:58,055 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> ClusterScopeStoragePoolAllocator looking for storage pool
> 2015-11-26 20:21:58,055 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Looking for
> pools in dc: 3 pod:3 cluster:3. Disabled pools will be ignored.
> 2015-11-26 20:21:58,056 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found pools
> matching tags: [Pool[8|NetworkFilesystem]]
> 2015-11-26 20:21:58,056 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
> storage pool is suitable, name: null ,poolId: 8
> 2015-11-26 20:21:58,057 INFO [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Storage pool
> null (8) does not supply IOPS capacity, assuming enough capacity
> 2015-11-26 20:21:58,057 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking pool
> 8 for storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
> 0.019253810234789077, disable threshold: 0.85
> 2015-11-26 20:21:58,059 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found storage
> pool primary of type NetworkFilesystem with overprovisioning factor 2
> 2015-11-26 20:21:58,059 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total over
> provisioned capacity calculated is 2 * 526199291904
> 2015-11-26 20:21:58,059 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total
> capacity of the pool primary id: 8 is 1052398583808
> 2015-11-26 20:21:58,060 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
> pool: 8 for volume allocation [Vol[7|vm=5|DATADISK]], maxSize :
> 1052398583808, totalAllocatedSize : 12156207104, askingSize : 21474836480,
> allocated disable threshold: 0.85
> 2015-11-26 20:21:58,060 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
> 2015-11-26 20:21:58,060 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
> find a potenial host and associated storage pools from the suitable
> host/pool lists for this VM
> 2015-11-26 20:21:58,060 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
> host: 4 can access any suitable storage pool for volume: DATADISK
> 2015-11-26 20:21:58,060 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Host: 4 can
> access pool: 8
> 2015-11-26 20:21:58,061 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking pool
> 8 for storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
> 0.019253810234789077, disable threshold: 0.85
> 2015-11-26 20:21:58,062 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found storage
> pool primary of type NetworkFilesystem with overprovisioning factor 2
> 2015-11-26 20:21:58,062 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total over
> provisioned capacity calculated is 2 * 526199291904
> 2015-11-26 20:21:58,062 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total
> capacity of the pool primary id: 8 is 1052398583808
> 2015-11-26 20:21:58,063 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
> pool: 8 for volume allocation [Vol[7|vm=5|DATADISK]], maxSize :
> 1052398583808, totalAllocatedSize : 12156207104, askingSize : 21474836480,
> allocated disable threshold: 0.85
> 2015-11-26 20:21:58,063 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
> host: 4 can access any suitable storage pool for volume: ROOT
> 2015-11-26 20:21:58,063 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Host: 4 can
> access pool: 8
> 2015-11-26 20:21:58,064 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking pool
> 8 for storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
> 0.019253810234789077, disable threshold: 0.85
> 2015-11-26 20:21:58,067 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found storage
> pool primary of type NetworkFilesystem with overprovisioning factor 2
> 2015-11-26 20:21:58,067 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total over
> provisioned capacity calculated is 2 * 526199291904
> 2015-11-26 20:21:58,067 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total
> capacity of the pool primary id: 8 is 1052398583808
> 2015-11-26 20:21:58,067 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
> pool: 8 for volume allocation [Vol[6|vm=5|ROOT]], maxSize : 1052398583808,
> totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
> disable threshold: 0.85
> 2015-11-26 20:21:58,067 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found a
> potential host id: 4 name: xenserver and associated storage pools for this
> VM
> 2015-11-26 20:21:58,068 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Returning
> Deployment Destination:
>
> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
> :
>
> Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage(Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
> Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
> Volume(7|DATADISK-->Pool(8))]
> 2015-11-26 20:21:58,068 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deployment
> found - P0=VM[User|i-2-5-VM],
>
> P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
> :
>
> Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage(Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
> Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
> Volume(7|DATADISK-->Pool(8))]
> 2015-11-26 20:21:58,073 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM state
> transitted from :Starting to Starting with event: OperationRetryvm's
> original host id: null new host id: 4 host id before state transition: null
> 2015-11-26 20:21:58,076 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Hosts's
> actual total CPU: 3399 and CPU after applying overprovisioning: 3399
> 2015-11-26 20:21:58,076 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) We are
> allocating VM, increasing the used capacity of this host:4
> 2015-11-26 20:21:58,076 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Current Used
> CPU: 1000 , Free CPU:2399 ,Requested CPU: 1000
> 2015-11-26 20:21:58,076 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Current Used
> RAM: 1610612736 , Free RAM:13743892480 ,Requested RAM: 1073741824
> 2015-11-26 20:21:58,076 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) CPU STATS
> after allocation: for host: 4, old used: 1000, old reserved: 0, actual
> total: 3399, total with overprovisioning: 3399; new used:2000, reserved:0;
> requested cpu:1000,alloc_from_last:false
> 2015-11-26 20:21:58,076 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) RAM STATS
> after allocation: for host: 4, old used: 1610612736, old reserved: 0,
> total: 15354505216; new used: 2684354560, reserved: 0; requested mem:
> 1073741824,alloc_from_last:false
> 2015-11-26 20:21:58,094 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM is being
> created in podId: 3
> 2015-11-26 20:21:58,097 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Lock is
> acquired for network id 212 as a part of network implement
> 2015-11-26 20:21:58,097 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Asking
> ExternalGuestNetworkGuru to implement Ntwk[212|Guest|8]
> 2015-11-26 20:21:58,117 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Asking
> VirtualRouter to implemenet Ntwk[212|Guest|8]
> 2015-11-26 20:21:58,120 DEBUG [c.c.n.r.NetworkHelperImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Starting
> router VM[DomainRouter|r-4-VM]
> 2015-11-26 20:21:58,127 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM state
> transitted from :Stopped to Starting with event: StartRequestedvm's
> original host id: 4 new host id: null host id before state transition: null
> 2015-11-26 20:21:58,127 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Successfully
> transitioned to start state for VM[DomainRouter|r-4-VM] reservation id =
> 36f90bcc-1fad-40d8-b878-3996e5c69c0e
> 2015-11-26 20:21:58,130 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
> deploy VM, vm has dcId: 3 and podId: 3
> 2015-11-26 20:21:58,130 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deploy avoids
> pods: null, clusters: null, hosts: null
> 2015-11-26 20:21:58,131 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Root volume
> is ready, need to place VM in volume's cluster
> 2015-11-26 20:21:58,131 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> Vol[5|vm=4|ROOT] is READY, changing deployment plan to use this pool's
> dcId: 3 , podId: 3 , and clusterId: 3
> 2015-11-26 20:21:58,137 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deploy avoids
> pods: [], clusters: [], hosts: []
> 2015-11-26 20:21:58,137 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> DeploymentPlanner allocation algorithm:
> com.cloud.deploy.FirstFitPlanner@1136745
> 2015-11-26 20:21:58,137 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
> allocate a host and storage pools from dc:3, pod:3,cluster:3, requested
> cpu: 500, requested ram: 268435456
> 2015-11-26 20:21:58,137 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Is ROOT
> volume READY (pool already allocated)?: Yes
> 2015-11-26 20:21:58,137 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) This VM has
> last host_id specified, trying to choose the same host: 4
> 2015-11-26 20:21:58,141 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Host: 4 has
> cpu capability (cpu:1, speed:3399) to support requested CPU: 1 and
> requested speed: 500
> 2015-11-26 20:21:58,141 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
> host: 4 has enough capacity for requested CPU: 500 and requested RAM:
> 268435456 , cpuOverprovisioningFactor: 1.0
> 2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Hosts's
> actual total CPU: 3399 and CPU after applying overprovisioning: 3399
> 2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) We need to
> allocate to the last host again, so checking if there is enough reserved
> capacity
> 2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reserved CPU:
> 0 , Requested CPU: 500
> 2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reserved RAM:
> 0 , Requested RAM: 268435456
> 2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) STATS: Failed
> to alloc resource from host: 4 reservedCpu: 0, requested cpu: 500,
> reservedMem: 0, requested mem: 268435456
> 2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Host does not
> have enough reserved CPU available, cannot allocate to this host.
> 2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
> host: 4 has enough capacity for requested CPU: 500 and requested RAM:
> 268435456 , cpuOverprovisioningFactor: 1.0
> 2015-11-26 20:21:58,143 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Hosts's
> actual total CPU: 3399 and CPU after applying overprovisioning: 3399
> 2015-11-26 20:21:58,143 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Free CPU:
> 1399 , Requested CPU: 500
> 2015-11-26 20:21:58,143 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Free RAM:
> 12670150656 , Requested RAM: 268435456
> 2015-11-26 20:21:58,143 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Host has
> enough CPU and RAM available
> 2015-11-26 20:21:58,143 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) STATS: Can
> alloc CPU from host: 4, used: 2000, reserved: 0, actual total: 3399, total
> with overprovisioning: 3399; requested cpu:500,alloc_from_last_host?:false
> ,considerReservedCapacity?: true
> 2015-11-26 20:21:58,143 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) STATS: Can
> alloc MEM from host: 4, used: 2684354560, reserved: 0, total: 15354505216;
> requested mem: 268435456,alloc_from_last_host?:false
> ,considerReservedCapacity?: true
> 2015-11-26 20:21:58,143 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) The last host
> of this VM is UP and has enough capacity
> 2015-11-26 20:21:58,143 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Now checking
> for suitable pools under zone: 3, pod: 3, cluster: 3
> 2015-11-26 20:21:58,145 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
> suitable pools for volume (Id, Type): (5,ROOT)
> 2015-11-26 20:21:58,145 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Volume has
> pool already allocated, checking if pool can be reused, poolId: 8
> 2015-11-26 20:21:58,145 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Planner need
> not allocate a pool for this volume since its READY
> 2015-11-26 20:21:58,145 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
> find a potenial host and associated storage pools from the suitable
> host/pool lists for this VM
> 2015-11-26 20:21:58,145 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
> host: 4 can access any suitable storage pool for volume: ROOT
> 2015-11-26 20:21:58,146 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Host: 4 can
> access pool: 8
> 2015-11-26 20:21:58,146 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found a
> potential host id: 4 name: xenserver and associated storage pools for this
> VM
> 2015-11-26 20:21:58,146 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Returning
> Deployment Destination:
>
> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
> : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage()]
> 2015-11-26 20:21:58,146 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deployment
> found - P0=VM[DomainRouter|r-4-VM],
>
> P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
> : Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage()]
> 2015-11-26 20:21:58,153 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM state
> transitted from :Starting to Starting with event: OperationRetryvm's
> original host id: 4 new host id: 4 host id before state transition: null
> 2015-11-26 20:21:58,153 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM starting
> again on the last host it was stopped on
> 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Hosts's
> actual total CPU: 3399 and CPU after applying overprovisioning: 3399
> 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) We are
> allocating VM, increasing the used capacity of this host:4
> 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Current Used
> CPU: 2000 , Free CPU:1399 ,Requested CPU: 500
> 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Current Used
> RAM: 2684354560 , Free RAM:12670150656 ,Requested RAM: 268435456
> 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) We are
> allocating VM to the last host again, so adjusting the reserved capacity if
> it is not less than required
> 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reserved CPU:
> 0 , Requested CPU: 500
> 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reserved RAM:
> 0 , Requested RAM: 268435456
> 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) CPU STATS
> after allocation: for host: 4, old used: 2000, old reserved: 0, actual
> total: 3399, total with overprovisioning: 3399; new used:2500, reserved:0;
> requested cpu:500,alloc_from_last:true
> 2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) RAM STATS
> after allocation: for host: 4, old used: 2684354560, old reserved: 0,
> total: 15354505216; new used: 2952790016, reserved: 0; requested mem:
> 268435456,alloc_from_last:true
> 2015-11-26 20:21:58,158 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM is being
> created in podId: 3
> 2015-11-26 20:21:58,173 DEBUG [c.c.n.NetworkModelImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
> SecurityGroup is not supported in the network id=212
> 2015-11-26 20:21:58,179 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Asking
> VirtualRouter to prepare for
> Nic[8-4-36f90bcc-1fad-40d8-b878-3996e5c69c0e-10.1.1.1]
> 2015-11-26 20:21:58,179 DEBUG [c.c.n.NetworkModelImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
> SecurityGroup is not supported in the network id=212
> 2015-11-26 20:21:58,193 DEBUG [o.a.c.e.o.VolumeOrchestrator]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
> we need to prepare 1 volumes for VM[DomainRouter|r-4-VM]
> 2015-11-26 20:21:58,193 DEBUG [o.a.c.e.o.VolumeOrchestrator]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) No need to
> recreate the volume: Vol[5|vm=4|ROOT], since it already has a pool
> assigned: 8, adding disk to VM
> 2015-11-26 20:21:58,207 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Boot Args for
> VM[DomainRouter|r-4-VM]: template=domP name=r-4-VM eth2ip=10.0.0.174
> eth2mask=255.255.255.0 gateway=10.0.0.1 eth0ip=10.1.1.1
> eth0mask=255.255.255.0 domain=cs2cloud.internal cidrsize=24
> dhcprange=10.1.1.1 eth1ip=169.254.0.43 eth1mask=255.255.0.0 type=router
> disable_rp_filter=true dns1=8.8.8.8
>
> baremetalnotificationsecuritykey=MD4bWVy5t0anMd4eq4UlKWj6cZTW4gFDMeDd0WR3H3BuAsrxVX28ShzvJgbd8RR5eMRZ7rNYAsaF9RPXAZoCrQ
>
> baremetalnotificationapikey=ZWNcizzJ0xXQE0Ubr6Sr_kN7xlMMMMtziuPTxHwZOyIN-Lo2f2CzvPhNw0o01LkNP3X4bp61YiZu0EWF-Mbfew
> host=10.0.0.170 port=8080
> 2015-11-26 20:21:58,229 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 1 ip(s)
> to apply as a part of domR VM[DomainRouter|r-4-VM] start.
> 2015-11-26 20:21:58,237 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Resending
> ipAssoc, port forwarding, load balancing rules as a part of Virtual router
> start
> 2015-11-26 20:21:58,241 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Egress policy
> for the Network 212 is already defined as Deny. So, no need to default the
> rule to Allow.
> 2015-11-26 20:21:58,241 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
> firewall Egress rule(s) to apply as a part of domR VM[DomainRouter|r-4-VM]
> start.
> 2015-11-26 20:21:58,243 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
> static nat(s) to apply as a part of domR VM[DomainRouter|r-4-VM] start.
> 2015-11-26 20:21:58,243 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
> firewall Ingress rule(s) to apply as a part of domR VM[DomainRouter|r-4-VM]
> start.
> 2015-11-26 20:21:58,243 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0 port
> forwarding rule(s) to apply as a part of domR VM[DomainRouter|r-4-VM]
> start.
> 2015-11-26 20:21:58,243 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
> static nat rule(s) to apply as a part of domR VM[DomainRouter|r-4-VM]
> start.
> 2015-11-26 20:21:58,243 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
> vpn(s) to apply as a part of domR VM[DomainRouter|r-4-VM] start.
> 2015-11-26 20:21:58,244 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0 load
> balancing rule(s) to apply as a part of domR VM[DomainRouter|r-4-VM] start.
> 2015-11-26 20:21:58,245 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Creating
> monitoring services on VM[DomainRouter|r-4-VM] start...
> 2015-11-26 20:21:58,248 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reapplying
> dhcp entries as a part of domR VM[DomainRouter|r-4-VM] start...
> 2015-11-26 20:21:58,249 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reapplying vm
> data (userData and metaData) entries as a part of domR
> VM[DomainRouter|r-4-VM] start...
> 2015-11-26 20:21:58,254 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> 4-8612571337392652838: Sending { Cmd , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 100011,
>
> [{"com.cloud.agent.api.StartCommand":{"vm":{"id":4,"name":"r-4-VM","bootloader":"PyGrub","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":268435456,"maxRam":268435456,"arch":"x86_64","os":"Debian
> GNU/Linux 7(64-bit)","platformEmulator":"Debian Wheezy 7.0
> (64-bit)","bootArgs":" template=domP name=r-4-VM eth2ip=10.0.0.174
> eth2mask=255.255.255.0 gateway=10.0.0.1 eth0ip=10.1.1.1
> eth0mask=255.255.255.0 domain=cs2cloud.internal cidrsize=24
> dhcprange=10.1.1.1 eth1ip=169.254.0.43 eth1mask=255.255.0.0 type=router
> disable_rp_filter=true dns1=8.8.8.8
>
> baremetalnotificationsecuritykey=MD4bWVy5t0anMd4eq4UlKWj6cZTW4gFDMeDd0WR3H3BuAsrxVX28ShzvJgbd8RR5eMRZ7rNYAsaF9RPXAZoCrQ
>
> baremetalnotificationapikey=ZWNcizzJ0xXQE0Ubr6Sr_kN7xlMMMMtziuPTxHwZOyIN-Lo2f2CzvPhNw0o01LkNP3X4bp61YiZu0EWF-Mbfew
> host=10.0.0.170
>
> port=8080","enableHA":true,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"SlzaiXi9iLi3YpfQ7v3kZw","params":{},"uuid":"27157005-7e89-4251-89e4-2c53ff43bb70","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"9478a811-8b96-4cfa-b6bf-1e09c3fecd39","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
>
> 10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc
>
> "}},"name":"ROOT-4","size":3145728000,"path":"dcc1ce80-4cd5-4f59-b063-34e2a93ed99a","volumeId":5,"vmName":"r-4-VM","accountId":2,"format":"VHD","provisioningType":"THIN","id":5,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"dcc1ce80-4cd5-4f59-b063-34e2a93ed99a","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"10.0.0.170","volumeSize":"3145728000"}}],"nics":[{"deviceId":2,"networkRateMbps":200,"defaultNic":true,"pxeDisable":true,"nicUuid":"9fbc00ea-599c-4455-a416-8e66986d9454","uuid":"8872476c-2fd1-4ed3-bfb1-c62efe2b6eab","ip":"10.0.0.174","netmask":"255.255.255.0","gateway":"10.0.0.1","mac":"06:a0:8a:00:00:09","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"mgmt"},{"deviceId":0,"networkRateMbps":200,"defaultNic":false,"pxeDisable":true,"nicUuid":"f38511fa-d2e8-4935-9fc4-74b2eea7621b","uuid":"2e97fcee-3d01-40d2-a624-376661747d0c","ip":"10.1.1.1","netmask":"255.255.255.0","mac":"02:00:4d:27:00:02","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://500","isolationUri":"vlan://500","isSecurityGroupEnabled":false,"name":"mgmt"},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"pxeDisable":true,"nicUuid":"5c6cd3fa-fddb-4ee0-bff2-87e5c04f8d81","uuid":"914b3b0d-541c-4c63-b331-3377672a824d","ip":"169.254.0.43","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:00:2b","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.0.0.171","executeInSequence":false,"wait":0}},{"com.cloud.agent.api.check.CheckSshCommand":{"ip":"169.254.0.43","port":3922,"interval":6,"retries":100,"name":"r-4-VM","wait":0}},{"com.cloud.agent.api.GetDomRVersionCmd":{"accessDetails":{"
> router.name
>
> ":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}},{},{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Start","accessDetails":{"router.guest.ip":"10.1.1.1","
> router.name
>
> ":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}},{"com.cloud.agent.api.routing.IpAssocCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.0.0.174","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":true,"broadcastUri":"vlan://untagged","vlanGateway":"10.0.0.1","vlanNetmask":"255.255.255.0","vifMacAddress":"06:35:62:00:00:09","networkRate":200,"trafficType":"Public","networkName":"mgmt","newNic":false}],"accessDetails":{"zone.network.type":"Advanced","
> router.name
>
> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.SetMonitorServiceCommand":{"services":[{"id":0,"service":"dhcp","processname":"dnsmasq","serviceName":"dnsmasq","servicePath":"/var/run/dnsmasq/dnsmasq.pid","pidFile":"/var/run/dnsmasq/dnsmasq.pid","isDefault":false},{"id":0,"service":"loadbalancing","processname":"haproxy","serviceName":"haproxy","servicePath":"/var/run/haproxy.pid","pidFile":"/var/run/haproxy.pid","isDefault":false},{"id":0,"service":"ssh","processname":"sshd","serviceName":"ssh","servicePath":"/var/run/sshd.pid","pidFile":"/var/run/sshd.pid","isDefault":true},{"id":0,"service":"webserver","processname":"apache2","serviceName":"apache2","servicePath":"/var/run/apache2.pid","pidFile":"/var/run/apache2.pid","isDefault":true}],"accessDetails":{"
> router.name
>
> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Finish","accessDetails":{"router.guest.ip":"10.1.1.1","
> router.name":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}}] }
> 2015-11-26 20:21:58,255 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> 4-8612571337392652838: Executing: { Cmd , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 100011,
>
> [{"com.cloud.agent.api.StartCommand":{"vm":{"id":4,"name":"r-4-VM","bootloader":"PyGrub","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":268435456,"maxRam":268435456,"arch":"x86_64","os":"Debian
> GNU/Linux 7(64-bit)","platformEmulator":"Debian Wheezy 7.0
> (64-bit)","bootArgs":" template=domP name=r-4-VM eth2ip=10.0.0.174
> eth2mask=255.255.255.0 gateway=10.0.0.1 eth0ip=10.1.1.1
> eth0mask=255.255.255.0 domain=cs2cloud.internal cidrsize=24
> dhcprange=10.1.1.1 eth1ip=169.254.0.43 eth1mask=255.255.0.0 type=router
> disable_rp_filter=true dns1=8.8.8.8
>
> baremetalnotificationsecuritykey=MD4bWVy5t0anMd4eq4UlKWj6cZTW4gFDMeDd0WR3H3BuAsrxVX28ShzvJgbd8RR5eMRZ7rNYAsaF9RPXAZoCrQ
>
> baremetalnotificationapikey=ZWNcizzJ0xXQE0Ubr6Sr_kN7xlMMMMtziuPTxHwZOyIN-Lo2f2CzvPhNw0o01LkNP3X4bp61YiZu0EWF-Mbfew
> host=10.0.0.170
>
> port=8080","enableHA":true,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"SlzaiXi9iLi3YpfQ7v3kZw","params":{},"uuid":"27157005-7e89-4251-89e4-2c53ff43bb70","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"9478a811-8b96-4cfa-b6bf-1e09c3fecd39","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
>
> 10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc
>
> "}},"name":"ROOT-4","size":3145728000,"path":"dcc1ce80-4cd5-4f59-b063-34e2a93ed99a","volumeId":5,"vmName":"r-4-VM","accountId":2,"format":"VHD","provisioningType":"THIN","id":5,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"dcc1ce80-4cd5-4f59-b063-34e2a93ed99a","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"10.0.0.170","volumeSize":"3145728000"}}],"nics":[{"deviceId":2,"networkRateMbps":200,"defaultNic":true,"pxeDisable":true,"nicUuid":"9fbc00ea-599c-4455-a416-8e66986d9454","uuid":"8872476c-2fd1-4ed3-bfb1-c62efe2b6eab","ip":"10.0.0.174","netmask":"255.255.255.0","gateway":"10.0.0.1","mac":"06:a0:8a:00:00:09","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"mgmt"},{"deviceId":0,"networkRateMbps":200,"defaultNic":false,"pxeDisable":true,"nicUuid":"f38511fa-d2e8-4935-9fc4-74b2eea7621b","uuid":"2e97fcee-3d01-40d2-a624-376661747d0c","ip":"10.1.1.1","netmask":"255.255.255.0","mac":"02:00:4d:27:00:02","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://500","isolationUri":"vlan://500","isSecurityGroupEnabled":false,"name":"mgmt"},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"pxeDisable":true,"nicUuid":"5c6cd3fa-fddb-4ee0-bff2-87e5c04f8d81","uuid":"914b3b0d-541c-4c63-b331-3377672a824d","ip":"169.254.0.43","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:00:2b","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.0.0.171","executeInSequence":false,"wait":0}},{"com.cloud.agent.api.check.CheckSshCommand":{"ip":"169.254.0.43","port":3922,"interval":6,"retries":100,"name":"r-4-VM","wait":0}},{"com.cloud.agent.api.GetDomRVersionCmd":{"accessDetails":{"
> router.name
>
> ":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}},{},{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Start","accessDetails":{"router.guest.ip":"10.1.1.1","
> router.name
>
> ":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}},{"com.cloud.agent.api.routing.IpAssocCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.0.0.174","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":true,"broadcastUri":"vlan://untagged","vlanGateway":"10.0.0.1","vlanNetmask":"255.255.255.0","vifMacAddress":"06:35:62:00:00:09","networkRate":200,"trafficType":"Public","networkName":"mgmt","newNic":false}],"accessDetails":{"zone.network.type":"Advanced","
> router.name
>
> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.SetMonitorServiceCommand":{"services":[{"id":0,"service":"dhcp","processname":"dnsmasq","serviceName":"dnsmasq","servicePath":"/var/run/dnsmasq/dnsmasq.pid","pidFile":"/var/run/dnsmasq/dnsmasq.pid","isDefault":false},{"id":0,"service":"loadbalancing","processname":"haproxy","serviceName":"haproxy","servicePath":"/var/run/haproxy.pid","pidFile":"/var/run/haproxy.pid","isDefault":false},{"id":0,"service":"ssh","processname":"sshd","serviceName":"ssh","servicePath":"/var/run/sshd.pid","pidFile":"/var/run/sshd.pid","isDefault":true},{"id":0,"service":"webserver","processname":"apache2","serviceName":"apache2","servicePath":"/var/run/apache2.pid","pidFile":"/var/run/apache2.pid","isDefault":true}],"accessDetails":{"
> router.name
>
> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Finish","accessDetails":{"router.guest.ip":"10.1.1.1","
> router.name":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}}] }
> 2015-11-26 20:21:58,256 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-69:ctx-a18e64d5) Seq 4-8612571337392652838: Executing request
> 2015-11-26 20:21:58,263 DEBUG [c.c.h.x.r.w.x.CitrixStartCommandWrapper]
> (DirectAgent-69:ctx-a18e64d5) 1. The VM r-4-VM is in Starting state.
> 2015-11-26 20:21:58,292 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-69:ctx-a18e64d5) Created VM
> 0d0fa28c-0513-b806-84fd-c528dfc1dbfb for r-4-VM
> 2015-11-26 20:21:58,298 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-69:ctx-a18e64d5) PV args are -- quiet
>
> console=hvc0%template=domP%name=r-4-VM%eth2ip=10.0.0.174%eth2mask=255.255.255.0%gateway=10.0.0.1%eth0ip=10.1.1.1%eth0mask=255.255.255.0%domain=cs2cloud.internal%cidrsize=24%dhcprange=10.1.1.1%eth1ip=169.254.0.43%eth1mask=255.255.0.0%type=router%disable_rp_filter=true%dns1=8.8.8.8%baremetalnotificationsecuritykey=MD4bWVy5t0anMd4eq4UlKWj6cZTW4gFDMeDd0WR3H3BuAsrxVX28ShzvJgbd8RR5eMRZ7rNYAsaF9RPXAZoCrQ%baremetalnotificationapikey=ZWNcizzJ0xXQE0Ubr6Sr_kN7xlMMMMtziuPTxHwZOyIN-Lo2f2CzvPhNw0o01LkNP3X4bp61YiZu0EWF-Mbfew%host=10.0.0.170%port=8080
> 2015-11-26 20:21:58,325 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-69:ctx-a18e64d5) VBD 11a8fbfd-fd97-18bc-1490-e088576f26e7
> created for com.cloud.agent.api.to.DiskTO@2578f349
> 2015-11-26 20:21:58,325 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-69:ctx-a18e64d5) Creating VIF for r-4-VM on nic
> [Nic:Public-10.0.0.174-vlan://untagged]
> 2015-11-26 20:21:58,327 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-69:ctx-a18e64d5) Looking for network named mgmt
> 2015-11-26 20:21:58,334 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-69:ctx-a18e64d5) Created a vif
> b7ad658b-483c-a442-cb04-02b2a54bfbc8 on 2
> 2015-11-26 20:21:58,334 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-69:ctx-a18e64d5) Creating VIF for r-4-VM on nic
> [Nic:Guest-10.1.1.1-vlan://500]
> 2015-11-26 20:21:58,335 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-69:ctx-a18e64d5) Looking for network named mgmt
> 2015-11-26 20:21:58,341 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-69:ctx-a18e64d5) Couldn't find vlan network with the new name
> so trying old name: VLAN500
> 2015-11-26 20:21:58,342 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-69:ctx-a18e64d5) Creating VLAN network for 500 on host
> 10.0.0.171
> 2015-11-26 20:21:58,349 DEBUG [c.c.h.x.r.XsLocalNetwork]
> (DirectAgent-69:ctx-a18e64d5) Found a network called mgmt on
> host=10.0.0.171; Network=1a561762-42f8-4907-9cc2-c90e69fc3a4d;
> pif=ebede886-b90c-4605-dcef-5b24824b154b
> 2015-11-26 20:21:58,352 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-69:ctx-a18e64d5) Creating VLAN 500 on host 10.0.0.171 on
> device eth0
> 2015-11-26 20:21:58,664 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-69:ctx-a18e64d5) VLAN is created for 500. The uuid is
> 4cf68d23-f831-273a-27a6-7639dadf3d04
> 2015-11-26 20:21:58,669 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-69:ctx-a18e64d5) Created a vif
> c21979e3-f425-6c92-24cb-356cfbdd3320 on 0
> 2015-11-26 20:21:58,669 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-69:ctx-a18e64d5) Creating VIF for r-4-VM on nic
> [Nic:Control-169.254.0.43-null]
> 2015-11-26 20:21:58,683 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-69:ctx-a18e64d5) already have a vif on dom0 for link local
> network
> 2015-11-26 20:21:58,787 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-69:ctx-a18e64d5) Created a vif
> 990f4458-ecb6-434f-2930-73b1e6d42e8c on 1
> 2015-11-26 20:21:59,092 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-13:ctx-2798b9c4) ===START=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549584411
> 2015-11-26 20:21:59,103 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-13:ctx-2798b9c4 ctx-c2ce3a57) ===END=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549584411
> 2015-11-26 20:22:02,111 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-14:ctx-38676bd6) ===START=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549587414
> 2015-11-26 20:22:02,124 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-14:ctx-38676bd6 ctx-947b14ea) ===END=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549587414
> 2015-11-26 20:22:02,803 DEBUG [c.c.h.x.r.w.x.CitrixStartCommandWrapper]
> (DirectAgent-69:ctx-a18e64d5) 2. The VM r-4-VM is in Running state.
> 2015-11-26 20:22:02,807 DEBUG [c.c.h.x.r.w.x.CitrixCheckSshCommandWrapper]
> (DirectAgent-69:ctx-a18e64d5) Ping command port, 169.254.0.43:3922
> 2015-11-26 20:22:02,809 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-69:ctx-a18e64d5) Trying to connect to 169.254.0.43 attempt 0
> of 100
> 2015-11-26 20:22:04,361 DEBUG [o.a.c.s.SecondaryStorageManagerImpl]
> (secstorage-1:ctx-2215d989) Zone 3 is ready to launch secondary storage VM
> 2015-11-26 20:22:04,681 DEBUG [c.c.c.ConsoleProxyManagerImpl]
> (consoleproxy-1:ctx-2ce987bc) Zone 3 is ready to launch console proxy
> 2015-11-26 20:22:05,104 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-15:ctx-4fa06d24) ===START=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549590422
> 2015-11-26 20:22:05,116 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-15:ctx-4fa06d24 ctx-19dff864) ===END=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549590422
> 2015-11-26 20:22:06,962 DEBUG [c.c.a.m.AgentManagerImpl]
> (AgentManager-Handler-14:null) SeqA 5-1783: Processing Seq 5-1783: { Cmd ,
> MgmtId: -1, via: 5, Ver: v1, Flags: 11,
>
> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
> \"connections\": []\n}","wait":0}}] }
> 2015-11-26 20:22:06,968 DEBUG [c.c.a.m.AgentManagerImpl]
> (AgentManager-Handler-14:null) SeqA 5-1783: Sending Seq 5-1783: { Ans: ,
> MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
> 2015-11-26 20:22:08,018 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> (AsyncJobMgr-Heartbeat-1:ctx-5e29ee49) Begin cleanup expired async-jobs
> 2015-11-26 20:22:08,022 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> (AsyncJobMgr-Heartbeat-1:ctx-5e29ee49) End cleanup expired async-jobs
> 2015-11-26 20:22:08,103 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-17:ctx-9917fe4e) ===START=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549593422
> 2015-11-26 20:22:08,114 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-17:ctx-9917fe4e ctx-bfd32cd5) ===END=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549593422
> 2015-11-26 20:22:11,103 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-12:ctx-88343d26) ===START=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549596422
> 2015-11-26 20:22:11,113 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-12:ctx-88343d26 ctx-6f3d43d4) ===END=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549596422
> 2015-11-26 20:22:14,215 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-16:ctx-725778e3) ===START=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549599535
> 2015-11-26 20:22:14,234 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-16:ctx-725778e3 ctx-dd88dc8f) ===END=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549599535
> 2015-11-26 20:22:15,885 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-69:ctx-a18e64d5) Trying to connect to 169.254.0.43 attempt 1
> of 100
> 2015-11-26 20:22:16,964 DEBUG [c.c.a.m.AgentManagerImpl]
> (AgentManager-Handler-3:null) SeqA 5-1784: Processing Seq 5-1784: { Cmd ,
> MgmtId: -1, via: 5, Ver: v1, Flags: 11,
>
> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
> \"connections\": []\n}","wait":0}}] }
> 2015-11-26 20:22:16,967 DEBUG [c.c.a.m.AgentManagerImpl]
> (AgentManager-Handler-3:null) SeqA 5-1784: Sending Seq 5-1784: { Ans: ,
> MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
> 2015-11-26 20:22:17,215 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-18:ctx-60f98a31) ===START=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549602535
> 2015-11-26 20:22:17,225 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-18:ctx-60f98a31 ctx-d1134f47) ===END=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549602535
> 2015-11-26 20:22:17,995 DEBUG [c.c.s.StatsCollector]
> (StatsCollector-3:ctx-98795072) StorageCollector is running...
> 2015-11-26 20:22:18,018 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> (AsyncJobMgr-Heartbeat-1:ctx-d66f35e7) Begin cleanup expired async-jobs
> 2015-11-26 20:22:18,020 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> (AsyncJobMgr-Heartbeat-1:ctx-d66f35e7) End cleanup expired async-jobs
> 2015-11-26 20:22:18,050 DEBUG [c.c.a.t.Request]
> (StatsCollector-3:ctx-98795072) Seq 6-2074470578357534957: Received: {
> Ans: , MgmtId: 52229922654, via: 6(s-2-VM), Ver: v1, Flags: 10, {
> GetStorageStatsAnswer } }
> 2015-11-26 20:22:18,051 DEBUG [c.c.h.XenServerGuru]
> (StatsCollector-3:ctx-98795072) getCommandHostDelegation: class
> com.cloud.agent.api.GetStorageStatsCommand
> 2015-11-26 20:22:18,052 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-275:ctx-69cd6660) Seq 4-8612571337392652839: Executing request
> 2015-11-26 20:22:18,210 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (RouterStatusMonitor-1:ctx-e533ad2d) Found 1 routers to update status.
> 2015-11-26 20:22:18,212 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (RouterStatusMonitor-1:ctx-e533ad2d) Found 0 VPC networks to update
> Redundant State.
> 2015-11-26 20:22:18,213 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (RouterStatusMonitor-1:ctx-e533ad2d) Found 0 networks to update RvR status.
> 2015-11-26 20:22:18,223 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (RouterStatusMonitor-1:ctx-ce59a463) Found 1 routers to update status.
> 2015-11-26 20:22:18,224 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (RouterStatusMonitor-1:ctx-ce59a463) Found 0 VPC networks to update
> Redundant State.
> 2015-11-26 20:22:18,225 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (RouterStatusMonitor-1:ctx-ce59a463) Found 0 networks to update RvR status.
> 2015-11-26 20:22:18,378 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-275:ctx-69cd6660) Seq 4-8612571337392652839: Response
> Received:
> 2015-11-26 20:22:18,379 DEBUG [c.c.a.t.Request]
> (StatsCollector-3:ctx-98795072) Seq 4-8612571337392652839: Received: {
> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10, {
> GetStorageStatsAnswer } }
> 2015-11-26 20:22:20,215 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-22:ctx-c6c73f9b) ===START=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549605535
> 2015-11-26 20:22:20,225 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-22:ctx-c6c73f9b ctx-135e3cc8) ===END=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549605535
> 2015-11-26 20:22:21,593 DEBUG [c.c.a.m.AgentManagerImpl]
> (AgentManager-Handler-2:null) Ping from 6
> 2015-11-26 20:22:21,679 DEBUG [c.c.a.m.AgentManagerImpl]
> (AgentManager-Handler-5:null) Ping from 5
> 2015-11-26 20:22:23,216 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-19:ctx-db19c3ed) ===START=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549608535
> 2015-11-26 20:22:23,227 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-19:ctx-db19c3ed ctx-846db858) ===END=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549608535
> 2015-11-26 20:22:24,782 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgentCronJob-79:ctx-8c839142) Ping from 4(xenserver)
> 2015-11-26 20:22:24,782 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> (DirectAgentCronJob-79:ctx-8c839142) Process host VM state report from ping
> process. host: 4
> 2015-11-26 20:22:24,785 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> (DirectAgentCronJob-79:ctx-8c839142) Process VM state report. host: 4,
> number of records in report: 3
> 2015-11-26 20:22:24,785 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> (DirectAgentCronJob-79:ctx-8c839142) VM state report. host: 4, vm id: 1,
> power state: PowerOn
> 2015-11-26 20:22:24,786 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> (DirectAgentCronJob-79:ctx-8c839142) VM power state does not change, skip
> DB writing. vm id: 1
> 2015-11-26 20:22:24,786 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> (DirectAgentCronJob-79:ctx-8c839142) VM state report. host: 4, vm id: 2,
> power state: PowerOn
> 2015-11-26 20:22:24,787 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> (DirectAgentCronJob-79:ctx-8c839142) VM power state does not change, skip
> DB writing. vm id: 2
> 2015-11-26 20:22:24,787 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> (DirectAgentCronJob-79:ctx-8c839142) VM state report. host: 4, vm id: 4,
> power state: PowerOn
> 2015-11-26 20:22:24,788 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> (DirectAgentCronJob-79:ctx-8c839142) VM power state does not change, skip
> DB writing. vm id: 4
> 2015-11-26 20:22:24,790 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> (DirectAgentCronJob-79:ctx-8c839142) Run missing VM report. current time:
> 1448549544790
> 2015-11-26 20:22:24,791 WARN [c.c.v.VirtualMachinePowerStateSyncImpl]
> (DirectAgentCronJob-79:ctx-8c839142) VM state was updated but update time
> is null?! vm id: 5
> 2015-11-26 20:22:24,794 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> (DirectAgentCronJob-79:ctx-8c839142) Detected missing VM. host: 4, vm id:
> 5, power state: PowerReportMissing, last state update: 1448549544790
> 2015-11-26 20:22:24,794 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> (DirectAgentCronJob-79:ctx-8c839142) vm id: 5 - time since last state
> update(0ms) has not passed graceful period yet
> 2015-11-26 20:22:24,794 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
> (DirectAgentCronJob-79:ctx-8c839142) Done with process of VM state report.
> host: 4
> 2015-11-26 20:22:25,994 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-69:ctx-a18e64d5) Trying to connect to 169.254.0.43 attempt 2
> of 100
> 2015-11-26 20:22:26,110 DEBUG [c.c.h.x.r.w.x.CitrixCheckSshCommandWrapper]
> (DirectAgent-69:ctx-a18e64d5) Ping command port succeeded for vm r-4-VM
> 2015-11-26 20:22:26,111 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-69:ctx-a18e64d5) Executing command in VR:
> /opt/cloud/bin/router_proxy.sh get_template_version.sh 169.254.0.43 null
> 2015-11-26 20:22:26,246 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-20:ctx-06bd0169) ===START=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549611535
> 2015-11-26 20:22:26,271 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-20:ctx-06bd0169 ctx-3118df18) ===END=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549611535
> 2015-11-26 20:22:26,389 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-69:ctx-a18e64d5) Executing command in VR:
> /opt/cloud/bin/router_proxy.sh netusage.sh 169.254.0.43 -c
> 2015-11-26 20:22:26,677 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-69:ctx-a18e64d5) Looking for network named mgmt
> 2015-11-26 20:22:26,692 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> (DirectAgent-69:ctx-a18e64d5) Transforming
> com.cloud.agent.api.routing.IpAssocCommand to ConfigItems
> 2015-11-26 20:22:26,692 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> (DirectAgent-69:ctx-a18e64d5) Transforming
> com.cloud.agent.api.routing.SetMonitorServiceCommand to ConfigItems
> 2015-11-26 20:22:26,695 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-69:ctx-a18e64d5) Copying VR with ip 169.254.0.43 config file
> into host 10.0.0.171
> 2015-11-26 20:22:26,964 DEBUG [c.c.a.m.AgentManagerImpl]
> (AgentManager-Handler-6:null) SeqA 5-1786: Processing Seq 5-1786: { Cmd ,
> MgmtId: -1, via: 5, Ver: v1, Flags: 11,
>
> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
> \"connections\": []\n}","wait":0}}] }
> 2015-11-26 20:22:26,966 DEBUG [c.c.a.m.AgentManagerImpl]
> (AgentManager-Handler-6:null) SeqA 5-1786: Sending Seq 5-1786: { Ans: ,
> MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
> 2015-11-26 20:22:27,075 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-69:ctx-a18e64d5) VR Config file
> VR-d0244a1d-2334-4771-868b-2910b7a8c359.cfg got created in VR, ip
> 169.254.0.43 with content
> #Apache CloudStack Virtual Router Config File
> <version>
> 1.0
> </version>
> <file>
> /var/cache/cloud/ip_associations.json
>
> {"ip_address":[{"public_ip":"10.0.0.174","source_nat":true,"add":true,"one_to_one_nat":false,"first_i_p":true,"gateway":"10.0.0.1","netmask":"255.255.255.0","vif_mac_address":"06:35:62:00:00:09","nic_dev_id":2,"new_nic":false}],"type":"ips"}
> </file>
> <script>
> /opt/cloud/bin/update_config.py ip_associations.json
> </script>
> <file>
> /var/cache/cloud/monitor_service.json
>
> {"config":"[dhcp]:processname=dnsmasq:servicename=dnsmasq:pidfile=/var/run/dnsmasq/dnsmasq.pid:,[loadbalancing]:processname=haproxy:servicename=haproxy:pidfile=/var/run/haproxy.pid:,[ssh]:processname=sshd:servicename=ssh:pidfile=/var/run/sshd.pid:,[webserver]:processname=apache2:servicename=apache2:pidfile=/var/run/apache2.pid:,","type":"monitorservice"}
> </file>
> <script>
> /opt/cloud/bin/update_config.py monitor_service.json
> </script>
>
> 2015-11-26 20:22:27,075 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-69:ctx-a18e64d5) Executing command in VR:
> /opt/cloud/bin/router_proxy.sh vr_cfg.sh 169.254.0.43 -c
> /var/cache/cloud/VR-d0244a1d-2334-4771-868b-2910b7a8c359.cfg
> 2015-11-26 20:22:28,018 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> (AsyncJobMgr-Heartbeat-1:ctx-ed233495) Begin cleanup expired async-jobs
> 2015-11-26 20:22:28,021 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> (AsyncJobMgr-Heartbeat-1:ctx-ed233495) End cleanup expired async-jobs
> 2015-11-26 20:22:29,218 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-21:ctx-1da30083) ===START=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549614535
> 2015-11-26 20:22:29,235 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-21:ctx-1da30083 ctx-605fe303) ===END=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549614535
> 2015-11-26 20:22:32,250 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-7:ctx-63ad70cb) ===START=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549617569
> 2015-11-26 20:22:32,277 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-7:ctx-63ad70cb ctx-3f0ef7d5) ===END=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549617569
> 2015-11-26 20:22:32,387 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-69:ctx-a18e64d5) Seq 4-8612571337392652838: Response Received:
> 2015-11-26 20:22:32,388 DEBUG [c.c.a.t.Request]
> (DirectAgent-69:ctx-a18e64d5) Seq 4-8612571337392652838: Processing: {
> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
>
> [{"com.cloud.agent.api.StartAnswer":{"vm":{"id":4,"name":"r-4-VM","bootloader":"PyGrub","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":268435456,"maxRam":268435456,"arch":"x86_64","os":"Debian
> GNU/Linux 7(64-bit)","platformEmulator":"Debian Wheezy 7.0
> (64-bit)","bootArgs":" template=domP name=r-4-VM eth2ip=10.0.0.174
> eth2mask=255.255.255.0 gateway=10.0.0.1 eth0ip=10.1.1.1
> eth0mask=255.255.255.0 domain=cs2cloud.internal cidrsize=24
> dhcprange=10.1.1.1 eth1ip=169.254.0.43 eth1mask=255.255.0.0 type=router
> disable_rp_filter=true dns1=8.8.8.8
>
> baremetalnotificationsecuritykey=MD4bWVy5t0anMd4eq4UlKWj6cZTW4gFDMeDd0WR3H3BuAsrxVX28ShzvJgbd8RR5eMRZ7rNYAsaF9RPXAZoCrQ
>
> baremetalnotificationapikey=ZWNcizzJ0xXQE0Ubr6Sr_kN7xlMMMMtziuPTxHwZOyIN-Lo2f2CzvPhNw0o01LkNP3X4bp61YiZu0EWF-Mbfew
> host=10.0.0.170
>
> port=8080","enableHA":true,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"SlzaiXi9iLi3YpfQ7v3kZw","params":{},"uuid":"27157005-7e89-4251-89e4-2c53ff43bb70","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"9478a811-8b96-4cfa-b6bf-1e09c3fecd39","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
>
> 10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc
> "}},"name":"ROOT-4","size":3145728000,"path":"dcc1ce80-4cd5-4f59-b063-34e2a93ed99a","volumeId":5,"vmName":"r-4-VM","accountId":2,"format":"VHD","provisioningType":"THIN","id":5,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"dcc1ce80-4cd5-4f59-b063-34e2a93ed99a","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"10.0.0.170","volumeSize":"3145728000"}}],"nics":[{"deviceId":2,"networkRateMbps":200,"defaultNic":true,"pxeDisable":true,"nicUuid":"9fbc00ea-599c-4455-a416-8e66986d9454","uuid":"8872476c-2fd1-4ed3-bfb1-c62efe2b6eab","ip":"10.0.0.174","netmask":"255.255.255.0","gateway":"10.0.0.1","mac":"06:a0:8a:00:00:09","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"mgmt"},{"deviceId":0,"networkRateMbps":200,"defaultNic":false,"pxeDisable":true,"nicUuid":"f38511fa-d2e8-4935-9fc4-74b2eea7621b","uuid":"2e97fcee-3d01-40d2-a624-376661747d0c","ip":"10.1.1.1","netmask":"255.255.255.0","mac":"02:00:4d:27:00:02","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://500","isolationUri":"vlan://500","isSecurityGroupEnabled":false,"name":"mgmt"},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"pxeDisable":true,"nicUuid":"5c6cd3fa-fddb-4ee0-bff2-87e5c04f8d81","uuid":"914b3b0d-541c-4c63-b331-3377672a824d","ip":"169.254.0.43","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:00:2b","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"_iqnToPath":{},"result":true,"wait":0}},{"com.cloud.agent.api.check.CheckSshAnswer":{"result":true,"wait":0}},{"com.cloud.agent.api.GetDomRVersionAnswer":{"templateVersion":"Cloudstack
> Release 4.6.0 Mon Nov 9 11:21:06 UTC
>
> 2015","scriptsVersion":"4042f3d5b3337372cf94955f2ae8a149\n","result":true,"details":"Cloudstack
> Release 4.6.0 Mon Nov 9 11:21:06 UTC
>
> 2015&4042f3d5b3337372cf94955f2ae8a149\n","wait":0}},{"com.cloud.agent.api.NetworkUsageAnswer":{"routerName":"r-4-VM","bytesSent":0,"bytesReceived":0,"result":true,"details":"","wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"details":"Command
> aggregation
>
> started","wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"details":"Command
> aggregation finished","wait":0}}] }
> 2015-11-26 20:22:32,389 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> 4-8612571337392652838: Received: { Ans: , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 10, { StartAnswer, CheckSshAnswer,
> GetDomRVersionAnswer, NetworkUsageAnswer, Answer, Answer, Answer, Answer }
> }
> 2015-11-26 20:22:32,405 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM state
> transitted from :Starting to Running with event: OperationSucceededvm's
> original host id: 4 new host id: 4 host id before state transition: 4
> 2015-11-26 20:22:32,408 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Start
> completed for VM VM[DomainRouter|r-4-VM]
> 2015-11-26 20:22:32,412 DEBUG [c.c.n.NetworkModelImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
> SecurityGroup is not supported in the network id=212
> 2015-11-26 20:22:32,417 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> 4-8612571337392652840: Sending { Cmd , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 100011,
>
> [{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Start","accessDetails":{"router.guest.ip":"10.1.1.1","
> router.name":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}}] }
> 2015-11-26 20:22:32,418 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> 4-8612571337392652840: Executing: { Cmd , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 100011,
>
> [{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Start","accessDetails":{"router.guest.ip":"10.1.1.1","
> router.name":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}}] }
> 2015-11-26 20:22:32,418 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-138:ctx-d5c945c8) Seq 4-8612571337392652840: Executing request
> 2015-11-26 20:22:32,418 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-138:ctx-d5c945c8) Seq 4-8612571337392652840: Response
> Received:
> 2015-11-26 20:22:32,418 DEBUG [c.c.a.t.Request]
> (DirectAgent-138:ctx-d5c945c8) Seq 4-8612571337392652840: Processing: {
> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.Answer":{"result":true,"details":"Command
> aggregation started","wait":0}}] }
> 2015-11-26 20:22:32,418 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> 4-8612571337392652840: Received: { Ans: , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 10, { Answer } }
> 2015-11-26 20:22:32,418 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reprogramming
> network Ntwk[212|Guest|8] as a part of network implement
> 2015-11-26 20:22:32,419 DEBUG [c.c.n.f.FirewallManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) applying
> default firewall egress rules
> 2015-11-26 20:22:32,425 DEBUG [o.a.c.n.t.BasicNetworkTopology]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) APPLYING
> FIREWALL RULES
> 2015-11-26 20:22:32,425 DEBUG [o.a.c.n.t.BasicNetworkTopology]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Applying
> firewall rules in network Ntwk[212|Guest|8]
> 2015-11-26 20:22:32,430 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> 4-8612571337392652841: Sending { Cmd , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 100001,
>
> [{"com.cloud.agent.api.routing.SetFirewallRulesCommand":{"rules":[{"id":0,"srcIp":"","protocol":"all","revoked":false,"alreadyAdded":false,"sourceCidrList":[],"purpose":"Firewall","trafficType":"Egress","defaultEgressPolicy":false}],"accessDetails":{"router.guest.ip":"10.1.1.1","firewall.egress.default":"System","zone.network.type":"Advanced","router.ip":"169.254.0.43","
> router.name":"r-4-VM"},"wait":0}}] }
> 2015-11-26 20:22:32,430 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> 4-8612571337392652841: Executing: { Cmd , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 100001,
>
> [{"com.cloud.agent.api.routing.SetFirewallRulesCommand":{"rules":[{"id":0,"srcIp":"","protocol":"all","revoked":false,"alreadyAdded":false,"sourceCidrList":[],"purpose":"Firewall","trafficType":"Egress","defaultEgressPolicy":false}],"accessDetails":{"router.guest.ip":"10.1.1.1","firewall.egress.default":"System","zone.network.type":"Advanced","router.ip":"169.254.0.43","
> router.name":"r-4-VM"},"wait":0}}] }
> 2015-11-26 20:22:32,430 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-276:ctx-9bb810d3) Seq 4-8612571337392652841: Executing request
> 2015-11-26 20:22:32,430 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-276:ctx-9bb810d3) Seq 4-8612571337392652841: Response
> Received:
> 2015-11-26 20:22:32,430 DEBUG [c.c.a.t.Request]
> (DirectAgent-276:ctx-9bb810d3) Seq 4-8612571337392652841: Processing: {
> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 0,
> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
> 2015-11-26 20:22:32,430 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> 4-8612571337392652841: Received: { Ans: , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 0, { Answer } }
> 2015-11-26 20:22:32,432 DEBUG [c.c.n.f.FirewallManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are no
> firewall rules to apply
> 2015-11-26 20:22:32,432 DEBUG [c.c.n.r.RulesManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are no
> static nat to apply for network id=212
> 2015-11-26 20:22:32,432 DEBUG [c.c.n.f.FirewallManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are no
> firewall rules to apply
> 2015-11-26 20:22:32,433 DEBUG [c.c.n.r.RulesManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are no
> port forwarding rules to apply for network id=212
> 2015-11-26 20:22:32,433 DEBUG [c.c.n.r.RulesManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are no
> static nat rules to apply for network id=212
> 2015-11-26 20:22:32,433 DEBUG [c.c.n.l.LoadBalancingRulesManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Applying load
> balancer rules of scheme Public in network id=212
> 2015-11-26 20:22:32,434 DEBUG [c.c.n.l.LoadBalancingRulesManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are no
> Load Balancing Rules to forward to the network elements
> 2015-11-26 20:22:32,434 DEBUG [c.c.n.l.LoadBalancingRulesManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Applying load
> balancer rules of scheme Internal in network id=212
> 2015-11-26 20:22:32,434 DEBUG [c.c.n.l.LoadBalancingRulesManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are no
> Load Balancing Rules to forward to the network elements
> 2015-11-26 20:22:32,435 DEBUG [c.c.n.NetworkModelImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
> SecurityGroup is not supported in the network id=212
> 2015-11-26 20:22:32,439 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> 4-8612571337392652842: Sending { Cmd , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 100011,
>
> [{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Finish","accessDetails":{"router.guest.ip":"10.1.1.1","
> router.name":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}}] }
> 2015-11-26 20:22:32,439 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> 4-8612571337392652842: Executing: { Cmd , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 100011,
>
> [{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Finish","accessDetails":{"router.guest.ip":"10.1.1.1","
> router.name":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}}] }
> 2015-11-26 20:22:32,439 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-70:ctx-436aff22) Seq 4-8612571337392652842: Executing request
> 2015-11-26 20:22:32,439 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> (DirectAgent-70:ctx-436aff22) Transforming
> com.cloud.agent.api.routing.SetFirewallRulesCommand to ConfigItems
> 2015-11-26 20:22:32,445 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-70:ctx-436aff22) Copying VR with ip 169.254.0.43 config file
> into host 10.0.0.171
> 2015-11-26 20:22:32,848 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-70:ctx-436aff22) VR Config file
> VR-a8dcb409-d150-4d21-b2c7-53b76dccedb3.cfg got created in VR, ip
> 169.254.0.43 with content
> #Apache CloudStack Virtual Router Config File
> <version>
> 1.0
> </version>
> <file>
> /var/cache/cloud/firewall_rules.json
>
> {"rules":[{"id":0,"src_ip":"","protocol":"all","revoked":false,"already_added":false,"source_cidr_list":[],"purpose":"Firewall","traffic_type":"Egress","default_egress_policy":false}],"type":"firewallrules"}
> </file>
> <script>
> /opt/cloud/bin/update_config.py firewall_rules.json
> </script>
>
> 2015-11-26 20:22:32,849 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-70:ctx-436aff22) Executing command in VR:
> /opt/cloud/bin/router_proxy.sh vr_cfg.sh 169.254.0.43 -c
> /var/cache/cloud/VR-a8dcb409-d150-4d21-b2c7-53b76dccedb3.cfg
> 2015-11-26 20:22:33,458 DEBUG [c.c.s.StatsCollector]
> (StatsCollector-4:ctx-f3f3d8c7) AutoScaling Monitor is running...
> 2015-11-26 20:22:33,734 DEBUG [c.c.s.StatsCollector]
> (StatsCollector-2:ctx-bc3ff1c1) VmStatsCollector is running...
> 2015-11-26 20:22:34,354 DEBUG [o.a.c.s.SecondaryStorageManagerImpl]
> (secstorage-1:ctx-7f9c4728) Zone 3 is ready to launch secondary storage VM
> 2015-11-26 20:22:34,681 DEBUG [c.c.c.ConsoleProxyManagerImpl]
> (consoleproxy-1:ctx-7ffdffac) Zone 3 is ready to launch console proxy
> 2015-11-26 20:22:35,261 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-23:ctx-032600be) ===START=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549620578
> 2015-11-26 20:22:35,273 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-23:ctx-032600be ctx-30e2f925) ===END=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549620578
> 2015-11-26 20:22:35,601 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-70:ctx-436aff22) Seq 4-8612571337392652842: Response Received:
> 2015-11-26 20:22:35,601 DEBUG [c.c.a.t.Request]
> (DirectAgent-70:ctx-436aff22) Seq 4-8612571337392652842: Processing: {
> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.Answer":{"result":true,"details":"Command
> aggregation finished","wait":0}}] }
> 2015-11-26 20:22:35,601 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> 4-8612571337392652842: Received: { Ans: , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 10, { Answer } }
> 2015-11-26 20:22:35,609 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Lock is
> released for network id 212 as a part of network implement
> 2015-11-26 20:22:35,616 DEBUG [c.c.n.NetworkModelImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
> SecurityGroup is not supported in the network id=212
> 2015-11-26 20:22:35,618 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Changing
> active number of nics for network id=212 on 1
> 2015-11-26 20:22:35,621 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Asking
> VirtualRouter to prepare for
> Nic[11-5-2a4a184a-eac9-4609-8a70-4d230ee3a37d-10.1.1.88]
> 2015-11-26 20:22:35,630 DEBUG [c.c.n.NetworkModelImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
> SecurityGroup is not supported in the network id=212
> 2015-11-26 20:22:35,631 DEBUG [o.a.c.n.t.BasicNetworkTopology]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) CONFIG DHCP
> FOR SUBNETS RULES
> 2015-11-26 20:22:35,636 DEBUG [c.c.n.NetworkModelImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
> SecurityGroup is not supported in the network id=212
> 2015-11-26 20:22:35,637 DEBUG [o.a.c.n.t.AdvancedNetworkTopology]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) APPLYING VPC
> DHCP ENTRY RULES
> 2015-11-26 20:22:35,637 DEBUG [o.a.c.n.t.BasicNetworkTopology]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Applying dhcp
> entry in network Ntwk[212|Guest|8]
> 2015-11-26 20:22:35,665 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> 4-8612571337392652843: Sending { Cmd , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 100011,
>
> [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:71:ff:00:03","vmIpAddress":"10.1.1.88","vmName":"Test002","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:71:ff:00:03","isDefault":true,"executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","router.guest.ip":"10.1.1.1","router.ip":"169.254.0.43","
> router.name":"r-4-VM"},"wait":0}}] }
> 2015-11-26 20:22:35,667 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> 4-8612571337392652843: Executing: { Cmd , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 100011,
>
> [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:71:ff:00:03","vmIpAddress":"10.1.1.88","vmName":"Test002","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:71:ff:00:03","isDefault":true,"executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","router.guest.ip":"10.1.1.1","router.ip":"169.254.0.43","
> router.name":"r-4-VM"},"wait":0}}] }
> 2015-11-26 20:22:35,667 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-277:ctx-490bf746) Seq 4-8612571337392652843: Executing request
> 2015-11-26 20:22:35,667 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> (DirectAgent-277:ctx-490bf746) Transforming
> com.cloud.agent.api.routing.DhcpEntryCommand to ConfigItems
> 2015-11-26 20:22:35,672 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-277:ctx-490bf746) Copying VR with ip 169.254.0.43 config file
> into host 10.0.0.171
> 2015-11-26 20:22:36,054 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-277:ctx-490bf746) VR Config file vm_dhcp_entry.json got
> created in VR, ip 169.254.0.43 with content
>
> {"host_name":"Test002","mac_address":"02:00:71:ff:00:03","ipv4_adress":"10.1.1.88","ipv6_duid":"00:03:00:01:02:00:71:ff:00:03","dns_adresses":"10.1.1.1","default_gateway":"10.1.1.1","default_entry":true,"type":"dhcpentry"}
> 2015-11-26 20:22:36,054 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> (DirectAgent-277:ctx-490bf746) Processing FileConfigItem, copying 222
> characters to vm_dhcp_entry.json took 387ms
> 2015-11-26 20:22:36,054 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-277:ctx-490bf746) Executing command in VR:
> /opt/cloud/bin/router_proxy.sh update_config.py 169.254.0.43
> vm_dhcp_entry.json
> 2015-11-26 20:22:36,965 DEBUG [c.c.a.m.AgentManagerImpl]
> (AgentManager-Handler-9:null) SeqA 5-1787: Processing Seq 5-1787: { Cmd ,
> MgmtId: -1, via: 5, Ver: v1, Flags: 11,
>
> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
> \"connections\": []\n}","wait":0}}] }
> 2015-11-26 20:22:36,969 DEBUG [c.c.a.m.AgentManagerImpl]
> (AgentManager-Handler-9:null) SeqA 5-1787: Sending Seq 5-1787: { Ans: ,
> MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
> 2015-11-26 20:22:38,021 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> (AsyncJobMgr-Heartbeat-1:ctx-a7e1fd79) Begin cleanup expired async-jobs
> 2015-11-26 20:22:38,023 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> (AsyncJobMgr-Heartbeat-1:ctx-a7e1fd79) End cleanup expired async-jobs
> 2015-11-26 20:22:38,275 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-6:ctx-d344515b) ===START=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549623593
> 2015-11-26 20:22:38,288 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-6:ctx-d344515b ctx-ff44d35a) ===END=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549623593
> 2015-11-26 20:22:38,760 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> (DirectAgent-277:ctx-490bf746) Processing ScriptConfigItem, executing
> update_config.py vm_dhcp_entry.json took 2706ms
> 2015-11-26 20:22:38,760 WARN [c.c.a.r.v.VirtualRoutingResource]
> (DirectAgent-277:ctx-490bf746) Expected 1 answers while executing
> DhcpEntryCommand but received 2
> 2015-11-26 20:22:38,760 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-277:ctx-490bf746) Seq 4-8612571337392652843: Response
> Received:
> 2015-11-26 20:22:38,760 DEBUG [c.c.a.t.Request]
> (DirectAgent-277:ctx-490bf746) Seq 4-8612571337392652843: Processing: {
> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null - success:
> ","null - success: RTNETLINK answers: File exists\nRTNETLINK answers: File
> exists\nRTNETLINK answers: File exists\n[INFO] update_config.py ::
> Processing incoming file => vm_dhcp_entry.json\n[INFO] Processing JSON file
> vm_dhcp_entry.json\nTest01 Test002\n"],"result":true,"wait":0}}] }
> 2015-11-26 20:22:38,760 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> 4-8612571337392652843: Received: { Ans: , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 10, { GroupAnswer } }
> 2015-11-26 20:22:38,766 DEBUG [c.c.n.NetworkModelImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
> SecurityGroup is not supported in the network id=212
> 2015-11-26 20:22:38,768 DEBUG [o.a.c.n.t.AdvancedNetworkTopology]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) APPLYING VPC
> USERDATA RULES
> 2015-11-26 20:22:38,768 DEBUG [o.a.c.n.t.BasicNetworkTopology]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Applying
> userdata and password entry in network Ntwk[212|Guest|8]
> 2015-11-26 20:22:38,778 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> 4-8612571337392652844: Sending { Cmd , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 100011,
>
> [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
> router.name
>
> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
> router.name
> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}}]
> }
> 2015-11-26 20:22:38,779 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> 4-8612571337392652844: Executing: { Cmd , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 100011,
>
> [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
> router.name
>
> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
> router.name
> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}}]
> }
> 2015-11-26 20:22:38,779 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-139:ctx-69673506) Seq 4-8612571337392652844: Executing request
> 2015-11-26 20:22:38,779 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> (DirectAgent-139:ctx-69673506) Transforming
> com.cloud.agent.api.routing.SavePasswordCommand to ConfigItems
> 2015-11-26 20:22:38,787 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-139:ctx-69673506) Copying VR with ip 169.254.0.43 config file
> into host 10.0.0.171
> 2015-11-26 20:22:39,199 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-139:ctx-69673506) VR Config file vm_password.json got created
> in VR, ip 169.254.0.43 with content
> {"ip_address":"10.1.1.88","password":"saved_password","type":"vmpassword"}
> 2015-11-26 20:22:39,199 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> (DirectAgent-139:ctx-69673506) Processing FileConfigItem, copying 74
> characters to vm_password.json took 420ms
> 2015-11-26 20:22:39,199 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-139:ctx-69673506) Executing command in VR:
> /opt/cloud/bin/router_proxy.sh update_config.py 169.254.0.43
> vm_password.json
> 2015-11-26 20:22:40,237 DEBUG [c.c.s.StatsCollector]
> (StatsCollector-1:ctx-32277352) HostStatsCollector is running...
> 2015-11-26 20:22:40,245 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-278:ctx-dc01444e) Seq 4-8612571337392652845: Executing request
> 2015-11-26 20:22:40,260 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-278:ctx-dc01444e) Seq 4-8612571337392652845: Response
> Received:
> 2015-11-26 20:22:40,260 DEBUG [c.c.a.t.Request]
> (StatsCollector-1:ctx-32277352) Seq 4-8612571337392652845: Received: {
> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10, {
> GetHostStatsAnswer } }
> 2015-11-26 20:22:40,263 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-18:ctx-53bf8c75) Seq 4-8612571337392652846: Executing request
> 2015-11-26 20:22:40,273 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-18:ctx-53bf8c75) Seq 4-8612571337392652846: Response Received:
> 2015-11-26 20:22:40,274 DEBUG [c.c.a.t.Request]
> (StatsCollector-1:ctx-32277352) Seq 4-8612571337392652846: Received: {
> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10, {
> GetGPUStatsAnswer } }
> 2015-11-26 20:22:41,275 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-4:ctx-f2410d29) ===START=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549626594
> 2015-11-26 20:22:41,287 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-4:ctx-f2410d29 ctx-f6f4a185) ===END=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549626594
> 2015-11-26 20:22:41,959 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> (DirectAgent-139:ctx-69673506) Processing ScriptConfigItem, executing
> update_config.py vm_password.json took 2760ms
> 2015-11-26 20:22:41,959 WARN [c.c.a.r.v.VirtualRoutingResource]
> (DirectAgent-139:ctx-69673506) Expected 1 answers while executing
> SavePasswordCommand but received 2
> 2015-11-26 20:22:41,960 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> (DirectAgent-139:ctx-69673506) Transforming
> com.cloud.agent.api.routing.VmDataCommand to ConfigItems
> 2015-11-26 20:22:41,964 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-139:ctx-69673506) Copying VR with ip 169.254.0.43 config file
> into host 10.0.0.171
> 2015-11-26 20:22:42,370 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-139:ctx-69673506) VR Config file vm_metadata.json got created
> in VR, ip 169.254.0.43 with content
>
> {"vm_ip_address":"10.1.1.88","vm_metadata":[["userdata","user-data",null],["metadata","service-offering","Medium
>
> Instance"],["metadata","availability-zone","TestZone"],["metadata","local-ipv4","10.1.1.88"],["metadata","local-hostname","Test002"],["metadata","public-ipv4","10.0.0.174"],["metadata","public-hostname","10.0.0.174"],["metadata","instance-id","4ce4731f-22a7-42ac-8e78-093d5f2e9a34"],["metadata","vm-id","4ce4731f-22a7-42ac-8e78-093d5f2e9a34"],["metadata","public-keys",null],["metadata","cloud-identifier","CloudStack-{de65e551-2e87-423b-90e6-03cd3eb706bb}"]],"type":"vmdata"}
> 2015-11-26 20:22:42,371 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> (DirectAgent-139:ctx-69673506) Processing FileConfigItem, copying 589
> characters to vm_metadata.json took 411ms
> 2015-11-26 20:22:42,371 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-139:ctx-69673506) Executing command in VR:
> /opt/cloud/bin/router_proxy.sh update_config.py 169.254.0.43
> vm_metadata.json
> 2015-11-26 20:22:44,606 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-25:ctx-128f2f7a) ===START=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549629925
> 2015-11-26 20:22:44,619 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-25:ctx-128f2f7a ctx-291bcd97) ===END=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549629925
> 2015-11-26 20:22:45,153 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> (DirectAgent-139:ctx-69673506) Processing ScriptConfigItem, executing
> update_config.py vm_metadata.json took 2782ms
> 2015-11-26 20:22:45,153 WARN [c.c.a.r.v.VirtualRoutingResource]
> (DirectAgent-139:ctx-69673506) Expected 1 answers while executing
> VmDataCommand but received 2
> 2015-11-26 20:22:45,153 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-139:ctx-69673506) Seq 4-8612571337392652844: Response
> Received:
> 2015-11-26 20:22:45,163 DEBUG [c.c.a.t.Request]
> (DirectAgent-139:ctx-69673506) Seq 4-8612571337392652844: Processing: {
> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null - success:
> ","null - success: RTNETLINK answers: File exists\nRTNETLINK answers: File
> exists\nRTNETLINK answers: File exists\n[INFO] update_config.py ::
> Processing incoming file => vm_password.json\n[INFO] Processing JSON file
>
> vm_password.json\n"],"result":true,"wait":0}},{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null
> - success: ","null - success: RTNETLINK answers: File exists\nRTNETLINK
> answers: File exists\nRTNETLINK answers: File exists\n[INFO]
> update_config.py :: Processing incoming file => vm_metadata.json\n[INFO]
> Processing JSON file vm_metadata.json\n"],"result":true,"wait":0}}] }
> 2015-11-26 20:22:45,163 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> 4-8612571337392652844: Received: { Ans: , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 10, { GroupAnswer, GroupAnswer } }
> 2015-11-26 20:22:45,164 DEBUG [c.c.n.NetworkModelImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
> SecurityGroup is not supported in the network id=212
> 2015-11-26 20:22:45,165 DEBUG [o.a.c.e.o.VolumeOrchestrator]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
> we need to prepare 2 volumes for VM[User|i-2-5-VM]
> 2015-11-26 20:22:45,168 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) template 5 is
> already in store:1, type:Image
> 2015-11-26 20:22:45,169 DEBUG [o.a.c.s.d.PrimaryDataStoreImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Not found
> (templateId:5poolId:8) in template_spool_ref, persisting it
> 2015-11-26 20:22:45,173 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) template 5 is
> already in store:8, type:Primary
> 2015-11-26 20:22:45,174 DEBUG [o.a.c.s.v.VolumeServiceImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found
> template centos56-x86_64-xen in storage pool 8 with VMTemplateStoragePool
> id: 3
> 2015-11-26 20:22:45,174 DEBUG [o.a.c.s.v.VolumeServiceImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Acquire lock
> on VMTemplateStoragePool 3 with timeout 3600 seconds
> 2015-11-26 20:22:45,175 INFO [o.a.c.s.v.VolumeServiceImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) lock is
> acquired for VMTemplateStoragePool 3
> 2015-11-26 20:22:45,179 DEBUG [o.a.c.s.m.AncientDataMotionStrategy]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) copyAsync
> inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE
> 2015-11-26 20:22:45,182 DEBUG [c.c.h.XenServerGuru]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> getCommandHostDelegation: class
> org.apache.cloudstack.storage.command.CopyCommand
> 2015-11-26 20:22:45,183 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> 4-8612571337392652847: Sending { Cmd , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 100111,
>
> [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/5/3986df71-b1d0-3e20-a655-7e42dd144370.vhd","origUrl":"
> http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
> 5.6(64-bit) no GUI
>
> (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://
> 10.0.0.170/export/secondary
>
> ","_role":"Image"}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"
> http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
> 5.6(64-bit) no GUI
>
> (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
>
> 10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc
> "}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"executeInSequence":true,"options":{},"options2":{},"wait":10800}}]
> }
> 2015-11-26 20:22:45,184 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> 4-8612571337392652847: Executing: { Cmd , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 100111,
>
> [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/5/3986df71-b1d0-3e20-a655-7e42dd144370.vhd","origUrl":"
> http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
> 5.6(64-bit) no GUI
>
> (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://
> 10.0.0.170/export/secondary
>
> ","_role":"Image"}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"
> http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
> 5.6(64-bit) no GUI
>
> (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
>
> 10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc
> "}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"executeInSequence":true,"options":{},"options2":{},"wait":10800}}]
> }
> 2015-11-26 20:22:45,184 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-279:ctx-532427fb) Seq 4-8612571337392652847: Executing request
> 2015-11-26 20:22:46,489 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-279:ctx-532427fb) Host 10.0.0.171
> OpaqueRef:53354999-bf25-32b9-01df-a695a039ba8d: Removing SR
> 2015-11-26 20:22:46,500 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-279:ctx-532427fb) Host 10.0.0.171
> OpaqueRef:f33f27b6-88c3-8c94-c8b3-40c094d9e66d: Unplugging pbd
> 2015-11-26 20:22:46,598 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-279:ctx-532427fb) Host 10.0.0.171
> OpaqueRef:53354999-bf25-32b9-01df-a695a039ba8d: Forgetting
> 2015-11-26 20:22:46,601 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-279:ctx-532427fb) Seq 4-8612571337392652847: Response
> Received:
> 2015-11-26 20:22:46,602 DEBUG [c.c.a.t.Request]
> (DirectAgent-279:ctx-532427fb) Seq 4-8612571337392652847: Processing: {
> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 110,
>
> [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Expected
> 1 VDI template but found 2 VDI template(s) on:
> 10.0.0.170:/export/secondary/template/tmpl/1/5","wait":0}}]
> }
> 2015-11-26 20:22:46,602 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> 4-8612571337392652847: Received: { Ans: , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 110, { CopyCmdAnswer } }
> 2015-11-26 20:22:46,603 DEBUG [c.c.a.m.AgentAttache]
> (DirectAgent-279:ctx-532427fb) Seq 4-8612571337392652847: No more commands
> found
> 2015-11-26 20:22:46,607 INFO [o.a.c.s.v.VolumeServiceImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) releasing
> lock for VMTemplateStoragePool 3
> 2015-11-26 20:22:46,608 DEBUG [o.a.c.e.o.VolumeOrchestrator]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Unable to
> create Vol[6|vm=5|ROOT]:Expected 1 VDI template but found 2 VDI template(s)
> on: 10.0.0.170:/export/secondary/template/tmpl/1/5
> 2015-11-26 20:22:46,608 INFO [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Unable to
> contact resource.
> com.cloud.exception.StorageUnavailableException: Resource [StoragePool:8]
> is unreachable: Unable to create Vol[6|vm=5|ROOT]:Expected 1 VDI template
> but found 2 VDI template(s) on: 10.0.0.170:
> /export/secondary/template/tmpl/1/5
> at
>
> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1278)
> at
>
> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1336)
> at
>
> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1000)
> at
>
> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4580)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
>
> com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
> at
>
> com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4736)
> at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
> at
>
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
> at
>
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
> at
>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
> at
>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
> at
>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
> at
>
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
> at
>
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> 2015-11-26 20:22:46,611 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Cleaning up
> resources for the vm VM[User|i-2-5-VM] in Starting state
> 2015-11-26 20:22:46,612 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> 4-8612571337392652848: Sending { Cmd , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 100011,
>
> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"checkBeforeCleanup":false,"vmName":"i-2-5-VM","wait":0}}]
> }
> 2015-11-26 20:22:46,612 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> 4-8612571337392652848: Executing: { Cmd , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 100011,
>
> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"checkBeforeCleanup":false,"vmName":"i-2-5-VM","wait":0}}]
> }
> 2015-11-26 20:22:46,613 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-140:ctx-7f6d3e96) Seq 4-8612571337392652848: Executing request
> 2015-11-26 20:22:46,618 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-140:ctx-7f6d3e96) Seq 4-8612571337392652848: Response
> Received:
> 2015-11-26 20:22:46,618 DEBUG [c.c.a.t.Request]
> (DirectAgent-140:ctx-7f6d3e96) Seq 4-8612571337392652848: Processing: {
> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not
> exist","wait":0}}] }
> 2015-11-26 20:22:46,618 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
> 4-8612571337392652848: Received: { Ans: , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 10, { StopAnswer } }
> 2015-11-26 20:22:46,623 DEBUG [c.c.n.NetworkModelImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
> SecurityGroup is not supported in the network id=212
> 2015-11-26 20:22:46,625 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Changing
> active number of nics for network id=212 on -1
> 2015-11-26 20:22:46,630 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Asking
> VirtualRouter to release
> NicProfile[11-5-2a4a184a-eac9-4609-8a70-4d230ee3a37d-10.1.1.88-null
> 2015-11-26 20:22:46,630 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Successfully
> released network resources for the vm VM[User|i-2-5-VM]
> 2015-11-26 20:22:46,630 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Successfully
> cleanued up resources for the vm VM[User|i-2-5-VM] in Starting state
> 2015-11-26 20:22:46,635 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deploy avoids
> pods: [], clusters: [], hosts: [4]
> 2015-11-26 20:22:46,636 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> DeploymentPlanner allocation algorithm:
> com.cloud.deploy.FirstFitPlanner@1136745
> 2015-11-26 20:22:46,636 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
> allocate a host and storage pools from dc:3, pod:3,cluster:3, requested
> cpu: 1000, requested ram: 1073741824
> 2015-11-26 20:22:46,636 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Is ROOT
> volume READY (pool already allocated)?: No
> 2015-11-26 20:22:46,636 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
> DeploymentPlan has host_id specified, choosing this host and making no
> checks on this host: 4
> 2015-11-26 20:22:46,636 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) The specified
> host is in avoid set
> 2015-11-26 20:22:46,636 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Cannot deploy
> to specified host, returning.
> 2015-11-26 20:22:46,645 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM state
> transitted from :Starting to Stopped with event: OperationFailedvm's
> original host id: null new host id: null host id before state transition: 4
> 2015-11-26 20:22:46,648 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Hosts's
> actual total CPU: 3399 and CPU after applying overprovisioning: 3399
> 2015-11-26 20:22:46,649 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Hosts's
> actual total RAM: 15354505344 and RAM after applying overprovisioning:
> 15354505216
> 2015-11-26 20:22:46,649 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) release cpu
> from host: 4, old used: 2500,reserved: 0, actual total: 3399, total with
> overprovisioning: 3399; new used: 1500,reserved:0; movedfromreserved:
> false,moveToReserveredfalse
> 2015-11-26 20:22:46,649 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) release mem
> from host: 4, old used: 2952790016,reserved: 0, total: 15354505216; new
> used: 1879048192,reserved:0; movedfromreserved: false,moveToReserveredfalse
> 2015-11-26 20:22:46,654 ERROR [c.c.v.VmWorkJobHandlerProxy]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Invocation
> exception, caused by:
> com.cloud.exception.InsufficientServerCapacityException: Unable to create a
> deployment for VM[User|i-2-5-VM]Scope=interface com.cloud.dc.DataCenter;
> id=3
> 2015-11-26 20:22:46,654 INFO [c.c.v.VmWorkJobHandlerProxy]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Rethrow
> exception com.cloud.exception.InsufficientServerCapacityException: Unable
> to create a deployment for VM[User|i-2-5-VM]Scope=interface
> com.cloud.dc.DataCenter; id=3
> 2015-11-26 20:22:46,654 DEBUG [c.c.v.VmWorkJobDispatcher]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Done with run of VM work
> job: com.cloud.vm.VmWorkStart for VM 5, job origin: 68
> 2015-11-26 20:22:46,654 ERROR [c.c.v.VmWorkJobDispatcher]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Unable to complete
> AsyncJobVO {id:69, userId: 2, accountId: 2, instanceType: null, instanceId:
> null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
>
> rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAABXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAA3BzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHIAEGphdmEubGFuZy5OdW1iZXKGrJUdC5TgiwIAAHhwAAAAAAAAAANzcQB-AAgAAAAAAAAABHBwcHEAfgAKcHNyABFqYXZhLnV0aWwuSGFzaE1hcAUH2sHDFmDRAwACRgAKbG9hZEZhY3RvckkACXRocmVzaG9sZHhwP0AAAAAAAAx3CAAAABAAAAABdAAKVm1QYXNzd29yZHQAHHJPMEFCWFFBRG5OaGRtVmtYM0JoYzNOM2IzSmt4cA,
> cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
> result: null, initMsid: 52229922654, completeMsid: null, lastUpdated: null,
> lastPolled: null, created: Thu Nov 26 20:21:56 IST 2015}, job origin:68
> com.cloud.exception.InsufficientServerCapacityException: Unable to create a
> deployment for VM[User|i-2-5-VM]Scope=interface com.cloud.dc.DataCenter;
> id=3
> at
>
> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:959)
> at
>
> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4580)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
>
> com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
> at
>
> com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4736)
> at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
> at
>
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
> at
>
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
> at
>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
> at
>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
> at
>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
> at
>
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
> at
>
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> 2015-11-26 20:22:46,662 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Complete async job-69,
> jobStatus: FAILED, resultCode: 0, result:
>
> rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAAzVW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1VzZXJ8aS0yLTUtVk1ddXIAHltMamF2YS5sYW5nLlN0YWNrVHJhY2VFbGVtZW50OwJGKjw8_SI5AgAAeHAAAAAVc3IAG2phdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudGEJxZomNt2FAgAESQAKbGluZU51bWJlckwADmRlY2xhcmluZ0NsYXNzcQB-AApMAAhmaWxlTmFtZXEAfgAKTAAKbWV0aG9kTmFtZXEAfgAKeHAAAAO_dAAmY29tLmNsb3VkLnZtLlZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGx0AB5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsLmphdmF0ABBvcmNoZXN0cmF0ZVN0YXJ0c3EAfgARAAAR5HEAfgATcQB-ABRxAH4AFXNxAH4AEf____50ACRzdW4ucmVmbGVjdC5OYXRpdmVNZXRob2RBY2Nlc3NvckltcGx0AB1OYXRpdmVNZXRob2RBY2Nlc3NvckltcGwuamF2YXQAB2ludm9rZTBzcQB-ABEAAAA5cQB-ABhxAH4AGXQABmludm9rZXNxAH4AEQAAACt0AChzdW4ucmVmbGVjdC5EZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsdAAhRGVsZWdhdGluZ01ldGhvZEFjY2Vzc29ySW1wbC5qYXZhcQB-ABxzcQB-ABEAAAJedAAYamF2YS5sYW5nLnJlZmxlY3QuTWV0aG9kdAALTWV0aG9kLmphdmFxAH4AHHNxAH4AEQAAAGt0ACJjb20uY2xvdWQudm0uVm1Xb3JrSm9iSGFuZGxlclByb3h5dAAaVm1Xb3JrSm9iSGFuZGxlclByb3h5LmphdmF0AA9oYW5kbGVWbVdvcmtKb2JzcQB-ABEAABKAcQB-ABNxAH4AFHEAfgAmc3EAfgARAAAAZnQAIGNvbS5jbG91ZC52bS5WbVdvcmtKb2JEaXNwYXRjaGVydAAYVm1Xb3JrSm9iRGlzcGF0Y2hlci5qYXZhdAAGcnVuSm9ic3EAfgARAAACGXQAP29yZy5hcGFjaGUuY2xvdWRzdGFjay5mcmFtZXdvcmsuam9icy5pbXBsLkFzeW5jSm9iTWFuYWdlckltcGwkNXQAGEFzeW5jSm9iTWFuYWdlckltcGwuamF2YXQADHJ1bkluQ29udGV4dHNxAH4AEQAAADF0AD5vcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGUkMXQAG01hbmFnZWRDb250ZXh0UnVubmFibGUuamF2YXQAA3J1bnNxAH4AEQAAADh0AEJvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0JDF0ABpEZWZhdWx0TWFuYWdlZENvbnRleHQuamF2YXQABGNhbGxzcQB-ABEAAABndABAb3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5pbXBsLkRlZmF1bHRNYW5hZ2VkQ29udGV4dHEAfgA2dAAPY2FsbFdpdGhDb250ZXh0c3EAfgARAAAANXEAfgA5cQB-ADZ0AA5ydW5XaXRoQ29udGV4dHNxAH4AEQAAAC50ADxvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGVxAH4AMnEAfgAzc3EAfgARAAAB7nEAfgAtcQB-AC5xAH4AM3NxAH4AEQAAAdd0AC5qYXZhLnV0aWwuY29uY3VycmVudC5FeGVjdXRvcnMkUnVubmFibGVBZGFwdGVydAAORXhlY3V0b3JzLmphdmFxAH4AN3NxAH4AEQAAAQZ0AB9qYXZhLnV0aWwuY29uY3VycmVudC5GdXR1cmVUYXNrdAAPRnV0dXJlVGFzay5qYXZhcQB-ADNzcQB-ABEAAAR5dAAnamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9ydAAXVGhyZWFkUG9vbEV4ZWN1dG9yLmphdmF0AAlydW5Xb3JrZXJzcQB-ABEAAAJndAAuamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9yJFdvcmtlcnEAfgBIcQB-ADNzcQB-ABEAAALpdAAQamF2YS5sYW5nLlRocmVhZHQAC1RocmVhZC5qYXZhcQB-ADNzcgAmamF2YS51dGlsLkNvbGxlY3Rpb25zJFVubW9kaWZpYWJsZUxpc3T8DyUxteyOEAIAAUwABGxpc3RxAH4ADHhyACxqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlQ29sbGVjdGlvbhlCAIDLXvceAgABTAABY3QAFkxqYXZhL3V0aWwvQ29sbGVjdGlvbjt4cHNyABNqYXZhLnV0aWwuQXJyYXlMaXN0eIHSHZnHYZ0DAAFJAARzaXpleHAAAAAAdwQAAAAAeHEAfgBUeHNyABFqYXZhLmxhbmcuSW50ZWdlchLioKT3gYc4AgABSQAFdmFsdWV4cgAQamF2YS5sYW5nLk51bWJlcoaslR0LlOCLAgAAeHAAABDvc3EAfgBTAAAAAHcEAAAAAHhzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHEAfgBWAAAAAAAAAAN2cgAXY29tLmNsb3VkLmRjLkRhdGFDZW50ZXKy8Qrrp-d4vgIAAHhwAA
> 2015-11-26 20:22:46,663 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Publish async job-69
> complete on message bus
> 2015-11-26 20:22:46,663 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Wake up jobs related to
> job-69
> 2015-11-26 20:22:46,663 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Update db status for
> job-69
> 2015-11-26 20:22:46,664 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Wake up jobs joined with
> job-69 and disjoin all subjobs created from job- 69
> 2015-11-26 20:22:46,671 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Done executing
> com.cloud.vm.VmWorkStart for job-69
> 2015-11-26 20:22:46,672 INFO [o.a.c.f.j.i.AsyncJobMonitor]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Remove job-69 from job
> monitoring
> 2015-11-26 20:22:46,680 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Sync job-71 execution
> on object VmWorkJobQueue.5
> 2015-11-26 20:22:46,966 DEBUG [c.c.a.m.AgentManagerImpl]
> (AgentManager-Handler-7:null) SeqA 5-1788: Processing Seq 5-1788: { Cmd ,
> MgmtId: -1, via: 5, Ver: v1, Flags: 11,
>
> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
> \"connections\": []\n}","wait":0}}] }
> 2015-11-26 20:22:46,971 DEBUG [c.c.a.m.AgentManagerImpl]
> (AgentManager-Handler-7:null) SeqA 5-1788: Sending Seq 5-1788: { Ans: ,
> MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
> 2015-11-26 20:22:48,032 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (AsyncJobMgr-Heartbeat-1:ctx-a78c3581) Execute sync-queue item:
> SyncQueueItemVO {id:10, queueId: 9, contentType: AsyncJob, contentId: 71,
> lastProcessMsid: 52229922654, lastprocessNumber: 2, lastProcessTime: Thu
> Nov 26 20:22:48 IST 2015, created: Thu Nov 26 20:22:46 IST 2015}
> 2015-11-26 20:22:48,033 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (AsyncJobMgr-Heartbeat-1:ctx-a78c3581) Schedule queued job-71
> 2015-11-26 20:22:48,038 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> (AsyncJobMgr-Heartbeat-1:ctx-5936202f) Begin cleanup expired async-jobs
> 2015-11-26 20:22:48,041 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> (AsyncJobMgr-Heartbeat-1:ctx-5936202f) End cleanup expired async-jobs
> 2015-11-26 20:22:48,041 INFO [o.a.c.f.j.i.AsyncJobMonitor]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Add job-71 into job
> monitoring
> 2015-11-26 20:22:48,045 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Executing AsyncJobVO
> {id:71, userId: 2, accountId: 2, instanceType: null, instanceId: null, cmd:
> com.cloud.vm.VmWorkStart, cmdInfo:
>
> rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAABXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwc3IAEWphdmEudXRpbC5IYXNoTWFwBQfawcMWYNEDAAJGAApsb2FkRmFjdG9ySQAJdGhyZXNob2xkeHA_QAAAAAAADHcIAAAAEAAAAAF0AApWbVBhc3N3b3JkdAAcck8wQUJYUUFEbk5oZG1Wa1gzQmhjM04zYjNKa3hw,
> cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
> result: null, initMsid: 52229922654, completeMsid: null, lastUpdated: null,
> lastPolled: null, created: Thu Nov 26 20:22:46 IST 2015}
> 2015-11-26 20:22:48,046 DEBUG [c.c.v.VmWorkJobDispatcher]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Run VM work job:
> com.cloud.vm.VmWorkStart for VM 5, job origin: 68
> 2015-11-26 20:22:48,046 DEBUG [c.c.v.VmWorkJobHandlerProxy]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Execute VM
> work job:
>
> com.cloud.vm.VmWorkStart{"dcId":0,"rawParams":{"VmPassword":"rO0ABXQADnNhdmVkX3Bhc3N3b3Jk"},"userId":2,"accountId":2,"vmId":5,"handlerName":"VirtualMachineManagerImpl"}
> 2015-11-26 20:22:48,050 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) VM state
> transitted from :Stopped to Starting with event: StartRequestedvm's
> original host id: null new host id: null host id before state transition:
> null
> 2015-11-26 20:22:48,050 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Successfully
> transitioned to start state for VM[User|i-2-5-VM] reservation id =
> 718d2456-bf61-48ad-9663-22ccfd4556f1
> 2015-11-26 20:22:48,052 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Trying to
> deploy VM, vm has dcId: 3 and podId: 3
> 2015-11-26 20:22:48,052 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Deploy avoids
> pods: null, clusters: null, hosts: null
> 2015-11-26 20:22:48,057 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Deploy avoids
> pods: [], clusters: [], hosts: []
> 2015-11-26 20:22:48,057 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
> DeploymentPlanner allocation algorithm:
> com.cloud.deploy.FirstFitPlanner@1136745
> 2015-11-26 20:22:48,057 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Trying to
> allocate a host and storage pools from dc:3, pod:3,cluster:null, requested
> cpu: 1000, requested ram: 1073741824
> 2015-11-26 20:22:48,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Is ROOT
> volume READY (pool already allocated)?: No
> 2015-11-26 20:22:48,058 DEBUG [c.c.d.FirstFitPlanner]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Searching
> resources only under specified Pod: 3
> 2015-11-26 20:22:48,058 DEBUG [c.c.d.FirstFitPlanner]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Listing
> clusters in order of aggregate capacity, that have (atleast one host with)
> enough CPU and RAM capacity under this Pod: 3
> 2015-11-26 20:22:48,059 DEBUG [c.c.d.FirstFitPlanner]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Removing from
> the clusterId list these clusters from avoid set: []
> 2015-11-26 20:22:48,063 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
> resources in Cluster: 3 under Pod: 3
> 2015-11-26 20:22:48,063 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
> FirstFitRoutingAllocator) Looking for hosts in dc: 3 pod:3 cluster:3
> 2015-11-26 20:22:48,065 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
> FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for
> allocation: [Host[-4-Routing]]
> 2015-11-26 20:22:48,067 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
> FirstFitRoutingAllocator) Found 1 hosts for allocation after
> prioritization: [Host[-4-Routing]]
> 2015-11-26 20:22:48,067 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
> FirstFitRoutingAllocator) Looking for speed=1000Mhz, Ram=1024
> 2015-11-26 20:22:48,070 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
> FirstFitRoutingAllocator) Host: 4 has cpu capability (cpu:1, speed:3399) to
> support requested CPU: 1 and requested speed: 1000
> 2015-11-26 20:22:48,070 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
> FirstFitRoutingAllocator) Checking if host: 4 has enough capacity for
> requested CPU: 1000 and requested RAM: 1073741824 ,
> cpuOverprovisioningFactor: 1.0
> 2015-11-26 20:22:48,071 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
> FirstFitRoutingAllocator) Hosts's actual total CPU: 3399 and CPU after
> applying overprovisioning: 3399
> 2015-11-26 20:22:48,071 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
> FirstFitRoutingAllocator) Free CPU: 1899 , Requested CPU: 1000
> 2015-11-26 20:22:48,071 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
> FirstFitRoutingAllocator) Free RAM: 13475457024 , Requested RAM: 1073741824
> 2015-11-26 20:22:48,071 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
> FirstFitRoutingAllocator) Host has enough CPU and RAM available
> 2015-11-26 20:22:48,071 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
> FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 4, used: 1500,
> reserved: 0, actual total: 3399, total with overprovisioning: 3399;
> requested cpu:1000,alloc_from_last_host?:false ,considerReservedCapacity?:
> true
> 2015-11-26 20:22:48,071 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
> FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 4, used:
> 1879048192, reserved: 0, total: 15354505216; requested mem:
> 1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
> 2015-11-26 20:22:48,071 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
> FirstFitRoutingAllocator) Found a suitable host, adding to list: 4
> 2015-11-26 20:22:48,071 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
> FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts
> 2015-11-26 20:22:48,072 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
> suitable pools for volume (Id, Type): (6,ROOT)
> 2015-11-26 20:22:48,072 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) We need to
> allocate new storagepool for this volume
> 2015-11-26 20:22:48,073 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Calling
> StoragePoolAllocators to find suitable pools
> 2015-11-26 20:22:48,073 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
> LocalStoragePoolAllocator trying to find storage pool to fit the vm
> 2015-11-26 20:22:48,073 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
> ClusterScopeStoragePoolAllocator looking for storage pool
> 2015-11-26 20:22:48,073 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Looking for
> pools in dc: 3 pod:3 cluster:3. Disabled pools will be ignored.
> 2015-11-26 20:22:48,073 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found pools
> matching tags: [Pool[8|NetworkFilesystem]]
> 2015-11-26 20:22:48,074 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking if
> storage pool is suitable, name: null ,poolId: 8
> 2015-11-26 20:22:48,075 INFO [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Storage pool
> null (8) does not supply IOPS capacity, assuming enough capacity
> 2015-11-26 20:22:48,076 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking pool
> 8 for storage, totalSize: 526199291904, usedBytes: 10131603456, usedPct:
> 0.019254308418659775, disable threshold: 0.85
> 2015-11-26 20:22:48,078 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found storage
> pool primary of type NetworkFilesystem with overprovisioning factor 2
> 2015-11-26 20:22:48,078 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total over
> provisioned capacity calculated is 2 * 526199291904
> 2015-11-26 20:22:48,079 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total
> capacity of the pool primary id: 8 is 1052398583808
> 2015-11-26 20:22:48,079 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
> pool: 8 for volume allocation [Vol[6|vm=5|ROOT]], maxSize : 1052398583808,
> totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
> disable threshold: 0.85
> 2015-11-26 20:22:48,079 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
> ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
> 2015-11-26 20:22:48,079 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
> suitable pools for volume (Id, Type): (7,DATADISK)
> 2015-11-26 20:22:48,079 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) We need to
> allocate new storagepool for this volume
> 2015-11-26 20:22:48,079 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Calling
> StoragePoolAllocators to find suitable pools
> 2015-11-26 20:22:48,079 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
> LocalStoragePoolAllocator trying to find storage pool to fit the vm
> 2015-11-26 20:22:48,079 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
> ClusterScopeStoragePoolAllocator looking for storage pool
> 2015-11-26 20:22:48,079 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Looking for
> pools in dc: 3 pod:3 cluster:3. Disabled pools will be ignored.
> 2015-11-26 20:22:48,080 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found pools
> matching tags: [Pool[8|NetworkFilesystem]]
> 2015-11-26 20:22:48,080 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking if
> storage pool is suitable, name: null ,poolId: 8
> 2015-11-26 20:22:48,081 INFO [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Storage pool
> null (8) does not supply IOPS capacity, assuming enough capacity
> 2015-11-26 20:22:48,081 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking pool
> 8 for storage, totalSize: 526199291904, usedBytes: 10131603456, usedPct:
> 0.019254308418659775, disable threshold: 0.85
> 2015-11-26 20:22:48,083 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found storage
> pool primary of type NetworkFilesystem with overprovisioning factor 2
> 2015-11-26 20:22:48,083 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total over
> provisioned capacity calculated is 2 * 526199291904
> 2015-11-26 20:22:48,083 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total
> capacity of the pool primary id: 8 is 1052398583808
> 2015-11-26 20:22:48,083 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
> pool: 8 for volume allocation [Vol[7|vm=5|DATADISK]], maxSize :
> 1052398583808, totalAllocatedSize : 12156207104, askingSize : 21474836480,
> allocated disable threshold: 0.85
> 2015-11-26 20:22:48,083 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
> ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
> 2015-11-26 20:22:48,083 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Trying to
> find a potenial host and associated storage pools from the suitable
> host/pool lists for this VM
> 2015-11-26 20:22:48,083 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking if
> host: 4 can access any suitable storage pool for volume: DATADISK
> 2015-11-26 20:22:48,084 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Host: 4 can
> access pool: 8
> 2015-11-26 20:22:48,084 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking pool
> 8 for storage, totalSize: 526199291904, usedBytes: 10131603456, usedPct:
> 0.019254308418659775, disable threshold: 0.85
> 2015-11-26 20:22:48,086 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found storage
> pool primary of type NetworkFilesystem with overprovisioning factor 2
> 2015-11-26 20:22:48,086 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total over
> provisioned capacity calculated is 2 * 526199291904
> 2015-11-26 20:22:48,086 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total
> capacity of the pool primary id: 8 is 1052398583808
> 2015-11-26 20:22:48,086 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
> pool: 8 for volume allocation [Vol[7|vm=5|DATADISK]], maxSize :
> 1052398583808, totalAllocatedSize : 12156207104, askingSize : 21474836480,
> allocated disable threshold: 0.85
> 2015-11-26 20:22:48,086 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking if
> host: 4 can access any suitable storage pool for volume: ROOT
> 2015-11-26 20:22:48,087 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Host: 4 can
> access pool: 8
> 2015-11-26 20:22:48,087 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking pool
> 8 for storage, totalSize: 526199291904, usedBytes: 10131603456, usedPct:
> 0.019254308418659775, disable threshold: 0.85
> 2015-11-26 20:22:48,090 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found storage
> pool primary of type NetworkFilesystem with overprovisioning factor 2
> 2015-11-26 20:22:48,090 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total over
> provisioned capacity calculated is 2 * 526199291904
> 2015-11-26 20:22:48,090 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total
> capacity of the pool primary id: 8 is 1052398583808
> 2015-11-26 20:22:48,090 DEBUG [c.c.s.StorageManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
> pool: 8 for volume allocation [Vol[6|vm=5|ROOT]], maxSize : 1052398583808,
> totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
> disable threshold: 0.85
> 2015-11-26 20:22:48,090 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found a
> potential host id: 4 name: xenserver and associated storage pools for this
> VM
> 2015-11-26 20:22:48,091 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Returning
> Deployment Destination:
>
> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
> :
>
> Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage(Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
> Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
> Volume(7|DATADISK-->Pool(8))]
> 2015-11-26 20:22:48,091 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Deployment
> found - P0=VM[User|i-2-5-VM],
>
> P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
> :
>
> Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage(Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
> Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
> Volume(7|DATADISK-->Pool(8))]
> 2015-11-26 20:22:48,097 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) VM state
> transitted from :Starting to Starting with event: OperationRetryvm's
> original host id: null new host id: 4 host id before state transition: null
> 2015-11-26 20:22:48,100 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Hosts's
> actual total CPU: 3399 and CPU after applying overprovisioning: 3399
> 2015-11-26 20:22:48,100 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) We are
> allocating VM, increasing the used capacity of this host:4
> 2015-11-26 20:22:48,100 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Current Used
> CPU: 1500 , Free CPU:1899 ,Requested CPU: 1000
> 2015-11-26 20:22:48,100 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Current Used
> RAM: 1879048192 , Free RAM:13475457024 ,Requested RAM: 1073741824
> 2015-11-26 20:22:48,100 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) CPU STATS
> after allocation: for host: 4, old used: 1500, old reserved: 0, actual
> total: 3399, total with overprovisioning: 3399; new used:2500, reserved:0;
> requested cpu:1000,alloc_from_last:false
> 2015-11-26 20:22:48,100 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) RAM STATS
> after allocation: for host: 4, old used: 1879048192, old reserved: 0,
> total: 15354505216; new used: 2952790016, reserved: 0; requested mem:
> 1073741824,alloc_from_last:false
> 2015-11-26 20:22:48,102 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) VM is being
> created in podId: 3
> 2015-11-26 20:22:48,103 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Network
> id=212 is already implemented
> 2015-11-26 20:22:48,109 DEBUG [c.c.n.NetworkModelImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Service
> SecurityGroup is not supported in the network id=212
> 2015-11-26 20:22:48,111 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Changing
> active number of nics for network id=212 on 1
> 2015-11-26 20:22:48,114 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Asking
> VirtualRouter to prepare for
> Nic[11-5-718d2456-bf61-48ad-9663-22ccfd4556f1-10.1.1.88]
> 2015-11-26 20:22:48,123 DEBUG [c.c.n.NetworkModelImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Service
> SecurityGroup is not supported in the network id=212
> 2015-11-26 20:22:48,125 DEBUG [o.a.c.n.t.BasicNetworkTopology]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) CONFIG DHCP
> FOR SUBNETS RULES
> 2015-11-26 20:22:48,129 DEBUG [c.c.n.NetworkModelImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Service
> SecurityGroup is not supported in the network id=212
> 2015-11-26 20:22:48,130 DEBUG [o.a.c.n.t.AdvancedNetworkTopology]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) APPLYING VPC
> DHCP ENTRY RULES
> 2015-11-26 20:22:48,130 DEBUG [o.a.c.n.t.BasicNetworkTopology]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Applying dhcp
> entry in network Ntwk[212|Guest|8]
> 2015-11-26 20:22:48,138 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
> 4-8612571337392652849: Sending { Cmd , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 100011,
>
> [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:71:ff:00:03","vmIpAddress":"10.1.1.88","vmName":"Test002","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:71:ff:00:03","isDefault":true,"executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","router.guest.ip":"10.1.1.1","router.ip":"169.254.0.43","
> router.name":"r-4-VM"},"wait":0}}] }
> 2015-11-26 20:22:48,139 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
> 4-8612571337392652849: Executing: { Cmd , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 100011,
>
> [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:71:ff:00:03","vmIpAddress":"10.1.1.88","vmName":"Test002","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:71:ff:00:03","isDefault":true,"executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","router.guest.ip":"10.1.1.1","router.ip":"169.254.0.43","
> router.name":"r-4-VM"},"wait":0}}] }
> 2015-11-26 20:22:48,139 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-280:ctx-eb580854) Seq 4-8612571337392652849: Executing request
> 2015-11-26 20:22:48,139 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> (DirectAgent-280:ctx-eb580854) Transforming
> com.cloud.agent.api.routing.DhcpEntryCommand to ConfigItems
> 2015-11-26 20:22:48,144 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-280:ctx-eb580854) Copying VR with ip 169.254.0.43 config file
> into host 10.0.0.171
> 2015-11-26 20:22:48,211 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (RouterStatusMonitor-1:ctx-8884e0d0) Found 1 routers to update status.
> 2015-11-26 20:22:48,213 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (RouterStatusMonitor-1:ctx-8884e0d0) Found 0 VPC networks to update
> Redundant State.
> 2015-11-26 20:22:48,214 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (RouterStatusMonitor-1:ctx-8884e0d0) Found 0 networks to update RvR status.
> 2015-11-26 20:22:48,222 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (RouterStatusMonitor-1:ctx-7dc158f2) Found 1 routers to update status.
> 2015-11-26 20:22:48,223 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (RouterStatusMonitor-1:ctx-7dc158f2) Found 0 VPC networks to update
> Redundant State.
> 2015-11-26 20:22:48,223 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (RouterStatusMonitor-1:ctx-7dc158f2) Found 0 networks to update RvR status.
> 2015-11-26 20:22:48,509 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-280:ctx-eb580854) VR Config file vm_dhcp_entry.json got
> created in VR, ip 169.254.0.43 with content
>
> {"host_name":"Test002","mac_address":"02:00:71:ff:00:03","ipv4_adress":"10.1.1.88","ipv6_duid":"00:03:00:01:02:00:71:ff:00:03","dns_adresses":"10.1.1.1","default_gateway":"10.1.1.1","default_entry":true,"type":"dhcpentry"}
> 2015-11-26 20:22:48,509 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> (DirectAgent-280:ctx-eb580854) Processing FileConfigItem, copying 222
> characters to vm_dhcp_entry.json took 370ms
> 2015-11-26 20:22:48,510 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-280:ctx-eb580854) Executing command in VR:
> /opt/cloud/bin/router_proxy.sh update_config.py 169.254.0.43
> vm_dhcp_entry.json
> 2015-11-26 20:22:48,606 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-5:ctx-6424a9fc) ===START=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549633925
> 2015-11-26 20:22:48,618 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-5:ctx-6424a9fc ctx-7c6e9282) ===END=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549633925
> 2015-11-26 20:22:51,265 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> (DirectAgent-280:ctx-eb580854) Processing ScriptConfigItem, executing
> update_config.py vm_dhcp_entry.json took 2756ms
> 2015-11-26 20:22:51,265 WARN [c.c.a.r.v.VirtualRoutingResource]
> (DirectAgent-280:ctx-eb580854) Expected 1 answers while executing
> DhcpEntryCommand but received 2
> 2015-11-26 20:22:51,265 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-280:ctx-eb580854) Seq 4-8612571337392652849: Response
> Received:
> 2015-11-26 20:22:51,266 DEBUG [c.c.a.t.Request]
> (DirectAgent-280:ctx-eb580854) Seq 4-8612571337392652849: Processing: {
> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null - success:
> ","null - success: RTNETLINK answers: File exists\nRTNETLINK answers: File
> exists\nRTNETLINK answers: File exists\n[INFO] update_config.py ::
> Processing incoming file => vm_dhcp_entry.json\n[INFO] Processing JSON file
> vm_dhcp_entry.json\nTest002 Test002\nTest01
> Test002\n"],"result":true,"wait":0}}] }
> 2015-11-26 20:22:51,266 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
> 4-8612571337392652849: Received: { Ans: , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 10, { GroupAnswer } }
> 2015-11-26 20:22:51,268 DEBUG [c.c.n.NetworkModelImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Service
> SecurityGroup is not supported in the network id=212
> 2015-11-26 20:22:51,269 DEBUG [o.a.c.n.t.AdvancedNetworkTopology]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) APPLYING VPC
> USERDATA RULES
> 2015-11-26 20:22:51,269 DEBUG [o.a.c.n.t.BasicNetworkTopology]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Applying
> userdata and password entry in network Ntwk[212|Guest|8]
> 2015-11-26 20:22:51,278 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
> 4-8612571337392652850: Sending { Cmd , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 100011,
>
> [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
> router.name
>
> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
> router.name
> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}}]
> }
> 2015-11-26 20:22:51,279 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
> 4-8612571337392652850: Executing: { Cmd , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 100011,
>
> [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
> router.name
>
> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
> router.name
> ":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}}]
> }
> 2015-11-26 20:22:51,279 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-71:ctx-0080bc2a) Seq 4-8612571337392652850: Executing request
> 2015-11-26 20:22:51,279 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> (DirectAgent-71:ctx-0080bc2a) Transforming
> com.cloud.agent.api.routing.SavePasswordCommand to ConfigItems
> 2015-11-26 20:22:51,282 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-71:ctx-0080bc2a) Copying VR with ip 169.254.0.43 config file
> into host 10.0.0.171
> 2015-11-26 20:22:51,662 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-71:ctx-0080bc2a) VR Config file vm_password.json got created
> in VR, ip 169.254.0.43 with content
> {"ip_address":"10.1.1.88","password":"saved_password","type":"vmpassword"}
> 2015-11-26 20:22:51,662 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> (DirectAgent-71:ctx-0080bc2a) Processing FileConfigItem, copying 74
> characters to vm_password.json took 383ms
> 2015-11-26 20:22:51,662 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-71:ctx-0080bc2a) Executing command in VR:
> /opt/cloud/bin/router_proxy.sh update_config.py 169.254.0.43
> vm_password.json
> 2015-11-26 20:22:51,966 DEBUG [c.c.a.m.AgentManagerImpl]
> (AgentManager-Handler-8:null) SeqA 5-1789: Processing Seq 5-1789: { Cmd ,
> MgmtId: -1, via: 5, Ver: v1, Flags: 11,
>
> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
> \"connections\": []\n}","wait":0}}] }
> 2015-11-26 20:22:51,969 DEBUG [c.c.a.m.AgentManagerImpl]
> (AgentManager-Handler-8:null) SeqA 5-1789: Sending Seq 5-1789: { Ans: ,
> MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
> 2015-11-26 20:22:52,954 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-24:ctx-bcef2c6d) ===START=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549638271
> 2015-11-26 20:22:52,968 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-24:ctx-bcef2c6d ctx-2fd0c6b9) ===END=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549638271
> 2015-11-26 20:22:54,399 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> (DirectAgent-71:ctx-0080bc2a) Processing ScriptConfigItem, executing
> update_config.py vm_password.json took 2737ms
> 2015-11-26 20:22:54,399 WARN [c.c.a.r.v.VirtualRoutingResource]
> (DirectAgent-71:ctx-0080bc2a) Expected 1 answers while executing
> SavePasswordCommand but received 2
> 2015-11-26 20:22:54,401 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> (DirectAgent-71:ctx-0080bc2a) Transforming
> com.cloud.agent.api.routing.VmDataCommand to ConfigItems
> 2015-11-26 20:22:54,404 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-71:ctx-0080bc2a) Copying VR with ip 169.254.0.43 config file
> into host 10.0.0.171
> 2015-11-26 20:22:54,786 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-71:ctx-0080bc2a) VR Config file vm_metadata.json got created
> in VR, ip 169.254.0.43 with content
>
> {"vm_ip_address":"10.1.1.88","vm_metadata":[["userdata","user-data",null],["metadata","service-offering","Medium
>
> Instance"],["metadata","availability-zone","TestZone"],["metadata","local-ipv4","10.1.1.88"],["metadata","local-hostname","Test002"],["metadata","public-ipv4","10.0.0.174"],["metadata","public-hostname","10.0.0.174"],["metadata","instance-id","4ce4731f-22a7-42ac-8e78-093d5f2e9a34"],["metadata","vm-id","4ce4731f-22a7-42ac-8e78-093d5f2e9a34"],["metadata","public-keys",null],["metadata","cloud-identifier","CloudStack-{de65e551-2e87-423b-90e6-03cd3eb706bb}"]],"type":"vmdata"}
> 2015-11-26 20:22:54,786 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> (DirectAgent-71:ctx-0080bc2a) Processing FileConfigItem, copying 589
> characters to vm_metadata.json took 385ms
> 2015-11-26 20:22:54,786 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-71:ctx-0080bc2a) Executing command in VR:
> /opt/cloud/bin/router_proxy.sh update_config.py 169.254.0.43
> vm_metadata.json
> 2015-11-26 20:22:56,607 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-3:ctx-060754d7) ===START=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549641926
> 2015-11-26 20:22:56,624 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-3:ctx-060754d7 ctx-a1cce698) ===END=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549641926
> 2015-11-26 20:22:57,514 DEBUG [c.c.a.r.v.VirtualRoutingResource]
> (DirectAgent-71:ctx-0080bc2a) Processing ScriptConfigItem, executing
> update_config.py vm_metadata.json took 2728ms
> 2015-11-26 20:22:57,514 WARN [c.c.a.r.v.VirtualRoutingResource]
> (DirectAgent-71:ctx-0080bc2a) Expected 1 answers while executing
> VmDataCommand but received 2
> 2015-11-26 20:22:57,515 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-71:ctx-0080bc2a) Seq 4-8612571337392652850: Response Received:
> 2015-11-26 20:22:57,523 DEBUG [c.c.a.t.Request]
> (DirectAgent-71:ctx-0080bc2a) Seq 4-8612571337392652850: Processing: {
> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null - success:
> ","null - success: RTNETLINK answers: File exists\nRTNETLINK answers: File
> exists\nRTNETLINK answers: File exists\n[INFO] update_config.py ::
> Processing incoming file => vm_password.json\n[INFO] Processing JSON file
>
> vm_password.json\n"],"result":true,"wait":0}},{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null
> - success: ","null - success: RTNETLINK answers: File exists\nRTNETLINK
> answers: File exists\nRTNETLINK answers: File exists\n[INFO]
> update_config.py :: Processing incoming file => vm_metadata.json\n[INFO]
> Processing JSON file vm_metadata.json\n"],"result":true,"wait":0}}] }
> 2015-11-26 20:22:57,523 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
> 4-8612571337392652850: Received: { Ans: , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 10, { GroupAnswer, GroupAnswer } }
> 2015-11-26 20:22:57,524 DEBUG [c.c.n.NetworkModelImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Service
> SecurityGroup is not supported in the network id=212
> 2015-11-26 20:22:57,525 DEBUG [o.a.c.e.o.VolumeOrchestrator]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking if
> we need to prepare 2 volumes for VM[User|i-2-5-VM]
> 2015-11-26 20:22:57,529 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) template 5 is
> already in store:1, type:Image
> 2015-11-26 20:22:57,530 DEBUG [o.a.c.s.d.PrimaryDataStoreImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Not found
> (templateId:5poolId:8) in template_spool_ref, persisting it
> 2015-11-26 20:22:57,533 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) template 5 is
> already in store:8, type:Primary
> 2015-11-26 20:22:57,533 DEBUG [o.a.c.s.v.VolumeServiceImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found
> template centos56-x86_64-xen in storage pool 8 with VMTemplateStoragePool
> id: 4
> 2015-11-26 20:22:57,534 DEBUG [o.a.c.s.v.VolumeServiceImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Acquire lock
> on VMTemplateStoragePool 4 with timeout 3600 seconds
> 2015-11-26 20:22:57,535 INFO [o.a.c.s.v.VolumeServiceImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) lock is
> acquired for VMTemplateStoragePool 4
> 2015-11-26 20:22:57,537 DEBUG [o.a.c.s.m.AncientDataMotionStrategy]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) copyAsync
> inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE
> 2015-11-26 20:22:57,541 DEBUG [c.c.h.XenServerGuru]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
> getCommandHostDelegation: class
> org.apache.cloudstack.storage.command.CopyCommand
> 2015-11-26 20:22:57,542 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
> 4-8612571337392652851: Sending { Cmd , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 100111,
>
> [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/5/3986df71-b1d0-3e20-a655-7e42dd144370.vhd","origUrl":"
> http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
> 5.6(64-bit) no GUI
>
> (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://
> 10.0.0.170/export/secondary
>
> ","_role":"Image"}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"
> http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
> 5.6(64-bit) no GUI
>
> (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
>
> 10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc
> "}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"executeInSequence":true,"options":{},"options2":{},"wait":10800}}]
> }
> 2015-11-26 20:22:57,542 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
> 4-8612571337392652851: Executing: { Cmd , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 100111,
>
> [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/5/3986df71-b1d0-3e20-a655-7e42dd144370.vhd","origUrl":"
> http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
> 5.6(64-bit) no GUI
>
> (XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://
> 10.0.0.170/export/secondary
>
> ","_role":"Image"}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"
> http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2
> ","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
> 5.6(64-bit) no GUI
>
> (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
>
> 10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc
> "}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"executeInSequence":true,"options":{},"options2":{},"wait":10800}}]
> }
> 2015-11-26 20:22:57,542 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-281:ctx-03a8f398) Seq 4-8612571337392652851: Executing request
> 2015-11-26 20:22:58,021 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> (AsyncJobMgr-Heartbeat-1:ctx-92cf866f) Begin cleanup expired async-jobs
> 2015-11-26 20:22:58,023 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> (AsyncJobMgr-Heartbeat-1:ctx-92cf866f) End cleanup expired async-jobs
> 2015-11-26 20:22:58,833 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-281:ctx-03a8f398) Host 10.0.0.171
> OpaqueRef:b0284c5b-613d-0522-5c44-797be269d661: Removing SR
> 2015-11-26 20:22:58,843 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-281:ctx-03a8f398) Host 10.0.0.171
> OpaqueRef:bfb2ccc2-135c-4f9a-bc84-143021c71bae: Unplugging pbd
> 2015-11-26 20:22:58,950 DEBUG [c.c.h.x.r.CitrixResourceBase]
> (DirectAgent-281:ctx-03a8f398) Host 10.0.0.171
> OpaqueRef:b0284c5b-613d-0522-5c44-797be269d661: Forgetting
> 2015-11-26 20:22:58,953 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-281:ctx-03a8f398) Seq 4-8612571337392652851: Response
> Received:
> 2015-11-26 20:22:58,953 DEBUG [c.c.a.t.Request]
> (DirectAgent-281:ctx-03a8f398) Seq 4-8612571337392652851: Processing: {
> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 110,
>
> [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Expected
> 1 VDI template but found 2 VDI template(s) on:
> 10.0.0.170:/export/secondary/template/tmpl/1/5","wait":0}}]
> }
> 2015-11-26 20:22:58,953 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
> 4-8612571337392652851: Received: { Ans: , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 110, { CopyCmdAnswer } }
> 2015-11-26 20:22:58,955 DEBUG [c.c.a.m.AgentAttache]
> (DirectAgent-281:ctx-03a8f398) Seq 4-8612571337392652851: No more commands
> found
> 2015-11-26 20:22:58,959 INFO [o.a.c.s.v.VolumeServiceImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) releasing
> lock for VMTemplateStoragePool 4
> 2015-11-26 20:22:58,959 DEBUG [o.a.c.e.o.VolumeOrchestrator]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Unable to
> create Vol[6|vm=5|ROOT]:Expected 1 VDI template but found 2 VDI template(s)
> on: 10.0.0.170:/export/secondary/template/tmpl/1/5
> 2015-11-26 20:22:58,959 INFO [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Unable to
> contact resource.
> com.cloud.exception.StorageUnavailableException: Resource [StoragePool:8]
> is unreachable: Unable to create Vol[6|vm=5|ROOT]:Expected 1 VDI template
> but found 2 VDI template(s) on: 10.0.0.170:
> /export/secondary/template/tmpl/1/5
> at
>
> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1278)
> at
>
> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1336)
> at
>
> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1000)
> at
>
> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4580)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
>
> com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
> at
>
> com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4736)
> at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
> at
>
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
> at
>
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
> at
>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
> at
>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
> at
>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
> at
>
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
> at
>
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> 2015-11-26 20:22:58,962 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Cleaning up
> resources for the vm VM[User|i-2-5-VM] in Starting state
> 2015-11-26 20:22:58,964 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
> 4-8612571337392652852: Sending { Cmd , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 100011,
>
> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"checkBeforeCleanup":false,"vmName":"i-2-5-VM","wait":0}}]
> }
> 2015-11-26 20:22:58,964 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
> 4-8612571337392652852: Executing: { Cmd , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 100011,
>
> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"checkBeforeCleanup":false,"vmName":"i-2-5-VM","wait":0}}]
> }
> 2015-11-26 20:22:58,964 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-141:ctx-62326db5) Seq 4-8612571337392652852: Executing request
> 2015-11-26 20:22:58,971 DEBUG [c.c.a.m.DirectAgentAttache]
> (DirectAgent-141:ctx-62326db5) Seq 4-8612571337392652852: Response
> Received:
> 2015-11-26 20:22:58,971 DEBUG [c.c.a.t.Request]
> (DirectAgent-141:ctx-62326db5) Seq 4-8612571337392652852: Processing: {
> Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not
> exist","wait":0}}] }
> 2015-11-26 20:22:58,971 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
> 4-8612571337392652852: Received: { Ans: , MgmtId: 52229922654, via:
> 4(xenserver), Ver: v1, Flags: 10, { StopAnswer } }
> 2015-11-26 20:22:58,976 DEBUG [c.c.n.NetworkModelImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Service
> SecurityGroup is not supported in the network id=212
> 2015-11-26 20:22:58,977 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Changing
> active number of nics for network id=212 on -1
> 2015-11-26 20:22:58,982 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Asking
> VirtualRouter to release
> NicProfile[11-5-718d2456-bf61-48ad-9663-22ccfd4556f1-10.1.1.88-null
> 2015-11-26 20:22:58,982 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Successfully
> released network resources for the vm VM[User|i-2-5-VM]
> 2015-11-26 20:22:58,982 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Successfully
> cleanued up resources for the vm VM[User|i-2-5-VM] in Starting state
> 2015-11-26 20:22:58,986 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Deploy avoids
> pods: [], clusters: [], hosts: [4]
> 2015-11-26 20:22:58,987 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
> DeploymentPlanner allocation algorithm:
> com.cloud.deploy.FirstFitPlanner@1136745
> 2015-11-26 20:22:58,987 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Trying to
> allocate a host and storage pools from dc:3, pod:3,cluster:null, requested
> cpu: 1000, requested ram: 1073741824
> 2015-11-26 20:22:58,987 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Is ROOT
> volume READY (pool already allocated)?: No
> 2015-11-26 20:22:58,987 DEBUG [c.c.d.FirstFitPlanner]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Searching
> resources only under specified Pod: 3
> 2015-11-26 20:22:58,987 DEBUG [c.c.d.FirstFitPlanner]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Listing
> clusters in order of aggregate capacity, that have (atleast one host with)
> enough CPU and RAM capacity under this Pod: 3
> 2015-11-26 20:22:58,988 DEBUG [c.c.d.FirstFitPlanner]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) No clusters
> found having a host with enough capacity, returning.
> 2015-11-26 20:22:58,995 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) VM state
> transitted from :Starting to Stopped with event: OperationFailedvm's
> original host id: null new host id: null host id before state transition: 4
> 2015-11-26 20:22:58,998 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Hosts's
> actual total CPU: 3399 and CPU after applying overprovisioning: 3399
> 2015-11-26 20:22:58,998 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Hosts's
> actual total RAM: 15354505344 and RAM after applying overprovisioning:
> 15354505216
> 2015-11-26 20:22:58,998 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) release cpu
> from host: 4, old used: 2500,reserved: 0, actual total: 3399, total with
> overprovisioning: 3399; new used: 1500,reserved:0; movedfromreserved:
> false,moveToReserveredfalse
> 2015-11-26 20:22:58,998 DEBUG [c.c.c.CapacityManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) release mem
> from host: 4, old used: 2952790016,reserved: 0, total: 15354505216; new
> used: 1879048192,reserved:0; movedfromreserved: false,moveToReserveredfalse
> 2015-11-26 20:22:59,004 ERROR [c.c.v.VmWorkJobHandlerProxy]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Invocation
> exception, caused by:
> com.cloud.exception.InsufficientServerCapacityException: Unable to create a
> deployment for VM[User|i-2-5-VM]Scope=interface com.cloud.dc.DataCenter;
> id=3
> 2015-11-26 20:22:59,004 INFO [c.c.v.VmWorkJobHandlerProxy]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Rethrow
> exception com.cloud.exception.InsufficientServerCapacityException: Unable
> to create a deployment for VM[User|i-2-5-VM]Scope=interface
> com.cloud.dc.DataCenter; id=3
> 2015-11-26 20:22:59,004 DEBUG [c.c.v.VmWorkJobDispatcher]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Done with run of VM work
> job: com.cloud.vm.VmWorkStart for VM 5, job origin: 68
> 2015-11-26 20:22:59,004 ERROR [c.c.v.VmWorkJobDispatcher]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Unable to complete
> AsyncJobVO {id:71, userId: 2, accountId: 2, instanceType: null, instanceId:
> null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
>
> rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAABXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwc3IAEWphdmEudXRpbC5IYXNoTWFwBQfawcMWYNEDAAJGAApsb2FkRmFjdG9ySQAJdGhyZXNob2xkeHA_QAAAAAAADHcIAAAAEAAAAAF0AApWbVBhc3N3b3JkdAAcck8wQUJYUUFEbk5oZG1Wa1gzQmhjM04zYjNKa3hw,
> cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
> result: null, initMsid: 52229922654, completeMsid: null, lastUpdated: null,
> lastPolled: null, created: Thu Nov 26 20:22:46 IST 2015}, job origin:68
> com.cloud.exception.InsufficientServerCapacityException: Unable to create a
> deployment for VM[User|i-2-5-VM]Scope=interface com.cloud.dc.DataCenter;
> id=3
> at
>
> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:959)
> at
>
> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4580)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
>
> com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
> at
>
> com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4736)
> at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
> at
>
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
> at
>
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
> at
>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
> at
>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
> at
>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
> at
>
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
> at
>
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> 2015-11-26 20:22:59,013 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Complete async job-71,
> jobStatus: FAILED, resultCode: 0, result:
>
> rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAAzVW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1VzZXJ8aS0yLTUtVk1ddXIAHltMamF2YS5sYW5nLlN0YWNrVHJhY2VFbGVtZW50OwJGKjw8_SI5AgAAeHAAAAAVc3IAG2phdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudGEJxZomNt2FAgAESQAKbGluZU51bWJlckwADmRlY2xhcmluZ0NsYXNzcQB-AApMAAhmaWxlTmFtZXEAfgAKTAAKbWV0aG9kTmFtZXEAfgAKeHAAAAO_dAAmY29tLmNsb3VkLnZtLlZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGx0AB5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsLmphdmF0ABBvcmNoZXN0cmF0ZVN0YXJ0c3EAfgARAAAR5HEAfgATcQB-ABRxAH4AFXNxAH4AEf____50ACRzdW4ucmVmbGVjdC5OYXRpdmVNZXRob2RBY2Nlc3NvckltcGx0AB1OYXRpdmVNZXRob2RBY2Nlc3NvckltcGwuamF2YXQAB2ludm9rZTBzcQB-ABEAAAA5cQB-ABhxAH4AGXQABmludm9rZXNxAH4AEQAAACt0AChzdW4ucmVmbGVjdC5EZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsdAAhRGVsZWdhdGluZ01ldGhvZEFjY2Vzc29ySW1wbC5qYXZhcQB-ABxzcQB-ABEAAAJedAAYamF2YS5sYW5nLnJlZmxlY3QuTWV0aG9kdAALTWV0aG9kLmphdmFxAH4AHHNxAH4AEQAAAGt0ACJjb20uY2xvdWQudm0uVm1Xb3JrSm9iSGFuZGxlclByb3h5dAAaVm1Xb3JrSm9iSGFuZGxlclByb3h5LmphdmF0AA9oYW5kbGVWbVdvcmtKb2JzcQB-ABEAABKAcQB-ABNxAH4AFHEAfgAmc3EAfgARAAAAZnQAIGNvbS5jbG91ZC52bS5WbVdvcmtKb2JEaXNwYXRjaGVydAAYVm1Xb3JrSm9iRGlzcGF0Y2hlci5qYXZhdAAGcnVuSm9ic3EAfgARAAACGXQAP29yZy5hcGFjaGUuY2xvdWRzdGFjay5mcmFtZXdvcmsuam9icy5pbXBsLkFzeW5jSm9iTWFuYWdlckltcGwkNXQAGEFzeW5jSm9iTWFuYWdlckltcGwuamF2YXQADHJ1bkluQ29udGV4dHNxAH4AEQAAADF0AD5vcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGUkMXQAG01hbmFnZWRDb250ZXh0UnVubmFibGUuamF2YXQAA3J1bnNxAH4AEQAAADh0AEJvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0JDF0ABpEZWZhdWx0TWFuYWdlZENvbnRleHQuamF2YXQABGNhbGxzcQB-ABEAAABndABAb3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5pbXBsLkRlZmF1bHRNYW5hZ2VkQ29udGV4dHEAfgA2dAAPY2FsbFdpdGhDb250ZXh0c3EAfgARAAAANXEAfgA5cQB-ADZ0AA5ydW5XaXRoQ29udGV4dHNxAH4AEQAAAC50ADxvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGVxAH4AMnEAfgAzc3EAfgARAAAB7nEAfgAtcQB-AC5xAH4AM3NxAH4AEQAAAdd0AC5qYXZhLnV0aWwuY29uY3VycmVudC5FeGVjdXRvcnMkUnVubmFibGVBZGFwdGVydAAORXhlY3V0b3JzLmphdmFxAH4AN3NxAH4AEQAAAQZ0AB9qYXZhLnV0aWwuY29uY3VycmVudC5GdXR1cmVUYXNrdAAPRnV0dXJlVGFzay5qYXZhcQB-ADNzcQB-ABEAAAR5dAAnamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9ydAAXVGhyZWFkUG9vbEV4ZWN1dG9yLmphdmF0AAlydW5Xb3JrZXJzcQB-ABEAAAJndAAuamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9yJFdvcmtlcnEAfgBIcQB-ADNzcQB-ABEAAALpdAAQamF2YS5sYW5nLlRocmVhZHQAC1RocmVhZC5qYXZhcQB-ADNzcgAmamF2YS51dGlsLkNvbGxlY3Rpb25zJFVubW9kaWZpYWJsZUxpc3T8DyUxteyOEAIAAUwABGxpc3RxAH4ADHhyACxqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlQ29sbGVjdGlvbhlCAIDLXvceAgABTAABY3QAFkxqYXZhL3V0aWwvQ29sbGVjdGlvbjt4cHNyABNqYXZhLnV0aWwuQXJyYXlMaXN0eIHSHZnHYZ0DAAFJAARzaXpleHAAAAAAdwQAAAAAeHEAfgBUeHNyABFqYXZhLmxhbmcuSW50ZWdlchLioKT3gYc4AgABSQAFdmFsdWV4cgAQamF2YS5sYW5nLk51bWJlcoaslR0LlOCLAgAAeHAAABDvc3EAfgBTAAAAAHcEAAAAAHhzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHEAfgBWAAAAAAAAAAN2cgAXY29tLmNsb3VkLmRjLkRhdGFDZW50ZXKy8Qrrp-d4vgIAAHhwAA
> 2015-11-26 20:22:59,015 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Publish async job-71
> complete on message bus
> 2015-11-26 20:22:59,015 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Wake up jobs related to
> job-71
> 2015-11-26 20:22:59,016 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Update db status for
> job-71
> 2015-11-26 20:22:59,016 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Wake up jobs joined with
> job-71 and disjoin all subjobs created from job- 71
> 2015-11-26 20:22:59,022 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Done executing
> com.cloud.vm.VmWorkStart for job-71
> 2015-11-26 20:22:59,022 INFO [o.a.c.f.j.i.AsyncJobMonitor]
> (Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Remove job-71 from job
> monitoring
> 2015-11-26 20:22:59,032 DEBUG [c.c.v.UserVmManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Destroying vm
> VM[User|i-2-5-VM] as it failed to create on Host with Id:null
> 2015-11-26 20:22:59,040 DEBUG [c.c.c.CapacityManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) VM state transitted
> from :Stopped to Error with event: OperationFailedToErrorvm's original host
> id: null new host id: null host id before state transition: null
> 2015-11-26 20:22:59,051 DEBUG [c.c.u.AccountManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Access granted to
> Acct[20064ffe-9415-11e5-a790-000c29255f5e-admin] to Domain:1/ by
> AffinityGroupAccessChecker
> 2015-11-26 20:22:59,076 DEBUG [c.c.u.AccountManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Access granted to
> Acct[20064ffe-9415-11e5-a790-000c29255f5e-admin] to Domain:1/ by
> AffinityGroupAccessChecker
> 2015-11-26 20:22:59,080 WARN [o.a.c.alerts]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) alertType:: 8 //
> dataCenterId:: 3 // podId:: 3 // clusterId:: null // message:: Failed to
> deploy Vm with Id: 5, on Host with Id: null
> 2015-11-26 20:22:59,095 ERROR [c.c.a.ApiAsyncJobDispatcher]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68) Unexpected exception while
> executing org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin
> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due
> to insufficient capacity
> at
>
> com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:622)
> at
>
> org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:242)
> at
>
> org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:212)
> at
>
> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3870)
> at
>
> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3488)
> at
>
> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3476)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
>
> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
> at
>
> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
> at
>
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
> at
>
> org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:106)
> at
>
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
> at
>
> com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
> at
>
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
> at
>
> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
> at
>
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
> at
>
> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
> at com.sun.proxy.$Proxy202.startVirtualMachine(Unknown Source)
> at
>
> org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin.execute(DeployVMCmdByAdmin.java:50)
> at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
> at
> com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
> at
>
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
> at
>
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
> at
>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
> at
>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
> at
>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
> at
>
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
> at
>
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: com.cloud.exception.InsufficientServerCapacityException: Unable
> to create a deployment for VM[User|i-2-5-VM]Scope=interface
> com.cloud.dc.DataCenter; id=3
> at
>
> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:959)
> at
>
> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4580)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> ... 18 more
> 2015-11-26 20:22:59,097 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68) Complete async job-68, jobStatus:
> FAILED, resultCode: 530, result:
>
> org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable
> to start a VM due to insufficient capacity"}
> 2015-11-26 20:22:59,097 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68) Publish async job-68 complete on
> message bus
> 2015-11-26 20:22:59,097 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68) Wake up jobs related to job-68
> 2015-11-26 20:22:59,097 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68) Update db status for job-68
> 2015-11-26 20:22:59,098 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68) Wake up jobs joined with job-68
> and disjoin all subjobs created from job- 68
> 2015-11-26 20:22:59,100 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68) Done executing
> org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin for job-68
> 2015-11-26 20:22:59,100 INFO [o.a.c.f.j.i.AsyncJobMonitor]
> (API-Job-Executor-3:ctx-a2ed53c6 job-68) Remove job-68 from job monitoring
> 2015-11-26 20:22:59,608 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-8:ctx-dd95e514) ===START=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549644927
> 2015-11-26 20:22:59,619 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-8:ctx-dd95e514 ctx-3583ca96) ===END=== 10.0.0.93 -- GET
>
> command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549644927
> 2015-11-26 20:22:59,623 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-9:ctx-c94acc67) ===START=== 10.0.0.93 -- GET
>
> command=listVirtualMachines&id=4ce4731f-22a7-42ac-8e78-093d5f2e9a34&response=json&_=1448549644944
> 2015-11-26 20:22:59,639 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-9:ctx-c94acc67 ctx-b3ea1be2) ===END=== 10.0.0.93 -- GET
>
> command=listVirtualMachines&id=4ce4731f-22a7-42ac-8e78-093d5f2e9a34&response=json&_=1448549644944
> 2015-11-26 20:23:01,968 DEBUG [c.c.a.m.AgentManagerImpl]
> (AgentManager-Handler-10:null) SeqA 5-1790: Processing Seq 5-1790: { Cmd ,
> MgmtId: -1, via: 5, Ver: v1, Flags: 11,
>
> [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
> \"connections\": []\n}","wait":0}}] }
> 2015-11-26 20:23:01,972 DEBUG [c.c.a.m.AgentManagerImpl]
> (AgentManager-Handler-10:null) SeqA 5-1790: Sending Seq 5-1790: { Ans: ,
> MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
> [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
> 2015-11-26 20:23:04,354 DEBUG [o.a.c.s.SecondaryStorageManagerImpl]
> (secstorage-1:ctx-e4c5abdc) Zone 3 is ready to launch secondary storage VM
> 2015-11-26 20:23:04,680 DEBUG [c.c.c.ConsoleProxyManagerImpl]
> (consoleproxy-1:ctx-f87cf64e) Zone 3 is ready to launch console proxy
> 2015-11-26 20:23:08,020 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> (AsyncJobMgr-Heartbeat-1:ctx-39ec59bb) Begin cleanup expired async-jobs
> 2015-11-26 20:23:08,023 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
> (AsyncJobMgr-Heartbeat-1:ctx-39ec59bb) End cleanup expired async-jobs
>
> Regards,
> Venkatesh.k
>
>
> On Thu, Nov 26, 2015 at 9:04 PM, kotipalli venkatesh <
> venkateshcloudtest@gmail.com> wrote:
>
> > Hi Erik,
> >
> > We found the error log, Please look in to this below error log,
> >
> > 2015-11-26 20:22:46,603 DEBUG [c.c.a.m.AgentAttache]
> > (DirectAgent-279:ctx-532427fb) Seq 4-8612571337392652847: No more
> commands
> > found
> > 2015-11-26 20:22:46,607 INFO [o.a.c.s.v.VolumeServiceImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) releasing
> > lock for VMTemplateStoragePool 3
> > 2015-11-26 20:22:46,608 DEBUG [o.a.c.e.o.VolumeOrchestrator]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Unable to
> > create Vol[6|vm=5|ROOT]:Expected 1 VDI template but found 2 VDI
> template(s)
> > on: 10.0.0.170:/export/secondary/template/tmpl/1/5
> > 2015-11-26 20:22:46,608 INFO [c.c.v.VirtualMachineManagerImpl]
> > (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Unable to
> > contact resource.
> > com.cloud.exception.StorageUnavailableException: Resource [StoragePool:8]
> > is unreachable: Unable to create Vol[6|vm=5|ROOT]:Expected 1 VDI template
> > but found 2 VDI template(s) on: 10.0.0.170:
> > /export/secondary/template/tmpl/1/5
> >
> >
> > /export/secondary/template/tmpl/1/5 Inside the 2 .vhd files and one
> > template properties file is there please look in to the below files;
> >
> > 3986df71-b1d0-3e20-a655-7e42dd144370.vhd
> > 429d6340-6a5f-31ce-a581-cc05618500ab.vhd template.properties
> >
> > Which one is remove?
> >
> > Could you please suggest.
> >
> > Regards,
> > Venkatesh.k
> >
> > On Thu, Nov 26, 2015 at 6:11 PM, Erik Weber <te...@gmail.com> wrote:
> >
> >> You need to paste more of your logs, in particular the (a lot of) lines
> >> before the exception where all the resource allocations happen.
> >>
> >> --
> >> Erik
> >>
> >> On Thu, Nov 26, 2015 at 1:38 PM, kotipalli venkatesh <
> >> venkateshcloudtest@gmail.com> wrote:
> >>
> >> > Hi All,
> >> >
> >> > I have successfully installed Cloudstack 4.6.0 setup
> >> > hypervisor is xenserver 6.5
> >> >
> >> > Successfully up and running SSVM and CPVM and Default templates
> >> downloaded.
> >> >
> >> > When i am spin the new instance it 's troughs *insufficient memory
> >> error*.
> >> > But i have *sufficient place* *RAM* and *STORAGE* also.
> >> >
> >> > Please look in to this Management server log:
> >> >
> >> > 2015-11-26 17:49:10,572 WARN [o.a.c.alerts]
> >> > (API-Job-Executor-1:ctx-801f0a96 job-56 ctx-63dfadf9) alertType:: 8
> //
> >> > dataCenterId:: 3 // podId:: 3 // clusterId:: null // message:: Failed
> to
> >> > deploy Vm with Id: 3, on Host with Id: null
> >> > 2015-11-26 17:49:10,601 ERROR [c.c.a.ApiAsyncJobDispatcher]
> >> > (API-Job-Executor-1:ctx-801f0a96 job-56) Unexpected exception while
> >> > executing
> org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin
> >> > com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM
> >> due
> >> > to insufficient capacity
> >> > at
> >> >
> >> >
> >>
> com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:622)
> >> > at
> >> >
> >> >
> >>
> org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:242)
> >> > at
> >> >
> >> >
> >>
> org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:212)
> >> > at
> >> >
> >> >
> >>
> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3870)
> >> > at
> >> >
> >> >
> >>
> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3488)
> >> > at
> >> >
> >> >
> >>
> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3476)
> >> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >> > at
> >> >
> >> >
> >>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> >> > at
> >> >
> >> >
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >> > at java.lang.reflect.Method.invoke(Method.java:606)
> >> > at
> >> >
> >> >
> >>
> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
> >> > at
> >> >
> >> >
> >>
> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
> >> > at
> >> >
> >> >
> >>
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
> >> > at
> >> >
> >> >
> >>
> org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:106)
> >> > at
> >> >
> >> >
> >>
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
> >> > at
> >> >
> >> >
> >>
> com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
> >> > at
> >> >
> >> >
> >>
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
> >> > at
> >> >
> >> >
> >>
> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
> >> > at
> >> >
> >> >
> >>
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
> >> > at
> >> >
> >> >
> >>
> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
> >> > at com.sun.proxy.$Proxy202.startVirtualMachine(Unknown Source)
> >> > at
> >> >
> >> >
> >>
> org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin.execute(DeployVMCmdByAdmin.java:50)
> >> > at
> com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
> >> > at
> >> >
> >>
> com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
> >> > at
> >> >
> >> >
> >>
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
> >> > at
> >> >
> >> >
> >>
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
> >> > at
> >> >
> >> >
> >>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
> >> > at
> >> >
> >> >
> >>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
> >> > at
> >> >
> >> >
> >>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
> >> > at
> >> >
> >> >
> >>
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
> >> > at
> >> >
> >> >
> >>
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
> >> > at
> >> >
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> >> > at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> >> > at
> >> >
> >> >
> >>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> >> > at
> >> >
> >> >
> >>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> >> > at java.lang.Thread.run(Thread.java:745)
> >> > Caused by: com.cloud.exception.InsufficientServerCapacityException:
> >> Unable
> >> > to create a deployment for VM[User|i-2-3-VM]Scope=interface
> >> > com.cloud.dc.DataCenter; id=3
> >> > at
> >> >
> >> >
> >>
> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:959)
> >> >
> >> > Please any suggestion....
> >> >
> >> > Warm Regards,
> >> > Venkatesh.k
> >> >
> >>
> >
> >
>
--
Rafael Weingärtner
Re: Insufficient Memory error
Posted by kotipalli venkatesh <ve...@gmail.com>.
Hi Erik,
Please look in to this full log:
2015-11-26 20:21:46,959 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-15:null) SeqA 5-1781: Processing Seq 5-1781: { Cmd ,
MgmtId: -1, via: 5, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
\"connections\": []\n}","wait":0}}] }
2015-11-26 20:21:46,962 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-15:null) SeqA 5-1781: Sending Seq 5-1781: { Ans: ,
MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
[{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2015-11-26 20:21:48,018 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-0bf05867) Begin cleanup expired async-jobs
2015-11-26 20:21:48,020 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-0bf05867) End cleanup expired async-jobs
2015-11-26 20:21:48,210 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:ctx-0e1a35ca) Found 1 routers to update status.
2015-11-26 20:21:48,210 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:ctx-0e1a35ca) Found 0 VPC networks to update
Redundant State.
2015-11-26 20:21:48,211 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:ctx-0e1a35ca) Found 0 networks to update RvR status.
2015-11-26 20:21:48,222 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:ctx-71753b97) Found 1 routers to update status.
2015-11-26 20:21:48,222 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:ctx-71753b97) Found 0 VPC networks to update
Redundant State.
2015-11-26 20:21:48,223 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:ctx-71753b97) Found 0 networks to update RvR status.
2015-11-26 20:21:53,165 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager
Timer:ctx-3ab0cd7f) Resetting hosts suitable for reconnect
2015-11-26 20:21:53,166 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager
Timer:ctx-3ab0cd7f) Completed resetting hosts suitable for reconnect
2015-11-26 20:21:53,166 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager
Timer:ctx-3ab0cd7f) Acquiring hosts for clusters already owned by this
management server
2015-11-26 20:21:53,168 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager
Timer:ctx-3ab0cd7f) Completed acquiring hosts for clusters already owned by
this management server
2015-11-26 20:21:53,168 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager
Timer:ctx-3ab0cd7f) Acquiring hosts for clusters not owned by any
management server
2015-11-26 20:21:53,168 DEBUG [c.c.h.d.HostDaoImpl] (ClusteredAgentManager
Timer:ctx-3ab0cd7f) Completed acquiring hosts for clusters not owned by any
management server
2015-11-26 20:21:55,958 DEBUG [c.c.a.ApiServlet]
(catalina-exec-2:ctx-5db7a86d) ===START=== 10.0.0.93 -- GET
command=deployVirtualMachine&response=json&zoneid=5b752672-2ac9-4ec0-86a6-103cae8217d1&templateid=900a5634-9414-11e5-ae19-000c29255f5e&hypervisor=XenServer&serviceofferingid=94b83ad1-406c-44d5-86c0-d4dbb82a50a1&diskofferingid=30f3f1fa-76b2-4bcb-82c5-449ce7d9a4c8&iptonetworklist%5B0%5D.networkid=2e97fcee-3d01-40d2-a624-376661747d0c&displayname=Test002&name=Test002&_=1448549581263
2015-11-26 20:21:55,969 DEBUG [c.c.u.AccountManagerImpl]
(catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Access granted to
Acct[20064ffe-9415-11e5-a790-000c29255f5e-admin] to
com.cloud.service.ServiceOfferingVO$$EnhancerByCGLIB$$8b588241@5020f5b3 by
AffinityGroupAccessChecker
2015-11-26 20:21:55,969 DEBUG [c.c.u.AccountManagerImpl]
(catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Access granted to
Acct[20064ffe-9415-11e5-a790-000c29255f5e-admin] to
com.cloud.storage.DiskOfferingVO$$EnhancerByCGLIB$$a160ea41@45e982eb by
AffinityGroupAccessChecker
2015-11-26 20:21:55,976 DEBUG [c.c.n.NetworkModelImpl]
(catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Service SecurityGroup is not
supported in the network id=212
2015-11-26 20:21:55,982 DEBUG [c.c.v.UserVmManagerImpl]
(catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Allocating in the DB for vm
2015-11-26 20:21:55,988 DEBUG [c.c.v.VirtualMachineManagerImpl]
(catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Allocating entries for VM:
VM[User|i-2-5-VM]
2015-11-26 20:21:55,988 DEBUG [c.c.v.VirtualMachineManagerImpl]
(catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Allocating nics for
VM[User|i-2-5-VM]
2015-11-26 20:21:55,989 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Allocating nic for vm
VM[User|i-2-5-VM] in network Ntwk[212|Guest|8] with requested profile
NicProfile[0-0-null-null-null
2015-11-26 20:21:55,996 DEBUG [c.c.n.NetworkModelImpl]
(catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Service SecurityGroup is not
supported in the network id=212
2015-11-26 20:21:55,997 DEBUG [c.c.v.VirtualMachineManagerImpl]
(catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Allocating disks for
VM[User|i-2-5-VM]
2015-11-26 20:21:56,008 DEBUG [c.c.v.VirtualMachineManagerImpl]
(catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Allocation completed for VM:
VM[User|i-2-5-VM]
2015-11-26 20:21:56,009 DEBUG [c.c.v.UserVmManagerImpl]
(catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Successfully allocated DB entry
for VM[User|i-2-5-VM]
2015-11-26 20:21:56,034 DEBUG [c.c.n.NetworkModelImpl]
(catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Service SecurityGroup is not
supported in the network id=212
2015-11-26 20:21:56,037 DEBUG [c.c.n.NetworkModelImpl]
(catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) Service SecurityGroup is not
supported in the network id=212
2015-11-26 20:21:56,053 INFO [o.a.c.f.j.i.AsyncJobMonitor]
(API-Job-Executor-3:ctx-a2ed53c6 job-68) Add job-68 into job monitoring
2015-11-26 20:21:56,054 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) submit async job-68, details:
AsyncJobVO {id:68, userId: 2, accountId: 2, instanceType: VirtualMachine,
instanceId: 5, cmd:
org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin, cmdInfo:
{"serviceofferingid":"94b83ad1-406c-44d5-86c0-d4dbb82a50a1","cmdEventType":"VM.CREATE","ctxUserId":"2","zoneid":"5b752672-2ac9-4ec0-86a6-103cae8217d1","httpmethod":"GET","templateid":"900a5634-9414-11e5-ae19-000c29255f5e","response":"json","id":"5","ctxDetails":"{\"interface
com.cloud.template.VirtualMachineTemplate\":\"900a5634-9414-11e5-ae19-000c29255f5e\",\"interface
com.cloud.offering.DiskOffering\":\"30f3f1fa-76b2-4bcb-82c5-449ce7d9a4c8\",\"interface
com.cloud.offering.ServiceOffering\":\"94b83ad1-406c-44d5-86c0-d4dbb82a50a1\",\"interface
com.cloud.vm.VirtualMachine\":\"4ce4731f-22a7-42ac-8e78-093d5f2e9a34\",\"interface
com.cloud.dc.DataCenter\":\"5b752672-2ac9-4ec0-86a6-103cae8217d1\"}","hypervisor":"XenServer","name":"Test002","iptonetworklist[0].networkid":"2e97fcee-3d01-40d2-a624-376661747d0c","_":"1448549581263","uuid":"4ce4731f-22a7-42ac-8e78-093d5f2e9a34","ctxAccountId":"2","diskofferingid":"30f3f1fa-76b2-4bcb-82c5-449ce7d9a4c8","ctxStartEventId":"168","displayname":"Test002"},
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
result: null, initMsid: 52229922654, completeMsid: null, lastUpdated: null,
lastPolled: null, created: null}
2015-11-26 20:21:56,058 DEBUG [c.c.a.ApiServlet]
(catalina-exec-2:ctx-5db7a86d ctx-4c1ffa3c) ===END=== 10.0.0.93 -- GET
command=deployVirtualMachine&response=json&zoneid=5b752672-2ac9-4ec0-86a6-103cae8217d1&templateid=900a5634-9414-11e5-ae19-000c29255f5e&hypervisor=XenServer&serviceofferingid=94b83ad1-406c-44d5-86c0-d4dbb82a50a1&diskofferingid=30f3f1fa-76b2-4bcb-82c5-449ce7d9a4c8&iptonetworklist%5B0%5D.networkid=2e97fcee-3d01-40d2-a624-376661747d0c&displayname=Test002&name=Test002&_=1448549581263
2015-11-26 20:21:56,061 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68) Executing AsyncJobVO {id:68,
userId: 2, accountId: 2, instanceType: VirtualMachine, instanceId: 5, cmd:
org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin, cmdInfo:
{"serviceofferingid":"94b83ad1-406c-44d5-86c0-d4dbb82a50a1","cmdEventType":"VM.CREATE","ctxUserId":"2","zoneid":"5b752672-2ac9-4ec0-86a6-103cae8217d1","httpmethod":"GET","templateid":"900a5634-9414-11e5-ae19-000c29255f5e","response":"json","id":"5","ctxDetails":"{\"interface
com.cloud.template.VirtualMachineTemplate\":\"900a5634-9414-11e5-ae19-000c29255f5e\",\"interface
com.cloud.offering.DiskOffering\":\"30f3f1fa-76b2-4bcb-82c5-449ce7d9a4c8\",\"interface
com.cloud.offering.ServiceOffering\":\"94b83ad1-406c-44d5-86c0-d4dbb82a50a1\",\"interface
com.cloud.vm.VirtualMachine\":\"4ce4731f-22a7-42ac-8e78-093d5f2e9a34\",\"interface
com.cloud.dc.DataCenter\":\"5b752672-2ac9-4ec0-86a6-103cae8217d1\"}","hypervisor":"XenServer","name":"Test002","iptonetworklist[0].networkid":"2e97fcee-3d01-40d2-a624-376661747d0c","_":"1448549581263","uuid":"4ce4731f-22a7-42ac-8e78-093d5f2e9a34","ctxAccountId":"2","diskofferingid":"30f3f1fa-76b2-4bcb-82c5-449ce7d9a4c8","ctxStartEventId":"168","displayname":"Test002"},
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
result: null, initMsid: 52229922654, completeMsid: null, lastUpdated: null,
lastPolled: null, created: null}
2015-11-26 20:21:56,085 DEBUG [c.c.n.NetworkModelImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Service SecurityGroup
is not supported in the network id=212
2015-11-26 20:21:56,087 DEBUG [c.c.n.NetworkModelImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Service SecurityGroup
is not supported in the network id=212
2015-11-26 20:21:56,094 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Deploy avoids pods:
[], clusters: [], hosts: []
2015-11-26 20:21:56,095 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) DeploymentPlanner
allocation algorithm: com.cloud.deploy.FirstFitPlanner@1136745
2015-11-26 20:21:56,095 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Trying to allocate a
host and storage pools from dc:3, pod:null,cluster:null, requested cpu:
1000, requested ram: 1073741824
2015-11-26 20:21:56,095 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Is ROOT volume READY
(pool already allocated)?: No
2015-11-26 20:21:56,095 DEBUG [c.c.d.FirstFitPlanner]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Searching all
possible resources under this Zone: 3
2015-11-26 20:21:56,096 DEBUG [c.c.d.FirstFitPlanner]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Listing clusters in
order of aggregate capacity, that have (atleast one host with) enough CPU
and RAM capacity under this Zone: 3
2015-11-26 20:21:56,097 DEBUG [c.c.d.FirstFitPlanner]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Removing from the
clusterId list these clusters from avoid set: []
2015-11-26 20:21:56,103 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking resources in
Cluster: 3 under Pod: 3
2015-11-26 20:21:56,104 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
FirstFitRoutingAllocator) Looking for hosts in dc: 3 pod:3 cluster:3
2015-11-26 20:21:56,105 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for
allocation: [Host[-4-Routing]]
2015-11-26 20:21:56,108 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
FirstFitRoutingAllocator) Found 1 hosts for allocation after
prioritization: [Host[-4-Routing]]
2015-11-26 20:21:56,108 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
FirstFitRoutingAllocator) Looking for speed=1000Mhz, Ram=1024
2015-11-26 20:21:56,111 DEBUG [c.c.c.CapacityManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
FirstFitRoutingAllocator) Host: 4 has cpu capability (cpu:1, speed:3399) to
support requested CPU: 1 and requested speed: 1000
2015-11-26 20:21:56,111 DEBUG [c.c.c.CapacityManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
FirstFitRoutingAllocator) Checking if host: 4 has enough capacity for
requested CPU: 1000 and requested RAM: 1073741824 ,
cpuOverprovisioningFactor: 1.0
2015-11-26 20:21:56,113 DEBUG [c.c.c.CapacityManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
FirstFitRoutingAllocator) Hosts's actual total CPU: 3399 and CPU after
applying overprovisioning: 3399
2015-11-26 20:21:56,113 DEBUG [c.c.c.CapacityManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
FirstFitRoutingAllocator) Free CPU: 2399 , Requested CPU: 1000
2015-11-26 20:21:56,113 DEBUG [c.c.c.CapacityManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
FirstFitRoutingAllocator) Free RAM: 13743892480 , Requested RAM: 1073741824
2015-11-26 20:21:56,113 DEBUG [c.c.c.CapacityManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
FirstFitRoutingAllocator) Host has enough CPU and RAM available
2015-11-26 20:21:56,113 DEBUG [c.c.c.CapacityManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 4, used: 1000,
reserved: 0, actual total: 3399, total with overprovisioning: 3399;
requested cpu:1000,alloc_from_last_host?:false ,considerReservedCapacity?:
true
2015-11-26 20:21:56,113 DEBUG [c.c.c.CapacityManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 4, used:
1610612736, reserved: 0, total: 15354505216; requested mem:
1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
2015-11-26 20:21:56,113 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
FirstFitRoutingAllocator) Found a suitable host, adding to list: 4
2015-11-26 20:21:56,113 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e
FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts
2015-11-26 20:21:56,115 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking suitable
pools for volume (Id, Type): (6,ROOT)
2015-11-26 20:21:56,115 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) We need to allocate
new storagepool for this volume
2015-11-26 20:21:56,115 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Calling
StoragePoolAllocators to find suitable pools
2015-11-26 20:21:56,116 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e)
LocalStoragePoolAllocator trying to find storage pool to fit the vm
2015-11-26 20:21:56,116 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e)
ClusterScopeStoragePoolAllocator looking for storage pool
2015-11-26 20:21:56,116 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Looking for pools in
dc: 3 pod:3 cluster:3. Disabled pools will be ignored.
2015-11-26 20:21:56,117 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found pools matching
tags: [Pool[8|NetworkFilesystem]]
2015-11-26 20:21:56,118 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking if storage
pool is suitable, name: null ,poolId: 8
2015-11-26 20:21:56,119 INFO [c.c.s.StorageManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Storage pool null (8)
does not supply IOPS capacity, assuming enough capacity
2015-11-26 20:21:56,120 DEBUG [c.c.s.StorageManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool 8 for
storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
0.019253810234789077, disable threshold: 0.85
2015-11-26 20:21:56,130 DEBUG [c.c.s.StorageManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found storage pool
primary of type NetworkFilesystem with overprovisioning factor 2
2015-11-26 20:21:56,130 DEBUG [c.c.s.StorageManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total over
provisioned capacity calculated is 2 * 526199291904
2015-11-26 20:21:56,130 DEBUG [c.c.s.StorageManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total capacity of the
pool primary id: 8 is 1052398583808
2015-11-26 20:21:56,130 DEBUG [c.c.s.StorageManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool: 8 for
volume allocation [Vol[6|vm=5|ROOT]], maxSize : 1052398583808,
totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
disable threshold: 0.85
2015-11-26 20:21:56,130 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e)
ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
2015-11-26 20:21:56,130 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking suitable
pools for volume (Id, Type): (7,DATADISK)
2015-11-26 20:21:56,130 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) We need to allocate
new storagepool for this volume
2015-11-26 20:21:56,131 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Calling
StoragePoolAllocators to find suitable pools
2015-11-26 20:21:56,131 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e)
LocalStoragePoolAllocator trying to find storage pool to fit the vm
2015-11-26 20:21:56,131 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e)
ClusterScopeStoragePoolAllocator looking for storage pool
2015-11-26 20:21:56,131 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Looking for pools in
dc: 3 pod:3 cluster:3. Disabled pools will be ignored.
2015-11-26 20:21:56,131 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found pools matching
tags: [Pool[8|NetworkFilesystem]]
2015-11-26 20:21:56,132 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking if storage
pool is suitable, name: null ,poolId: 8
2015-11-26 20:21:56,132 INFO [c.c.s.StorageManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Storage pool null (8)
does not supply IOPS capacity, assuming enough capacity
2015-11-26 20:21:56,133 DEBUG [c.c.s.StorageManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool 8 for
storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
0.019253810234789077, disable threshold: 0.85
2015-11-26 20:21:56,139 DEBUG [c.c.s.StorageManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found storage pool
primary of type NetworkFilesystem with overprovisioning factor 2
2015-11-26 20:21:56,139 DEBUG [c.c.s.StorageManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total over
provisioned capacity calculated is 2 * 526199291904
2015-11-26 20:21:56,139 DEBUG [c.c.s.StorageManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total capacity of the
pool primary id: 8 is 1052398583808
2015-11-26 20:21:56,140 DEBUG [c.c.s.StorageManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool: 8 for
volume allocation [Vol[7|vm=5|DATADISK]], maxSize : 1052398583808,
totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
disable threshold: 0.85
2015-11-26 20:21:56,140 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e)
ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
2015-11-26 20:21:56,140 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Trying to find a
potenial host and associated storage pools from the suitable host/pool
lists for this VM
2015-11-26 20:21:56,140 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking if host: 4
can access any suitable storage pool for volume: DATADISK
2015-11-26 20:21:56,140 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Host: 4 can access
pool: 8
2015-11-26 20:21:56,141 DEBUG [c.c.s.StorageManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool 8 for
storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
0.019253810234789077, disable threshold: 0.85
2015-11-26 20:21:56,142 DEBUG [c.c.s.StorageManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found storage pool
primary of type NetworkFilesystem with overprovisioning factor 2
2015-11-26 20:21:56,142 DEBUG [c.c.s.StorageManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total over
provisioned capacity calculated is 2 * 526199291904
2015-11-26 20:21:56,143 DEBUG [c.c.s.StorageManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total capacity of the
pool primary id: 8 is 1052398583808
2015-11-26 20:21:56,143 DEBUG [c.c.s.StorageManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool: 8 for
volume allocation [Vol[7|vm=5|DATADISK]], maxSize : 1052398583808,
totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
disable threshold: 0.85
2015-11-26 20:21:56,143 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking if host: 4
can access any suitable storage pool for volume: ROOT
2015-11-26 20:21:56,143 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Host: 4 can access
pool: 8
2015-11-26 20:21:56,144 DEBUG [c.c.s.StorageManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool 8 for
storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
0.019253810234789077, disable threshold: 0.85
2015-11-26 20:21:56,146 DEBUG [c.c.s.StorageManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found storage pool
primary of type NetworkFilesystem with overprovisioning factor 2
2015-11-26 20:21:56,146 DEBUG [c.c.s.StorageManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total over
provisioned capacity calculated is 2 * 526199291904
2015-11-26 20:21:56,146 DEBUG [c.c.s.StorageManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Total capacity of the
pool primary id: 8 is 1052398583808
2015-11-26 20:21:56,147 DEBUG [c.c.s.StorageManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Checking pool: 8 for
volume allocation [Vol[6|vm=5|ROOT]], maxSize : 1052398583808,
totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
disable threshold: 0.85
2015-11-26 20:21:56,147 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Found a potential
host id: 4 name: xenserver and associated storage pools for this VM
2015-11-26 20:21:56,148 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Returning Deployment
Destination:
Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
:
Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage(Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
Volume(7|DATADISK-->Pool(8))]
2015-11-26 20:21:56,155 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Sync job-69 execution
on object VmWorkJobQueue.5
2015-11-26 20:21:56,961 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-1:null) SeqA 5-1782: Processing Seq 5-1782: { Cmd ,
MgmtId: -1, via: 5, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
\"connections\": []\n}","wait":0}}] }
2015-11-26 20:21:56,966 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-1:null) SeqA 5-1782: Sending Seq 5-1782: { Ans: ,
MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
[{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2015-11-26 20:21:58,022 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-7d4d1e50) Execute sync-queue item:
SyncQueueItemVO {id:9, queueId: 9, contentType: AsyncJob, contentId: 69,
lastProcessMsid: 52229922654, lastprocessNumber: 1, lastProcessTime: Thu
Nov 26 20:21:58 IST 2015, created: Thu Nov 26 20:21:56 IST 2015}
2015-11-26 20:21:58,022 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-7d4d1e50) Schedule queued job-69
2015-11-26 20:21:58,026 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-05b26563) Begin cleanup expired async-jobs
2015-11-26 20:21:58,029 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-05b26563) End cleanup expired async-jobs
2015-11-26 20:21:58,029 INFO [o.a.c.f.j.i.AsyncJobMonitor]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Add job-69 into job
monitoring
2015-11-26 20:21:58,033 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Executing AsyncJobVO
{id:69, userId: 2, accountId: 2, instanceType: null, instanceId: null, cmd:
com.cloud.vm.VmWorkStart, cmdInfo:
rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAABXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAA3BzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHIAEGphdmEubGFuZy5OdW1iZXKGrJUdC5TgiwIAAHhwAAAAAAAAAANzcQB-AAgAAAAAAAAABHBwcHEAfgAKcHNyABFqYXZhLnV0aWwuSGFzaE1hcAUH2sHDFmDRAwACRgAKbG9hZEZhY3RvckkACXRocmVzaG9sZHhwP0AAAAAAAAx3CAAAABAAAAABdAAKVm1QYXNzd29yZHQAHHJPMEFCWFFBRG5OaGRtVmtYM0JoYzNOM2IzSmt4cA,
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
result: null, initMsid: 52229922654, completeMsid: null, lastUpdated: null,
lastPolled: null, created: Thu Nov 26 20:21:56 IST 2015}
2015-11-26 20:21:58,033 DEBUG [c.c.v.VmWorkJobDispatcher]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Run VM work job:
com.cloud.vm.VmWorkStart for VM 5, job origin: 68
2015-11-26 20:21:58,034 DEBUG [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Execute VM
work job:
com.cloud.vm.VmWorkStart{"dcId":3,"podId":3,"clusterId":3,"hostId":4,"rawParams":{"VmPassword":"rO0ABXQADnNhdmVkX3Bhc3N3b3Jk"},"userId":2,"accountId":2,"vmId":5,"handlerName":"VirtualMachineManagerImpl"}
2015-11-26 20:21:58,038 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM state
transitted from :Stopped to Starting with event: StartRequestedvm's
original host id: null new host id: null host id before state transition:
null
2015-11-26 20:21:58,038 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Successfully
transitioned to start state for VM[User|i-2-5-VM] reservation id =
2a4a184a-eac9-4609-8a70-4d230ee3a37d
2015-11-26 20:21:58,040 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
deploy VM, vm has dcId: 3 and podId: null
2015-11-26 20:21:58,041 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) advanceStart:
DeploymentPlan is provided, using dcId:3, podId: 3, clusterId: 3, hostId:
4, poolId: null
2015-11-26 20:21:58,041 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deploy avoids
pods: null, clusters: null, hosts: null
2015-11-26 20:21:58,045 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deploy avoids
pods: [], clusters: [], hosts: []
2015-11-26 20:21:58,046 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
DeploymentPlanner allocation algorithm:
com.cloud.deploy.FirstFitPlanner@1136745
2015-11-26 20:21:58,046 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
allocate a host and storage pools from dc:3, pod:3,cluster:3, requested
cpu: 1000, requested ram: 1073741824
2015-11-26 20:21:58,046 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Is ROOT
volume READY (pool already allocated)?: No
2015-11-26 20:21:58,046 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
DeploymentPlan has host_id specified, choosing this host and making no
checks on this host: 4
2015-11-26 20:21:58,046 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Looking for
suitable pools for this host under zone: 3, pod: 3, cluster: 3
2015-11-26 20:21:58,048 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
suitable pools for volume (Id, Type): (6,ROOT)
2015-11-26 20:21:58,048 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) We need to
allocate new storagepool for this volume
2015-11-26 20:21:58,049 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Calling
StoragePoolAllocators to find suitable pools
2015-11-26 20:21:58,049 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
LocalStoragePoolAllocator trying to find storage pool to fit the vm
2015-11-26 20:21:58,049 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
ClusterScopeStoragePoolAllocator looking for storage pool
2015-11-26 20:21:58,049 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Looking for
pools in dc: 3 pod:3 cluster:3. Disabled pools will be ignored.
2015-11-26 20:21:58,049 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found pools
matching tags: [Pool[8|NetworkFilesystem]]
2015-11-26 20:21:58,050 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
storage pool is suitable, name: null ,poolId: 8
2015-11-26 20:21:58,051 INFO [c.c.s.StorageManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Storage pool
null (8) does not supply IOPS capacity, assuming enough capacity
2015-11-26 20:21:58,052 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking pool
8 for storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
0.019253810234789077, disable threshold: 0.85
2015-11-26 20:21:58,054 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found storage
pool primary of type NetworkFilesystem with overprovisioning factor 2
2015-11-26 20:21:58,055 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total over
provisioned capacity calculated is 2 * 526199291904
2015-11-26 20:21:58,055 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total
capacity of the pool primary id: 8 is 1052398583808
2015-11-26 20:21:58,055 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
pool: 8 for volume allocation [Vol[6|vm=5|ROOT]], maxSize : 1052398583808,
totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
disable threshold: 0.85
2015-11-26 20:21:58,055 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
2015-11-26 20:21:58,055 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
suitable pools for volume (Id, Type): (7,DATADISK)
2015-11-26 20:21:58,055 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) We need to
allocate new storagepool for this volume
2015-11-26 20:21:58,055 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Calling
StoragePoolAllocators to find suitable pools
2015-11-26 20:21:58,055 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
LocalStoragePoolAllocator trying to find storage pool to fit the vm
2015-11-26 20:21:58,055 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
ClusterScopeStoragePoolAllocator looking for storage pool
2015-11-26 20:21:58,055 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Looking for
pools in dc: 3 pod:3 cluster:3. Disabled pools will be ignored.
2015-11-26 20:21:58,056 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found pools
matching tags: [Pool[8|NetworkFilesystem]]
2015-11-26 20:21:58,056 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
storage pool is suitable, name: null ,poolId: 8
2015-11-26 20:21:58,057 INFO [c.c.s.StorageManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Storage pool
null (8) does not supply IOPS capacity, assuming enough capacity
2015-11-26 20:21:58,057 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking pool
8 for storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
0.019253810234789077, disable threshold: 0.85
2015-11-26 20:21:58,059 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found storage
pool primary of type NetworkFilesystem with overprovisioning factor 2
2015-11-26 20:21:58,059 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total over
provisioned capacity calculated is 2 * 526199291904
2015-11-26 20:21:58,059 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total
capacity of the pool primary id: 8 is 1052398583808
2015-11-26 20:21:58,060 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
pool: 8 for volume allocation [Vol[7|vm=5|DATADISK]], maxSize :
1052398583808, totalAllocatedSize : 12156207104, askingSize : 21474836480,
allocated disable threshold: 0.85
2015-11-26 20:21:58,060 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
2015-11-26 20:21:58,060 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
find a potenial host and associated storage pools from the suitable
host/pool lists for this VM
2015-11-26 20:21:58,060 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
host: 4 can access any suitable storage pool for volume: DATADISK
2015-11-26 20:21:58,060 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Host: 4 can
access pool: 8
2015-11-26 20:21:58,061 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking pool
8 for storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
0.019253810234789077, disable threshold: 0.85
2015-11-26 20:21:58,062 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found storage
pool primary of type NetworkFilesystem with overprovisioning factor 2
2015-11-26 20:21:58,062 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total over
provisioned capacity calculated is 2 * 526199291904
2015-11-26 20:21:58,062 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total
capacity of the pool primary id: 8 is 1052398583808
2015-11-26 20:21:58,063 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
pool: 8 for volume allocation [Vol[7|vm=5|DATADISK]], maxSize :
1052398583808, totalAllocatedSize : 12156207104, askingSize : 21474836480,
allocated disable threshold: 0.85
2015-11-26 20:21:58,063 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
host: 4 can access any suitable storage pool for volume: ROOT
2015-11-26 20:21:58,063 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Host: 4 can
access pool: 8
2015-11-26 20:21:58,064 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking pool
8 for storage, totalSize: 526199291904, usedBytes: 10131341312, usedPct:
0.019253810234789077, disable threshold: 0.85
2015-11-26 20:21:58,067 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found storage
pool primary of type NetworkFilesystem with overprovisioning factor 2
2015-11-26 20:21:58,067 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total over
provisioned capacity calculated is 2 * 526199291904
2015-11-26 20:21:58,067 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Total
capacity of the pool primary id: 8 is 1052398583808
2015-11-26 20:21:58,067 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
pool: 8 for volume allocation [Vol[6|vm=5|ROOT]], maxSize : 1052398583808,
totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
disable threshold: 0.85
2015-11-26 20:21:58,067 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found a
potential host id: 4 name: xenserver and associated storage pools for this
VM
2015-11-26 20:21:58,068 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Returning
Deployment Destination:
Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
:
Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage(Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
Volume(7|DATADISK-->Pool(8))]
2015-11-26 20:21:58,068 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deployment
found - P0=VM[User|i-2-5-VM],
P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
:
Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage(Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
Volume(7|DATADISK-->Pool(8))]
2015-11-26 20:21:58,073 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM state
transitted from :Starting to Starting with event: OperationRetryvm's
original host id: null new host id: 4 host id before state transition: null
2015-11-26 20:21:58,076 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Hosts's
actual total CPU: 3399 and CPU after applying overprovisioning: 3399
2015-11-26 20:21:58,076 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) We are
allocating VM, increasing the used capacity of this host:4
2015-11-26 20:21:58,076 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Current Used
CPU: 1000 , Free CPU:2399 ,Requested CPU: 1000
2015-11-26 20:21:58,076 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Current Used
RAM: 1610612736 , Free RAM:13743892480 ,Requested RAM: 1073741824
2015-11-26 20:21:58,076 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) CPU STATS
after allocation: for host: 4, old used: 1000, old reserved: 0, actual
total: 3399, total with overprovisioning: 3399; new used:2000, reserved:0;
requested cpu:1000,alloc_from_last:false
2015-11-26 20:21:58,076 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) RAM STATS
after allocation: for host: 4, old used: 1610612736, old reserved: 0,
total: 15354505216; new used: 2684354560, reserved: 0; requested mem:
1073741824,alloc_from_last:false
2015-11-26 20:21:58,094 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM is being
created in podId: 3
2015-11-26 20:21:58,097 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Lock is
acquired for network id 212 as a part of network implement
2015-11-26 20:21:58,097 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Asking
ExternalGuestNetworkGuru to implement Ntwk[212|Guest|8]
2015-11-26 20:21:58,117 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Asking
VirtualRouter to implemenet Ntwk[212|Guest|8]
2015-11-26 20:21:58,120 DEBUG [c.c.n.r.NetworkHelperImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Starting
router VM[DomainRouter|r-4-VM]
2015-11-26 20:21:58,127 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM state
transitted from :Stopped to Starting with event: StartRequestedvm's
original host id: 4 new host id: null host id before state transition: null
2015-11-26 20:21:58,127 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Successfully
transitioned to start state for VM[DomainRouter|r-4-VM] reservation id =
36f90bcc-1fad-40d8-b878-3996e5c69c0e
2015-11-26 20:21:58,130 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
deploy VM, vm has dcId: 3 and podId: 3
2015-11-26 20:21:58,130 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deploy avoids
pods: null, clusters: null, hosts: null
2015-11-26 20:21:58,131 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Root volume
is ready, need to place VM in volume's cluster
2015-11-26 20:21:58,131 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
Vol[5|vm=4|ROOT] is READY, changing deployment plan to use this pool's
dcId: 3 , podId: 3 , and clusterId: 3
2015-11-26 20:21:58,137 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deploy avoids
pods: [], clusters: [], hosts: []
2015-11-26 20:21:58,137 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
DeploymentPlanner allocation algorithm:
com.cloud.deploy.FirstFitPlanner@1136745
2015-11-26 20:21:58,137 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
allocate a host and storage pools from dc:3, pod:3,cluster:3, requested
cpu: 500, requested ram: 268435456
2015-11-26 20:21:58,137 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Is ROOT
volume READY (pool already allocated)?: Yes
2015-11-26 20:21:58,137 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) This VM has
last host_id specified, trying to choose the same host: 4
2015-11-26 20:21:58,141 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Host: 4 has
cpu capability (cpu:1, speed:3399) to support requested CPU: 1 and
requested speed: 500
2015-11-26 20:21:58,141 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
host: 4 has enough capacity for requested CPU: 500 and requested RAM:
268435456 , cpuOverprovisioningFactor: 1.0
2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Hosts's
actual total CPU: 3399 and CPU after applying overprovisioning: 3399
2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) We need to
allocate to the last host again, so checking if there is enough reserved
capacity
2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reserved CPU:
0 , Requested CPU: 500
2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reserved RAM:
0 , Requested RAM: 268435456
2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) STATS: Failed
to alloc resource from host: 4 reservedCpu: 0, requested cpu: 500,
reservedMem: 0, requested mem: 268435456
2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Host does not
have enough reserved CPU available, cannot allocate to this host.
2015-11-26 20:21:58,142 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
host: 4 has enough capacity for requested CPU: 500 and requested RAM:
268435456 , cpuOverprovisioningFactor: 1.0
2015-11-26 20:21:58,143 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Hosts's
actual total CPU: 3399 and CPU after applying overprovisioning: 3399
2015-11-26 20:21:58,143 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Free CPU:
1399 , Requested CPU: 500
2015-11-26 20:21:58,143 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Free RAM:
12670150656 , Requested RAM: 268435456
2015-11-26 20:21:58,143 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Host has
enough CPU and RAM available
2015-11-26 20:21:58,143 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) STATS: Can
alloc CPU from host: 4, used: 2000, reserved: 0, actual total: 3399, total
with overprovisioning: 3399; requested cpu:500,alloc_from_last_host?:false
,considerReservedCapacity?: true
2015-11-26 20:21:58,143 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) STATS: Can
alloc MEM from host: 4, used: 2684354560, reserved: 0, total: 15354505216;
requested mem: 268435456,alloc_from_last_host?:false
,considerReservedCapacity?: true
2015-11-26 20:21:58,143 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) The last host
of this VM is UP and has enough capacity
2015-11-26 20:21:58,143 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Now checking
for suitable pools under zone: 3, pod: 3, cluster: 3
2015-11-26 20:21:58,145 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking
suitable pools for volume (Id, Type): (5,ROOT)
2015-11-26 20:21:58,145 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Volume has
pool already allocated, checking if pool can be reused, poolId: 8
2015-11-26 20:21:58,145 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Planner need
not allocate a pool for this volume since its READY
2015-11-26 20:21:58,145 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
find a potenial host and associated storage pools from the suitable
host/pool lists for this VM
2015-11-26 20:21:58,145 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
host: 4 can access any suitable storage pool for volume: ROOT
2015-11-26 20:21:58,146 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Host: 4 can
access pool: 8
2015-11-26 20:21:58,146 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found a
potential host id: 4 name: xenserver and associated storage pools for this
VM
2015-11-26 20:21:58,146 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Returning
Deployment Destination:
Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
: Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage()]
2015-11-26 20:21:58,146 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deployment
found - P0=VM[DomainRouter|r-4-VM],
P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
: Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage()]
2015-11-26 20:21:58,153 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM state
transitted from :Starting to Starting with event: OperationRetryvm's
original host id: 4 new host id: 4 host id before state transition: null
2015-11-26 20:21:58,153 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM starting
again on the last host it was stopped on
2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Hosts's
actual total CPU: 3399 and CPU after applying overprovisioning: 3399
2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) We are
allocating VM, increasing the used capacity of this host:4
2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Current Used
CPU: 2000 , Free CPU:1399 ,Requested CPU: 500
2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Current Used
RAM: 2684354560 , Free RAM:12670150656 ,Requested RAM: 268435456
2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) We are
allocating VM to the last host again, so adjusting the reserved capacity if
it is not less than required
2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reserved CPU:
0 , Requested CPU: 500
2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reserved RAM:
0 , Requested RAM: 268435456
2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) CPU STATS
after allocation: for host: 4, old used: 2000, old reserved: 0, actual
total: 3399, total with overprovisioning: 3399; new used:2500, reserved:0;
requested cpu:500,alloc_from_last:true
2015-11-26 20:21:58,156 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) RAM STATS
after allocation: for host: 4, old used: 2684354560, old reserved: 0,
total: 15354505216; new used: 2952790016, reserved: 0; requested mem:
268435456,alloc_from_last:true
2015-11-26 20:21:58,158 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM is being
created in podId: 3
2015-11-26 20:21:58,173 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
SecurityGroup is not supported in the network id=212
2015-11-26 20:21:58,179 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Asking
VirtualRouter to prepare for
Nic[8-4-36f90bcc-1fad-40d8-b878-3996e5c69c0e-10.1.1.1]
2015-11-26 20:21:58,179 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
SecurityGroup is not supported in the network id=212
2015-11-26 20:21:58,193 DEBUG [o.a.c.e.o.VolumeOrchestrator]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
we need to prepare 1 volumes for VM[DomainRouter|r-4-VM]
2015-11-26 20:21:58,193 DEBUG [o.a.c.e.o.VolumeOrchestrator]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) No need to
recreate the volume: Vol[5|vm=4|ROOT], since it already has a pool
assigned: 8, adding disk to VM
2015-11-26 20:21:58,207 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Boot Args for
VM[DomainRouter|r-4-VM]: template=domP name=r-4-VM eth2ip=10.0.0.174
eth2mask=255.255.255.0 gateway=10.0.0.1 eth0ip=10.1.1.1
eth0mask=255.255.255.0 domain=cs2cloud.internal cidrsize=24
dhcprange=10.1.1.1 eth1ip=169.254.0.43 eth1mask=255.255.0.0 type=router
disable_rp_filter=true dns1=8.8.8.8
baremetalnotificationsecuritykey=MD4bWVy5t0anMd4eq4UlKWj6cZTW4gFDMeDd0WR3H3BuAsrxVX28ShzvJgbd8RR5eMRZ7rNYAsaF9RPXAZoCrQ
baremetalnotificationapikey=ZWNcizzJ0xXQE0Ubr6Sr_kN7xlMMMMtziuPTxHwZOyIN-Lo2f2CzvPhNw0o01LkNP3X4bp61YiZu0EWF-Mbfew
host=10.0.0.170 port=8080
2015-11-26 20:21:58,229 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 1 ip(s)
to apply as a part of domR VM[DomainRouter|r-4-VM] start.
2015-11-26 20:21:58,237 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Resending
ipAssoc, port forwarding, load balancing rules as a part of Virtual router
start
2015-11-26 20:21:58,241 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Egress policy
for the Network 212 is already defined as Deny. So, no need to default the
rule to Allow.
2015-11-26 20:21:58,241 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
firewall Egress rule(s) to apply as a part of domR VM[DomainRouter|r-4-VM]
start.
2015-11-26 20:21:58,243 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
static nat(s) to apply as a part of domR VM[DomainRouter|r-4-VM] start.
2015-11-26 20:21:58,243 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
firewall Ingress rule(s) to apply as a part of domR VM[DomainRouter|r-4-VM]
start.
2015-11-26 20:21:58,243 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0 port
forwarding rule(s) to apply as a part of domR VM[DomainRouter|r-4-VM] start.
2015-11-26 20:21:58,243 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
static nat rule(s) to apply as a part of domR VM[DomainRouter|r-4-VM] start.
2015-11-26 20:21:58,243 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0
vpn(s) to apply as a part of domR VM[DomainRouter|r-4-VM] start.
2015-11-26 20:21:58,244 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found 0 load
balancing rule(s) to apply as a part of domR VM[DomainRouter|r-4-VM] start.
2015-11-26 20:21:58,245 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Creating
monitoring services on VM[DomainRouter|r-4-VM] start...
2015-11-26 20:21:58,248 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reapplying
dhcp entries as a part of domR VM[DomainRouter|r-4-VM] start...
2015-11-26 20:21:58,249 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reapplying vm
data (userData and metaData) entries as a part of domR
VM[DomainRouter|r-4-VM] start...
2015-11-26 20:21:58,254 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
4-8612571337392652838: Sending { Cmd , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 100011,
[{"com.cloud.agent.api.StartCommand":{"vm":{"id":4,"name":"r-4-VM","bootloader":"PyGrub","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":268435456,"maxRam":268435456,"arch":"x86_64","os":"Debian
GNU/Linux 7(64-bit)","platformEmulator":"Debian Wheezy 7.0
(64-bit)","bootArgs":" template=domP name=r-4-VM eth2ip=10.0.0.174
eth2mask=255.255.255.0 gateway=10.0.0.1 eth0ip=10.1.1.1
eth0mask=255.255.255.0 domain=cs2cloud.internal cidrsize=24
dhcprange=10.1.1.1 eth1ip=169.254.0.43 eth1mask=255.255.0.0 type=router
disable_rp_filter=true dns1=8.8.8.8
baremetalnotificationsecuritykey=MD4bWVy5t0anMd4eq4UlKWj6cZTW4gFDMeDd0WR3H3BuAsrxVX28ShzvJgbd8RR5eMRZ7rNYAsaF9RPXAZoCrQ
baremetalnotificationapikey=ZWNcizzJ0xXQE0Ubr6Sr_kN7xlMMMMtziuPTxHwZOyIN-Lo2f2CzvPhNw0o01LkNP3X4bp61YiZu0EWF-Mbfew
host=10.0.0.170
port=8080","enableHA":true,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"SlzaiXi9iLi3YpfQ7v3kZw","params":{},"uuid":"27157005-7e89-4251-89e4-2c53ff43bb70","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"9478a811-8b96-4cfa-b6bf-1e09c3fecd39","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc
"}},"name":"ROOT-4","size":3145728000,"path":"dcc1ce80-4cd5-4f59-b063-34e2a93ed99a","volumeId":5,"vmName":"r-4-VM","accountId":2,"format":"VHD","provisioningType":"THIN","id":5,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"dcc1ce80-4cd5-4f59-b063-34e2a93ed99a","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"10.0.0.170","volumeSize":"3145728000"}}],"nics":[{"deviceId":2,"networkRateMbps":200,"defaultNic":true,"pxeDisable":true,"nicUuid":"9fbc00ea-599c-4455-a416-8e66986d9454","uuid":"8872476c-2fd1-4ed3-bfb1-c62efe2b6eab","ip":"10.0.0.174","netmask":"255.255.255.0","gateway":"10.0.0.1","mac":"06:a0:8a:00:00:09","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"mgmt"},{"deviceId":0,"networkRateMbps":200,"defaultNic":false,"pxeDisable":true,"nicUuid":"f38511fa-d2e8-4935-9fc4-74b2eea7621b","uuid":"2e97fcee-3d01-40d2-a624-376661747d0c","ip":"10.1.1.1","netmask":"255.255.255.0","mac":"02:00:4d:27:00:02","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://500","isolationUri":"vlan://500","isSecurityGroupEnabled":false,"name":"mgmt"},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"pxeDisable":true,"nicUuid":"5c6cd3fa-fddb-4ee0-bff2-87e5c04f8d81","uuid":"914b3b0d-541c-4c63-b331-3377672a824d","ip":"169.254.0.43","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:00:2b","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.0.0.171","executeInSequence":false,"wait":0}},{"com.cloud.agent.api.check.CheckSshCommand":{"ip":"169.254.0.43","port":3922,"interval":6,"retries":100,"name":"r-4-VM","wait":0}},{"com.cloud.agent.api.GetDomRVersionCmd":{"accessDetails":{"
router.name
":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}},{},{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Start","accessDetails":{"router.guest.ip":"10.1.1.1","
router.name
":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}},{"com.cloud.agent.api.routing.IpAssocCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.0.0.174","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":true,"broadcastUri":"vlan://untagged","vlanGateway":"10.0.0.1","vlanNetmask":"255.255.255.0","vifMacAddress":"06:35:62:00:00:09","networkRate":200,"trafficType":"Public","networkName":"mgmt","newNic":false}],"accessDetails":{"zone.network.type":"Advanced","
router.name
":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.SetMonitorServiceCommand":{"services":[{"id":0,"service":"dhcp","processname":"dnsmasq","serviceName":"dnsmasq","servicePath":"/var/run/dnsmasq/dnsmasq.pid","pidFile":"/var/run/dnsmasq/dnsmasq.pid","isDefault":false},{"id":0,"service":"loadbalancing","processname":"haproxy","serviceName":"haproxy","servicePath":"/var/run/haproxy.pid","pidFile":"/var/run/haproxy.pid","isDefault":false},{"id":0,"service":"ssh","processname":"sshd","serviceName":"ssh","servicePath":"/var/run/sshd.pid","pidFile":"/var/run/sshd.pid","isDefault":true},{"id":0,"service":"webserver","processname":"apache2","serviceName":"apache2","servicePath":"/var/run/apache2.pid","pidFile":"/var/run/apache2.pid","isDefault":true}],"accessDetails":{"
router.name
":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Finish","accessDetails":{"router.guest.ip":"10.1.1.1","
router.name":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}}] }
2015-11-26 20:21:58,255 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
4-8612571337392652838: Executing: { Cmd , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 100011,
[{"com.cloud.agent.api.StartCommand":{"vm":{"id":4,"name":"r-4-VM","bootloader":"PyGrub","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":268435456,"maxRam":268435456,"arch":"x86_64","os":"Debian
GNU/Linux 7(64-bit)","platformEmulator":"Debian Wheezy 7.0
(64-bit)","bootArgs":" template=domP name=r-4-VM eth2ip=10.0.0.174
eth2mask=255.255.255.0 gateway=10.0.0.1 eth0ip=10.1.1.1
eth0mask=255.255.255.0 domain=cs2cloud.internal cidrsize=24
dhcprange=10.1.1.1 eth1ip=169.254.0.43 eth1mask=255.255.0.0 type=router
disable_rp_filter=true dns1=8.8.8.8
baremetalnotificationsecuritykey=MD4bWVy5t0anMd4eq4UlKWj6cZTW4gFDMeDd0WR3H3BuAsrxVX28ShzvJgbd8RR5eMRZ7rNYAsaF9RPXAZoCrQ
baremetalnotificationapikey=ZWNcizzJ0xXQE0Ubr6Sr_kN7xlMMMMtziuPTxHwZOyIN-Lo2f2CzvPhNw0o01LkNP3X4bp61YiZu0EWF-Mbfew
host=10.0.0.170
port=8080","enableHA":true,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"SlzaiXi9iLi3YpfQ7v3kZw","params":{},"uuid":"27157005-7e89-4251-89e4-2c53ff43bb70","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"9478a811-8b96-4cfa-b6bf-1e09c3fecd39","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc
"}},"name":"ROOT-4","size":3145728000,"path":"dcc1ce80-4cd5-4f59-b063-34e2a93ed99a","volumeId":5,"vmName":"r-4-VM","accountId":2,"format":"VHD","provisioningType":"THIN","id":5,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"dcc1ce80-4cd5-4f59-b063-34e2a93ed99a","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"10.0.0.170","volumeSize":"3145728000"}}],"nics":[{"deviceId":2,"networkRateMbps":200,"defaultNic":true,"pxeDisable":true,"nicUuid":"9fbc00ea-599c-4455-a416-8e66986d9454","uuid":"8872476c-2fd1-4ed3-bfb1-c62efe2b6eab","ip":"10.0.0.174","netmask":"255.255.255.0","gateway":"10.0.0.1","mac":"06:a0:8a:00:00:09","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"mgmt"},{"deviceId":0,"networkRateMbps":200,"defaultNic":false,"pxeDisable":true,"nicUuid":"f38511fa-d2e8-4935-9fc4-74b2eea7621b","uuid":"2e97fcee-3d01-40d2-a624-376661747d0c","ip":"10.1.1.1","netmask":"255.255.255.0","mac":"02:00:4d:27:00:02","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://500","isolationUri":"vlan://500","isSecurityGroupEnabled":false,"name":"mgmt"},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"pxeDisable":true,"nicUuid":"5c6cd3fa-fddb-4ee0-bff2-87e5c04f8d81","uuid":"914b3b0d-541c-4c63-b331-3377672a824d","ip":"169.254.0.43","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:00:2b","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.0.0.171","executeInSequence":false,"wait":0}},{"com.cloud.agent.api.check.CheckSshCommand":{"ip":"169.254.0.43","port":3922,"interval":6,"retries":100,"name":"r-4-VM","wait":0}},{"com.cloud.agent.api.GetDomRVersionCmd":{"accessDetails":{"
router.name
":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}},{},{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Start","accessDetails":{"router.guest.ip":"10.1.1.1","
router.name
":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}},{"com.cloud.agent.api.routing.IpAssocCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.0.0.174","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":true,"broadcastUri":"vlan://untagged","vlanGateway":"10.0.0.1","vlanNetmask":"255.255.255.0","vifMacAddress":"06:35:62:00:00:09","networkRate":200,"trafficType":"Public","networkName":"mgmt","newNic":false}],"accessDetails":{"zone.network.type":"Advanced","
router.name
":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.SetMonitorServiceCommand":{"services":[{"id":0,"service":"dhcp","processname":"dnsmasq","serviceName":"dnsmasq","servicePath":"/var/run/dnsmasq/dnsmasq.pid","pidFile":"/var/run/dnsmasq/dnsmasq.pid","isDefault":false},{"id":0,"service":"loadbalancing","processname":"haproxy","serviceName":"haproxy","servicePath":"/var/run/haproxy.pid","pidFile":"/var/run/haproxy.pid","isDefault":false},{"id":0,"service":"ssh","processname":"sshd","serviceName":"ssh","servicePath":"/var/run/sshd.pid","pidFile":"/var/run/sshd.pid","isDefault":true},{"id":0,"service":"webserver","processname":"apache2","serviceName":"apache2","servicePath":"/var/run/apache2.pid","pidFile":"/var/run/apache2.pid","isDefault":true}],"accessDetails":{"
router.name
":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Finish","accessDetails":{"router.guest.ip":"10.1.1.1","
router.name":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}}] }
2015-11-26 20:21:58,256 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-69:ctx-a18e64d5) Seq 4-8612571337392652838: Executing request
2015-11-26 20:21:58,263 DEBUG [c.c.h.x.r.w.x.CitrixStartCommandWrapper]
(DirectAgent-69:ctx-a18e64d5) 1. The VM r-4-VM is in Starting state.
2015-11-26 20:21:58,292 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-69:ctx-a18e64d5) Created VM
0d0fa28c-0513-b806-84fd-c528dfc1dbfb for r-4-VM
2015-11-26 20:21:58,298 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-69:ctx-a18e64d5) PV args are -- quiet
console=hvc0%template=domP%name=r-4-VM%eth2ip=10.0.0.174%eth2mask=255.255.255.0%gateway=10.0.0.1%eth0ip=10.1.1.1%eth0mask=255.255.255.0%domain=cs2cloud.internal%cidrsize=24%dhcprange=10.1.1.1%eth1ip=169.254.0.43%eth1mask=255.255.0.0%type=router%disable_rp_filter=true%dns1=8.8.8.8%baremetalnotificationsecuritykey=MD4bWVy5t0anMd4eq4UlKWj6cZTW4gFDMeDd0WR3H3BuAsrxVX28ShzvJgbd8RR5eMRZ7rNYAsaF9RPXAZoCrQ%baremetalnotificationapikey=ZWNcizzJ0xXQE0Ubr6Sr_kN7xlMMMMtziuPTxHwZOyIN-Lo2f2CzvPhNw0o01LkNP3X4bp61YiZu0EWF-Mbfew%host=10.0.0.170%port=8080
2015-11-26 20:21:58,325 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-69:ctx-a18e64d5) VBD 11a8fbfd-fd97-18bc-1490-e088576f26e7
created for com.cloud.agent.api.to.DiskTO@2578f349
2015-11-26 20:21:58,325 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-69:ctx-a18e64d5) Creating VIF for r-4-VM on nic
[Nic:Public-10.0.0.174-vlan://untagged]
2015-11-26 20:21:58,327 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-69:ctx-a18e64d5) Looking for network named mgmt
2015-11-26 20:21:58,334 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-69:ctx-a18e64d5) Created a vif
b7ad658b-483c-a442-cb04-02b2a54bfbc8 on 2
2015-11-26 20:21:58,334 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-69:ctx-a18e64d5) Creating VIF for r-4-VM on nic
[Nic:Guest-10.1.1.1-vlan://500]
2015-11-26 20:21:58,335 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-69:ctx-a18e64d5) Looking for network named mgmt
2015-11-26 20:21:58,341 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-69:ctx-a18e64d5) Couldn't find vlan network with the new name
so trying old name: VLAN500
2015-11-26 20:21:58,342 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-69:ctx-a18e64d5) Creating VLAN network for 500 on host
10.0.0.171
2015-11-26 20:21:58,349 DEBUG [c.c.h.x.r.XsLocalNetwork]
(DirectAgent-69:ctx-a18e64d5) Found a network called mgmt on
host=10.0.0.171; Network=1a561762-42f8-4907-9cc2-c90e69fc3a4d;
pif=ebede886-b90c-4605-dcef-5b24824b154b
2015-11-26 20:21:58,352 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-69:ctx-a18e64d5) Creating VLAN 500 on host 10.0.0.171 on
device eth0
2015-11-26 20:21:58,664 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-69:ctx-a18e64d5) VLAN is created for 500. The uuid is
4cf68d23-f831-273a-27a6-7639dadf3d04
2015-11-26 20:21:58,669 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-69:ctx-a18e64d5) Created a vif
c21979e3-f425-6c92-24cb-356cfbdd3320 on 0
2015-11-26 20:21:58,669 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-69:ctx-a18e64d5) Creating VIF for r-4-VM on nic
[Nic:Control-169.254.0.43-null]
2015-11-26 20:21:58,683 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-69:ctx-a18e64d5) already have a vif on dom0 for link local
network
2015-11-26 20:21:58,787 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-69:ctx-a18e64d5) Created a vif
990f4458-ecb6-434f-2930-73b1e6d42e8c on 1
2015-11-26 20:21:59,092 DEBUG [c.c.a.ApiServlet]
(catalina-exec-13:ctx-2798b9c4) ===START=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549584411
2015-11-26 20:21:59,103 DEBUG [c.c.a.ApiServlet]
(catalina-exec-13:ctx-2798b9c4 ctx-c2ce3a57) ===END=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549584411
2015-11-26 20:22:02,111 DEBUG [c.c.a.ApiServlet]
(catalina-exec-14:ctx-38676bd6) ===START=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549587414
2015-11-26 20:22:02,124 DEBUG [c.c.a.ApiServlet]
(catalina-exec-14:ctx-38676bd6 ctx-947b14ea) ===END=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549587414
2015-11-26 20:22:02,803 DEBUG [c.c.h.x.r.w.x.CitrixStartCommandWrapper]
(DirectAgent-69:ctx-a18e64d5) 2. The VM r-4-VM is in Running state.
2015-11-26 20:22:02,807 DEBUG [c.c.h.x.r.w.x.CitrixCheckSshCommandWrapper]
(DirectAgent-69:ctx-a18e64d5) Ping command port, 169.254.0.43:3922
2015-11-26 20:22:02,809 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-69:ctx-a18e64d5) Trying to connect to 169.254.0.43 attempt 0
of 100
2015-11-26 20:22:04,361 DEBUG [o.a.c.s.SecondaryStorageManagerImpl]
(secstorage-1:ctx-2215d989) Zone 3 is ready to launch secondary storage VM
2015-11-26 20:22:04,681 DEBUG [c.c.c.ConsoleProxyManagerImpl]
(consoleproxy-1:ctx-2ce987bc) Zone 3 is ready to launch console proxy
2015-11-26 20:22:05,104 DEBUG [c.c.a.ApiServlet]
(catalina-exec-15:ctx-4fa06d24) ===START=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549590422
2015-11-26 20:22:05,116 DEBUG [c.c.a.ApiServlet]
(catalina-exec-15:ctx-4fa06d24 ctx-19dff864) ===END=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549590422
2015-11-26 20:22:06,962 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-14:null) SeqA 5-1783: Processing Seq 5-1783: { Cmd ,
MgmtId: -1, via: 5, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
\"connections\": []\n}","wait":0}}] }
2015-11-26 20:22:06,968 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-14:null) SeqA 5-1783: Sending Seq 5-1783: { Ans: ,
MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
[{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2015-11-26 20:22:08,018 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-5e29ee49) Begin cleanup expired async-jobs
2015-11-26 20:22:08,022 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-5e29ee49) End cleanup expired async-jobs
2015-11-26 20:22:08,103 DEBUG [c.c.a.ApiServlet]
(catalina-exec-17:ctx-9917fe4e) ===START=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549593422
2015-11-26 20:22:08,114 DEBUG [c.c.a.ApiServlet]
(catalina-exec-17:ctx-9917fe4e ctx-bfd32cd5) ===END=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549593422
2015-11-26 20:22:11,103 DEBUG [c.c.a.ApiServlet]
(catalina-exec-12:ctx-88343d26) ===START=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549596422
2015-11-26 20:22:11,113 DEBUG [c.c.a.ApiServlet]
(catalina-exec-12:ctx-88343d26 ctx-6f3d43d4) ===END=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549596422
2015-11-26 20:22:14,215 DEBUG [c.c.a.ApiServlet]
(catalina-exec-16:ctx-725778e3) ===START=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549599535
2015-11-26 20:22:14,234 DEBUG [c.c.a.ApiServlet]
(catalina-exec-16:ctx-725778e3 ctx-dd88dc8f) ===END=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549599535
2015-11-26 20:22:15,885 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-69:ctx-a18e64d5) Trying to connect to 169.254.0.43 attempt 1
of 100
2015-11-26 20:22:16,964 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-3:null) SeqA 5-1784: Processing Seq 5-1784: { Cmd ,
MgmtId: -1, via: 5, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
\"connections\": []\n}","wait":0}}] }
2015-11-26 20:22:16,967 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-3:null) SeqA 5-1784: Sending Seq 5-1784: { Ans: ,
MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
[{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2015-11-26 20:22:17,215 DEBUG [c.c.a.ApiServlet]
(catalina-exec-18:ctx-60f98a31) ===START=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549602535
2015-11-26 20:22:17,225 DEBUG [c.c.a.ApiServlet]
(catalina-exec-18:ctx-60f98a31 ctx-d1134f47) ===END=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549602535
2015-11-26 20:22:17,995 DEBUG [c.c.s.StatsCollector]
(StatsCollector-3:ctx-98795072) StorageCollector is running...
2015-11-26 20:22:18,018 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-d66f35e7) Begin cleanup expired async-jobs
2015-11-26 20:22:18,020 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-d66f35e7) End cleanup expired async-jobs
2015-11-26 20:22:18,050 DEBUG [c.c.a.t.Request]
(StatsCollector-3:ctx-98795072) Seq 6-2074470578357534957: Received: {
Ans: , MgmtId: 52229922654, via: 6(s-2-VM), Ver: v1, Flags: 10, {
GetStorageStatsAnswer } }
2015-11-26 20:22:18,051 DEBUG [c.c.h.XenServerGuru]
(StatsCollector-3:ctx-98795072) getCommandHostDelegation: class
com.cloud.agent.api.GetStorageStatsCommand
2015-11-26 20:22:18,052 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-275:ctx-69cd6660) Seq 4-8612571337392652839: Executing request
2015-11-26 20:22:18,210 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:ctx-e533ad2d) Found 1 routers to update status.
2015-11-26 20:22:18,212 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:ctx-e533ad2d) Found 0 VPC networks to update
Redundant State.
2015-11-26 20:22:18,213 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:ctx-e533ad2d) Found 0 networks to update RvR status.
2015-11-26 20:22:18,223 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:ctx-ce59a463) Found 1 routers to update status.
2015-11-26 20:22:18,224 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:ctx-ce59a463) Found 0 VPC networks to update
Redundant State.
2015-11-26 20:22:18,225 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:ctx-ce59a463) Found 0 networks to update RvR status.
2015-11-26 20:22:18,378 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-275:ctx-69cd6660) Seq 4-8612571337392652839: Response
Received:
2015-11-26 20:22:18,379 DEBUG [c.c.a.t.Request]
(StatsCollector-3:ctx-98795072) Seq 4-8612571337392652839: Received: {
Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10, {
GetStorageStatsAnswer } }
2015-11-26 20:22:20,215 DEBUG [c.c.a.ApiServlet]
(catalina-exec-22:ctx-c6c73f9b) ===START=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549605535
2015-11-26 20:22:20,225 DEBUG [c.c.a.ApiServlet]
(catalina-exec-22:ctx-c6c73f9b ctx-135e3cc8) ===END=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549605535
2015-11-26 20:22:21,593 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-2:null) Ping from 6
2015-11-26 20:22:21,679 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-5:null) Ping from 5
2015-11-26 20:22:23,216 DEBUG [c.c.a.ApiServlet]
(catalina-exec-19:ctx-db19c3ed) ===START=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549608535
2015-11-26 20:22:23,227 DEBUG [c.c.a.ApiServlet]
(catalina-exec-19:ctx-db19c3ed ctx-846db858) ===END=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549608535
2015-11-26 20:22:24,782 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgentCronJob-79:ctx-8c839142) Ping from 4(xenserver)
2015-11-26 20:22:24,782 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
(DirectAgentCronJob-79:ctx-8c839142) Process host VM state report from ping
process. host: 4
2015-11-26 20:22:24,785 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
(DirectAgentCronJob-79:ctx-8c839142) Process VM state report. host: 4,
number of records in report: 3
2015-11-26 20:22:24,785 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
(DirectAgentCronJob-79:ctx-8c839142) VM state report. host: 4, vm id: 1,
power state: PowerOn
2015-11-26 20:22:24,786 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
(DirectAgentCronJob-79:ctx-8c839142) VM power state does not change, skip
DB writing. vm id: 1
2015-11-26 20:22:24,786 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
(DirectAgentCronJob-79:ctx-8c839142) VM state report. host: 4, vm id: 2,
power state: PowerOn
2015-11-26 20:22:24,787 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
(DirectAgentCronJob-79:ctx-8c839142) VM power state does not change, skip
DB writing. vm id: 2
2015-11-26 20:22:24,787 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
(DirectAgentCronJob-79:ctx-8c839142) VM state report. host: 4, vm id: 4,
power state: PowerOn
2015-11-26 20:22:24,788 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
(DirectAgentCronJob-79:ctx-8c839142) VM power state does not change, skip
DB writing. vm id: 4
2015-11-26 20:22:24,790 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
(DirectAgentCronJob-79:ctx-8c839142) Run missing VM report. current time:
1448549544790
2015-11-26 20:22:24,791 WARN [c.c.v.VirtualMachinePowerStateSyncImpl]
(DirectAgentCronJob-79:ctx-8c839142) VM state was updated but update time
is null?! vm id: 5
2015-11-26 20:22:24,794 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
(DirectAgentCronJob-79:ctx-8c839142) Detected missing VM. host: 4, vm id:
5, power state: PowerReportMissing, last state update: 1448549544790
2015-11-26 20:22:24,794 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
(DirectAgentCronJob-79:ctx-8c839142) vm id: 5 - time since last state
update(0ms) has not passed graceful period yet
2015-11-26 20:22:24,794 DEBUG [c.c.v.VirtualMachinePowerStateSyncImpl]
(DirectAgentCronJob-79:ctx-8c839142) Done with process of VM state report.
host: 4
2015-11-26 20:22:25,994 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-69:ctx-a18e64d5) Trying to connect to 169.254.0.43 attempt 2
of 100
2015-11-26 20:22:26,110 DEBUG [c.c.h.x.r.w.x.CitrixCheckSshCommandWrapper]
(DirectAgent-69:ctx-a18e64d5) Ping command port succeeded for vm r-4-VM
2015-11-26 20:22:26,111 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-69:ctx-a18e64d5) Executing command in VR:
/opt/cloud/bin/router_proxy.sh get_template_version.sh 169.254.0.43 null
2015-11-26 20:22:26,246 DEBUG [c.c.a.ApiServlet]
(catalina-exec-20:ctx-06bd0169) ===START=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549611535
2015-11-26 20:22:26,271 DEBUG [c.c.a.ApiServlet]
(catalina-exec-20:ctx-06bd0169 ctx-3118df18) ===END=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549611535
2015-11-26 20:22:26,389 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-69:ctx-a18e64d5) Executing command in VR:
/opt/cloud/bin/router_proxy.sh netusage.sh 169.254.0.43 -c
2015-11-26 20:22:26,677 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-69:ctx-a18e64d5) Looking for network named mgmt
2015-11-26 20:22:26,692 DEBUG [c.c.a.r.v.VirtualRoutingResource]
(DirectAgent-69:ctx-a18e64d5) Transforming
com.cloud.agent.api.routing.IpAssocCommand to ConfigItems
2015-11-26 20:22:26,692 DEBUG [c.c.a.r.v.VirtualRoutingResource]
(DirectAgent-69:ctx-a18e64d5) Transforming
com.cloud.agent.api.routing.SetMonitorServiceCommand to ConfigItems
2015-11-26 20:22:26,695 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-69:ctx-a18e64d5) Copying VR with ip 169.254.0.43 config file
into host 10.0.0.171
2015-11-26 20:22:26,964 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-6:null) SeqA 5-1786: Processing Seq 5-1786: { Cmd ,
MgmtId: -1, via: 5, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
\"connections\": []\n}","wait":0}}] }
2015-11-26 20:22:26,966 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-6:null) SeqA 5-1786: Sending Seq 5-1786: { Ans: ,
MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
[{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2015-11-26 20:22:27,075 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-69:ctx-a18e64d5) VR Config file
VR-d0244a1d-2334-4771-868b-2910b7a8c359.cfg got created in VR, ip
169.254.0.43 with content
#Apache CloudStack Virtual Router Config File
<version>
1.0
</version>
<file>
/var/cache/cloud/ip_associations.json
{"ip_address":[{"public_ip":"10.0.0.174","source_nat":true,"add":true,"one_to_one_nat":false,"first_i_p":true,"gateway":"10.0.0.1","netmask":"255.255.255.0","vif_mac_address":"06:35:62:00:00:09","nic_dev_id":2,"new_nic":false}],"type":"ips"}
</file>
<script>
/opt/cloud/bin/update_config.py ip_associations.json
</script>
<file>
/var/cache/cloud/monitor_service.json
{"config":"[dhcp]:processname=dnsmasq:servicename=dnsmasq:pidfile=/var/run/dnsmasq/dnsmasq.pid:,[loadbalancing]:processname=haproxy:servicename=haproxy:pidfile=/var/run/haproxy.pid:,[ssh]:processname=sshd:servicename=ssh:pidfile=/var/run/sshd.pid:,[webserver]:processname=apache2:servicename=apache2:pidfile=/var/run/apache2.pid:,","type":"monitorservice"}
</file>
<script>
/opt/cloud/bin/update_config.py monitor_service.json
</script>
2015-11-26 20:22:27,075 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-69:ctx-a18e64d5) Executing command in VR:
/opt/cloud/bin/router_proxy.sh vr_cfg.sh 169.254.0.43 -c
/var/cache/cloud/VR-d0244a1d-2334-4771-868b-2910b7a8c359.cfg
2015-11-26 20:22:28,018 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-ed233495) Begin cleanup expired async-jobs
2015-11-26 20:22:28,021 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-ed233495) End cleanup expired async-jobs
2015-11-26 20:22:29,218 DEBUG [c.c.a.ApiServlet]
(catalina-exec-21:ctx-1da30083) ===START=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549614535
2015-11-26 20:22:29,235 DEBUG [c.c.a.ApiServlet]
(catalina-exec-21:ctx-1da30083 ctx-605fe303) ===END=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549614535
2015-11-26 20:22:32,250 DEBUG [c.c.a.ApiServlet]
(catalina-exec-7:ctx-63ad70cb) ===START=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549617569
2015-11-26 20:22:32,277 DEBUG [c.c.a.ApiServlet]
(catalina-exec-7:ctx-63ad70cb ctx-3f0ef7d5) ===END=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549617569
2015-11-26 20:22:32,387 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-69:ctx-a18e64d5) Seq 4-8612571337392652838: Response Received:
2015-11-26 20:22:32,388 DEBUG [c.c.a.t.Request]
(DirectAgent-69:ctx-a18e64d5) Seq 4-8612571337392652838: Processing: {
Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
[{"com.cloud.agent.api.StartAnswer":{"vm":{"id":4,"name":"r-4-VM","bootloader":"PyGrub","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":268435456,"maxRam":268435456,"arch":"x86_64","os":"Debian
GNU/Linux 7(64-bit)","platformEmulator":"Debian Wheezy 7.0
(64-bit)","bootArgs":" template=domP name=r-4-VM eth2ip=10.0.0.174
eth2mask=255.255.255.0 gateway=10.0.0.1 eth0ip=10.1.1.1
eth0mask=255.255.255.0 domain=cs2cloud.internal cidrsize=24
dhcprange=10.1.1.1 eth1ip=169.254.0.43 eth1mask=255.255.0.0 type=router
disable_rp_filter=true dns1=8.8.8.8
baremetalnotificationsecuritykey=MD4bWVy5t0anMd4eq4UlKWj6cZTW4gFDMeDd0WR3H3BuAsrxVX28ShzvJgbd8RR5eMRZ7rNYAsaF9RPXAZoCrQ
baremetalnotificationapikey=ZWNcizzJ0xXQE0Ubr6Sr_kN7xlMMMMtziuPTxHwZOyIN-Lo2f2CzvPhNw0o01LkNP3X4bp61YiZu0EWF-Mbfew
host=10.0.0.170
port=8080","enableHA":true,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"SlzaiXi9iLi3YpfQ7v3kZw","params":{},"uuid":"27157005-7e89-4251-89e4-2c53ff43bb70","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"9478a811-8b96-4cfa-b6bf-1e09c3fecd39","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc"}},"name":"ROOT-4","size":3145728000,"path":"dcc1ce80-4cd5-4f59-b063-34e2a93ed99a","volumeId":5,"vmName":"r-4-VM","accountId":2,"format":"VHD","provisioningType":"THIN","id":5,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"dcc1ce80-4cd5-4f59-b063-34e2a93ed99a","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"10.0.0.170","volumeSize":"3145728000"}}],"nics":[{"deviceId":2,"networkRateMbps":200,"defaultNic":true,"pxeDisable":true,"nicUuid":"9fbc00ea-599c-4455-a416-8e66986d9454","uuid":"8872476c-2fd1-4ed3-bfb1-c62efe2b6eab","ip":"10.0.0.174","netmask":"255.255.255.0","gateway":"10.0.0.1","mac":"06:a0:8a:00:00:09","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"mgmt"},{"deviceId":0,"networkRateMbps":200,"defaultNic":false,"pxeDisable":true,"nicUuid":"f38511fa-d2e8-4935-9fc4-74b2eea7621b","uuid":"2e97fcee-3d01-40d2-a624-376661747d0c","ip":"10.1.1.1","netmask":"255.255.255.0","mac":"02:00:4d:27:00:02","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://500","isolationUri":"vlan://500","isSecurityGroupEnabled":false,"name":"mgmt"},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"pxeDisable":true,"nicUuid":"5c6cd3fa-fddb-4ee0-bff2-87e5c04f8d81","uuid":"914b3b0d-541c-4c63-b331-3377672a824d","ip":"169.254.0.43","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:00:2b","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"_iqnToPath":{},"result":true,"wait":0}},{"com.cloud.agent.api.check.CheckSshAnswer":{"result":true,"wait":0}},{"com.cloud.agent.api.GetDomRVersionAnswer":{"templateVersion":"Cloudstack
Release 4.6.0 Mon Nov 9 11:21:06 UTC
2015","scriptsVersion":"4042f3d5b3337372cf94955f2ae8a149\n","result":true,"details":"Cloudstack
Release 4.6.0 Mon Nov 9 11:21:06 UTC
2015&4042f3d5b3337372cf94955f2ae8a149\n","wait":0}},{"com.cloud.agent.api.NetworkUsageAnswer":{"routerName":"r-4-VM","bytesSent":0,"bytesReceived":0,"result":true,"details":"","wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"details":"Command
aggregation
started","wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"details":"Command
aggregation finished","wait":0}}] }
2015-11-26 20:22:32,389 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
4-8612571337392652838: Received: { Ans: , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 10, { StartAnswer, CheckSshAnswer,
GetDomRVersionAnswer, NetworkUsageAnswer, Answer, Answer, Answer, Answer } }
2015-11-26 20:22:32,405 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM state
transitted from :Starting to Running with event: OperationSucceededvm's
original host id: 4 new host id: 4 host id before state transition: 4
2015-11-26 20:22:32,408 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Start
completed for VM VM[DomainRouter|r-4-VM]
2015-11-26 20:22:32,412 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
SecurityGroup is not supported in the network id=212
2015-11-26 20:22:32,417 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
4-8612571337392652840: Sending { Cmd , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 100011,
[{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Start","accessDetails":{"router.guest.ip":"10.1.1.1","
router.name":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}}] }
2015-11-26 20:22:32,418 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
4-8612571337392652840: Executing: { Cmd , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 100011,
[{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Start","accessDetails":{"router.guest.ip":"10.1.1.1","
router.name":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}}] }
2015-11-26 20:22:32,418 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-138:ctx-d5c945c8) Seq 4-8612571337392652840: Executing request
2015-11-26 20:22:32,418 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-138:ctx-d5c945c8) Seq 4-8612571337392652840: Response
Received:
2015-11-26 20:22:32,418 DEBUG [c.c.a.t.Request]
(DirectAgent-138:ctx-d5c945c8) Seq 4-8612571337392652840: Processing: {
Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
[{"com.cloud.agent.api.Answer":{"result":true,"details":"Command
aggregation started","wait":0}}] }
2015-11-26 20:22:32,418 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
4-8612571337392652840: Received: { Ans: , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 10, { Answer } }
2015-11-26 20:22:32,418 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Reprogramming
network Ntwk[212|Guest|8] as a part of network implement
2015-11-26 20:22:32,419 DEBUG [c.c.n.f.FirewallManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) applying
default firewall egress rules
2015-11-26 20:22:32,425 DEBUG [o.a.c.n.t.BasicNetworkTopology]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) APPLYING
FIREWALL RULES
2015-11-26 20:22:32,425 DEBUG [o.a.c.n.t.BasicNetworkTopology]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Applying
firewall rules in network Ntwk[212|Guest|8]
2015-11-26 20:22:32,430 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
4-8612571337392652841: Sending { Cmd , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 100001,
[{"com.cloud.agent.api.routing.SetFirewallRulesCommand":{"rules":[{"id":0,"srcIp":"","protocol":"all","revoked":false,"alreadyAdded":false,"sourceCidrList":[],"purpose":"Firewall","trafficType":"Egress","defaultEgressPolicy":false}],"accessDetails":{"router.guest.ip":"10.1.1.1","firewall.egress.default":"System","zone.network.type":"Advanced","router.ip":"169.254.0.43","
router.name":"r-4-VM"},"wait":0}}] }
2015-11-26 20:22:32,430 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
4-8612571337392652841: Executing: { Cmd , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 100001,
[{"com.cloud.agent.api.routing.SetFirewallRulesCommand":{"rules":[{"id":0,"srcIp":"","protocol":"all","revoked":false,"alreadyAdded":false,"sourceCidrList":[],"purpose":"Firewall","trafficType":"Egress","defaultEgressPolicy":false}],"accessDetails":{"router.guest.ip":"10.1.1.1","firewall.egress.default":"System","zone.network.type":"Advanced","router.ip":"169.254.0.43","
router.name":"r-4-VM"},"wait":0}}] }
2015-11-26 20:22:32,430 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-276:ctx-9bb810d3) Seq 4-8612571337392652841: Executing request
2015-11-26 20:22:32,430 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-276:ctx-9bb810d3) Seq 4-8612571337392652841: Response
Received:
2015-11-26 20:22:32,430 DEBUG [c.c.a.t.Request]
(DirectAgent-276:ctx-9bb810d3) Seq 4-8612571337392652841: Processing: {
Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 0,
[{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
2015-11-26 20:22:32,430 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
4-8612571337392652841: Received: { Ans: , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 0, { Answer } }
2015-11-26 20:22:32,432 DEBUG [c.c.n.f.FirewallManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are no
firewall rules to apply
2015-11-26 20:22:32,432 DEBUG [c.c.n.r.RulesManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are no
static nat to apply for network id=212
2015-11-26 20:22:32,432 DEBUG [c.c.n.f.FirewallManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are no
firewall rules to apply
2015-11-26 20:22:32,433 DEBUG [c.c.n.r.RulesManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are no
port forwarding rules to apply for network id=212
2015-11-26 20:22:32,433 DEBUG [c.c.n.r.RulesManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are no
static nat rules to apply for network id=212
2015-11-26 20:22:32,433 DEBUG [c.c.n.l.LoadBalancingRulesManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Applying load
balancer rules of scheme Public in network id=212
2015-11-26 20:22:32,434 DEBUG [c.c.n.l.LoadBalancingRulesManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are no
Load Balancing Rules to forward to the network elements
2015-11-26 20:22:32,434 DEBUG [c.c.n.l.LoadBalancingRulesManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Applying load
balancer rules of scheme Internal in network id=212
2015-11-26 20:22:32,434 DEBUG [c.c.n.l.LoadBalancingRulesManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) There are no
Load Balancing Rules to forward to the network elements
2015-11-26 20:22:32,435 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
SecurityGroup is not supported in the network id=212
2015-11-26 20:22:32,439 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
4-8612571337392652842: Sending { Cmd , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 100011,
[{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Finish","accessDetails":{"router.guest.ip":"10.1.1.1","
router.name":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}}] }
2015-11-26 20:22:32,439 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
4-8612571337392652842: Executing: { Cmd , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 100011,
[{"com.cloud.agent.api.routing.AggregationControlCommand":{"action":"Finish","accessDetails":{"router.guest.ip":"10.1.1.1","
router.name":"r-4-VM","router.ip":"169.254.0.43"},"wait":0}}] }
2015-11-26 20:22:32,439 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-70:ctx-436aff22) Seq 4-8612571337392652842: Executing request
2015-11-26 20:22:32,439 DEBUG [c.c.a.r.v.VirtualRoutingResource]
(DirectAgent-70:ctx-436aff22) Transforming
com.cloud.agent.api.routing.SetFirewallRulesCommand to ConfigItems
2015-11-26 20:22:32,445 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-70:ctx-436aff22) Copying VR with ip 169.254.0.43 config file
into host 10.0.0.171
2015-11-26 20:22:32,848 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-70:ctx-436aff22) VR Config file
VR-a8dcb409-d150-4d21-b2c7-53b76dccedb3.cfg got created in VR, ip
169.254.0.43 with content
#Apache CloudStack Virtual Router Config File
<version>
1.0
</version>
<file>
/var/cache/cloud/firewall_rules.json
{"rules":[{"id":0,"src_ip":"","protocol":"all","revoked":false,"already_added":false,"source_cidr_list":[],"purpose":"Firewall","traffic_type":"Egress","default_egress_policy":false}],"type":"firewallrules"}
</file>
<script>
/opt/cloud/bin/update_config.py firewall_rules.json
</script>
2015-11-26 20:22:32,849 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-70:ctx-436aff22) Executing command in VR:
/opt/cloud/bin/router_proxy.sh vr_cfg.sh 169.254.0.43 -c
/var/cache/cloud/VR-a8dcb409-d150-4d21-b2c7-53b76dccedb3.cfg
2015-11-26 20:22:33,458 DEBUG [c.c.s.StatsCollector]
(StatsCollector-4:ctx-f3f3d8c7) AutoScaling Monitor is running...
2015-11-26 20:22:33,734 DEBUG [c.c.s.StatsCollector]
(StatsCollector-2:ctx-bc3ff1c1) VmStatsCollector is running...
2015-11-26 20:22:34,354 DEBUG [o.a.c.s.SecondaryStorageManagerImpl]
(secstorage-1:ctx-7f9c4728) Zone 3 is ready to launch secondary storage VM
2015-11-26 20:22:34,681 DEBUG [c.c.c.ConsoleProxyManagerImpl]
(consoleproxy-1:ctx-7ffdffac) Zone 3 is ready to launch console proxy
2015-11-26 20:22:35,261 DEBUG [c.c.a.ApiServlet]
(catalina-exec-23:ctx-032600be) ===START=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549620578
2015-11-26 20:22:35,273 DEBUG [c.c.a.ApiServlet]
(catalina-exec-23:ctx-032600be ctx-30e2f925) ===END=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549620578
2015-11-26 20:22:35,601 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-70:ctx-436aff22) Seq 4-8612571337392652842: Response Received:
2015-11-26 20:22:35,601 DEBUG [c.c.a.t.Request]
(DirectAgent-70:ctx-436aff22) Seq 4-8612571337392652842: Processing: {
Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
[{"com.cloud.agent.api.Answer":{"result":true,"details":"Command
aggregation finished","wait":0}}] }
2015-11-26 20:22:35,601 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
4-8612571337392652842: Received: { Ans: , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 10, { Answer } }
2015-11-26 20:22:35,609 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Lock is
released for network id 212 as a part of network implement
2015-11-26 20:22:35,616 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
SecurityGroup is not supported in the network id=212
2015-11-26 20:22:35,618 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Changing
active number of nics for network id=212 on 1
2015-11-26 20:22:35,621 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Asking
VirtualRouter to prepare for
Nic[11-5-2a4a184a-eac9-4609-8a70-4d230ee3a37d-10.1.1.88]
2015-11-26 20:22:35,630 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
SecurityGroup is not supported in the network id=212
2015-11-26 20:22:35,631 DEBUG [o.a.c.n.t.BasicNetworkTopology]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) CONFIG DHCP
FOR SUBNETS RULES
2015-11-26 20:22:35,636 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
SecurityGroup is not supported in the network id=212
2015-11-26 20:22:35,637 DEBUG [o.a.c.n.t.AdvancedNetworkTopology]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) APPLYING VPC
DHCP ENTRY RULES
2015-11-26 20:22:35,637 DEBUG [o.a.c.n.t.BasicNetworkTopology]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Applying dhcp
entry in network Ntwk[212|Guest|8]
2015-11-26 20:22:35,665 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
4-8612571337392652843: Sending { Cmd , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 100011,
[{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:71:ff:00:03","vmIpAddress":"10.1.1.88","vmName":"Test002","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:71:ff:00:03","isDefault":true,"executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","router.guest.ip":"10.1.1.1","router.ip":"169.254.0.43","
router.name":"r-4-VM"},"wait":0}}] }
2015-11-26 20:22:35,667 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
4-8612571337392652843: Executing: { Cmd , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 100011,
[{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:71:ff:00:03","vmIpAddress":"10.1.1.88","vmName":"Test002","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:71:ff:00:03","isDefault":true,"executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","router.guest.ip":"10.1.1.1","router.ip":"169.254.0.43","
router.name":"r-4-VM"},"wait":0}}] }
2015-11-26 20:22:35,667 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-277:ctx-490bf746) Seq 4-8612571337392652843: Executing request
2015-11-26 20:22:35,667 DEBUG [c.c.a.r.v.VirtualRoutingResource]
(DirectAgent-277:ctx-490bf746) Transforming
com.cloud.agent.api.routing.DhcpEntryCommand to ConfigItems
2015-11-26 20:22:35,672 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-277:ctx-490bf746) Copying VR with ip 169.254.0.43 config file
into host 10.0.0.171
2015-11-26 20:22:36,054 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-277:ctx-490bf746) VR Config file vm_dhcp_entry.json got
created in VR, ip 169.254.0.43 with content
{"host_name":"Test002","mac_address":"02:00:71:ff:00:03","ipv4_adress":"10.1.1.88","ipv6_duid":"00:03:00:01:02:00:71:ff:00:03","dns_adresses":"10.1.1.1","default_gateway":"10.1.1.1","default_entry":true,"type":"dhcpentry"}
2015-11-26 20:22:36,054 DEBUG [c.c.a.r.v.VirtualRoutingResource]
(DirectAgent-277:ctx-490bf746) Processing FileConfigItem, copying 222
characters to vm_dhcp_entry.json took 387ms
2015-11-26 20:22:36,054 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-277:ctx-490bf746) Executing command in VR:
/opt/cloud/bin/router_proxy.sh update_config.py 169.254.0.43
vm_dhcp_entry.json
2015-11-26 20:22:36,965 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-9:null) SeqA 5-1787: Processing Seq 5-1787: { Cmd ,
MgmtId: -1, via: 5, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
\"connections\": []\n}","wait":0}}] }
2015-11-26 20:22:36,969 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-9:null) SeqA 5-1787: Sending Seq 5-1787: { Ans: ,
MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
[{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2015-11-26 20:22:38,021 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-a7e1fd79) Begin cleanup expired async-jobs
2015-11-26 20:22:38,023 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-a7e1fd79) End cleanup expired async-jobs
2015-11-26 20:22:38,275 DEBUG [c.c.a.ApiServlet]
(catalina-exec-6:ctx-d344515b) ===START=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549623593
2015-11-26 20:22:38,288 DEBUG [c.c.a.ApiServlet]
(catalina-exec-6:ctx-d344515b ctx-ff44d35a) ===END=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549623593
2015-11-26 20:22:38,760 DEBUG [c.c.a.r.v.VirtualRoutingResource]
(DirectAgent-277:ctx-490bf746) Processing ScriptConfigItem, executing
update_config.py vm_dhcp_entry.json took 2706ms
2015-11-26 20:22:38,760 WARN [c.c.a.r.v.VirtualRoutingResource]
(DirectAgent-277:ctx-490bf746) Expected 1 answers while executing
DhcpEntryCommand but received 2
2015-11-26 20:22:38,760 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-277:ctx-490bf746) Seq 4-8612571337392652843: Response
Received:
2015-11-26 20:22:38,760 DEBUG [c.c.a.t.Request]
(DirectAgent-277:ctx-490bf746) Seq 4-8612571337392652843: Processing: {
Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
[{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null - success:
","null - success: RTNETLINK answers: File exists\nRTNETLINK answers: File
exists\nRTNETLINK answers: File exists\n[INFO] update_config.py ::
Processing incoming file => vm_dhcp_entry.json\n[INFO] Processing JSON file
vm_dhcp_entry.json\nTest01 Test002\n"],"result":true,"wait":0}}] }
2015-11-26 20:22:38,760 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
4-8612571337392652843: Received: { Ans: , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 10, { GroupAnswer } }
2015-11-26 20:22:38,766 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
SecurityGroup is not supported in the network id=212
2015-11-26 20:22:38,768 DEBUG [o.a.c.n.t.AdvancedNetworkTopology]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) APPLYING VPC
USERDATA RULES
2015-11-26 20:22:38,768 DEBUG [o.a.c.n.t.BasicNetworkTopology]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Applying
userdata and password entry in network Ntwk[212|Guest|8]
2015-11-26 20:22:38,778 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
4-8612571337392652844: Sending { Cmd , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 100011,
[{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
router.name
":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
router.name":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}}]
}
2015-11-26 20:22:38,779 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
4-8612571337392652844: Executing: { Cmd , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 100011,
[{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
router.name
":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
router.name":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}}]
}
2015-11-26 20:22:38,779 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-139:ctx-69673506) Seq 4-8612571337392652844: Executing request
2015-11-26 20:22:38,779 DEBUG [c.c.a.r.v.VirtualRoutingResource]
(DirectAgent-139:ctx-69673506) Transforming
com.cloud.agent.api.routing.SavePasswordCommand to ConfigItems
2015-11-26 20:22:38,787 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-139:ctx-69673506) Copying VR with ip 169.254.0.43 config file
into host 10.0.0.171
2015-11-26 20:22:39,199 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-139:ctx-69673506) VR Config file vm_password.json got created
in VR, ip 169.254.0.43 with content
{"ip_address":"10.1.1.88","password":"saved_password","type":"vmpassword"}
2015-11-26 20:22:39,199 DEBUG [c.c.a.r.v.VirtualRoutingResource]
(DirectAgent-139:ctx-69673506) Processing FileConfigItem, copying 74
characters to vm_password.json took 420ms
2015-11-26 20:22:39,199 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-139:ctx-69673506) Executing command in VR:
/opt/cloud/bin/router_proxy.sh update_config.py 169.254.0.43
vm_password.json
2015-11-26 20:22:40,237 DEBUG [c.c.s.StatsCollector]
(StatsCollector-1:ctx-32277352) HostStatsCollector is running...
2015-11-26 20:22:40,245 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-278:ctx-dc01444e) Seq 4-8612571337392652845: Executing request
2015-11-26 20:22:40,260 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-278:ctx-dc01444e) Seq 4-8612571337392652845: Response
Received:
2015-11-26 20:22:40,260 DEBUG [c.c.a.t.Request]
(StatsCollector-1:ctx-32277352) Seq 4-8612571337392652845: Received: {
Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10, {
GetHostStatsAnswer } }
2015-11-26 20:22:40,263 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-18:ctx-53bf8c75) Seq 4-8612571337392652846: Executing request
2015-11-26 20:22:40,273 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-18:ctx-53bf8c75) Seq 4-8612571337392652846: Response Received:
2015-11-26 20:22:40,274 DEBUG [c.c.a.t.Request]
(StatsCollector-1:ctx-32277352) Seq 4-8612571337392652846: Received: {
Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10, {
GetGPUStatsAnswer } }
2015-11-26 20:22:41,275 DEBUG [c.c.a.ApiServlet]
(catalina-exec-4:ctx-f2410d29) ===START=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549626594
2015-11-26 20:22:41,287 DEBUG [c.c.a.ApiServlet]
(catalina-exec-4:ctx-f2410d29 ctx-f6f4a185) ===END=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549626594
2015-11-26 20:22:41,959 DEBUG [c.c.a.r.v.VirtualRoutingResource]
(DirectAgent-139:ctx-69673506) Processing ScriptConfigItem, executing
update_config.py vm_password.json took 2760ms
2015-11-26 20:22:41,959 WARN [c.c.a.r.v.VirtualRoutingResource]
(DirectAgent-139:ctx-69673506) Expected 1 answers while executing
SavePasswordCommand but received 2
2015-11-26 20:22:41,960 DEBUG [c.c.a.r.v.VirtualRoutingResource]
(DirectAgent-139:ctx-69673506) Transforming
com.cloud.agent.api.routing.VmDataCommand to ConfigItems
2015-11-26 20:22:41,964 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-139:ctx-69673506) Copying VR with ip 169.254.0.43 config file
into host 10.0.0.171
2015-11-26 20:22:42,370 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-139:ctx-69673506) VR Config file vm_metadata.json got created
in VR, ip 169.254.0.43 with content
{"vm_ip_address":"10.1.1.88","vm_metadata":[["userdata","user-data",null],["metadata","service-offering","Medium
Instance"],["metadata","availability-zone","TestZone"],["metadata","local-ipv4","10.1.1.88"],["metadata","local-hostname","Test002"],["metadata","public-ipv4","10.0.0.174"],["metadata","public-hostname","10.0.0.174"],["metadata","instance-id","4ce4731f-22a7-42ac-8e78-093d5f2e9a34"],["metadata","vm-id","4ce4731f-22a7-42ac-8e78-093d5f2e9a34"],["metadata","public-keys",null],["metadata","cloud-identifier","CloudStack-{de65e551-2e87-423b-90e6-03cd3eb706bb}"]],"type":"vmdata"}
2015-11-26 20:22:42,371 DEBUG [c.c.a.r.v.VirtualRoutingResource]
(DirectAgent-139:ctx-69673506) Processing FileConfigItem, copying 589
characters to vm_metadata.json took 411ms
2015-11-26 20:22:42,371 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-139:ctx-69673506) Executing command in VR:
/opt/cloud/bin/router_proxy.sh update_config.py 169.254.0.43
vm_metadata.json
2015-11-26 20:22:44,606 DEBUG [c.c.a.ApiServlet]
(catalina-exec-25:ctx-128f2f7a) ===START=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549629925
2015-11-26 20:22:44,619 DEBUG [c.c.a.ApiServlet]
(catalina-exec-25:ctx-128f2f7a ctx-291bcd97) ===END=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549629925
2015-11-26 20:22:45,153 DEBUG [c.c.a.r.v.VirtualRoutingResource]
(DirectAgent-139:ctx-69673506) Processing ScriptConfigItem, executing
update_config.py vm_metadata.json took 2782ms
2015-11-26 20:22:45,153 WARN [c.c.a.r.v.VirtualRoutingResource]
(DirectAgent-139:ctx-69673506) Expected 1 answers while executing
VmDataCommand but received 2
2015-11-26 20:22:45,153 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-139:ctx-69673506) Seq 4-8612571337392652844: Response
Received:
2015-11-26 20:22:45,163 DEBUG [c.c.a.t.Request]
(DirectAgent-139:ctx-69673506) Seq 4-8612571337392652844: Processing: {
Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
[{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null - success:
","null - success: RTNETLINK answers: File exists\nRTNETLINK answers: File
exists\nRTNETLINK answers: File exists\n[INFO] update_config.py ::
Processing incoming file => vm_password.json\n[INFO] Processing JSON file
vm_password.json\n"],"result":true,"wait":0}},{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null
- success: ","null - success: RTNETLINK answers: File exists\nRTNETLINK
answers: File exists\nRTNETLINK answers: File exists\n[INFO]
update_config.py :: Processing incoming file => vm_metadata.json\n[INFO]
Processing JSON file vm_metadata.json\n"],"result":true,"wait":0}}] }
2015-11-26 20:22:45,163 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
4-8612571337392652844: Received: { Ans: , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 10, { GroupAnswer, GroupAnswer } }
2015-11-26 20:22:45,164 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
SecurityGroup is not supported in the network id=212
2015-11-26 20:22:45,165 DEBUG [o.a.c.e.o.VolumeOrchestrator]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Checking if
we need to prepare 2 volumes for VM[User|i-2-5-VM]
2015-11-26 20:22:45,168 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) template 5 is
already in store:1, type:Image
2015-11-26 20:22:45,169 DEBUG [o.a.c.s.d.PrimaryDataStoreImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Not found
(templateId:5poolId:8) in template_spool_ref, persisting it
2015-11-26 20:22:45,173 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) template 5 is
already in store:8, type:Primary
2015-11-26 20:22:45,174 DEBUG [o.a.c.s.v.VolumeServiceImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Found
template centos56-x86_64-xen in storage pool 8 with VMTemplateStoragePool
id: 3
2015-11-26 20:22:45,174 DEBUG [o.a.c.s.v.VolumeServiceImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Acquire lock
on VMTemplateStoragePool 3 with timeout 3600 seconds
2015-11-26 20:22:45,175 INFO [o.a.c.s.v.VolumeServiceImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) lock is
acquired for VMTemplateStoragePool 3
2015-11-26 20:22:45,179 DEBUG [o.a.c.s.m.AncientDataMotionStrategy]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) copyAsync
inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE
2015-11-26 20:22:45,182 DEBUG [c.c.h.XenServerGuru]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
getCommandHostDelegation: class
org.apache.cloudstack.storage.command.CopyCommand
2015-11-26 20:22:45,183 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
4-8612571337392652847: Sending { Cmd , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 100111,
[{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/5/3986df71-b1d0-3e20-a655-7e42dd144370.vhd","origUrl":"
http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
5.6(64-bit) no GUI
(XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://
10.0.0.170/export/secondary
","_role":"Image"}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"
http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
5.6(64-bit) no GUI
(XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc"}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"executeInSequence":true,"options":{},"options2":{},"wait":10800}}]
}
2015-11-26 20:22:45,184 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
4-8612571337392652847: Executing: { Cmd , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 100111,
[{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/5/3986df71-b1d0-3e20-a655-7e42dd144370.vhd","origUrl":"
http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
5.6(64-bit) no GUI
(XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://
10.0.0.170/export/secondary
","_role":"Image"}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"
http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
5.6(64-bit) no GUI
(XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc"}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"executeInSequence":true,"options":{},"options2":{},"wait":10800}}]
}
2015-11-26 20:22:45,184 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-279:ctx-532427fb) Seq 4-8612571337392652847: Executing request
2015-11-26 20:22:46,489 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-279:ctx-532427fb) Host 10.0.0.171
OpaqueRef:53354999-bf25-32b9-01df-a695a039ba8d: Removing SR
2015-11-26 20:22:46,500 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-279:ctx-532427fb) Host 10.0.0.171
OpaqueRef:f33f27b6-88c3-8c94-c8b3-40c094d9e66d: Unplugging pbd
2015-11-26 20:22:46,598 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-279:ctx-532427fb) Host 10.0.0.171
OpaqueRef:53354999-bf25-32b9-01df-a695a039ba8d: Forgetting
2015-11-26 20:22:46,601 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-279:ctx-532427fb) Seq 4-8612571337392652847: Response
Received:
2015-11-26 20:22:46,602 DEBUG [c.c.a.t.Request]
(DirectAgent-279:ctx-532427fb) Seq 4-8612571337392652847: Processing: {
Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 110,
[{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Expected
1 VDI template but found 2 VDI template(s) on:
10.0.0.170:/export/secondary/template/tmpl/1/5","wait":0}}]
}
2015-11-26 20:22:46,602 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
4-8612571337392652847: Received: { Ans: , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 110, { CopyCmdAnswer } }
2015-11-26 20:22:46,603 DEBUG [c.c.a.m.AgentAttache]
(DirectAgent-279:ctx-532427fb) Seq 4-8612571337392652847: No more commands
found
2015-11-26 20:22:46,607 INFO [o.a.c.s.v.VolumeServiceImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) releasing
lock for VMTemplateStoragePool 3
2015-11-26 20:22:46,608 DEBUG [o.a.c.e.o.VolumeOrchestrator]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Unable to
create Vol[6|vm=5|ROOT]:Expected 1 VDI template but found 2 VDI template(s)
on: 10.0.0.170:/export/secondary/template/tmpl/1/5
2015-11-26 20:22:46,608 INFO [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Unable to
contact resource.
com.cloud.exception.StorageUnavailableException: Resource [StoragePool:8]
is unreachable: Unable to create Vol[6|vm=5|ROOT]:Expected 1 VDI template
but found 2 VDI template(s) on: 10.0.0.170:
/export/secondary/template/tmpl/1/5
at
org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1278)
at
org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1336)
at
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1000)
at
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4580)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
at
com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4736)
at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2015-11-26 20:22:46,611 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Cleaning up
resources for the vm VM[User|i-2-5-VM] in Starting state
2015-11-26 20:22:46,612 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
4-8612571337392652848: Sending { Cmd , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 100011,
[{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"checkBeforeCleanup":false,"vmName":"i-2-5-VM","wait":0}}]
}
2015-11-26 20:22:46,612 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
4-8612571337392652848: Executing: { Cmd , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 100011,
[{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"checkBeforeCleanup":false,"vmName":"i-2-5-VM","wait":0}}]
}
2015-11-26 20:22:46,613 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-140:ctx-7f6d3e96) Seq 4-8612571337392652848: Executing request
2015-11-26 20:22:46,618 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-140:ctx-7f6d3e96) Seq 4-8612571337392652848: Response
Received:
2015-11-26 20:22:46,618 DEBUG [c.c.a.t.Request]
(DirectAgent-140:ctx-7f6d3e96) Seq 4-8612571337392652848: Processing: {
Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
[{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not
exist","wait":0}}] }
2015-11-26 20:22:46,618 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Seq
4-8612571337392652848: Received: { Ans: , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 10, { StopAnswer } }
2015-11-26 20:22:46,623 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Service
SecurityGroup is not supported in the network id=212
2015-11-26 20:22:46,625 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Changing
active number of nics for network id=212 on -1
2015-11-26 20:22:46,630 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Asking
VirtualRouter to release
NicProfile[11-5-2a4a184a-eac9-4609-8a70-4d230ee3a37d-10.1.1.88-null
2015-11-26 20:22:46,630 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Successfully
released network resources for the vm VM[User|i-2-5-VM]
2015-11-26 20:22:46,630 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Successfully
cleanued up resources for the vm VM[User|i-2-5-VM] in Starting state
2015-11-26 20:22:46,635 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Deploy avoids
pods: [], clusters: [], hosts: [4]
2015-11-26 20:22:46,636 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
DeploymentPlanner allocation algorithm:
com.cloud.deploy.FirstFitPlanner@1136745
2015-11-26 20:22:46,636 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Trying to
allocate a host and storage pools from dc:3, pod:3,cluster:3, requested
cpu: 1000, requested ram: 1073741824
2015-11-26 20:22:46,636 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Is ROOT
volume READY (pool already allocated)?: No
2015-11-26 20:22:46,636 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535)
DeploymentPlan has host_id specified, choosing this host and making no
checks on this host: 4
2015-11-26 20:22:46,636 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) The specified
host is in avoid set
2015-11-26 20:22:46,636 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Cannot deploy
to specified host, returning.
2015-11-26 20:22:46,645 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) VM state
transitted from :Starting to Stopped with event: OperationFailedvm's
original host id: null new host id: null host id before state transition: 4
2015-11-26 20:22:46,648 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Hosts's
actual total CPU: 3399 and CPU after applying overprovisioning: 3399
2015-11-26 20:22:46,649 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Hosts's
actual total RAM: 15354505344 and RAM after applying overprovisioning:
15354505216
2015-11-26 20:22:46,649 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) release cpu
from host: 4, old used: 2500,reserved: 0, actual total: 3399, total with
overprovisioning: 3399; new used: 1500,reserved:0; movedfromreserved:
false,moveToReserveredfalse
2015-11-26 20:22:46,649 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) release mem
from host: 4, old used: 2952790016,reserved: 0, total: 15354505216; new
used: 1879048192,reserved:0; movedfromreserved: false,moveToReserveredfalse
2015-11-26 20:22:46,654 ERROR [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Invocation
exception, caused by:
com.cloud.exception.InsufficientServerCapacityException: Unable to create a
deployment for VM[User|i-2-5-VM]Scope=interface com.cloud.dc.DataCenter;
id=3
2015-11-26 20:22:46,654 INFO [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Rethrow
exception com.cloud.exception.InsufficientServerCapacityException: Unable
to create a deployment for VM[User|i-2-5-VM]Scope=interface
com.cloud.dc.DataCenter; id=3
2015-11-26 20:22:46,654 DEBUG [c.c.v.VmWorkJobDispatcher]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Done with run of VM work
job: com.cloud.vm.VmWorkStart for VM 5, job origin: 68
2015-11-26 20:22:46,654 ERROR [c.c.v.VmWorkJobDispatcher]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Unable to complete
AsyncJobVO {id:69, userId: 2, accountId: 2, instanceType: null, instanceId:
null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAABXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAA3BzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHIAEGphdmEubGFuZy5OdW1iZXKGrJUdC5TgiwIAAHhwAAAAAAAAAANzcQB-AAgAAAAAAAAABHBwcHEAfgAKcHNyABFqYXZhLnV0aWwuSGFzaE1hcAUH2sHDFmDRAwACRgAKbG9hZEZhY3RvckkACXRocmVzaG9sZHhwP0AAAAAAAAx3CAAAABAAAAABdAAKVm1QYXNzd29yZHQAHHJPMEFCWFFBRG5OaGRtVmtYM0JoYzNOM2IzSmt4cA,
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
result: null, initMsid: 52229922654, completeMsid: null, lastUpdated: null,
lastPolled: null, created: Thu Nov 26 20:21:56 IST 2015}, job origin:68
com.cloud.exception.InsufficientServerCapacityException: Unable to create a
deployment for VM[User|i-2-5-VM]Scope=interface com.cloud.dc.DataCenter;
id=3
at
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:959)
at
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4580)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
at
com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4736)
at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2015-11-26 20:22:46,662 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Complete async job-69,
jobStatus: FAILED, resultCode: 0, result:
rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAAzVW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1VzZXJ8aS0yLTUtVk1ddXIAHltMamF2YS5sYW5nLlN0YWNrVHJhY2VFbGVtZW50OwJGKjw8_SI5AgAAeHAAAAAVc3IAG2phdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudGEJxZomNt2FAgAESQAKbGluZU51bWJlckwADmRlY2xhcmluZ0NsYXNzcQB-AApMAAhmaWxlTmFtZXEAfgAKTAAKbWV0aG9kTmFtZXEAfgAKeHAAAAO_dAAmY29tLmNsb3VkLnZtLlZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGx0AB5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsLmphdmF0ABBvcmNoZXN0cmF0ZVN0YXJ0c3EAfgARAAAR5HEAfgATcQB-ABRxAH4AFXNxAH4AEf____50ACRzdW4ucmVmbGVjdC5OYXRpdmVNZXRob2RBY2Nlc3NvckltcGx0AB1OYXRpdmVNZXRob2RBY2Nlc3NvckltcGwuamF2YXQAB2ludm9rZTBzcQB-ABEAAAA5cQB-ABhxAH4AGXQABmludm9rZXNxAH4AEQAAACt0AChzdW4ucmVmbGVjdC5EZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsdAAhRGVsZWdhdGluZ01ldGhvZEFjY2Vzc29ySW1wbC5qYXZhcQB-ABxzcQB-ABEAAAJedAAYamF2YS5sYW5nLnJlZmxlY3QuTWV0aG9kdAALTWV0aG9kLmphdmFxAH4AHHNxAH4AEQAAAGt0ACJjb20uY2xvdWQudm0uVm1Xb3JrSm9iSGFuZGxlclByb3h5dAAaVm1Xb3JrSm9iSGFuZGxlclByb3h5LmphdmF0AA9oYW5kbGVWbVdvcmtKb2JzcQB-ABEAABKAcQB-ABNxAH4AFHEAfgAmc3EAfgARAAAAZnQAIGNvbS5jbG91ZC52bS5WbVdvcmtKb2JEaXNwYXRjaGVydAAYVm1Xb3JrSm9iRGlzcGF0Y2hlci5qYXZhdAAGcnVuSm9ic3EAfgARAAACGXQAP29yZy5hcGFjaGUuY2xvdWRzdGFjay5mcmFtZXdvcmsuam9icy5pbXBsLkFzeW5jSm9iTWFuYWdlckltcGwkNXQAGEFzeW5jSm9iTWFuYWdlckltcGwuamF2YXQADHJ1bkluQ29udGV4dHNxAH4AEQAAADF0AD5vcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGUkMXQAG01hbmFnZWRDb250ZXh0UnVubmFibGUuamF2YXQAA3J1bnNxAH4AEQAAADh0AEJvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0JDF0ABpEZWZhdWx0TWFuYWdlZENvbnRleHQuamF2YXQABGNhbGxzcQB-ABEAAABndABAb3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5pbXBsLkRlZmF1bHRNYW5hZ2VkQ29udGV4dHEAfgA2dAAPY2FsbFdpdGhDb250ZXh0c3EAfgARAAAANXEAfgA5cQB-ADZ0AA5ydW5XaXRoQ29udGV4dHNxAH4AEQAAAC50ADxvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGVxAH4AMnEAfgAzc3EAfgARAAAB7nEAfgAtcQB-AC5xAH4AM3NxAH4AEQAAAdd0AC5qYXZhLnV0aWwuY29uY3VycmVudC5FeGVjdXRvcnMkUnVubmFibGVBZGFwdGVydAAORXhlY3V0b3JzLmphdmFxAH4AN3NxAH4AEQAAAQZ0AB9qYXZhLnV0aWwuY29uY3VycmVudC5GdXR1cmVUYXNrdAAPRnV0dXJlVGFzay5qYXZhcQB-ADNzcQB-ABEAAAR5dAAnamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9ydAAXVGhyZWFkUG9vbEV4ZWN1dG9yLmphdmF0AAlydW5Xb3JrZXJzcQB-ABEAAAJndAAuamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9yJFdvcmtlcnEAfgBIcQB-ADNzcQB-ABEAAALpdAAQamF2YS5sYW5nLlRocmVhZHQAC1RocmVhZC5qYXZhcQB-ADNzcgAmamF2YS51dGlsLkNvbGxlY3Rpb25zJFVubW9kaWZpYWJsZUxpc3T8DyUxteyOEAIAAUwABGxpc3RxAH4ADHhyACxqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlQ29sbGVjdGlvbhlCAIDLXvceAgABTAABY3QAFkxqYXZhL3V0aWwvQ29sbGVjdGlvbjt4cHNyABNqYXZhLnV0aWwuQXJyYXlMaXN0eIHSHZnHYZ0DAAFJAARzaXpleHAAAAAAdwQAAAAAeHEAfgBUeHNyABFqYXZhLmxhbmcuSW50ZWdlchLioKT3gYc4AgABSQAFdmFsdWV4cgAQamF2YS5sYW5nLk51bWJlcoaslR0LlOCLAgAAeHAAABDvc3EAfgBTAAAAAHcEAAAAAHhzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHEAfgBWAAAAAAAAAAN2cgAXY29tLmNsb3VkLmRjLkRhdGFDZW50ZXKy8Qrrp-d4vgIAAHhwAA
2015-11-26 20:22:46,663 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Publish async job-69
complete on message bus
2015-11-26 20:22:46,663 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Wake up jobs related to
job-69
2015-11-26 20:22:46,663 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Update db status for job-69
2015-11-26 20:22:46,664 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Wake up jobs joined with
job-69 and disjoin all subjobs created from job- 69
2015-11-26 20:22:46,671 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Done executing
com.cloud.vm.VmWorkStart for job-69
2015-11-26 20:22:46,672 INFO [o.a.c.f.j.i.AsyncJobMonitor]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69) Remove job-69 from job
monitoring
2015-11-26 20:22:46,680 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Sync job-71 execution
on object VmWorkJobQueue.5
2015-11-26 20:22:46,966 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-7:null) SeqA 5-1788: Processing Seq 5-1788: { Cmd ,
MgmtId: -1, via: 5, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
\"connections\": []\n}","wait":0}}] }
2015-11-26 20:22:46,971 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-7:null) SeqA 5-1788: Sending Seq 5-1788: { Ans: ,
MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
[{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2015-11-26 20:22:48,032 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-a78c3581) Execute sync-queue item:
SyncQueueItemVO {id:10, queueId: 9, contentType: AsyncJob, contentId: 71,
lastProcessMsid: 52229922654, lastprocessNumber: 2, lastProcessTime: Thu
Nov 26 20:22:48 IST 2015, created: Thu Nov 26 20:22:46 IST 2015}
2015-11-26 20:22:48,033 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-a78c3581) Schedule queued job-71
2015-11-26 20:22:48,038 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-5936202f) Begin cleanup expired async-jobs
2015-11-26 20:22:48,041 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-5936202f) End cleanup expired async-jobs
2015-11-26 20:22:48,041 INFO [o.a.c.f.j.i.AsyncJobMonitor]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Add job-71 into job
monitoring
2015-11-26 20:22:48,045 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Executing AsyncJobVO
{id:71, userId: 2, accountId: 2, instanceType: null, instanceId: null, cmd:
com.cloud.vm.VmWorkStart, cmdInfo:
rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAABXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwc3IAEWphdmEudXRpbC5IYXNoTWFwBQfawcMWYNEDAAJGAApsb2FkRmFjdG9ySQAJdGhyZXNob2xkeHA_QAAAAAAADHcIAAAAEAAAAAF0AApWbVBhc3N3b3JkdAAcck8wQUJYUUFEbk5oZG1Wa1gzQmhjM04zYjNKa3hw,
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
result: null, initMsid: 52229922654, completeMsid: null, lastUpdated: null,
lastPolled: null, created: Thu Nov 26 20:22:46 IST 2015}
2015-11-26 20:22:48,046 DEBUG [c.c.v.VmWorkJobDispatcher]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Run VM work job:
com.cloud.vm.VmWorkStart for VM 5, job origin: 68
2015-11-26 20:22:48,046 DEBUG [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Execute VM
work job:
com.cloud.vm.VmWorkStart{"dcId":0,"rawParams":{"VmPassword":"rO0ABXQADnNhdmVkX3Bhc3N3b3Jk"},"userId":2,"accountId":2,"vmId":5,"handlerName":"VirtualMachineManagerImpl"}
2015-11-26 20:22:48,050 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) VM state
transitted from :Stopped to Starting with event: StartRequestedvm's
original host id: null new host id: null host id before state transition:
null
2015-11-26 20:22:48,050 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Successfully
transitioned to start state for VM[User|i-2-5-VM] reservation id =
718d2456-bf61-48ad-9663-22ccfd4556f1
2015-11-26 20:22:48,052 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Trying to
deploy VM, vm has dcId: 3 and podId: 3
2015-11-26 20:22:48,052 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Deploy avoids
pods: null, clusters: null, hosts: null
2015-11-26 20:22:48,057 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Deploy avoids
pods: [], clusters: [], hosts: []
2015-11-26 20:22:48,057 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
DeploymentPlanner allocation algorithm:
com.cloud.deploy.FirstFitPlanner@1136745
2015-11-26 20:22:48,057 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Trying to
allocate a host and storage pools from dc:3, pod:3,cluster:null, requested
cpu: 1000, requested ram: 1073741824
2015-11-26 20:22:48,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Is ROOT
volume READY (pool already allocated)?: No
2015-11-26 20:22:48,058 DEBUG [c.c.d.FirstFitPlanner]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Searching
resources only under specified Pod: 3
2015-11-26 20:22:48,058 DEBUG [c.c.d.FirstFitPlanner]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Listing
clusters in order of aggregate capacity, that have (atleast one host with)
enough CPU and RAM capacity under this Pod: 3
2015-11-26 20:22:48,059 DEBUG [c.c.d.FirstFitPlanner]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Removing from
the clusterId list these clusters from avoid set: []
2015-11-26 20:22:48,063 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
resources in Cluster: 3 under Pod: 3
2015-11-26 20:22:48,063 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
FirstFitRoutingAllocator) Looking for hosts in dc: 3 pod:3 cluster:3
2015-11-26 20:22:48,065 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for
allocation: [Host[-4-Routing]]
2015-11-26 20:22:48,067 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
FirstFitRoutingAllocator) Found 1 hosts for allocation after
prioritization: [Host[-4-Routing]]
2015-11-26 20:22:48,067 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
FirstFitRoutingAllocator) Looking for speed=1000Mhz, Ram=1024
2015-11-26 20:22:48,070 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
FirstFitRoutingAllocator) Host: 4 has cpu capability (cpu:1, speed:3399) to
support requested CPU: 1 and requested speed: 1000
2015-11-26 20:22:48,070 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
FirstFitRoutingAllocator) Checking if host: 4 has enough capacity for
requested CPU: 1000 and requested RAM: 1073741824 ,
cpuOverprovisioningFactor: 1.0
2015-11-26 20:22:48,071 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
FirstFitRoutingAllocator) Hosts's actual total CPU: 3399 and CPU after
applying overprovisioning: 3399
2015-11-26 20:22:48,071 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
FirstFitRoutingAllocator) Free CPU: 1899 , Requested CPU: 1000
2015-11-26 20:22:48,071 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
FirstFitRoutingAllocator) Free RAM: 13475457024 , Requested RAM: 1073741824
2015-11-26 20:22:48,071 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
FirstFitRoutingAllocator) Host has enough CPU and RAM available
2015-11-26 20:22:48,071 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
FirstFitRoutingAllocator) STATS: Can alloc CPU from host: 4, used: 1500,
reserved: 0, actual total: 3399, total with overprovisioning: 3399;
requested cpu:1000,alloc_from_last_host?:false ,considerReservedCapacity?:
true
2015-11-26 20:22:48,071 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
FirstFitRoutingAllocator) STATS: Can alloc MEM from host: 4, used:
1879048192, reserved: 0, total: 15354505216; requested mem:
1073741824,alloc_from_last_host?:false ,considerReservedCapacity?: true
2015-11-26 20:22:48,071 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
FirstFitRoutingAllocator) Found a suitable host, adding to list: 4
2015-11-26 20:22:48,071 DEBUG [c.c.a.m.a.i.FirstFitAllocator]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437
FirstFitRoutingAllocator) Host Allocator returning 1 suitable hosts
2015-11-26 20:22:48,072 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
suitable pools for volume (Id, Type): (6,ROOT)
2015-11-26 20:22:48,072 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) We need to
allocate new storagepool for this volume
2015-11-26 20:22:48,073 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Calling
StoragePoolAllocators to find suitable pools
2015-11-26 20:22:48,073 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
LocalStoragePoolAllocator trying to find storage pool to fit the vm
2015-11-26 20:22:48,073 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
ClusterScopeStoragePoolAllocator looking for storage pool
2015-11-26 20:22:48,073 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Looking for
pools in dc: 3 pod:3 cluster:3. Disabled pools will be ignored.
2015-11-26 20:22:48,073 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found pools
matching tags: [Pool[8|NetworkFilesystem]]
2015-11-26 20:22:48,074 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking if
storage pool is suitable, name: null ,poolId: 8
2015-11-26 20:22:48,075 INFO [c.c.s.StorageManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Storage pool
null (8) does not supply IOPS capacity, assuming enough capacity
2015-11-26 20:22:48,076 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking pool
8 for storage, totalSize: 526199291904, usedBytes: 10131603456, usedPct:
0.019254308418659775, disable threshold: 0.85
2015-11-26 20:22:48,078 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found storage
pool primary of type NetworkFilesystem with overprovisioning factor 2
2015-11-26 20:22:48,078 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total over
provisioned capacity calculated is 2 * 526199291904
2015-11-26 20:22:48,079 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total
capacity of the pool primary id: 8 is 1052398583808
2015-11-26 20:22:48,079 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
pool: 8 for volume allocation [Vol[6|vm=5|ROOT]], maxSize : 1052398583808,
totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
disable threshold: 0.85
2015-11-26 20:22:48,079 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
2015-11-26 20:22:48,079 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
suitable pools for volume (Id, Type): (7,DATADISK)
2015-11-26 20:22:48,079 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) We need to
allocate new storagepool for this volume
2015-11-26 20:22:48,079 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Calling
StoragePoolAllocators to find suitable pools
2015-11-26 20:22:48,079 DEBUG [o.a.c.s.a.LocalStoragePoolAllocator]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
LocalStoragePoolAllocator trying to find storage pool to fit the vm
2015-11-26 20:22:48,079 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
ClusterScopeStoragePoolAllocator looking for storage pool
2015-11-26 20:22:48,079 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Looking for
pools in dc: 3 pod:3 cluster:3. Disabled pools will be ignored.
2015-11-26 20:22:48,080 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found pools
matching tags: [Pool[8|NetworkFilesystem]]
2015-11-26 20:22:48,080 DEBUG [o.a.c.s.a.AbstractStoragePoolAllocator]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking if
storage pool is suitable, name: null ,poolId: 8
2015-11-26 20:22:48,081 INFO [c.c.s.StorageManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Storage pool
null (8) does not supply IOPS capacity, assuming enough capacity
2015-11-26 20:22:48,081 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking pool
8 for storage, totalSize: 526199291904, usedBytes: 10131603456, usedPct:
0.019254308418659775, disable threshold: 0.85
2015-11-26 20:22:48,083 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found storage
pool primary of type NetworkFilesystem with overprovisioning factor 2
2015-11-26 20:22:48,083 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total over
provisioned capacity calculated is 2 * 526199291904
2015-11-26 20:22:48,083 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total
capacity of the pool primary id: 8 is 1052398583808
2015-11-26 20:22:48,083 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
pool: 8 for volume allocation [Vol[7|vm=5|DATADISK]], maxSize :
1052398583808, totalAllocatedSize : 12156207104, askingSize : 21474836480,
allocated disable threshold: 0.85
2015-11-26 20:22:48,083 DEBUG [o.a.c.s.a.ClusterScopeStoragePoolAllocator]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
ClusterScopeStoragePoolAllocator returning 1 suitable storage pools
2015-11-26 20:22:48,083 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Trying to
find a potenial host and associated storage pools from the suitable
host/pool lists for this VM
2015-11-26 20:22:48,083 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking if
host: 4 can access any suitable storage pool for volume: DATADISK
2015-11-26 20:22:48,084 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Host: 4 can
access pool: 8
2015-11-26 20:22:48,084 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking pool
8 for storage, totalSize: 526199291904, usedBytes: 10131603456, usedPct:
0.019254308418659775, disable threshold: 0.85
2015-11-26 20:22:48,086 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found storage
pool primary of type NetworkFilesystem with overprovisioning factor 2
2015-11-26 20:22:48,086 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total over
provisioned capacity calculated is 2 * 526199291904
2015-11-26 20:22:48,086 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total
capacity of the pool primary id: 8 is 1052398583808
2015-11-26 20:22:48,086 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
pool: 8 for volume allocation [Vol[7|vm=5|DATADISK]], maxSize :
1052398583808, totalAllocatedSize : 12156207104, askingSize : 21474836480,
allocated disable threshold: 0.85
2015-11-26 20:22:48,086 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking if
host: 4 can access any suitable storage pool for volume: ROOT
2015-11-26 20:22:48,087 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Host: 4 can
access pool: 8
2015-11-26 20:22:48,087 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking pool
8 for storage, totalSize: 526199291904, usedBytes: 10131603456, usedPct:
0.019254308418659775, disable threshold: 0.85
2015-11-26 20:22:48,090 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found storage
pool primary of type NetworkFilesystem with overprovisioning factor 2
2015-11-26 20:22:48,090 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total over
provisioned capacity calculated is 2 * 526199291904
2015-11-26 20:22:48,090 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Total
capacity of the pool primary id: 8 is 1052398583808
2015-11-26 20:22:48,090 DEBUG [c.c.s.StorageManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking
pool: 8 for volume allocation [Vol[6|vm=5|ROOT]], maxSize : 1052398583808,
totalAllocatedSize : 12156207104, askingSize : 21474836480, allocated
disable threshold: 0.85
2015-11-26 20:22:48,090 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found a
potential host id: 4 name: xenserver and associated storage pools for this
VM
2015-11-26 20:22:48,091 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Returning
Deployment Destination:
Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
:
Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage(Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
Volume(7|DATADISK-->Pool(8))]
2015-11-26 20:22:48,091 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Deployment
found - P0=VM[User|i-2-5-VM],
P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
:
Dest[Zone(3)-Pod(3)-Cluster(3)-Host(4)-Storage(Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
Volume(6|ROOT-->Pool(8)Volume(6|ROOT-->Pool(8),
Volume(7|DATADISK-->Pool(8))]
2015-11-26 20:22:48,097 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) VM state
transitted from :Starting to Starting with event: OperationRetryvm's
original host id: null new host id: 4 host id before state transition: null
2015-11-26 20:22:48,100 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Hosts's
actual total CPU: 3399 and CPU after applying overprovisioning: 3399
2015-11-26 20:22:48,100 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) We are
allocating VM, increasing the used capacity of this host:4
2015-11-26 20:22:48,100 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Current Used
CPU: 1500 , Free CPU:1899 ,Requested CPU: 1000
2015-11-26 20:22:48,100 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Current Used
RAM: 1879048192 , Free RAM:13475457024 ,Requested RAM: 1073741824
2015-11-26 20:22:48,100 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) CPU STATS
after allocation: for host: 4, old used: 1500, old reserved: 0, actual
total: 3399, total with overprovisioning: 3399; new used:2500, reserved:0;
requested cpu:1000,alloc_from_last:false
2015-11-26 20:22:48,100 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) RAM STATS
after allocation: for host: 4, old used: 1879048192, old reserved: 0,
total: 15354505216; new used: 2952790016, reserved: 0; requested mem:
1073741824,alloc_from_last:false
2015-11-26 20:22:48,102 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) VM is being
created in podId: 3
2015-11-26 20:22:48,103 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Network
id=212 is already implemented
2015-11-26 20:22:48,109 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Service
SecurityGroup is not supported in the network id=212
2015-11-26 20:22:48,111 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Changing
active number of nics for network id=212 on 1
2015-11-26 20:22:48,114 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Asking
VirtualRouter to prepare for
Nic[11-5-718d2456-bf61-48ad-9663-22ccfd4556f1-10.1.1.88]
2015-11-26 20:22:48,123 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Service
SecurityGroup is not supported in the network id=212
2015-11-26 20:22:48,125 DEBUG [o.a.c.n.t.BasicNetworkTopology]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) CONFIG DHCP
FOR SUBNETS RULES
2015-11-26 20:22:48,129 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Service
SecurityGroup is not supported in the network id=212
2015-11-26 20:22:48,130 DEBUG [o.a.c.n.t.AdvancedNetworkTopology]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) APPLYING VPC
DHCP ENTRY RULES
2015-11-26 20:22:48,130 DEBUG [o.a.c.n.t.BasicNetworkTopology]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Applying dhcp
entry in network Ntwk[212|Guest|8]
2015-11-26 20:22:48,138 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
4-8612571337392652849: Sending { Cmd , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 100011,
[{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:71:ff:00:03","vmIpAddress":"10.1.1.88","vmName":"Test002","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:71:ff:00:03","isDefault":true,"executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","router.guest.ip":"10.1.1.1","router.ip":"169.254.0.43","
router.name":"r-4-VM"},"wait":0}}] }
2015-11-26 20:22:48,139 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
4-8612571337392652849: Executing: { Cmd , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 100011,
[{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:71:ff:00:03","vmIpAddress":"10.1.1.88","vmName":"Test002","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:71:ff:00:03","isDefault":true,"executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","router.guest.ip":"10.1.1.1","router.ip":"169.254.0.43","
router.name":"r-4-VM"},"wait":0}}] }
2015-11-26 20:22:48,139 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-280:ctx-eb580854) Seq 4-8612571337392652849: Executing request
2015-11-26 20:22:48,139 DEBUG [c.c.a.r.v.VirtualRoutingResource]
(DirectAgent-280:ctx-eb580854) Transforming
com.cloud.agent.api.routing.DhcpEntryCommand to ConfigItems
2015-11-26 20:22:48,144 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-280:ctx-eb580854) Copying VR with ip 169.254.0.43 config file
into host 10.0.0.171
2015-11-26 20:22:48,211 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:ctx-8884e0d0) Found 1 routers to update status.
2015-11-26 20:22:48,213 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:ctx-8884e0d0) Found 0 VPC networks to update
Redundant State.
2015-11-26 20:22:48,214 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:ctx-8884e0d0) Found 0 networks to update RvR status.
2015-11-26 20:22:48,222 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:ctx-7dc158f2) Found 1 routers to update status.
2015-11-26 20:22:48,223 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:ctx-7dc158f2) Found 0 VPC networks to update
Redundant State.
2015-11-26 20:22:48,223 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:ctx-7dc158f2) Found 0 networks to update RvR status.
2015-11-26 20:22:48,509 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-280:ctx-eb580854) VR Config file vm_dhcp_entry.json got
created in VR, ip 169.254.0.43 with content
{"host_name":"Test002","mac_address":"02:00:71:ff:00:03","ipv4_adress":"10.1.1.88","ipv6_duid":"00:03:00:01:02:00:71:ff:00:03","dns_adresses":"10.1.1.1","default_gateway":"10.1.1.1","default_entry":true,"type":"dhcpentry"}
2015-11-26 20:22:48,509 DEBUG [c.c.a.r.v.VirtualRoutingResource]
(DirectAgent-280:ctx-eb580854) Processing FileConfigItem, copying 222
characters to vm_dhcp_entry.json took 370ms
2015-11-26 20:22:48,510 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-280:ctx-eb580854) Executing command in VR:
/opt/cloud/bin/router_proxy.sh update_config.py 169.254.0.43
vm_dhcp_entry.json
2015-11-26 20:22:48,606 DEBUG [c.c.a.ApiServlet]
(catalina-exec-5:ctx-6424a9fc) ===START=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549633925
2015-11-26 20:22:48,618 DEBUG [c.c.a.ApiServlet]
(catalina-exec-5:ctx-6424a9fc ctx-7c6e9282) ===END=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549633925
2015-11-26 20:22:51,265 DEBUG [c.c.a.r.v.VirtualRoutingResource]
(DirectAgent-280:ctx-eb580854) Processing ScriptConfigItem, executing
update_config.py vm_dhcp_entry.json took 2756ms
2015-11-26 20:22:51,265 WARN [c.c.a.r.v.VirtualRoutingResource]
(DirectAgent-280:ctx-eb580854) Expected 1 answers while executing
DhcpEntryCommand but received 2
2015-11-26 20:22:51,265 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-280:ctx-eb580854) Seq 4-8612571337392652849: Response
Received:
2015-11-26 20:22:51,266 DEBUG [c.c.a.t.Request]
(DirectAgent-280:ctx-eb580854) Seq 4-8612571337392652849: Processing: {
Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
[{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null - success:
","null - success: RTNETLINK answers: File exists\nRTNETLINK answers: File
exists\nRTNETLINK answers: File exists\n[INFO] update_config.py ::
Processing incoming file => vm_dhcp_entry.json\n[INFO] Processing JSON file
vm_dhcp_entry.json\nTest002 Test002\nTest01
Test002\n"],"result":true,"wait":0}}] }
2015-11-26 20:22:51,266 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
4-8612571337392652849: Received: { Ans: , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 10, { GroupAnswer } }
2015-11-26 20:22:51,268 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Service
SecurityGroup is not supported in the network id=212
2015-11-26 20:22:51,269 DEBUG [o.a.c.n.t.AdvancedNetworkTopology]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) APPLYING VPC
USERDATA RULES
2015-11-26 20:22:51,269 DEBUG [o.a.c.n.t.BasicNetworkTopology]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Applying
userdata and password entry in network Ntwk[212|Guest|8]
2015-11-26 20:22:51,278 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
4-8612571337392652850: Sending { Cmd , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 100011,
[{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
router.name
":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
router.name":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}}]
}
2015-11-26 20:22:51,279 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
4-8612571337392652850: Executing: { Cmd , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 100011,
[{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
router.name
":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.88","vmName":"Test002","executeInSequence":false,"accessDetails":{"zone.network.type":"Advanced","
router.name":"r-4-VM","router.ip":"169.254.0.43","router.guest.ip":"10.1.1.1"},"wait":0}}]
}
2015-11-26 20:22:51,279 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-71:ctx-0080bc2a) Seq 4-8612571337392652850: Executing request
2015-11-26 20:22:51,279 DEBUG [c.c.a.r.v.VirtualRoutingResource]
(DirectAgent-71:ctx-0080bc2a) Transforming
com.cloud.agent.api.routing.SavePasswordCommand to ConfigItems
2015-11-26 20:22:51,282 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-71:ctx-0080bc2a) Copying VR with ip 169.254.0.43 config file
into host 10.0.0.171
2015-11-26 20:22:51,662 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-71:ctx-0080bc2a) VR Config file vm_password.json got created
in VR, ip 169.254.0.43 with content
{"ip_address":"10.1.1.88","password":"saved_password","type":"vmpassword"}
2015-11-26 20:22:51,662 DEBUG [c.c.a.r.v.VirtualRoutingResource]
(DirectAgent-71:ctx-0080bc2a) Processing FileConfigItem, copying 74
characters to vm_password.json took 383ms
2015-11-26 20:22:51,662 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-71:ctx-0080bc2a) Executing command in VR:
/opt/cloud/bin/router_proxy.sh update_config.py 169.254.0.43
vm_password.json
2015-11-26 20:22:51,966 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-8:null) SeqA 5-1789: Processing Seq 5-1789: { Cmd ,
MgmtId: -1, via: 5, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
\"connections\": []\n}","wait":0}}] }
2015-11-26 20:22:51,969 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-8:null) SeqA 5-1789: Sending Seq 5-1789: { Ans: ,
MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
[{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2015-11-26 20:22:52,954 DEBUG [c.c.a.ApiServlet]
(catalina-exec-24:ctx-bcef2c6d) ===START=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549638271
2015-11-26 20:22:52,968 DEBUG [c.c.a.ApiServlet]
(catalina-exec-24:ctx-bcef2c6d ctx-2fd0c6b9) ===END=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549638271
2015-11-26 20:22:54,399 DEBUG [c.c.a.r.v.VirtualRoutingResource]
(DirectAgent-71:ctx-0080bc2a) Processing ScriptConfigItem, executing
update_config.py vm_password.json took 2737ms
2015-11-26 20:22:54,399 WARN [c.c.a.r.v.VirtualRoutingResource]
(DirectAgent-71:ctx-0080bc2a) Expected 1 answers while executing
SavePasswordCommand but received 2
2015-11-26 20:22:54,401 DEBUG [c.c.a.r.v.VirtualRoutingResource]
(DirectAgent-71:ctx-0080bc2a) Transforming
com.cloud.agent.api.routing.VmDataCommand to ConfigItems
2015-11-26 20:22:54,404 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-71:ctx-0080bc2a) Copying VR with ip 169.254.0.43 config file
into host 10.0.0.171
2015-11-26 20:22:54,786 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-71:ctx-0080bc2a) VR Config file vm_metadata.json got created
in VR, ip 169.254.0.43 with content
{"vm_ip_address":"10.1.1.88","vm_metadata":[["userdata","user-data",null],["metadata","service-offering","Medium
Instance"],["metadata","availability-zone","TestZone"],["metadata","local-ipv4","10.1.1.88"],["metadata","local-hostname","Test002"],["metadata","public-ipv4","10.0.0.174"],["metadata","public-hostname","10.0.0.174"],["metadata","instance-id","4ce4731f-22a7-42ac-8e78-093d5f2e9a34"],["metadata","vm-id","4ce4731f-22a7-42ac-8e78-093d5f2e9a34"],["metadata","public-keys",null],["metadata","cloud-identifier","CloudStack-{de65e551-2e87-423b-90e6-03cd3eb706bb}"]],"type":"vmdata"}
2015-11-26 20:22:54,786 DEBUG [c.c.a.r.v.VirtualRoutingResource]
(DirectAgent-71:ctx-0080bc2a) Processing FileConfigItem, copying 589
characters to vm_metadata.json took 385ms
2015-11-26 20:22:54,786 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-71:ctx-0080bc2a) Executing command in VR:
/opt/cloud/bin/router_proxy.sh update_config.py 169.254.0.43
vm_metadata.json
2015-11-26 20:22:56,607 DEBUG [c.c.a.ApiServlet]
(catalina-exec-3:ctx-060754d7) ===START=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549641926
2015-11-26 20:22:56,624 DEBUG [c.c.a.ApiServlet]
(catalina-exec-3:ctx-060754d7 ctx-a1cce698) ===END=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549641926
2015-11-26 20:22:57,514 DEBUG [c.c.a.r.v.VirtualRoutingResource]
(DirectAgent-71:ctx-0080bc2a) Processing ScriptConfigItem, executing
update_config.py vm_metadata.json took 2728ms
2015-11-26 20:22:57,514 WARN [c.c.a.r.v.VirtualRoutingResource]
(DirectAgent-71:ctx-0080bc2a) Expected 1 answers while executing
VmDataCommand but received 2
2015-11-26 20:22:57,515 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-71:ctx-0080bc2a) Seq 4-8612571337392652850: Response Received:
2015-11-26 20:22:57,523 DEBUG [c.c.a.t.Request]
(DirectAgent-71:ctx-0080bc2a) Seq 4-8612571337392652850: Processing: {
Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
[{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null - success:
","null - success: RTNETLINK answers: File exists\nRTNETLINK answers: File
exists\nRTNETLINK answers: File exists\n[INFO] update_config.py ::
Processing incoming file => vm_password.json\n[INFO] Processing JSON file
vm_password.json\n"],"result":true,"wait":0}},{"com.cloud.agent.api.routing.GroupAnswer":{"results":["null
- success: ","null - success: RTNETLINK answers: File exists\nRTNETLINK
answers: File exists\nRTNETLINK answers: File exists\n[INFO]
update_config.py :: Processing incoming file => vm_metadata.json\n[INFO]
Processing JSON file vm_metadata.json\n"],"result":true,"wait":0}}] }
2015-11-26 20:22:57,523 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
4-8612571337392652850: Received: { Ans: , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 10, { GroupAnswer, GroupAnswer } }
2015-11-26 20:22:57,524 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Service
SecurityGroup is not supported in the network id=212
2015-11-26 20:22:57,525 DEBUG [o.a.c.e.o.VolumeOrchestrator]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Checking if
we need to prepare 2 volumes for VM[User|i-2-5-VM]
2015-11-26 20:22:57,529 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) template 5 is
already in store:1, type:Image
2015-11-26 20:22:57,530 DEBUG [o.a.c.s.d.PrimaryDataStoreImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Not found
(templateId:5poolId:8) in template_spool_ref, persisting it
2015-11-26 20:22:57,533 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) template 5 is
already in store:8, type:Primary
2015-11-26 20:22:57,533 DEBUG [o.a.c.s.v.VolumeServiceImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Found
template centos56-x86_64-xen in storage pool 8 with VMTemplateStoragePool
id: 4
2015-11-26 20:22:57,534 DEBUG [o.a.c.s.v.VolumeServiceImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Acquire lock
on VMTemplateStoragePool 4 with timeout 3600 seconds
2015-11-26 20:22:57,535 INFO [o.a.c.s.v.VolumeServiceImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) lock is
acquired for VMTemplateStoragePool 4
2015-11-26 20:22:57,537 DEBUG [o.a.c.s.m.AncientDataMotionStrategy]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) copyAsync
inspecting src type TEMPLATE copyAsync inspecting dest type TEMPLATE
2015-11-26 20:22:57,541 DEBUG [c.c.h.XenServerGuru]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
getCommandHostDelegation: class
org.apache.cloudstack.storage.command.CopyCommand
2015-11-26 20:22:57,542 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
4-8612571337392652851: Sending { Cmd , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 100111,
[{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/5/3986df71-b1d0-3e20-a655-7e42dd144370.vhd","origUrl":"
http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
5.6(64-bit) no GUI
(XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://
10.0.0.170/export/secondary
","_role":"Image"}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"
http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
5.6(64-bit) no GUI
(XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc"}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"executeInSequence":true,"options":{},"options2":{},"wait":10800}}]
}
2015-11-26 20:22:57,542 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
4-8612571337392652851: Executing: { Cmd , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 100111,
[{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"template/tmpl/1/5/3986df71-b1d0-3e20-a655-7e42dd144370.vhd","origUrl":"
http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
5.6(64-bit) no GUI
(XenServer)","imageDataStore":{"com.cloud.agent.api.to.NfsTO":{"_url":"nfs://
10.0.0.170/export/secondary
","_role":"Image"}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"origUrl":"
http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2","uuid":"900a5634-9414-11e5-ae19-000c29255f5e","id":5,"format":"VHD","accountId":1,"checksum":"905cec879afd9c9d22ecc8036131a180","hvm":false,"displayText":"CentOS
5.6(64-bit) no GUI
(XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"8b257efa-aa88-3d32-952d-2f21940ce8fc","id":8,"poolType":"NetworkFilesystem","host":"10.0.0.170","path":"/export/primary","port":2049,"url":"NetworkFilesystem://
10.0.0.170/export/primary/?ROLE=Primary&STOREUUID=8b257efa-aa88-3d32-952d-2f21940ce8fc"}},"name":"centos56-x86_64-xen","hypervisorType":"XenServer"}},"executeInSequence":true,"options":{},"options2":{},"wait":10800}}]
}
2015-11-26 20:22:57,542 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-281:ctx-03a8f398) Seq 4-8612571337392652851: Executing request
2015-11-26 20:22:58,021 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-92cf866f) Begin cleanup expired async-jobs
2015-11-26 20:22:58,023 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-92cf866f) End cleanup expired async-jobs
2015-11-26 20:22:58,833 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-281:ctx-03a8f398) Host 10.0.0.171
OpaqueRef:b0284c5b-613d-0522-5c44-797be269d661: Removing SR
2015-11-26 20:22:58,843 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-281:ctx-03a8f398) Host 10.0.0.171
OpaqueRef:bfb2ccc2-135c-4f9a-bc84-143021c71bae: Unplugging pbd
2015-11-26 20:22:58,950 DEBUG [c.c.h.x.r.CitrixResourceBase]
(DirectAgent-281:ctx-03a8f398) Host 10.0.0.171
OpaqueRef:b0284c5b-613d-0522-5c44-797be269d661: Forgetting
2015-11-26 20:22:58,953 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-281:ctx-03a8f398) Seq 4-8612571337392652851: Response
Received:
2015-11-26 20:22:58,953 DEBUG [c.c.a.t.Request]
(DirectAgent-281:ctx-03a8f398) Seq 4-8612571337392652851: Processing: {
Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 110,
[{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"Expected
1 VDI template but found 2 VDI template(s) on:
10.0.0.170:/export/secondary/template/tmpl/1/5","wait":0}}]
}
2015-11-26 20:22:58,953 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
4-8612571337392652851: Received: { Ans: , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 110, { CopyCmdAnswer } }
2015-11-26 20:22:58,955 DEBUG [c.c.a.m.AgentAttache]
(DirectAgent-281:ctx-03a8f398) Seq 4-8612571337392652851: No more commands
found
2015-11-26 20:22:58,959 INFO [o.a.c.s.v.VolumeServiceImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) releasing
lock for VMTemplateStoragePool 4
2015-11-26 20:22:58,959 DEBUG [o.a.c.e.o.VolumeOrchestrator]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Unable to
create Vol[6|vm=5|ROOT]:Expected 1 VDI template but found 2 VDI template(s)
on: 10.0.0.170:/export/secondary/template/tmpl/1/5
2015-11-26 20:22:58,959 INFO [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Unable to
contact resource.
com.cloud.exception.StorageUnavailableException: Resource [StoragePool:8]
is unreachable: Unable to create Vol[6|vm=5|ROOT]:Expected 1 VDI template
but found 2 VDI template(s) on: 10.0.0.170:
/export/secondary/template/tmpl/1/5
at
org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.recreateVolume(VolumeOrchestrator.java:1278)
at
org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.prepare(VolumeOrchestrator.java:1336)
at
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:1000)
at
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4580)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
at
com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4736)
at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2015-11-26 20:22:58,962 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Cleaning up
resources for the vm VM[User|i-2-5-VM] in Starting state
2015-11-26 20:22:58,964 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
4-8612571337392652852: Sending { Cmd , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 100011,
[{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"checkBeforeCleanup":false,"vmName":"i-2-5-VM","wait":0}}]
}
2015-11-26 20:22:58,964 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
4-8612571337392652852: Executing: { Cmd , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 100011,
[{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"checkBeforeCleanup":false,"vmName":"i-2-5-VM","wait":0}}]
}
2015-11-26 20:22:58,964 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-141:ctx-62326db5) Seq 4-8612571337392652852: Executing request
2015-11-26 20:22:58,971 DEBUG [c.c.a.m.DirectAgentAttache]
(DirectAgent-141:ctx-62326db5) Seq 4-8612571337392652852: Response
Received:
2015-11-26 20:22:58,971 DEBUG [c.c.a.t.Request]
(DirectAgent-141:ctx-62326db5) Seq 4-8612571337392652852: Processing: {
Ans: , MgmtId: 52229922654, via: 4(xenserver), Ver: v1, Flags: 10,
[{"com.cloud.agent.api.StopAnswer":{"result":true,"details":"VM does not
exist","wait":0}}] }
2015-11-26 20:22:58,971 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Seq
4-8612571337392652852: Received: { Ans: , MgmtId: 52229922654, via:
4(xenserver), Ver: v1, Flags: 10, { StopAnswer } }
2015-11-26 20:22:58,976 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Service
SecurityGroup is not supported in the network id=212
2015-11-26 20:22:58,977 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Changing
active number of nics for network id=212 on -1
2015-11-26 20:22:58,982 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Asking
VirtualRouter to release
NicProfile[11-5-718d2456-bf61-48ad-9663-22ccfd4556f1-10.1.1.88-null
2015-11-26 20:22:58,982 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Successfully
released network resources for the vm VM[User|i-2-5-VM]
2015-11-26 20:22:58,982 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Successfully
cleanued up resources for the vm VM[User|i-2-5-VM] in Starting state
2015-11-26 20:22:58,986 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Deploy avoids
pods: [], clusters: [], hosts: [4]
2015-11-26 20:22:58,987 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437)
DeploymentPlanner allocation algorithm:
com.cloud.deploy.FirstFitPlanner@1136745
2015-11-26 20:22:58,987 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Trying to
allocate a host and storage pools from dc:3, pod:3,cluster:null, requested
cpu: 1000, requested ram: 1073741824
2015-11-26 20:22:58,987 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Is ROOT
volume READY (pool already allocated)?: No
2015-11-26 20:22:58,987 DEBUG [c.c.d.FirstFitPlanner]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Searching
resources only under specified Pod: 3
2015-11-26 20:22:58,987 DEBUG [c.c.d.FirstFitPlanner]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Listing
clusters in order of aggregate capacity, that have (atleast one host with)
enough CPU and RAM capacity under this Pod: 3
2015-11-26 20:22:58,988 DEBUG [c.c.d.FirstFitPlanner]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) No clusters
found having a host with enough capacity, returning.
2015-11-26 20:22:58,995 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) VM state
transitted from :Starting to Stopped with event: OperationFailedvm's
original host id: null new host id: null host id before state transition: 4
2015-11-26 20:22:58,998 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Hosts's
actual total CPU: 3399 and CPU after applying overprovisioning: 3399
2015-11-26 20:22:58,998 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Hosts's
actual total RAM: 15354505344 and RAM after applying overprovisioning:
15354505216
2015-11-26 20:22:58,998 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) release cpu
from host: 4, old used: 2500,reserved: 0, actual total: 3399, total with
overprovisioning: 3399; new used: 1500,reserved:0; movedfromreserved:
false,moveToReserveredfalse
2015-11-26 20:22:58,998 DEBUG [c.c.c.CapacityManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) release mem
from host: 4, old used: 2952790016,reserved: 0, total: 15354505216; new
used: 1879048192,reserved:0; movedfromreserved: false,moveToReserveredfalse
2015-11-26 20:22:59,004 ERROR [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Invocation
exception, caused by:
com.cloud.exception.InsufficientServerCapacityException: Unable to create a
deployment for VM[User|i-2-5-VM]Scope=interface com.cloud.dc.DataCenter;
id=3
2015-11-26 20:22:59,004 INFO [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71 ctx-8c176437) Rethrow
exception com.cloud.exception.InsufficientServerCapacityException: Unable
to create a deployment for VM[User|i-2-5-VM]Scope=interface
com.cloud.dc.DataCenter; id=3
2015-11-26 20:22:59,004 DEBUG [c.c.v.VmWorkJobDispatcher]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Done with run of VM work
job: com.cloud.vm.VmWorkStart for VM 5, job origin: 68
2015-11-26 20:22:59,004 ERROR [c.c.v.VmWorkJobDispatcher]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Unable to complete
AsyncJobVO {id:71, userId: 2, accountId: 2, instanceType: null, instanceId:
null, cmd: com.cloud.vm.VmWorkStart, cmdInfo:
rO0ABXNyABhjb20uY2xvdWQudm0uVm1Xb3JrU3RhcnR9cMGsvxz73gIAC0oABGRjSWRMAAZhdm9pZHN0ADBMY29tL2Nsb3VkL2RlcGxveS9EZXBsb3ltZW50UGxhbm5lciRFeGNsdWRlTGlzdDtMAAljbHVzdGVySWR0ABBMamF2YS9sYW5nL0xvbmc7TAAGaG9zdElkcQB-AAJMAAtqb3VybmFsTmFtZXQAEkxqYXZhL2xhbmcvU3RyaW5nO0wAEXBoeXNpY2FsTmV0d29ya0lkcQB-AAJMAAdwbGFubmVycQB-AANMAAVwb2RJZHEAfgACTAAGcG9vbElkcQB-AAJMAAlyYXdQYXJhbXN0AA9MamF2YS91dGlsL01hcDtMAA1yZXNlcnZhdGlvbklkcQB-AAN4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1lcQB-AAN4cAAAAAAAAAACAAAAAAAAAAIAAAAAAAAABXQAGVZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGwAAAAAAAAAAHBwcHBwcHBwc3IAEWphdmEudXRpbC5IYXNoTWFwBQfawcMWYNEDAAJGAApsb2FkRmFjdG9ySQAJdGhyZXNob2xkeHA_QAAAAAAADHcIAAAAEAAAAAF0AApWbVBhc3N3b3JkdAAcck8wQUJYUUFEbk5oZG1Wa1gzQmhjM04zYjNKa3hw,
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0,
result: null, initMsid: 52229922654, completeMsid: null, lastUpdated: null,
lastPolled: null, created: Thu Nov 26 20:22:46 IST 2015}, job origin:68
com.cloud.exception.InsufficientServerCapacityException: Unable to create a
deployment for VM[User|i-2-5-VM]Scope=interface com.cloud.dc.DataCenter;
id=3
at
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:959)
at
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4580)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107)
at
com.cloud.vm.VirtualMachineManagerImpl.handleVmWorkJob(VirtualMachineManagerImpl.java:4736)
at com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:102)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2015-11-26 20:22:59,013 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Complete async job-71,
jobStatus: FAILED, resultCode: 0, result:
rO0ABXNyADdjb20uY2xvdWQuZXhjZXB0aW9uLkluc3VmZmljaWVudFNlcnZlckNhcGFjaXR5RXhjZXB0aW9uAAAAAFZNT3ACAAFaABVhZmZpbml0eUdyb3Vwc0FwcGxpZWR4cgAxY29tLmNsb3VkLmV4Y2VwdGlvbi5JbnN1ZmZpY2llbnRDYXBhY2l0eUV4Y2VwdGlvbgAAAABWTU91AgACTAACaWR0ABBMamF2YS9sYW5nL0xvbmc7TAAFc2NvcGV0ABFMamF2YS9sYW5nL0NsYXNzO3hyACJjb20uY2xvdWQuZXhjZXB0aW9uLkNsb3VkRXhjZXB0aW9ueeiOG_HkRMcCAAJMAAtjc0Vycm9yQ29kZXQAE0xqYXZhL2xhbmcvSW50ZWdlcjtMAAZpZExpc3R0ABVMamF2YS91dGlsL0FycmF5TGlzdDt4cgATamF2YS5sYW5nLkV4Y2VwdGlvbtD9Hz4aOxzEAgAAeHIAE2phdmEubGFuZy5UaHJvd2FibGXVxjUnOXe4ywMABEwABWNhdXNldAAVTGphdmEvbGFuZy9UaHJvd2FibGU7TAANZGV0YWlsTWVzc2FnZXQAEkxqYXZhL2xhbmcvU3RyaW5nO1sACnN0YWNrVHJhY2V0AB5bTGphdmEvbGFuZy9TdGFja1RyYWNlRWxlbWVudDtMABRzdXBwcmVzc2VkRXhjZXB0aW9uc3QAEExqYXZhL3V0aWwvTGlzdDt4cHEAfgANdAAzVW5hYmxlIHRvIGNyZWF0ZSBhIGRlcGxveW1lbnQgZm9yIFZNW1VzZXJ8aS0yLTUtVk1ddXIAHltMamF2YS5sYW5nLlN0YWNrVHJhY2VFbGVtZW50OwJGKjw8_SI5AgAAeHAAAAAVc3IAG2phdmEubGFuZy5TdGFja1RyYWNlRWxlbWVudGEJxZomNt2FAgAESQAKbGluZU51bWJlckwADmRlY2xhcmluZ0NsYXNzcQB-AApMAAhmaWxlTmFtZXEAfgAKTAAKbWV0aG9kTmFtZXEAfgAKeHAAAAO_dAAmY29tLmNsb3VkLnZtLlZpcnR1YWxNYWNoaW5lTWFuYWdlckltcGx0AB5WaXJ0dWFsTWFjaGluZU1hbmFnZXJJbXBsLmphdmF0ABBvcmNoZXN0cmF0ZVN0YXJ0c3EAfgARAAAR5HEAfgATcQB-ABRxAH4AFXNxAH4AEf____50ACRzdW4ucmVmbGVjdC5OYXRpdmVNZXRob2RBY2Nlc3NvckltcGx0AB1OYXRpdmVNZXRob2RBY2Nlc3NvckltcGwuamF2YXQAB2ludm9rZTBzcQB-ABEAAAA5cQB-ABhxAH4AGXQABmludm9rZXNxAH4AEQAAACt0AChzdW4ucmVmbGVjdC5EZWxlZ2F0aW5nTWV0aG9kQWNjZXNzb3JJbXBsdAAhRGVsZWdhdGluZ01ldGhvZEFjY2Vzc29ySW1wbC5qYXZhcQB-ABxzcQB-ABEAAAJedAAYamF2YS5sYW5nLnJlZmxlY3QuTWV0aG9kdAALTWV0aG9kLmphdmFxAH4AHHNxAH4AEQAAAGt0ACJjb20uY2xvdWQudm0uVm1Xb3JrSm9iSGFuZGxlclByb3h5dAAaVm1Xb3JrSm9iSGFuZGxlclByb3h5LmphdmF0AA9oYW5kbGVWbVdvcmtKb2JzcQB-ABEAABKAcQB-ABNxAH4AFHEAfgAmc3EAfgARAAAAZnQAIGNvbS5jbG91ZC52bS5WbVdvcmtKb2JEaXNwYXRjaGVydAAYVm1Xb3JrSm9iRGlzcGF0Y2hlci5qYXZhdAAGcnVuSm9ic3EAfgARAAACGXQAP29yZy5hcGFjaGUuY2xvdWRzdGFjay5mcmFtZXdvcmsuam9icy5pbXBsLkFzeW5jSm9iTWFuYWdlckltcGwkNXQAGEFzeW5jSm9iTWFuYWdlckltcGwuamF2YXQADHJ1bkluQ29udGV4dHNxAH4AEQAAADF0AD5vcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGUkMXQAG01hbmFnZWRDb250ZXh0UnVubmFibGUuamF2YXQAA3J1bnNxAH4AEQAAADh0AEJvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0LmltcGwuRGVmYXVsdE1hbmFnZWRDb250ZXh0JDF0ABpEZWZhdWx0TWFuYWdlZENvbnRleHQuamF2YXQABGNhbGxzcQB-ABEAAABndABAb3JnLmFwYWNoZS5jbG91ZHN0YWNrLm1hbmFnZWQuY29udGV4dC5pbXBsLkRlZmF1bHRNYW5hZ2VkQ29udGV4dHEAfgA2dAAPY2FsbFdpdGhDb250ZXh0c3EAfgARAAAANXEAfgA5cQB-ADZ0AA5ydW5XaXRoQ29udGV4dHNxAH4AEQAAAC50ADxvcmcuYXBhY2hlLmNsb3Vkc3RhY2subWFuYWdlZC5jb250ZXh0Lk1hbmFnZWRDb250ZXh0UnVubmFibGVxAH4AMnEAfgAzc3EAfgARAAAB7nEAfgAtcQB-AC5xAH4AM3NxAH4AEQAAAdd0AC5qYXZhLnV0aWwuY29uY3VycmVudC5FeGVjdXRvcnMkUnVubmFibGVBZGFwdGVydAAORXhlY3V0b3JzLmphdmFxAH4AN3NxAH4AEQAAAQZ0AB9qYXZhLnV0aWwuY29uY3VycmVudC5GdXR1cmVUYXNrdAAPRnV0dXJlVGFzay5qYXZhcQB-ADNzcQB-ABEAAAR5dAAnamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9ydAAXVGhyZWFkUG9vbEV4ZWN1dG9yLmphdmF0AAlydW5Xb3JrZXJzcQB-ABEAAAJndAAuamF2YS51dGlsLmNvbmN1cnJlbnQuVGhyZWFkUG9vbEV4ZWN1dG9yJFdvcmtlcnEAfgBIcQB-ADNzcQB-ABEAAALpdAAQamF2YS5sYW5nLlRocmVhZHQAC1RocmVhZC5qYXZhcQB-ADNzcgAmamF2YS51dGlsLkNvbGxlY3Rpb25zJFVubW9kaWZpYWJsZUxpc3T8DyUxteyOEAIAAUwABGxpc3RxAH4ADHhyACxqYXZhLnV0aWwuQ29sbGVjdGlvbnMkVW5tb2RpZmlhYmxlQ29sbGVjdGlvbhlCAIDLXvceAgABTAABY3QAFkxqYXZhL3V0aWwvQ29sbGVjdGlvbjt4cHNyABNqYXZhLnV0aWwuQXJyYXlMaXN0eIHSHZnHYZ0DAAFJAARzaXpleHAAAAAAdwQAAAAAeHEAfgBUeHNyABFqYXZhLmxhbmcuSW50ZWdlchLioKT3gYc4AgABSQAFdmFsdWV4cgAQamF2YS5sYW5nLk51bWJlcoaslR0LlOCLAgAAeHAAABDvc3EAfgBTAAAAAHcEAAAAAHhzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHEAfgBWAAAAAAAAAAN2cgAXY29tLmNsb3VkLmRjLkRhdGFDZW50ZXKy8Qrrp-d4vgIAAHhwAA
2015-11-26 20:22:59,015 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Publish async job-71
complete on message bus
2015-11-26 20:22:59,015 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Wake up jobs related to
job-71
2015-11-26 20:22:59,016 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Update db status for job-71
2015-11-26 20:22:59,016 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Wake up jobs joined with
job-71 and disjoin all subjobs created from job- 71
2015-11-26 20:22:59,022 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Done executing
com.cloud.vm.VmWorkStart for job-71
2015-11-26 20:22:59,022 INFO [o.a.c.f.j.i.AsyncJobMonitor]
(Work-Job-Executor-8:ctx-4000bfda job-68/job-71) Remove job-71 from job
monitoring
2015-11-26 20:22:59,032 DEBUG [c.c.v.UserVmManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Destroying vm
VM[User|i-2-5-VM] as it failed to create on Host with Id:null
2015-11-26 20:22:59,040 DEBUG [c.c.c.CapacityManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) VM state transitted
from :Stopped to Error with event: OperationFailedToErrorvm's original host
id: null new host id: null host id before state transition: null
2015-11-26 20:22:59,051 DEBUG [c.c.u.AccountManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Access granted to
Acct[20064ffe-9415-11e5-a790-000c29255f5e-admin] to Domain:1/ by
AffinityGroupAccessChecker
2015-11-26 20:22:59,076 DEBUG [c.c.u.AccountManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) Access granted to
Acct[20064ffe-9415-11e5-a790-000c29255f5e-admin] to Domain:1/ by
AffinityGroupAccessChecker
2015-11-26 20:22:59,080 WARN [o.a.c.alerts]
(API-Job-Executor-3:ctx-a2ed53c6 job-68 ctx-dca59d4e) alertType:: 8 //
dataCenterId:: 3 // podId:: 3 // clusterId:: null // message:: Failed to
deploy Vm with Id: 5, on Host with Id: null
2015-11-26 20:22:59,095 ERROR [c.c.a.ApiAsyncJobDispatcher]
(API-Job-Executor-3:ctx-a2ed53c6 job-68) Unexpected exception while
executing org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin
com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due
to insufficient capacity
at
com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:622)
at
org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:242)
at
org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:212)
at
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3870)
at
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3488)
at
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3476)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at
org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:106)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at
com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at com.sun.proxy.$Proxy202.startVirtualMachine(Unknown Source)
at
org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin.execute(DeployVMCmdByAdmin.java:50)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
at
com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: com.cloud.exception.InsufficientServerCapacityException: Unable
to create a deployment for VM[User|i-2-5-VM]Scope=interface
com.cloud.dc.DataCenter; id=3
at
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:959)
at
com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:4580)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
... 18 more
2015-11-26 20:22:59,097 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68) Complete async job-68, jobStatus:
FAILED, resultCode: 530, result:
org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable
to start a VM due to insufficient capacity"}
2015-11-26 20:22:59,097 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68) Publish async job-68 complete on
message bus
2015-11-26 20:22:59,097 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68) Wake up jobs related to job-68
2015-11-26 20:22:59,097 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68) Update db status for job-68
2015-11-26 20:22:59,098 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68) Wake up jobs joined with job-68
and disjoin all subjobs created from job- 68
2015-11-26 20:22:59,100 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-3:ctx-a2ed53c6 job-68) Done executing
org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin for job-68
2015-11-26 20:22:59,100 INFO [o.a.c.f.j.i.AsyncJobMonitor]
(API-Job-Executor-3:ctx-a2ed53c6 job-68) Remove job-68 from job monitoring
2015-11-26 20:22:59,608 DEBUG [c.c.a.ApiServlet]
(catalina-exec-8:ctx-dd95e514) ===START=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549644927
2015-11-26 20:22:59,619 DEBUG [c.c.a.ApiServlet]
(catalina-exec-8:ctx-dd95e514 ctx-3583ca96) ===END=== 10.0.0.93 -- GET
command=queryAsyncJobResult&jobId=17fdd52a-9e44-45fd-8375-feff6faeb130&response=json&_=1448549644927
2015-11-26 20:22:59,623 DEBUG [c.c.a.ApiServlet]
(catalina-exec-9:ctx-c94acc67) ===START=== 10.0.0.93 -- GET
command=listVirtualMachines&id=4ce4731f-22a7-42ac-8e78-093d5f2e9a34&response=json&_=1448549644944
2015-11-26 20:22:59,639 DEBUG [c.c.a.ApiServlet]
(catalina-exec-9:ctx-c94acc67 ctx-b3ea1be2) ===END=== 10.0.0.93 -- GET
command=listVirtualMachines&id=4ce4731f-22a7-42ac-8e78-093d5f2e9a34&response=json&_=1448549644944
2015-11-26 20:23:01,968 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-10:null) SeqA 5-1790: Processing Seq 5-1790: { Cmd ,
MgmtId: -1, via: 5, Ver: v1, Flags: 11,
[{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":1,"_loadInfo":"{\n
\"connections\": []\n}","wait":0}}] }
2015-11-26 20:23:01,972 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-10:null) SeqA 5-1790: Sending Seq 5-1790: { Ans: ,
MgmtId: 52229922654, via: 5, Ver: v1, Flags: 100010,
[{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2015-11-26 20:23:04,354 DEBUG [o.a.c.s.SecondaryStorageManagerImpl]
(secstorage-1:ctx-e4c5abdc) Zone 3 is ready to launch secondary storage VM
2015-11-26 20:23:04,680 DEBUG [c.c.c.ConsoleProxyManagerImpl]
(consoleproxy-1:ctx-f87cf64e) Zone 3 is ready to launch console proxy
2015-11-26 20:23:08,020 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-39ec59bb) Begin cleanup expired async-jobs
2015-11-26 20:23:08,023 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-39ec59bb) End cleanup expired async-jobs
Regards,
Venkatesh.k
On Thu, Nov 26, 2015 at 9:04 PM, kotipalli venkatesh <
venkateshcloudtest@gmail.com> wrote:
> Hi Erik,
>
> We found the error log, Please look in to this below error log,
>
> 2015-11-26 20:22:46,603 DEBUG [c.c.a.m.AgentAttache]
> (DirectAgent-279:ctx-532427fb) Seq 4-8612571337392652847: No more commands
> found
> 2015-11-26 20:22:46,607 INFO [o.a.c.s.v.VolumeServiceImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) releasing
> lock for VMTemplateStoragePool 3
> 2015-11-26 20:22:46,608 DEBUG [o.a.c.e.o.VolumeOrchestrator]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Unable to
> create Vol[6|vm=5|ROOT]:Expected 1 VDI template but found 2 VDI template(s)
> on: 10.0.0.170:/export/secondary/template/tmpl/1/5
> 2015-11-26 20:22:46,608 INFO [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Unable to
> contact resource.
> com.cloud.exception.StorageUnavailableException: Resource [StoragePool:8]
> is unreachable: Unable to create Vol[6|vm=5|ROOT]:Expected 1 VDI template
> but found 2 VDI template(s) on: 10.0.0.170:
> /export/secondary/template/tmpl/1/5
>
>
> /export/secondary/template/tmpl/1/5 Inside the 2 .vhd files and one
> template properties file is there please look in to the below files;
>
> 3986df71-b1d0-3e20-a655-7e42dd144370.vhd
> 429d6340-6a5f-31ce-a581-cc05618500ab.vhd template.properties
>
> Which one is remove?
>
> Could you please suggest.
>
> Regards,
> Venkatesh.k
>
> On Thu, Nov 26, 2015 at 6:11 PM, Erik Weber <te...@gmail.com> wrote:
>
>> You need to paste more of your logs, in particular the (a lot of) lines
>> before the exception where all the resource allocations happen.
>>
>> --
>> Erik
>>
>> On Thu, Nov 26, 2015 at 1:38 PM, kotipalli venkatesh <
>> venkateshcloudtest@gmail.com> wrote:
>>
>> > Hi All,
>> >
>> > I have successfully installed Cloudstack 4.6.0 setup
>> > hypervisor is xenserver 6.5
>> >
>> > Successfully up and running SSVM and CPVM and Default templates
>> downloaded.
>> >
>> > When i am spin the new instance it 's troughs *insufficient memory
>> error*.
>> > But i have *sufficient place* *RAM* and *STORAGE* also.
>> >
>> > Please look in to this Management server log:
>> >
>> > 2015-11-26 17:49:10,572 WARN [o.a.c.alerts]
>> > (API-Job-Executor-1:ctx-801f0a96 job-56 ctx-63dfadf9) alertType:: 8 //
>> > dataCenterId:: 3 // podId:: 3 // clusterId:: null // message:: Failed to
>> > deploy Vm with Id: 3, on Host with Id: null
>> > 2015-11-26 17:49:10,601 ERROR [c.c.a.ApiAsyncJobDispatcher]
>> > (API-Job-Executor-1:ctx-801f0a96 job-56) Unexpected exception while
>> > executing org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin
>> > com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM
>> due
>> > to insufficient capacity
>> > at
>> >
>> >
>> com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:622)
>> > at
>> >
>> >
>> org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:242)
>> > at
>> >
>> >
>> org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:212)
>> > at
>> >
>> >
>> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3870)
>> > at
>> >
>> >
>> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3488)
>> > at
>> >
>> >
>> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3476)
>> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> > at
>> >
>> >
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>> > at
>> >
>> >
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> > at java.lang.reflect.Method.invoke(Method.java:606)
>> > at
>> >
>> >
>> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
>> > at
>> >
>> >
>> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
>> > at
>> >
>> >
>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
>> > at
>> >
>> >
>> org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:106)
>> > at
>> >
>> >
>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
>> > at
>> >
>> >
>> com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
>> > at
>> >
>> >
>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
>> > at
>> >
>> >
>> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
>> > at
>> >
>> >
>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
>> > at
>> >
>> >
>> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
>> > at com.sun.proxy.$Proxy202.startVirtualMachine(Unknown Source)
>> > at
>> >
>> >
>> org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin.execute(DeployVMCmdByAdmin.java:50)
>> > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
>> > at
>> >
>> com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
>> > at
>> >
>> >
>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
>> > at
>> >
>> >
>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
>> > at
>> >
>> >
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
>> > at
>> >
>> >
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
>> > at
>> >
>> >
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
>> > at
>> >
>> >
>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
>> > at
>> >
>> >
>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
>> > at
>> > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>> > at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>> > at
>> >
>> >
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>> > at
>> >
>> >
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>> > at java.lang.Thread.run(Thread.java:745)
>> > Caused by: com.cloud.exception.InsufficientServerCapacityException:
>> Unable
>> > to create a deployment for VM[User|i-2-3-VM]Scope=interface
>> > com.cloud.dc.DataCenter; id=3
>> > at
>> >
>> >
>> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:959)
>> >
>> > Please any suggestion....
>> >
>> > Warm Regards,
>> > Venkatesh.k
>> >
>>
>
>
Re: Insufficient Memory error
Posted by kotipalli venkatesh <ve...@gmail.com>.
Hi Erik,
We found the error log, Please look in to this below error log,
2015-11-26 20:22:46,603 DEBUG [c.c.a.m.AgentAttache]
(DirectAgent-279:ctx-532427fb) Seq 4-8612571337392652847: No more commands
found
2015-11-26 20:22:46,607 INFO [o.a.c.s.v.VolumeServiceImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) releasing
lock for VMTemplateStoragePool 3
2015-11-26 20:22:46,608 DEBUG [o.a.c.e.o.VolumeOrchestrator]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Unable to
create Vol[6|vm=5|ROOT]:Expected 1 VDI template but found 2 VDI template(s)
on: 10.0.0.170:/export/secondary/template/tmpl/1/5
2015-11-26 20:22:46,608 INFO [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-7:ctx-b83ccf52 job-68/job-69 ctx-95031535) Unable to
contact resource.
com.cloud.exception.StorageUnavailableException: Resource [StoragePool:8]
is unreachable: Unable to create Vol[6|vm=5|ROOT]:Expected 1 VDI template
but found 2 VDI template(s) on: 10.0.0.170:
/export/secondary/template/tmpl/1/5
/export/secondary/template/tmpl/1/5 Inside the 2 .vhd files and one
template properties file is there please look in to the below files;
3986df71-b1d0-3e20-a655-7e42dd144370.vhd
429d6340-6a5f-31ce-a581-cc05618500ab.vhd template.properties
Which one is remove?
Could you please suggest.
Regards,
Venkatesh.k
On Thu, Nov 26, 2015 at 6:11 PM, Erik Weber <te...@gmail.com> wrote:
> You need to paste more of your logs, in particular the (a lot of) lines
> before the exception where all the resource allocations happen.
>
> --
> Erik
>
> On Thu, Nov 26, 2015 at 1:38 PM, kotipalli venkatesh <
> venkateshcloudtest@gmail.com> wrote:
>
> > Hi All,
> >
> > I have successfully installed Cloudstack 4.6.0 setup
> > hypervisor is xenserver 6.5
> >
> > Successfully up and running SSVM and CPVM and Default templates
> downloaded.
> >
> > When i am spin the new instance it 's troughs *insufficient memory
> error*.
> > But i have *sufficient place* *RAM* and *STORAGE* also.
> >
> > Please look in to this Management server log:
> >
> > 2015-11-26 17:49:10,572 WARN [o.a.c.alerts]
> > (API-Job-Executor-1:ctx-801f0a96 job-56 ctx-63dfadf9) alertType:: 8 //
> > dataCenterId:: 3 // podId:: 3 // clusterId:: null // message:: Failed to
> > deploy Vm with Id: 3, on Host with Id: null
> > 2015-11-26 17:49:10,601 ERROR [c.c.a.ApiAsyncJobDispatcher]
> > (API-Job-Executor-1:ctx-801f0a96 job-56) Unexpected exception while
> > executing org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin
> > com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due
> > to insufficient capacity
> > at
> >
> >
> com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:622)
> > at
> >
> >
> org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:242)
> > at
> >
> >
> org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:212)
> > at
> >
> >
> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3870)
> > at
> >
> >
> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3488)
> > at
> >
> >
> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3476)
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at
> >
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> > at
> >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > at java.lang.reflect.Method.invoke(Method.java:606)
> > at
> >
> >
> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
> > at
> >
> >
> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
> > at
> >
> >
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
> > at
> >
> >
> org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:106)
> > at
> >
> >
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
> > at
> >
> >
> com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
> > at
> >
> >
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
> > at
> >
> >
> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
> > at
> >
> >
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
> > at
> >
> >
> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
> > at com.sun.proxy.$Proxy202.startVirtualMachine(Unknown Source)
> > at
> >
> >
> org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin.execute(DeployVMCmdByAdmin.java:50)
> > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
> > at
> >
> com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
> > at
> >
> >
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
> > at
> >
> >
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
> > at
> >
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
> > at
> >
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
> > at
> >
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
> > at
> >
> >
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
> > at
> >
> >
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
> > at
> > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> > at
> >
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > at
> >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > at java.lang.Thread.run(Thread.java:745)
> > Caused by: com.cloud.exception.InsufficientServerCapacityException:
> Unable
> > to create a deployment for VM[User|i-2-3-VM]Scope=interface
> > com.cloud.dc.DataCenter; id=3
> > at
> >
> >
> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:959)
> >
> > Please any suggestion....
> >
> > Warm Regards,
> > Venkatesh.k
> >
>
Re: Insufficient Memory error
Posted by Erik Weber <te...@gmail.com>.
You need to paste more of your logs, in particular the (a lot of) lines
before the exception where all the resource allocations happen.
--
Erik
On Thu, Nov 26, 2015 at 1:38 PM, kotipalli venkatesh <
venkateshcloudtest@gmail.com> wrote:
> Hi All,
>
> I have successfully installed Cloudstack 4.6.0 setup
> hypervisor is xenserver 6.5
>
> Successfully up and running SSVM and CPVM and Default templates downloaded.
>
> When i am spin the new instance it 's troughs *insufficient memory error*.
> But i have *sufficient place* *RAM* and *STORAGE* also.
>
> Please look in to this Management server log:
>
> 2015-11-26 17:49:10,572 WARN [o.a.c.alerts]
> (API-Job-Executor-1:ctx-801f0a96 job-56 ctx-63dfadf9) alertType:: 8 //
> dataCenterId:: 3 // podId:: 3 // clusterId:: null // message:: Failed to
> deploy Vm with Id: 3, on Host with Id: null
> 2015-11-26 17:49:10,601 ERROR [c.c.a.ApiAsyncJobDispatcher]
> (API-Job-Executor-1:ctx-801f0a96 job-56) Unexpected exception while
> executing org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin
> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due
> to insufficient capacity
> at
>
> com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:622)
> at
>
> org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:242)
> at
>
> org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:212)
> at
>
> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3870)
> at
>
> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3488)
> at
>
> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3476)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
>
> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
> at
>
> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
> at
>
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
> at
>
> org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:106)
> at
>
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
> at
>
> com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
> at
>
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
> at
>
> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
> at
>
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
> at
>
> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
> at com.sun.proxy.$Proxy202.startVirtualMachine(Unknown Source)
> at
>
> org.apache.cloudstack.api.command.admin.vm.DeployVMCmdByAdmin.execute(DeployVMCmdByAdmin.java:50)
> at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)
> at
> com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
> at
>
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:537)
> at
>
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
> at
>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
> at
>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
> at
>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
> at
>
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
> at
>
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:494)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at
>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: com.cloud.exception.InsufficientServerCapacityException: Unable
> to create a deployment for VM[User|i-2-3-VM]Scope=interface
> com.cloud.dc.DataCenter; id=3
> at
>
> com.cloud.vm.VirtualMachineManagerImpl.orchestrateStart(VirtualMachineManagerImpl.java:959)
>
> Please any suggestion....
>
> Warm Regards,
> Venkatesh.k
>