You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users-cn@cloudstack.apache.org by "wanghaicheng2004@gmail.com" <wa...@gmail.com> on 2013/11/16 10:28:35 UTC
回复: 无法创建实例
FirstFitRoutingAllocator) Not considering hosts: [Host[-1-Routing]] to deploy template: Tmpl[201-ISO-201-2-281cbc51-8e8c-350e-9c78-83cb5cab5ae4 as they are not HVM enabled
日志当中有这条报错，应该是host不支持虚拟话或者虚拟化没有开启
wanghaicheng2004@gmail.com
发件人： 高手
发送时间： 2013-11-16 17:03
收件人： users-cn
主题： 无法创建实例
环境：cloudstack4.2+CentOS6.2 host：xenserver6.2 8G内存（上面现在只跑了两台系统虚拟机）问题：无法创建实例，创建的时候，查看日志都是说找不到host来部署虚拟机。有没有高手知道错在哪里。
日志如下：
2013-11-16 00:54:31,186 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-4:null) Seq 1-1325989893: Response Received:
2013-11-16 00:54:31,187 DEBUG [agent.transport.Request] (DirectAgent-4:null) Seq 1-1325989893: Processing: { Ans: , MgmtId: 52235182734, via: 1, Ver: v1, Flags: 10, [{"com.cloud.agent.api.ClusterSyncAnswer":{"_clusterId":1,"_newStates":{},"_isExecuted":false,"result":true,"wait":0}}] }
2013-11-16 00:54:35,083 DEBUG [cloud.api.ApiServlet] (catalina-exec-13:null) ===START=== 192.168.16.111 -- GET command=deployVirtualMachine&zoneId=42530a8e-6dd4-4be3-9530-7448a165cd29&templateId=d3d6597a-9d6a-4f07-8ae2-e5930b248471&hypervisor=XenServer&serviceOfferingId=27c6028d-a43e-4fc2-b55b-ad9fa92074f5&diskOfferingId=f30cc1ae-0009-4c95-8d27-8fdf8b500aa7&displayname=liang&name=liang&response=json&sessionkey=hyZ3jyP7HScd6egutBy8MrCZpoI%3D&_=1384592075183
2013-11-16 00:54:35,102 DEBUG [cloud.api.ApiDispatcher] (catalina-exec-13:null) InfrastructureEntity name is:com.cloud.offering.ServiceOffering
2013-11-16 00:54:35,104 DEBUG [cloud.api.ApiDispatcher] (catalina-exec-13:null) ControlledEntity name is:com.cloud.template.VirtualMachineTemplate
2013-11-16 00:54:35,601 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-4:null) SeqA 3-137: Processing Seq 3-137: { Cmd , MgmtId: -1, via: 3, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2013-11-16 00:54:35,607 DEBUG [cloud.api.ApiDispatcher] (catalina-exec-13:null) InfrastructureEntity name is:com.cloud.offering.DiskOffering
2013-11-16 00:54:35,612 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-4:null) SeqA 3-137: Sending Seq 3-137: { Ans: , MgmtId: 52235182734, via: 3, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2013-11-16 00:54:35,661 DEBUG [cloud.vm.UserVmManagerImpl] (catalina-exec-13:null) Allocating in the DB for vm
2013-11-16 00:54:35,695 DEBUG [cloud.vm.VirtualMachineManagerImpl] (catalina-exec-13:null) Allocating entries for VM: VM[User|liang]
2013-11-16 00:54:35,700 DEBUG [cloud.vm.VirtualMachineManagerImpl] (catalina-exec-13:null) Allocating nics for VM[User|liang]
2013-11-16 00:54:35,701 DEBUG [cloud.network.NetworkManagerImpl] (catalina-exec-13:null) Allocating nic for vm VM[User|liang] in network Ntwk[204|Guest|6] with requested profile NicProfile[0-0-null-null-null
2013-11-16 00:54:35,713 DEBUG [cloud.vm.VirtualMachineManagerImpl] (catalina-exec-13:null) Allocating disks for VM[User|liang]
2013-11-16 00:54:35,732 DEBUG [cloud.vm.VirtualMachineManagerImpl] (catalina-exec-13:null) Allocation completed for VM: VM[User|liang]
2013-11-16 00:54:35,732 DEBUG [cloud.vm.UserVmManagerImpl] (catalina-exec-13:null) Successfully allocated DB entry for VM[User|liang]
2013-11-16 00:54:35,816 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-13:null) submit async job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ], details: AsyncJobVO {id:18, userId: 2, accountId: 2, sessionKey: null, instanceType: VirtualMachine, instanceId: 5, cmd: org.apache.cloudstack.api.command.user.vm.DeployVMCmd, cmdOriginator: null, cmdInfo: {"sessionkey":"hyZ3jyP7HScd6egutBy8MrCZpoI\u003d","cmdEventType":"VM.CREATE","ctxUserId":"2","serviceOfferingId":"27c6028d-a43e-4fc2-b55b-ad9fa92074f5","httpmethod":"GET","zoneId":"42530a8e-6dd4-4be3-9530-7448a165cd29","templateId":"d3d6597a-9d6a-4f07-8ae2-e5930b248471","response":"json","id":"5","hypervisor":"XenServer","name":"liang","diskOfferingId":"f30cc1ae-0009-4c95-8d27-8fdf8b500aa7","_":"1384592075183","ctxAccountId":"2","ctxStartEventId":"67","displayname":"liang"}, cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0, processStatus: 0, resultCode: 0, result: null, initMsid: 52235182734, completeMsid: null, lastUpdated: null, lastPolled: null, created: null}
2013-11-16 00:54:35,821 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Executing org.apache.cloudstack.api.command.user.vm.DeployVMCmd for job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]
2013-11-16 00:54:35,822 DEBUG [cloud.api.ApiServlet] (catalina-exec-13:null) ===END=== 192.168.16.111 -- GET command=deployVirtualMachine&zoneId=42530a8e-6dd4-4be3-9530-7448a165cd29&templateId=d3d6597a-9d6a-4f07-8ae2-e5930b248471&hypervisor=XenServer&serviceOfferingId=27c6028d-a43e-4fc2-b55b-ad9fa92074f5&diskOfferingId=f30cc1ae-0009-4c95-8d27-8fdf8b500aa7&displayname=liang&name=liang&response=json&sessionkey=hyZ3jyP7HScd6egutBy8MrCZpoI%3D&_=1384592075183
2013-11-16 00:54:35,828 DEBUG [cloud.api.ApiDispatcher] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) InfrastructureEntity name is:com.cloud.offering.ServiceOffering
2013-11-16 00:54:35,830 DEBUG [cloud.api.ApiDispatcher] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) ControlledEntity name is:com.cloud.template.VirtualMachineTemplate
2013-11-16 00:54:35,832 DEBUG [cloud.api.ApiDispatcher] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) InfrastructureEntity name is:com.cloud.offering.DiskOffering
2013-11-16 00:54:35,924 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Deploy avoids pods: [], clusters: [], hosts: []
2013-11-16 00:54:35,929 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner_EnhancerByCloudStack_8232bcd9@1553b17c
2013-11-16 00:54:35,929 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 536870912
2013-11-16 00:54:35,929 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Is ROOT volume READY (pool already allocated)?: No
2013-11-16 00:54:35,930 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Searching all possible resources under this Zone: 1
2013-11-16 00:54:35,931 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
2013-11-16 00:54:35,943 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Removing from the clusterId list these clusters from avoid set: []
2013-11-16 00:54:35,962 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Checking resources in Cluster: 1 under Pod: 1
2013-11-16 00:54:35,979 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
2013-11-16 00:54:35,993 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
2013-11-16 00:54:35,998 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Not considering hosts: [Host[-1-Routing]] to deploy template: Tmpl[201-ISO-201-2-281cbc51-8e8c-350e-9c78-83cb5cab5ae4 as they are not HVM enabled
2013-11-16 00:54:35,998 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Found 0 hosts for allocation after prioritization: []
2013-11-16 00:54:35,999 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=512
2013-11-16 00:54:35,999 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Host Allocator returning 0 suitable hosts
2013-11-16 00:54:35,999 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) No suitable hosts found
2013-11-16 00:54:35,999 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) No suitable hosts found under this Cluster: 1
2013-11-16 00:54:36,009 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Could not find suitable Deployment Destination for this VM under any clusters, returning.
2013-11-16 00:54:36,011 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Searching all possible resources under this Zone: 1
2013-11-16 00:54:36,014 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
2013-11-16 00:54:36,024 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Removing from the clusterId list these clusters from avoid set: []
2013-11-16 00:54:36,040 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Checking resources in Cluster: 1 under Pod: 1
2013-11-16 00:54:36,040 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
2013-11-16 00:54:36,047 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
2013-11-16 00:54:36,050 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Not considering hosts: [Host[-1-Routing]] to deploy template: Tmpl[201-ISO-201-2-281cbc51-8e8c-350e-9c78-83cb5cab5ae4 as they are not HVM enabled
2013-11-16 00:54:36,050 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Found 0 hosts for allocation after prioritization: []
2013-11-16 00:54:36,050 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=512
2013-11-16 00:54:36,050 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Host Allocator returning 0 suitable hosts
2013-11-16 00:54:36,050 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) No suitable hosts found
2013-11-16 00:54:36,050 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) No suitable hosts found under this Cluster: 1
2013-11-16 00:54:36,061 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Could not find suitable Deployment Destination for this VM under any clusters, returning.
2013-11-16 00:54:36,061 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Searching all possible resources under this Zone: 1
2013-11-16 00:54:36,062 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
2013-11-16 00:54:36,072 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Removing from the clusterId list these clusters from avoid set: []
2013-11-16 00:54:36,107 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Checking resources in Cluster: 1 under Pod: 1
2013-11-16 00:54:36,108 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
2013-11-16 00:54:36,114 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
2013-11-16 00:54:36,117 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Not considering hosts: [Host[-1-Routing]] to deploy template: Tmpl[201-ISO-201-2-281cbc51-8e8c-350e-9c78-83cb5cab5ae4 as they are not HVM enabled
2013-11-16 00:54:36,117 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Found 0 hosts for allocation after prioritization: []
2013-11-16 00:54:36,117 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=512
2013-11-16 00:54:36,117 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Host Allocator returning 0 suitable hosts
2013-11-16 00:54:36,117 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) No suitable hosts found
2013-11-16 00:54:36,117 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) No suitable hosts found under this Cluster: 1
2013-11-16 00:54:36,128 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Could not find suitable Deployment Destination for this VM under any clusters, returning.
2013-11-16 00:54:36,129 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Searching all possible resources under this Zone: 1
2013-11-16 00:54:36,131 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
2013-11-16 00:54:36,139 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Removing from the clusterId list these clusters from avoid set: []
2013-11-16 00:54:36,150 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Checking resources in Cluster: 1 under Pod: 1
2013-11-16 00:54:36,150 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
2013-11-16 00:54:36,162 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
2013-11-16 00:54:36,165 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Not considering hosts: [Host[-1-Routing]] to deploy template: Tmpl[201-ISO-201-2-281cbc51-8e8c-350e-9c78-83cb5cab5ae4 as they are not HVM enabled
2013-11-16 00:54:36,165 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Found 0 hosts for allocation after prioritization: []
2013-11-16 00:54:36,165 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=512
2013-11-16 00:54:36,165 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Host Allocator returning 0 suitable hosts
2013-11-16 00:54:36,165 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) No suitable hosts found
2013-11-16 00:54:36,165 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) No suitable hosts found under this Cluster: 1
2013-11-16 00:54:36,174 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Could not find suitable Deployment Destination for this VM under any clusters, returning.
回复： 无法创建实例
Posted by 高手 <84...@qq.com>.
用xencenter创建虚拟机可以的啊。如果是我所用的xenserver虚拟化没开启，这么开启？
------------------ 原始邮件 ------------------
发件人: "wanghaicheng2004@gmail.com";<wa...@gmail.com>;
发送时间: 2013年11月16日(星期六) 下午5:28
收件人: "users-cn"<us...@cloudstack.apache.org>;
主题: 回复: 无法创建实例
FirstFitRoutingAllocator) Not considering hosts: [Host[-1-Routing]] to deploy template: Tmpl[201-ISO-201-2-281cbc51-8e8c-350e-9c78-83cb5cab5ae4 as they are not HVM enabled
日志当中有这条报错，应该是host不支持虚拟话或者虚拟化没有开启
wanghaicheng2004@gmail.com
发件人： 高手
发送时间： 2013-11-16 17:03
收件人： users-cn
主题： 无法创建实例
环境：cloudstack4.2+CentOS6.2 host：xenserver6.2 8G内存（上面现在只跑了两台系统虚拟机）问题：无法创建实例，创建的时候，查看日志都是说找不到host来部署虚拟机。有没有高手知道错在哪里。
日志如下：
2013-11-16 00:54:31,186 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-4:null) Seq 1-1325989893: Response Received:
2013-11-16 00:54:31,187 DEBUG [agent.transport.Request] (DirectAgent-4:null) Seq 1-1325989893: Processing: { Ans: , MgmtId: 52235182734, via: 1, Ver: v1, Flags: 10, [{"com.cloud.agent.api.ClusterSyncAnswer":{"_clusterId":1,"_newStates":{},"_isExecuted":false,"result":true,"wait":0}}] }
2013-11-16 00:54:35,083 DEBUG [cloud.api.ApiServlet] (catalina-exec-13:null) ===START=== 192.168.16.111 -- GET command=deployVirtualMachine&zoneId=42530a8e-6dd4-4be3-9530-7448a165cd29&templateId=d3d6597a-9d6a-4f07-8ae2-e5930b248471&hypervisor=XenServer&serviceOfferingId=27c6028d-a43e-4fc2-b55b-ad9fa92074f5&diskOfferingId=f30cc1ae-0009-4c95-8d27-8fdf8b500aa7&displayname=liang&name=liang&response=json&sessionkey=hyZ3jyP7HScd6egutBy8MrCZpoI%3D&_=1384592075183
2013-11-16 00:54:35,102 DEBUG [cloud.api.ApiDispatcher] (catalina-exec-13:null) InfrastructureEntity name is:com.cloud.offering.ServiceOffering
2013-11-16 00:54:35,104 DEBUG [cloud.api.ApiDispatcher] (catalina-exec-13:null) ControlledEntity name is:com.cloud.template.VirtualMachineTemplate
2013-11-16 00:54:35,601 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-4:null) SeqA 3-137: Processing Seq 3-137: { Cmd , MgmtId: -1, via: 3, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] }
2013-11-16 00:54:35,607 DEBUG [cloud.api.ApiDispatcher] (catalina-exec-13:null) InfrastructureEntity name is:com.cloud.offering.DiskOffering
2013-11-16 00:54:35,612 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-4:null) SeqA 3-137: Sending Seq 3-137: { Ans: , MgmtId: 52235182734, via: 3, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] }
2013-11-16 00:54:35,661 DEBUG [cloud.vm.UserVmManagerImpl] (catalina-exec-13:null) Allocating in the DB for vm
2013-11-16 00:54:35,695 DEBUG [cloud.vm.VirtualMachineManagerImpl] (catalina-exec-13:null) Allocating entries for VM: VM[User|liang]
2013-11-16 00:54:35,700 DEBUG [cloud.vm.VirtualMachineManagerImpl] (catalina-exec-13:null) Allocating nics for VM[User|liang]
2013-11-16 00:54:35,701 DEBUG [cloud.network.NetworkManagerImpl] (catalina-exec-13:null) Allocating nic for vm VM[User|liang] in network Ntwk[204|Guest|6] with requested profile NicProfile[0-0-null-null-null
2013-11-16 00:54:35,713 DEBUG [cloud.vm.VirtualMachineManagerImpl] (catalina-exec-13:null) Allocating disks for VM[User|liang]
2013-11-16 00:54:35,732 DEBUG [cloud.vm.VirtualMachineManagerImpl] (catalina-exec-13:null) Allocation completed for VM: VM[User|liang]
2013-11-16 00:54:35,732 DEBUG [cloud.vm.UserVmManagerImpl] (catalina-exec-13:null) Successfully allocated DB entry for VM[User|liang]
2013-11-16 00:54:35,816 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-13:null) submit async job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ], details: AsyncJobVO {id:18, userId: 2, accountId: 2, sessionKey: null, instanceType: VirtualMachine, instanceId: 5, cmd: org.apache.cloudstack.api.command.user.vm.DeployVMCmd, cmdOriginator: null, cmdInfo: {"sessionkey":"hyZ3jyP7HScd6egutBy8MrCZpoI\u003d","cmdEventType":"VM.CREATE","ctxUserId":"2","serviceOfferingId":"27c6028d-a43e-4fc2-b55b-ad9fa92074f5","httpmethod":"GET","zoneId":"42530a8e-6dd4-4be3-9530-7448a165cd29","templateId":"d3d6597a-9d6a-4f07-8ae2-e5930b248471","response":"json","id":"5","hypervisor":"XenServer","name":"liang","diskOfferingId":"f30cc1ae-0009-4c95-8d27-8fdf8b500aa7","_":"1384592075183","ctxAccountId":"2","ctxStartEventId":"67","displayname":"liang"}, cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0, processStatus: 0, resultCode: 0, result: null, initMsid: 52235182734, completeMsid: null, lastUpdated: null, lastPolled: null, created: null}
2013-11-16 00:54:35,821 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Executing org.apache.cloudstack.api.command.user.vm.DeployVMCmd for job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]
2013-11-16 00:54:35,822 DEBUG [cloud.api.ApiServlet] (catalina-exec-13:null) ===END=== 192.168.16.111 -- GET command=deployVirtualMachine&zoneId=42530a8e-6dd4-4be3-9530-7448a165cd29&templateId=d3d6597a-9d6a-4f07-8ae2-e5930b248471&hypervisor=XenServer&serviceOfferingId=27c6028d-a43e-4fc2-b55b-ad9fa92074f5&diskOfferingId=f30cc1ae-0009-4c95-8d27-8fdf8b500aa7&displayname=liang&name=liang&response=json&sessionkey=hyZ3jyP7HScd6egutBy8MrCZpoI%3D&_=1384592075183
2013-11-16 00:54:35,828 DEBUG [cloud.api.ApiDispatcher] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) InfrastructureEntity name is:com.cloud.offering.ServiceOffering
2013-11-16 00:54:35,830 DEBUG [cloud.api.ApiDispatcher] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) ControlledEntity name is:com.cloud.template.VirtualMachineTemplate
2013-11-16 00:54:35,832 DEBUG [cloud.api.ApiDispatcher] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) InfrastructureEntity name is:com.cloud.offering.DiskOffering
2013-11-16 00:54:35,924 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Deploy avoids pods: [], clusters: [], hosts: []
2013-11-16 00:54:35,929 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) DeploymentPlanner allocation algorithm: com.cloud.deploy.FirstFitPlanner_EnhancerByCloudStack_8232bcd9@1553b17c
2013-11-16 00:54:35,929 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Trying to allocate a host and storage pools from dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 536870912
2013-11-16 00:54:35,929 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Is ROOT volume READY (pool already allocated)?: No
2013-11-16 00:54:35,930 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Searching all possible resources under this Zone: 1
2013-11-16 00:54:35,931 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
2013-11-16 00:54:35,943 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Removing from the clusterId list these clusters from avoid set: []
2013-11-16 00:54:35,962 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Checking resources in Cluster: 1 under Pod: 1
2013-11-16 00:54:35,979 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
2013-11-16 00:54:35,993 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
2013-11-16 00:54:35,998 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Not considering hosts: [Host[-1-Routing]] to deploy template: Tmpl[201-ISO-201-2-281cbc51-8e8c-350e-9c78-83cb5cab5ae4 as they are not HVM enabled
2013-11-16 00:54:35,998 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Found 0 hosts for allocation after prioritization: []
2013-11-16 00:54:35,999 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=512
2013-11-16 00:54:35,999 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Host Allocator returning 0 suitable hosts
2013-11-16 00:54:35,999 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) No suitable hosts found
2013-11-16 00:54:35,999 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) No suitable hosts found under this Cluster: 1
2013-11-16 00:54:36,009 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Could not find suitable Deployment Destination for this VM under any clusters, returning.
2013-11-16 00:54:36,011 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Searching all possible resources under this Zone: 1
2013-11-16 00:54:36,014 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
2013-11-16 00:54:36,024 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Removing from the clusterId list these clusters from avoid set: []
2013-11-16 00:54:36,040 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Checking resources in Cluster: 1 under Pod: 1
2013-11-16 00:54:36,040 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
2013-11-16 00:54:36,047 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
2013-11-16 00:54:36,050 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Not considering hosts: [Host[-1-Routing]] to deploy template: Tmpl[201-ISO-201-2-281cbc51-8e8c-350e-9c78-83cb5cab5ae4 as they are not HVM enabled
2013-11-16 00:54:36,050 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Found 0 hosts for allocation after prioritization: []
2013-11-16 00:54:36,050 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=512
2013-11-16 00:54:36,050 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Host Allocator returning 0 suitable hosts
2013-11-16 00:54:36,050 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) No suitable hosts found
2013-11-16 00:54:36,050 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) No suitable hosts found under this Cluster: 1
2013-11-16 00:54:36,061 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Could not find suitable Deployment Destination for this VM under any clusters, returning.
2013-11-16 00:54:36,061 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Searching all possible resources under this Zone: 1
2013-11-16 00:54:36,062 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
2013-11-16 00:54:36,072 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Removing from the clusterId list these clusters from avoid set: []
2013-11-16 00:54:36,107 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Checking resources in Cluster: 1 under Pod: 1
2013-11-16 00:54:36,108 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
2013-11-16 00:54:36,114 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
2013-11-16 00:54:36,117 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Not considering hosts: [Host[-1-Routing]] to deploy template: Tmpl[201-ISO-201-2-281cbc51-8e8c-350e-9c78-83cb5cab5ae4 as they are not HVM enabled
2013-11-16 00:54:36,117 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Found 0 hosts for allocation after prioritization: []
2013-11-16 00:54:36,117 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=512
2013-11-16 00:54:36,117 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Host Allocator returning 0 suitable hosts
2013-11-16 00:54:36,117 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) No suitable hosts found
2013-11-16 00:54:36,117 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) No suitable hosts found under this Cluster: 1
2013-11-16 00:54:36,128 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Could not find suitable Deployment Destination for this VM under any clusters, returning.
2013-11-16 00:54:36,129 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Searching all possible resources under this Zone: 1
2013-11-16 00:54:36,131 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
2013-11-16 00:54:36,139 DEBUG [cloud.deploy.FirstFitPlanner] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Removing from the clusterId list these clusters from avoid set: []
2013-11-16 00:54:36,150 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Checking resources in Cluster: 1 under Pod: 1
2013-11-16 00:54:36,150 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 cluster:1
2013-11-16 00:54:36,162 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for allocation: [Host[-1-Routing]]
2013-11-16 00:54:36,165 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Not considering hosts: [Host[-1-Routing]] to deploy template: Tmpl[201-ISO-201-2-281cbc51-8e8c-350e-9c78-83cb5cab5ae4 as they are not HVM enabled
2013-11-16 00:54:36,165 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Found 0 hosts for allocation after prioritization: []
2013-11-16 00:54:36,165 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=512
2013-11-16 00:54:36,165 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ] FirstFitRoutingAllocator) Host Allocator returning 0 suitable hosts
2013-11-16 00:54:36,165 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) No suitable hosts found
2013-11-16 00:54:36,165 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) No suitable hosts found under this Cluster: 1
2013-11-16 00:54:36,174 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl] (Job-Executor-1:job-18 = [ 6f006332-08c9-4a30-997b-eceaf1f27c15 ]) Could not find suitable Deployment Destination for this VM under any clusters, returning.