You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by Ugo Vasi <ug...@procne.it> on 2014/08/01 10:05:58 UTC
Re: Unable to start a VM due to insufficient capacity
Hi Geoff,
I tried restarting r-29-VM but the problem is still blocking creation of
new VM in that isolated network.
Creating a new VM in another isolated network, it works. Where can I
look at to find the problem?
Il 31/07/2014 21:53, Geoff Higginbottom ha scritto:
> Ugo,
>
> Looks like CS is failing to update the VR with details for the new VM, try restarting the VR.
>
> Regards
>
> Geoff Higginbottom
> CTO / Cloud Architect
>
>
> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>
> geoff.higginbottom@shapeblue.com<ma...@shapeblue.com> | www.shapeblue.com<htp://www.shapeblue.com/>
>
> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N 4HS<x-apple-data-detectors://37>
>
>
>
> On 31 Jul 2014, at 15:40, "Ugo Vasi" <ug...@procne.it>> wrote:
>
> Hi everybody,
> I installed a CloudStack 4.3.0 system with a manager (in a virtual machine), two NFS primary storage, one NFS secondary storare and two host agent on ubuntu distribution.
>
> The cluster have one advanced zone without security group configuration with KVM hipervisors.
>
> I create some VM but now does not allow me to create more giving the error message "Unable to start a VM due to insufficient capacity".
>
> I am sure that the resources (ip, ram, cpu and storage) are enough to create new instances. In dashboard I see all ok.
>
> >From the management-server.log I see this errors messages (see attachment for full version) when I try to deploy a new virtual machine with 1x1GHz cpu, 1GB or RAM and 20GB disk space:
>
> 2014-07-31 14:59:11,983 DEBUG [c.c.a.t.Request] (AgentManager-Handler-12:null) Seq 1-684594119: Processing: { Ans: , MgmtId: 77916390353436, via: 1, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":false,"details":"VmDataCommand failed, check agent logs","wait":0}}] }
> 2014-07-31 14:59:11,983 INFO [c.c.v.VirtualMachineManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Unable to contact resource.
> com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is unreachable: Unable to apply userdata and password entry on router
> 2014-07-31 14:59:12,453 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 7
> 2014-07-31 14:59:12,677 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
> 2014-07-31 14:59:12,708 DEBUG [c.c.v.UserVmManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Destroying vm VM[User|csweb2] as it failed to create on Host with Id:null
> 2014-07-31 14:59:12,738 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from :Stopped to Error with event: OperationFailedToErrorvm's original host id: null new host id: null host id before state transition: null
> 2014-07-31 14:59:12,929 WARN [o.a.c.alerts] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) alertType:: 8 // dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed to deploy Vm with Id: 70, on Host with Id: null
> 2014-07-31 14:59:13,159 ERROR [c.c.a.ApiAsyncJobDispatcher] (Job-Executor-26:ctx-ab3aee38) Unexpected exception while executing org.apache.cloudstack.api.command.user.vm.DeployVMCmd
> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due to insufficient capacity
> Caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|csweb2]Scope=interface com.cloud.dc.DataCenter; id=1
> 2014-07-31 14:59:13,161 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Job-Executor-26:ctx-ab3aee38) Complete async job-783, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable to start a VM due to insufficient capacity"}
> 2014-07-31 14:59:46,280 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-27:ctx-82be396e ctx-41f0cf24) Stopped called on VM[User|csweb2] but the state is Error
> 2014-07-31 14:59:46,330 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-27:ctx-82be396e ctx-41f0cf24) VM state transitted from :Error to Expunging with event: DestroyRequestedvm's original host id: null new host id: null host id before state transition: null
>
> I tried to search in others log file ("VmDataCommand failed, check agent logs"), but I don't found nothing...
>
> Can anyone Help me?
>
> --
>
> U g o V a s i <ug...@procne.it>>
> P r o c n e s.r.l >)
> via Cotonificio 45 33010 Tavagnacco IT
> phone: +390432486523 fax: +390432486523
>
> Le informazioni contenute in questo messaggio sono riservate e
> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
> Qualora Lei non fosse la persona a cui il presente messaggio ?
> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
> gentilmente comunicazione.
> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
> Rif. D.L. 196/2003
>
>
>
>
> <management-server.log>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge - rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>
>
>
>
--
U g o V a s i <ug...@procne.it>
P r o c n e s.r.l >)
via Cotonificio 45 33010 Tavagnacco IT
phone: +390432486523 fax: +390432486523
Le informazioni contenute in questo messaggio sono riservate e
confidenziali ed è vietata la diffusione in qualunque modo eseguita.
Qualora Lei non fosse la persona a cui il presente messaggio è
destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
gentilmente comunicazione.
Per qualsiasi informazione si prega di contattare support@procne.it .
Rif. D.L. 196/2003
RE: Unable to start a VM due to insufficient capacity
Posted by Matthew Midgett <cl...@trick-solutions.com.INVALID>.
Thank you for your answer and I will try that.
-----Original Message-----
From: ilya musayev [mailto:ilya.mailing.lists@gmail.com]
Sent: Tuesday, September 16, 2014 11:19 PM
To: users@cloudstack.apache.org
Subject: Re: Unable to start a VM due to insufficient capacity
I've seen this before and had similar issues.
Instead of re-installing or dropping DB, you can delete all job_ids that are
stuck.
For example, this is what i would see in my logs.
(1013,VmWorkJobQueue, 2375) is reaching concurrency limit 1
(1013,VmWorkJobQueue, 2375) is reaching concurrency limit 1
(1433,VmWorkJobQueue, 2470) is reaching concurrency limit 1
(1434,VmWorkJobQueue, 2471) is reaching concurrency limit 1
(1475,VmWorkJobQueue, 2483) is reaching concurrency limit 1
(1477,VmWorkJobQueue, 2484) is reaching concurrency limit 1
(1478,VmWorkJobQueue, 596) is reaching concurrency limit 1
(981,VmWorkJobQueue, 2371) is reaching concurrency limit 1
DELETE ALL FROM BELOW:
SELECT * FROM cloud.sync_queue_item where queue_id=981 or queue_id=1478 or
queue_id=1477 or queue_id=1475 or queue_id=1434 or queue_id=1433 or
queue_id=1013 ;
SELECT * FROM cloud.sync_queue where id=1433 or id=1434 or id=1475 or
id=1477 or id=1478 or id=981;
While i did SELECT statement, you can alter to DELETE.
Regards
ilya
On 9/16/14, 6:31 PM, Matthew Midgett wrote:
> Ugo, I am having an issue just like you. I can deploy the default
> centos template but if I try to deploy a iso it looks like its failing
> in the network area. I've been reading your emails to Geoff and I have
> restarted the network with a clean and that didn't fix my problem. I
> also restarted the management servers during this process. I don't
> know what happed but ssvm and console quit working. I've spent all day
> deleting the whole thing and setting it back up again. Just to find that
it's not working.
>
> Now I just saw this in the logs
>
> Cannot delete or update a parent row: a foreign key constraint fails
> (`cloud`.`async_job_join_map`, CONSTRAINT
> `fk_async_job_join_map__join_job_id` FOREIGN KEY (`join_job_id`)
> REFERENCES `async_job` (`id`))
>
> I am running a 2 node haproxy with virtual ip in front of a galera sql
> cluster.
>
> I dropped the DB, gave the cloud user more permissions. Deleted
> everything and restarted and it's doing this all over again. I am
> running xenserver 6.2 and acs4.4. I even tried 4.3 again and it started
doing the same thing.
>
>
>
> -----Original Message-----
> From: Ugo Vasi [mailto:ugo.vasi@procne.it]
> Sent: Tuesday, September 16, 2014 5:36 AM
> To: users@cloudstack.apache.org
> Subject: Re: Unable to start a VM due to insufficient capacity
>
> Hi Geoff,
> I restarted the network and now I can create new VM without errors.
>
> Now, how can I prevent this issue?
>
>
>
>
> Il 11/09/2014 09:28, Geoff Higginbottom ha scritto:
>> Hi Ugo,
>>
>> Did restarting the network with cleanup option resolve your issue
>> last
> time, if yes have you tried the same on this network?
>> Regards
>>
>> Geoff Higginbottom
>> CTO / Cloud Architect
>>
>> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603
>> 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>>
>> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.
>> c
>> om> | www.shapeblue.com<htp://www.shapeblue.com/> |
>> Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
>>
>> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
>> 4HS<x-apple-data-detectors://5>
>>
>>
>> On 11 Sep 2014, at 08:17, "Ugo Vasi"
> <ug...@procne.it>> wrote:
>> Hi Geoff,
>> I still have the problem creating new VMs but in another isolated
network.
> The problem seems to be the same:
>> 2014-09-11 08:55:27,048 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM is being created in
>> podId: 1
>> 2014-09-11 08:55:27,050 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Network id=212 is already
>> implemented
>> 2014-09-11 08:55:27,118 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:27,122 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
>> nics for network id=212 on 1
>> 2014-09-11 08:55:27,174 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
>> prepare for
>> Nic[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19]
>> 2014-09-11 08:55:27,181 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is acquired for
>> network id 212 as a part of router startup in
>> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->P
>> o
>> ol(Id))] :
>> Dest[Zone(1)-Pod(1)-Cluster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(
>> 6
>> ))]
>> 2014-09-11 08:55:27,183 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is released for
>> network id 212 as a part of router startup in
>> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->P
>> o
>> ol(Id))] :
>> Dest[Zone(1)-Pod(1)-Cluster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(
>> 6
>> ))]
>> 2014-09-11 08:55:27,189 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:27,198 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:27,202 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Applying dhcp entry in
>> network Ntwk[212|Guest|8]
>> 2014-09-11 08:55:27,215 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304056: Sending
>> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags:
>> 100011,
>> [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:15:7
>> 6
>> :00:0e","vmIpAddress":"10.1.1.19","vmName":"giannitest","defaultRoute
>> r
>> ":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:15:76:
>> 0
>> 0:0e","isDefault":true,"executeInSequence":false,"accessDetails":{"ro
>> u
>> ter.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.name":
>> "r-60-VM","router.ip":"169.254.1.230"},"wait":0}}] }
>> 2014-09-11 08:55:27,941 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
>> (secstorage-1:ctx-327037b2) Zone 1 is ready to launch secondary
>> storage VM
>> 2014-09-11 08:55:28,022 DEBUG [c.c.c.ConsoleProxyManagerImpl]
>> (consoleproxy-1:ctx-a8ba3b1e) Zone 1 is ready to launch console proxy
>> 2014-09-11 08:55:28,820 DEBUG [c.c.a.ApiServlet]
>> (catalina-exec-16:ctx-58e92382) ===START=== 192.168.130.89 -- GET
>> command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf
>> 0
>> &response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=141041
>> 8
>> 528731
>> 2014-09-11 08:55:29,069 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-13:null) Seq 7-564304056: Processing: { Ans: ,
>> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
>> 2014-09-11 08:55:29,069 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304056: Received:
>> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { Answer
>> } }
>> 2014-09-11 08:55:29,075 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:29,078 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Applying userdata and
>> password entry in network Ntwk[212|Guest|8]
>> 2014-09-11 08:55:29,089 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304057: Sending
>> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags:
>> 100011,
>> [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"
>> 1
>> 0.1.1.19","vmName":"giannitest","executeInSequence":false,"accessDeta
>> i
>> ls":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","rou
>> t
>> er.ip":"169.254.1.230","router.name":"r-60-VM"},"wait":0}},{"com.clou
>> d
>> .agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.19","vmName":
>> "giannitest","executeInSequence":false,"accessDetails":{"router.guest.
>> ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.1.
>> 2 30","router.name":"r-60-VM"},"wait":0}}] }
>> 2014-09-11 08:55:29,399 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-10:null) Seq 7-564304057: Processing: { Ans: ,
>> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.
>> a gent.api.Answer":{"result":false,"details":"VmDataCommand failed,
>> check agent logs","wait":0}}] }
>> 2014-09-11 08:55:29,491 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304057: Received:
>> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, {
>> Answer, Answer } }
>> 2014-09-11 08:55:29,491 INFO [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Unable to contact resource.
>> com.cloud.exception.ResourceUnavailableException: Resource
>> [DataCenter:1]
> is unreachable: Unable to apply userdata and password entry on router
>> at
> com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyRules
> (Virtu
> alNetworkApplianceManagerImpl.java:3915)
>> at
> com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyUserD
> ata(Vi
> rtualNetworkApplianceManagerImpl.java:3118)
>> at sun.reflect.GeneratedMethodAccessor472.invoke(Unknown
>> Source) ...
>> 2014-09-11 08:55:29,755 DEBUG [c.c.a.ApiServlet]
>> (catalina-exec-16:ctx-58e92382 ctx-ad8ddf67) ===END=== 192.168.130.89
>> -- GET
>> command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf
>> 0
>> &response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=141041
>> 8
>> 528731
>> 2014-09-11 08:55:29,798 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Cleaning up resources for
>> the vm VM[User|giannitest] in Starting state
>> 2014-09-11 08:55:29,800 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Sending
>> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags:
>> 100011,
>> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequen
>> c e":false,"vmName":"i-2-86-VM","wait":0}}] }
>> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-6:null) Seq 7-564304058: Processing: { Ans: ,
>> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
>> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Received:
>> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, {
>> StopAnswer } }
>> 2014-09-11 08:55:29,955 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:29,957 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
>> nics for network id=212 on -1
>> 2014-09-11 08:55:30,051 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
>> release
>> NicProfile[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19-null
>> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully released
>> network resources for the vm VM[User|giannitest]
>> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully cleanued up
>> resources for the vm VM[User|giannitest] in Starting state
>> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1'
> provided is in avoid set, DeploymentPlanner cannot allocate the VM,
returning.
>> 2014-09-11 08:55:30,214 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: 7
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total CPU:
>> 36256 and CPU after applying overprovisioning: 36256
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total RAM:
>> 50639785984 and RAM after applying overprovisioning: 50639785984
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release cpu from host: 7,
>> old used: 26500,reserved: 0, actual total: 36256, total with
>> overprovisioning: 36256; new used: 26000,reserved:0;
>> movedfromreserved: false,moveToReserveredfalse
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release mem from host: 7,
>> old used: 21072183296,reserved: 0, total: 50639785984; new used:
>> 20535312384,reserved:0; movedfromreserved:
>> false,moveToReserveredfalse
>> 2014-09-11 08:55:30,302 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Stopped to Starting with event: StartRequestedvm's original host id:
>> null new host id: null host id before state transition: null
>> 2014-09-11 08:55:30,302 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully transitioned
>> to start state for VM[User|giannitest] reservation id =
>> 4b6c2f8d-a34c-4b86-a0d4-acd5ea87353a
>> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Trying to deploy VM, vm
>> has dcId: 1 and podId: 1
>> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1'
> provided is in avoid set, DeploymentPlanner cannot allocate the VM,
returning.
>> 2014-09-11 08:55:30,435 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: null
>> 2014-09-11 08:55:30,477 DEBUG [c.c.v.UserVmManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Destroying vm
>> VM[User|giannitest] as it failed to create on Host with Id:null
>> 2014-09-11 08:55:30,609 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Stopped to Error with event: OperationFailedToErrorvm's original
>> host
>> id: null new host id: null host id before state transition: null
>> 2014-09-11 08:55:29,755 DEBUG [c.c.a.ApiServlet]
>> (catalina-exec-16:ctx-58e92382 ctx-ad8ddf67) ===END=== 192.168.130.89
>> -- GET
>> command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf
>> 0
>> &response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=141041
>> 8
>> 528731
>> 2014-09-11 08:55:29,798 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Cleaning up resources for
>> the vm VM[User|giannitest] in Starting state
>> 2014-09-11 08:55:29,800 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Sending
>> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags:
>> 100011,
>> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequen
>> c e":false,"vmName":"i-2-86-VM","wait":0}}] }
>> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-6:null) Seq 7-564304058: Processing: { Ans: ,
>> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
>> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Received:
>> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, {
>> StopAnswer } }
>> 2014-09-11 08:55:29,955 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:29,957 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
>> nics for network id=212 on -1
>> 2014-09-11 08:55:30,051 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
>> release
>> NicProfile[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19-null
>> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully released
>> network resources for the vm VM[User|giannitest]
>> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully cleanued up
>> resources for the vm VM[User|giannitest] in Starting state
>> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1'
> provided is in avoid set, DeploymentPlanner cannot allocate the VM,
returning.
>> 2014-09-11 08:55:30,214 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: 7
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total CPU:
>> 36256 and CPU after applying overprovisioning: 36256
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total RAM:
>> 50639785984 and RAM after applying overprovisioning: 50639785984
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release cpu from host: 7,
>> old used: 26500,reserved: 0, actual total: 36256, total with
>> overprovisioning: 36256; new used: 26000,reserved:0;
>> movedfromreserved: false,moveToReserveredfalse
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release mem from host: 7,
>> old used: 21072183296,reserved: 0, total: 50639785984; new used:
>> 20535312384,reserved:0; movedfromreserved:
>> false,moveToReserveredfalse
>> 2014-09-11 08:55:30,302 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Stopped to Starting with event: StartRequestedvm's original host id:
>> null new host id: null host id before state transition: null
>> 2014-09-11 08:55:30,302 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully transitioned
>> to start state for VM[User|giannitest] reservation id =
>> 4b6c2f8d-a34c-4b86-a0d4-acd5ea87353a
>> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Trying to deploy VM, vm
>> has dcId: 1 and podId: 1
>> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1'
> provided is in avoid set, DeploymentPlanner cannot allocate the VM,
returning.
>> 2014-09-11 08:55:30,435 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: null
>> 2014-09-11 08:55:30,477 DEBUG [c.c.v.UserVmManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Destroying vm
>> VM[User|giannitest] as it failed to create on Host with Id:null
>> 2014-09-11 08:55:30,609 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Stopped to Error with event: OperationFailedToErrorvm's original
>> host
>> id: null new host id: null host id before state transition: null
>> 2014-09-11 08:55:30,809 WARN [o.a.c.alerts]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) alertType:: 8 //
>> dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed
>> to deploy Vm with Id: 86, on Host with Id: null
>> 2014-09-11 08:55:30,932 DEBUG [c.c.a.m.AgentManagerImpl]
>> (AgentManager-Handler-1:null) Ping from 6
>> 2014-09-11 08:55:31,078 ERROR [c.c.a.ApiAsyncJobDispatcher]
>> (Job-Executor-55:ctx-b5c34ec7) Unexpected exception while executing
>> org.apache.cloudstack.api.command.user.vm.DeployVMCmd
>> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM
>> due
> to insufficient capacity
>> at
>
com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:
> 605)
>> at
> org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.depl
> oyVirt
> ualMachine(VMEntityManagerImpl.java:237)
>> at
> org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl
> .deplo
> y(VirtualMachineEntityImpl.java:207)
>> at
> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.j
> ava:35
> 81)
>> at
> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.j
> ava:31
> 61)
>> at
> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.j
> ava:31
> 47)
>> at sun.reflect.GeneratedMethodAccessor587.invoke(Unknown
>> Source) ...
>>
>>
>> Il 01/08/2014 11:44, Geoff Higginbottom ha scritto:
>> Ugo,
>>
>> Login to the VR and tail the messages log then attempt to start the
>> VM,
> you should see various messages re DHCP updating etc in the VR. If
> you don't see the VR update try restarting the network Iain the 'cleanup'
> option, this will create a new VR.
>> Regards
>>
>> Geoff Higginbottom
>> CTO / Cloud Architect
>>
>> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603
>> 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>>
>> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.
>> c
>> om><ma...@shapeblue.com> |
>> www.shapeblue.com<http://www.shapeblue.com><htp://www.shapeblue.com/>
>> | Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
>>
>> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
>> 4HS<x-apple-data-detectors://5>
>>
>>
>> On 1 Aug 2014, at 09:06, "Ugo Vasi"
> <ug...@procne.it><mailto:ugo.vasi@procne.
> it>>
> wrote:
>> Hi Geoff,
>> I tried restarting r-29-VM but the problem is still blocking creation
>> of
> new VM in that isolated network.
>> Creating a new VM in another isolated network, it works. Where can I
>> look
> at to find the problem?
>>
>>
>> Il 31/07/2014 21:53, Geoff Higginbottom ha scritto:
>> Ugo,
>>
>> Looks like CS is failing to update the VR with details for the new
>> VM, try
> restarting the VR.
>> Regards
>>
>> Geoff Higginbottom
>> CTO / Cloud Architect
>>
>>
>> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603
>> 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>>
>> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.
>> c
>> om><ma...@shapeblue.com><mailto:geoff.higginbotto
>> om>m
>> @shapeblue.com> |
>> www.shapeblue.com<http://www.shapeblue.com><http://www.shapeblue.com>
>> <
>> htp://www.shapeblue.com/>
>>
>> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
>> 4HS<x-apple-data-detectors://37>
>>
>>
>>
>> On 31 Jul 2014, at 15:40, "Ugo Vasi"
> <ug...@procne.it><mailto:ugo.vasi@procne.
> it><ma
> ilto:ugo.vasi@procne.it>> wrote:
>> Hi everybody,
>> I installed a CloudStack 4.3.0 system with a manager (in a virtual
> machine), two NFS primary storage, one NFS secondary storare and two
> host agent on ubuntu distribution.
>> The cluster have one advanced zone without security group
>> configuration
> with KVM hipervisors.
>> I create some VM but now does not allow me to create more giving the
>> error
> message "Unable to start a VM due to insufficient capacity".
>> I am sure that the resources (ip, ram, cpu and storage) are enough to
> create new instances. In dashboard I see all ok.
>> >From the management-server.log I see this errors messages (see
>> >attachment
> for full version) when I try to deploy a new virtual machine with
> 1x1GHz cpu, 1GB or RAM and 20GB disk space:
>> 2014-07-31 14:59:11,983 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-12:null) Seq 1-684594119: Processing: { Ans: ,
>> MgmtId: 77916390353436, via: 1, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.
>> a gent.api.Answer":{"result":false,"details":"VmDataCommand failed,
>> check agent logs","wait":0}}] }
>> 2014-07-31 14:59:11,983 INFO [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Unable to contact resource.
>> com.cloud.exception.ResourceUnavailableException: Resource
>> [DataCenter:1] is unreachable: Unable to apply userdata and password
>> entry on router
>> 2014-07-31 14:59:12,453 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: 7
>> 2014-07-31 14:59:12,677 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: null
>> 2014-07-31 14:59:12,708 DEBUG [c.c.v.UserVmManagerImpl]
>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Destroying vm
>> VM[User|csweb2] as it failed to create on Host with Id:null
>> 2014-07-31 14:59:12,738 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from
>> :Stopped to Error with event: OperationFailedToErrorvm's original
>> host
>> id: null new host id: null host id before state transition: null
>> 2014-07-31 14:59:12,929 WARN [o.a.c.alerts]
>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) alertType:: 8 //
>> dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed
>> to deploy Vm with Id: 70, on Host with Id: null
>> 2014-07-31 14:59:13,159 ERROR [c.c.a.ApiAsyncJobDispatcher]
>> (Job-Executor-26:ctx-ab3aee38) Unexpected exception while executing
>> org.apache.cloudstack.api.command.user.vm.DeployVMCmd
>> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM
>> due to insufficient capacity Caused by:
>> com.cloud.exception.InsufficientServerCapacityException: Unable to
>> create a deployment for VM[User|csweb2]Scope=interface
>> com.cloud.dc.DataCenter; id=1
>> 2014-07-31 14:59:13,161 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>> (Job-Executor-26:ctx-ab3aee38) Complete async job-783, jobStatus:
>> FAILED, resultCode: 530, result:
>> org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":
>> [],"errorcode":530,"errortext":"Unable to start a VM due to
>> insufficient capacity"}
>> 2014-07-31 14:59:46,280 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-27:ctx-82be396e ctx-41f0cf24) Stopped called on
>> VM[User|csweb2] but the state is Error
>> 2014-07-31 14:59:46,330 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-27:ctx-82be396e ctx-41f0cf24) VM state transitted from
>> :Error to Expunging with event: DestroyRequestedvm's original host id:
>> null new host id: null host id before state transition: null
>>
>> I tried to search in others log file ("VmDataCommand failed, check
>> agent
> logs"), but I don't found nothing...
>> Can anyone Help me?
>>
>> --
>>
>> U g o V a s i
> <ug...@procne.it><mailto:ugo.vasi@procne.
> it><ma
> ilto:ugo.vasi@procne.it>>
>> P r o c n e s.r.l >)
>> via Cotonificio 45 33010 Tavagnacco IT
>> phone: +390432486523 fax: +390432486523
>>
>> Le informazioni contenute in questo messaggio sono riservate e
>> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
>> Qualora Lei non fosse la persona a cui il presente messaggio ?
>> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
>> gentilmente comunicazione.
>> Per qualsiasi informazione si prega di contattare
> support@procne.it<ma...@procne.it><
> mailto
> :support@procne.it> .
>> Rif. D.L. 196/2003
>>
>>
>>
>>
>> <management-server.log>
>> Find out more about ShapeBlue and our range of CloudStack related
>> services
>>
>> IaaS Cloud Design &
>> Build<http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge - rapid IaaS deployment
>> framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Infrastructure
>> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training
>> Courses<http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are
>> intended
> solely for the use of the individual to whom it is addressed. Any
> views or opinions expressed are solely those of the author and do not
> necessarily represent those of Shape Blue Ltd or related companies. If
> you are not the intended recipient of this email, you must neither
> take any action based upon its contents, nor copy or show it to
> anyone. Please contact the sender if you believe you have received
> this email in error. Shape Blue Ltd is a company incorporated in
> England & Wales. ShapeBlue Services India LLP is a company
> incorporated in India and is operated under license from Shape Blue
> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in
> Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA
> Pty Ltd is a company registered by The Republic of South Africa and is
traded under license from Shape Blue Ltd. ShapeBlue is a registered
trademark.
>>
>>
>>
>>
>>
>> --
>>
>> U g o V a s i
> <ug...@procne.it><mailto:ugo.vasi@procne.
> it>>
>> P r o c n e s.r.l >)
>> via Cotonificio 45 33010 Tavagnacco IT
>> phone: +390432486523 fax: +390432486523
>>
>> Le informazioni contenute in questo messaggio sono riservate e
>> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
>> Qualora Lei non fosse la persona a cui il presente messaggio ?
>> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
>> gentilmente comunicazione.
>> Per qualsiasi informazione si prega di contattare
> support@procne.it<ma...@procne.it> .
>> Rif. D.L. 196/2003
>>
>>
>>
>>
>>
>> Find out more about ShapeBlue and our range of CloudStack related
>> services
>>
>> IaaS Cloud Design &
>> Build<http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge - rapid IaaS deployment
>> framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Infrastructure
>> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training
>> Courses<http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are
>> intended
> solely for the use of the individual to whom it is addressed. Any
> views or opinions expressed are solely those of the author and do not
> necessarily represent those of Shape Blue Ltd or related companies. If
> you are not the intended recipient of this email, you must neither
> take any action based upon its contents, nor copy or show it to
> anyone. Please contact the sender if you believe you have received
> this email in error. Shape Blue Ltd is a company incorporated in
> England & Wales. ShapeBlue Services India LLP is a company
> incorporated in India and is operated under license from Shape Blue
> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in
> Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA
> Pty Ltd is a company registered by The Republic of South Africa and is
traded under license from Shape Blue Ltd. ShapeBlue is a registered
trademark.
>>
>>
>>
>>
>>
>> --
>>
>> U g o V a s i <ug...@procne.it>>
>> P r o c n e s.r.l >)
>> via Cotonificio 45 33010 Tavagnacco IT
>> phone: +390432486523 fax: +390432486523
>>
>> Le informazioni contenute in questo messaggio sono riservate e
>> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
>> Qualora Lei non fosse la persona a cui il presente messaggio ?
>> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
>> gentilmente comunicazione.
>> Per qualsiasi informazione si prega di contattare
> support@procne.it<ma...@procne.it> .
>> Rif. D.L. 196/2003
>>
>>
>> Find out more about ShapeBlue and our range of CloudStack related
>> services
>>
>> IaaS Cloud Design &
>> Build<http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge - rapid IaaS deployment
>> framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Infrastructure
>> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training
>> Courses<http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are
>> intended
> solely for the use of the individual to whom it is addressed. Any
> views or opinions expressed are solely those of the author and do not
> necessarily represent those of Shape Blue Ltd or related companies. If
> you are not the intended recipient of this email, you must neither
> take any action based upon its contents, nor copy or show it to
> anyone. Please contact the sender if you believe you have received
> this email in error. Shape Blue Ltd is a company incorporated in
> England & Wales. ShapeBlue Services India LLP is a company
> incorporated in India and is operated under license from Shape Blue
> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in
> Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA
> Pty Ltd is a company registered by The Republic of South Africa and is
traded under license from Shape Blue Ltd. ShapeBlue is a registered
trademark.
>>
>>
>>
>
Re: Unable to start a VM due to insufficient capacity
Posted by ilya musayev <il...@gmail.com>.
I've seen this before and had similar issues.
Instead of re-installing or dropping DB, you can delete all job_ids that
are stuck.
For example, this is what i would see in my logs.
(1013,VmWorkJobQueue, 2375) is reaching concurrency limit 1
(1013,VmWorkJobQueue, 2375) is reaching concurrency limit 1
(1433,VmWorkJobQueue, 2470) is reaching concurrency limit 1
(1434,VmWorkJobQueue, 2471) is reaching concurrency limit 1
(1475,VmWorkJobQueue, 2483) is reaching concurrency limit 1
(1477,VmWorkJobQueue, 2484) is reaching concurrency limit 1
(1478,VmWorkJobQueue, 596) is reaching concurrency limit 1
(981,VmWorkJobQueue, 2371) is reaching concurrency limit 1
DELETE ALL FROM BELOW:
SELECT * FROM cloud.sync_queue_item where queue_id=981 or queue_id=1478
or queue_id=1477 or queue_id=1475 or queue_id=1434 or queue_id=1433 or
queue_id=1013 ;
SELECT * FROM cloud.sync_queue where id=1433 or id=1434 or id=1475 or
id=1477 or id=1478 or id=981;
While i did SELECT statement, you can alter to DELETE.
Regards
ilya
On 9/16/14, 6:31 PM, Matthew Midgett wrote:
> Ugo, I am having an issue just like you. I can deploy the default centos
> template but if I try to deploy a iso it looks like its failing in the
> network area. I've been reading your emails to Geoff and I have restarted
> the network with a clean and that didn't fix my problem. I also restarted
> the management servers during this process. I don't know what happed but
> ssvm and console quit working. I've spent all day deleting the whole thing
> and setting it back up again. Just to find that it's not working.
>
> Now I just saw this in the logs
>
> Cannot delete or update a parent row: a foreign key constraint fails
> (`cloud`.`async_job_join_map`, CONSTRAINT
> `fk_async_job_join_map__join_job_id` FOREIGN KEY (`join_job_id`) REFERENCES
> `async_job` (`id`))
>
> I am running a 2 node haproxy with virtual ip in front of a galera sql
> cluster.
>
> I dropped the DB, gave the cloud user more permissions. Deleted everything
> and restarted and it's doing this all over again. I am running xenserver 6.2
> and acs4.4. I even tried 4.3 again and it started doing the same thing.
>
>
>
> -----Original Message-----
> From: Ugo Vasi [mailto:ugo.vasi@procne.it]
> Sent: Tuesday, September 16, 2014 5:36 AM
> To: users@cloudstack.apache.org
> Subject: Re: Unable to start a VM due to insufficient capacity
>
> Hi Geoff,
> I restarted the network and now I can create new VM without errors.
>
> Now, how can I prevent this issue?
>
>
>
>
> Il 11/09/2014 09:28, Geoff Higginbottom ha scritto:
>> Hi Ugo,
>>
>> Did restarting the network with cleanup option resolve your issue last
> time, if yes have you tried the same on this network?
>> Regards
>>
>> Geoff Higginbottom
>> CTO / Cloud Architect
>>
>> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603
>> 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>>
>> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.c
>> om> | www.shapeblue.com<htp://www.shapeblue.com/> |
>> Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
>>
>> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
>> 4HS<x-apple-data-detectors://5>
>>
>>
>> On 11 Sep 2014, at 08:17, "Ugo Vasi"
> <ug...@procne.it>> wrote:
>> Hi Geoff,
>> I still have the problem creating new VMs but in another isolated network.
> The problem seems to be the same:
>> 2014-09-11 08:55:27,048 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM is being created in
>> podId: 1
>> 2014-09-11 08:55:27,050 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Network id=212 is already
>> implemented
>> 2014-09-11 08:55:27,118 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:27,122 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
>> nics for network id=212 on 1
>> 2014-09-11 08:55:27,174 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
>> prepare for Nic[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19]
>> 2014-09-11 08:55:27,181 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is acquired for
>> network id 212 as a part of router startup in
>> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Po
>> ol(Id))] :
>> Dest[Zone(1)-Pod(1)-Cluster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(6
>> ))]
>> 2014-09-11 08:55:27,183 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is released for
>> network id 212 as a part of router startup in
>> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Po
>> ol(Id))] :
>> Dest[Zone(1)-Pod(1)-Cluster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(6
>> ))]
>> 2014-09-11 08:55:27,189 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:27,198 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:27,202 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Applying dhcp entry in
>> network Ntwk[212|Guest|8]
>> 2014-09-11 08:55:27,215 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304056: Sending
>> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
>> [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:15:76
>> :00:0e","vmIpAddress":"10.1.1.19","vmName":"giannitest","defaultRouter
>> ":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:15:76:0
>> 0:0e","isDefault":true,"executeInSequence":false,"accessDetails":{"rou
>> ter.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.name":
>> "r-60-VM","router.ip":"169.254.1.230"},"wait":0}}] }
>> 2014-09-11 08:55:27,941 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
>> (secstorage-1:ctx-327037b2) Zone 1 is ready to launch secondary
>> storage VM
>> 2014-09-11 08:55:28,022 DEBUG [c.c.c.ConsoleProxyManagerImpl]
>> (consoleproxy-1:ctx-a8ba3b1e) Zone 1 is ready to launch console proxy
>> 2014-09-11 08:55:28,820 DEBUG [c.c.a.ApiServlet]
>> (catalina-exec-16:ctx-58e92382) ===START=== 192.168.130.89 -- GET
>> command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0
>> &response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418
>> 528731
>> 2014-09-11 08:55:29,069 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-13:null) Seq 7-564304056: Processing: { Ans: ,
>> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
>> 2014-09-11 08:55:29,069 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304056: Received:
>> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { Answer
>> } }
>> 2014-09-11 08:55:29,075 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:29,078 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Applying userdata and
>> password entry in network Ntwk[212|Guest|8]
>> 2014-09-11 08:55:29,089 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304057: Sending
>> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
>> [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"1
>> 0.1.1.19","vmName":"giannitest","executeInSequence":false,"accessDetai
>> ls":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","rout
>> er.ip":"169.254.1.230","router.name":"r-60-VM"},"wait":0}},{"com.cloud
>> .agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.19","vmName":
>> "giannitest","executeInSequence":false,"accessDetails":{"router.guest.
>> ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.1.2
>> 30","router.name":"r-60-VM"},"wait":0}}] }
>> 2014-09-11 08:55:29,399 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-10:null) Seq 7-564304057: Processing: { Ans: ,
>> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.a
>> gent.api.Answer":{"result":false,"details":"VmDataCommand failed,
>> check agent logs","wait":0}}] }
>> 2014-09-11 08:55:29,491 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304057: Received:
>> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { Answer,
>> Answer } }
>> 2014-09-11 08:55:29,491 INFO [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Unable to contact resource.
>> com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1]
> is unreachable: Unable to apply userdata and password entry on router
>> at
> com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyRules(Virtu
> alNetworkApplianceManagerImpl.java:3915)
>> at
> com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyUserData(Vi
> rtualNetworkApplianceManagerImpl.java:3118)
>> at sun.reflect.GeneratedMethodAccessor472.invoke(Unknown
>> Source) ...
>> 2014-09-11 08:55:29,755 DEBUG [c.c.a.ApiServlet]
>> (catalina-exec-16:ctx-58e92382 ctx-ad8ddf67) ===END=== 192.168.130.89
>> -- GET
>> command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0
>> &response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418
>> 528731
>> 2014-09-11 08:55:29,798 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Cleaning up resources for
>> the vm VM[User|giannitest] in Starting state
>> 2014-09-11 08:55:29,800 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Sending
>> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
>> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequenc
>> e":false,"vmName":"i-2-86-VM","wait":0}}] }
>> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-6:null) Seq 7-564304058: Processing: { Ans: ,
>> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
>> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Received:
>> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, {
>> StopAnswer } }
>> 2014-09-11 08:55:29,955 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:29,957 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
>> nics for network id=212 on -1
>> 2014-09-11 08:55:30,051 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
>> release
>> NicProfile[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19-null
>> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully released
>> network resources for the vm VM[User|giannitest]
>> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully cleanued up
>> resources for the vm VM[User|giannitest] in Starting state
>> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is
> in avoid set, DeploymentPlanner cannot allocate the VM, returning.
>> 2014-09-11 08:55:30,214 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: 7
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total CPU:
>> 36256 and CPU after applying overprovisioning: 36256
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total RAM:
>> 50639785984 and RAM after applying overprovisioning: 50639785984
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release cpu from host: 7,
>> old used: 26500,reserved: 0, actual total: 36256, total with
>> overprovisioning: 36256; new used: 26000,reserved:0;
>> movedfromreserved: false,moveToReserveredfalse
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release mem from host: 7,
>> old used: 21072183296,reserved: 0, total: 50639785984; new used:
>> 20535312384,reserved:0; movedfromreserved: false,moveToReserveredfalse
>> 2014-09-11 08:55:30,302 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Stopped to Starting with event: StartRequestedvm's original host id:
>> null new host id: null host id before state transition: null
>> 2014-09-11 08:55:30,302 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully transitioned
>> to start state for VM[User|giannitest] reservation id =
>> 4b6c2f8d-a34c-4b86-a0d4-acd5ea87353a
>> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Trying to deploy VM, vm
>> has dcId: 1 and podId: 1
>> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is
> in avoid set, DeploymentPlanner cannot allocate the VM, returning.
>> 2014-09-11 08:55:30,435 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: null
>> 2014-09-11 08:55:30,477 DEBUG [c.c.v.UserVmManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Destroying vm
>> VM[User|giannitest] as it failed to create on Host with Id:null
>> 2014-09-11 08:55:30,609 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Stopped to Error with event: OperationFailedToErrorvm's original host
>> id: null new host id: null host id before state transition: null
>> 2014-09-11 08:55:29,755 DEBUG [c.c.a.ApiServlet]
>> (catalina-exec-16:ctx-58e92382 ctx-ad8ddf67) ===END=== 192.168.130.89
>> -- GET
>> command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0
>> &response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418
>> 528731
>> 2014-09-11 08:55:29,798 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Cleaning up resources for
>> the vm VM[User|giannitest] in Starting state
>> 2014-09-11 08:55:29,800 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Sending
>> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
>> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequenc
>> e":false,"vmName":"i-2-86-VM","wait":0}}] }
>> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-6:null) Seq 7-564304058: Processing: { Ans: ,
>> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
>> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Received:
>> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, {
>> StopAnswer } }
>> 2014-09-11 08:55:29,955 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:29,957 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
>> nics for network id=212 on -1
>> 2014-09-11 08:55:30,051 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
>> release
>> NicProfile[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19-null
>> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully released
>> network resources for the vm VM[User|giannitest]
>> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully cleanued up
>> resources for the vm VM[User|giannitest] in Starting state
>> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is
> in avoid set, DeploymentPlanner cannot allocate the VM, returning.
>> 2014-09-11 08:55:30,214 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: 7
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total CPU:
>> 36256 and CPU after applying overprovisioning: 36256
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total RAM:
>> 50639785984 and RAM after applying overprovisioning: 50639785984
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release cpu from host: 7,
>> old used: 26500,reserved: 0, actual total: 36256, total with
>> overprovisioning: 36256; new used: 26000,reserved:0;
>> movedfromreserved: false,moveToReserveredfalse
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release mem from host: 7,
>> old used: 21072183296,reserved: 0, total: 50639785984; new used:
>> 20535312384,reserved:0; movedfromreserved: false,moveToReserveredfalse
>> 2014-09-11 08:55:30,302 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Stopped to Starting with event: StartRequestedvm's original host id:
>> null new host id: null host id before state transition: null
>> 2014-09-11 08:55:30,302 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully transitioned
>> to start state for VM[User|giannitest] reservation id =
>> 4b6c2f8d-a34c-4b86-a0d4-acd5ea87353a
>> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Trying to deploy VM, vm
>> has dcId: 1 and podId: 1
>> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is
> in avoid set, DeploymentPlanner cannot allocate the VM, returning.
>> 2014-09-11 08:55:30,435 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: null
>> 2014-09-11 08:55:30,477 DEBUG [c.c.v.UserVmManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Destroying vm
>> VM[User|giannitest] as it failed to create on Host with Id:null
>> 2014-09-11 08:55:30,609 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Stopped to Error with event: OperationFailedToErrorvm's original host
>> id: null new host id: null host id before state transition: null
>> 2014-09-11 08:55:30,809 WARN [o.a.c.alerts]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) alertType:: 8 //
>> dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed
>> to deploy Vm with Id: 86, on Host with Id: null
>> 2014-09-11 08:55:30,932 DEBUG [c.c.a.m.AgentManagerImpl]
>> (AgentManager-Handler-1:null) Ping from 6
>> 2014-09-11 08:55:31,078 ERROR [c.c.a.ApiAsyncJobDispatcher]
>> (Job-Executor-55:ctx-b5c34ec7) Unexpected exception while executing
>> org.apache.cloudstack.api.command.user.vm.DeployVMCmd
>> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due
> to insufficient capacity
>> at
> com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:
> 605)
>> at
> org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirt
> ualMachine(VMEntityManagerImpl.java:237)
>> at
> org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deplo
> y(VirtualMachineEntityImpl.java:207)
>> at
> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:35
> 81)
>> at
> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:31
> 61)
>> at
> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:31
> 47)
>> at sun.reflect.GeneratedMethodAccessor587.invoke(Unknown
>> Source) ...
>>
>>
>> Il 01/08/2014 11:44, Geoff Higginbottom ha scritto:
>> Ugo,
>>
>> Login to the VR and tail the messages log then attempt to start the VM,
> you should see various messages re DHCP updating etc in the VR. If you
> don't see the VR update try restarting the network Iain the 'cleanup'
> option, this will create a new VR.
>> Regards
>>
>> Geoff Higginbottom
>> CTO / Cloud Architect
>>
>> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603
>> 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>>
>> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.c
>> om><ma...@shapeblue.com> |
>> www.shapeblue.com<http://www.shapeblue.com><htp://www.shapeblue.com/>
>> | Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
>>
>> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
>> 4HS<x-apple-data-detectors://5>
>>
>>
>> On 1 Aug 2014, at 09:06, "Ugo Vasi"
> <ug...@procne.it>>
> wrote:
>> Hi Geoff,
>> I tried restarting r-29-VM but the problem is still blocking creation of
> new VM in that isolated network.
>> Creating a new VM in another isolated network, it works. Where can I look
> at to find the problem?
>>
>>
>> Il 31/07/2014 21:53, Geoff Higginbottom ha scritto:
>> Ugo,
>>
>> Looks like CS is failing to update the VR with details for the new VM, try
> restarting the VR.
>> Regards
>>
>> Geoff Higginbottom
>> CTO / Cloud Architect
>>
>>
>> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603
>> 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>>
>> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.c
>> om><ma...@shapeblue.com><mailto:geoff.higginbottom
>> @shapeblue.com> |
>> www.shapeblue.com<http://www.shapeblue.com><http://www.shapeblue.com><
>> htp://www.shapeblue.com/>
>>
>> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
>> 4HS<x-apple-data-detectors://37>
>>
>>
>>
>> On 31 Jul 2014, at 15:40, "Ugo Vasi"
> <ug...@procne.it><ma
> ilto:ugo.vasi@procne.it>> wrote:
>> Hi everybody,
>> I installed a CloudStack 4.3.0 system with a manager (in a virtual
> machine), two NFS primary storage, one NFS secondary storare and two host
> agent on ubuntu distribution.
>> The cluster have one advanced zone without security group configuration
> with KVM hipervisors.
>> I create some VM but now does not allow me to create more giving the error
> message "Unable to start a VM due to insufficient capacity".
>> I am sure that the resources (ip, ram, cpu and storage) are enough to
> create new instances. In dashboard I see all ok.
>> >From the management-server.log I see this errors messages (see attachment
> for full version) when I try to deploy a new virtual machine with 1x1GHz
> cpu, 1GB or RAM and 20GB disk space:
>> 2014-07-31 14:59:11,983 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-12:null) Seq 1-684594119: Processing: { Ans: ,
>> MgmtId: 77916390353436, via: 1, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.a
>> gent.api.Answer":{"result":false,"details":"VmDataCommand failed,
>> check agent logs","wait":0}}] }
>> 2014-07-31 14:59:11,983 INFO [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Unable to contact resource.
>> com.cloud.exception.ResourceUnavailableException: Resource
>> [DataCenter:1] is unreachable: Unable to apply userdata and password
>> entry on router
>> 2014-07-31 14:59:12,453 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: 7
>> 2014-07-31 14:59:12,677 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: null
>> 2014-07-31 14:59:12,708 DEBUG [c.c.v.UserVmManagerImpl]
>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Destroying vm
>> VM[User|csweb2] as it failed to create on Host with Id:null
>> 2014-07-31 14:59:12,738 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from
>> :Stopped to Error with event: OperationFailedToErrorvm's original host
>> id: null new host id: null host id before state transition: null
>> 2014-07-31 14:59:12,929 WARN [o.a.c.alerts]
>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) alertType:: 8 //
>> dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed
>> to deploy Vm with Id: 70, on Host with Id: null
>> 2014-07-31 14:59:13,159 ERROR [c.c.a.ApiAsyncJobDispatcher]
>> (Job-Executor-26:ctx-ab3aee38) Unexpected exception while executing
>> org.apache.cloudstack.api.command.user.vm.DeployVMCmd
>> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM
>> due to insufficient capacity Caused by:
>> com.cloud.exception.InsufficientServerCapacityException: Unable to
>> create a deployment for VM[User|csweb2]Scope=interface
>> com.cloud.dc.DataCenter; id=1
>> 2014-07-31 14:59:13,161 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>> (Job-Executor-26:ctx-ab3aee38) Complete async job-783, jobStatus:
>> FAILED, resultCode: 530, result:
>> org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":
>> [],"errorcode":530,"errortext":"Unable to start a VM due to
>> insufficient capacity"}
>> 2014-07-31 14:59:46,280 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-27:ctx-82be396e ctx-41f0cf24) Stopped called on
>> VM[User|csweb2] but the state is Error
>> 2014-07-31 14:59:46,330 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-27:ctx-82be396e ctx-41f0cf24) VM state transitted from
>> :Error to Expunging with event: DestroyRequestedvm's original host id:
>> null new host id: null host id before state transition: null
>>
>> I tried to search in others log file ("VmDataCommand failed, check agent
> logs"), but I don't found nothing...
>> Can anyone Help me?
>>
>> --
>>
>> U g o V a s i
> <ug...@procne.it><ma
> ilto:ugo.vasi@procne.it>>
>> P r o c n e s.r.l >)
>> via Cotonificio 45 33010 Tavagnacco IT
>> phone: +390432486523 fax: +390432486523
>>
>> Le informazioni contenute in questo messaggio sono riservate e
>> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
>> Qualora Lei non fosse la persona a cui il presente messaggio ?
>> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
>> gentilmente comunicazione.
>> Per qualsiasi informazione si prega di contattare
> support@procne.it<ma...@procne.it><mailto
> :support@procne.it> .
>> Rif. D.L. 196/2003
>>
>>
>>
>>
>> <management-server.log>
>> Find out more about ShapeBlue and our range of CloudStack related
>> services
>>
>> IaaS Cloud Design &
>> Build<http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge - rapid IaaS deployment
>> framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Infrastructure
>> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training
>> Courses<http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are intended
> solely for the use of the individual to whom it is addressed. Any views or
> opinions expressed are solely those of the author and do not necessarily
> represent those of Shape Blue Ltd or related companies. If you are not the
> intended recipient of this email, you must neither take any action based
> upon its contents, nor copy or show it to anyone. Please contact the sender
> if you believe you have received this email in error. Shape Blue Ltd is a
> company incorporated in England & Wales. ShapeBlue Services India LLP is a
> company incorporated in India and is operated under license from Shape Blue
> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a
> company registered by The Republic of South Africa and is traded under
> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>
>>
>>
>>
>>
>> --
>>
>> U g o V a s i
> <ug...@procne.it>>
>> P r o c n e s.r.l >)
>> via Cotonificio 45 33010 Tavagnacco IT
>> phone: +390432486523 fax: +390432486523
>>
>> Le informazioni contenute in questo messaggio sono riservate e
>> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
>> Qualora Lei non fosse la persona a cui il presente messaggio ?
>> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
>> gentilmente comunicazione.
>> Per qualsiasi informazione si prega di contattare
> support@procne.it<ma...@procne.it> .
>> Rif. D.L. 196/2003
>>
>>
>>
>>
>>
>> Find out more about ShapeBlue and our range of CloudStack related
>> services
>>
>> IaaS Cloud Design &
>> Build<http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge - rapid IaaS deployment
>> framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Infrastructure
>> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training
>> Courses<http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are intended
> solely for the use of the individual to whom it is addressed. Any views or
> opinions expressed are solely those of the author and do not necessarily
> represent those of Shape Blue Ltd or related companies. If you are not the
> intended recipient of this email, you must neither take any action based
> upon its contents, nor copy or show it to anyone. Please contact the sender
> if you believe you have received this email in error. Shape Blue Ltd is a
> company incorporated in England & Wales. ShapeBlue Services India LLP is a
> company incorporated in India and is operated under license from Shape Blue
> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a
> company registered by The Republic of South Africa and is traded under
> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>
>>
>>
>>
>>
>> --
>>
>> U g o V a s i <ug...@procne.it>>
>> P r o c n e s.r.l >)
>> via Cotonificio 45 33010 Tavagnacco IT
>> phone: +390432486523 fax: +390432486523
>>
>> Le informazioni contenute in questo messaggio sono riservate e
>> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
>> Qualora Lei non fosse la persona a cui il presente messaggio ?
>> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
>> gentilmente comunicazione.
>> Per qualsiasi informazione si prega di contattare
> support@procne.it<ma...@procne.it> .
>> Rif. D.L. 196/2003
>>
>>
>> Find out more about ShapeBlue and our range of CloudStack related
>> services
>>
>> IaaS Cloud Design &
>> Build<http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge - rapid IaaS deployment
>> framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Infrastructure
>> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training
>> Courses<http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are intended
> solely for the use of the individual to whom it is addressed. Any views or
> opinions expressed are solely those of the author and do not necessarily
> represent those of Shape Blue Ltd or related companies. If you are not the
> intended recipient of this email, you must neither take any action based
> upon its contents, nor copy or show it to anyone. Please contact the sender
> if you believe you have received this email in error. Shape Blue Ltd is a
> company incorporated in England & Wales. ShapeBlue Services India LLP is a
> company incorporated in India and is operated under license from Shape Blue
> Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
> and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a
> company registered by The Republic of South Africa and is traded under
> license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>
>>
>>
>
RE: Unable to start a VM due to insufficient capacity
Posted by Matthew Midgett <cl...@trick-solutions.com.INVALID>.
Ugo, I am having an issue just like you. I can deploy the default centos
template but if I try to deploy a iso it looks like its failing in the
network area. I've been reading your emails to Geoff and I have restarted
the network with a clean and that didn't fix my problem. I also restarted
the management servers during this process. I don't know what happed but
ssvm and console quit working. I've spent all day deleting the whole thing
and setting it back up again. Just to find that it's not working.
Now I just saw this in the logs
Cannot delete or update a parent row: a foreign key constraint fails
(`cloud`.`async_job_join_map`, CONSTRAINT
`fk_async_job_join_map__join_job_id` FOREIGN KEY (`join_job_id`) REFERENCES
`async_job` (`id`))
I am running a 2 node haproxy with virtual ip in front of a galera sql
cluster.
I dropped the DB, gave the cloud user more permissions. Deleted everything
and restarted and it's doing this all over again. I am running xenserver 6.2
and acs4.4. I even tried 4.3 again and it started doing the same thing.
-----Original Message-----
From: Ugo Vasi [mailto:ugo.vasi@procne.it]
Sent: Tuesday, September 16, 2014 5:36 AM
To: users@cloudstack.apache.org
Subject: Re: Unable to start a VM due to insufficient capacity
Hi Geoff,
I restarted the network and now I can create new VM without errors.
Now, how can I prevent this issue?
Il 11/09/2014 09:28, Geoff Higginbottom ha scritto:
> Hi Ugo,
>
> Did restarting the network with cleanup option resolve your issue last
time, if yes have you tried the same on this network?
>
> Regards
>
> Geoff Higginbottom
> CTO / Cloud Architect
>
> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603
> 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>
> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.c
> om> | www.shapeblue.com<htp://www.shapeblue.com/> |
> Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
>
> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
> 4HS<x-apple-data-detectors://5>
>
>
> On 11 Sep 2014, at 08:17, "Ugo Vasi"
<ug...@procne.it>> wrote:
>
> Hi Geoff,
> I still have the problem creating new VMs but in another isolated network.
The problem seems to be the same:
>
> 2014-09-11 08:55:27,048 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM is being created in
> podId: 1
> 2014-09-11 08:55:27,050 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Network id=212 is already
> implemented
> 2014-09-11 08:55:27,118 DEBUG [c.c.n.NetworkModelImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
> not supported in the network id=212
> 2014-09-11 08:55:27,122 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
> nics for network id=212 on 1
> 2014-09-11 08:55:27,174 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
> prepare for Nic[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19]
> 2014-09-11 08:55:27,181 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is acquired for
> network id 212 as a part of router startup in
> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Po
> ol(Id))] :
> Dest[Zone(1)-Pod(1)-Cluster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(6
> ))]
> 2014-09-11 08:55:27,183 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is released for
> network id 212 as a part of router startup in
> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Po
> ol(Id))] :
> Dest[Zone(1)-Pod(1)-Cluster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(6
> ))]
> 2014-09-11 08:55:27,189 DEBUG [c.c.n.NetworkModelImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
> not supported in the network id=212
> 2014-09-11 08:55:27,198 DEBUG [c.c.n.NetworkModelImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
> not supported in the network id=212
> 2014-09-11 08:55:27,202 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Applying dhcp entry in
> network Ntwk[212|Guest|8]
> 2014-09-11 08:55:27,215 DEBUG [c.c.a.t.Request]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304056: Sending
> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
> [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:15:76
> :00:0e","vmIpAddress":"10.1.1.19","vmName":"giannitest","defaultRouter
> ":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:15:76:0
> 0:0e","isDefault":true,"executeInSequence":false,"accessDetails":{"rou
> ter.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.name":
> "r-60-VM","router.ip":"169.254.1.230"},"wait":0}}] }
> 2014-09-11 08:55:27,941 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
> (secstorage-1:ctx-327037b2) Zone 1 is ready to launch secondary
> storage VM
> 2014-09-11 08:55:28,022 DEBUG [c.c.c.ConsoleProxyManagerImpl]
> (consoleproxy-1:ctx-a8ba3b1e) Zone 1 is ready to launch console proxy
> 2014-09-11 08:55:28,820 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-16:ctx-58e92382) ===START=== 192.168.130.89 -- GET
> command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0
> &response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418
> 528731
> 2014-09-11 08:55:29,069 DEBUG [c.c.a.t.Request]
> (AgentManager-Handler-13:null) Seq 7-564304056: Processing: { Ans: ,
> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
> 2014-09-11 08:55:29,069 DEBUG [c.c.a.t.Request]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304056: Received:
> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { Answer
> } }
> 2014-09-11 08:55:29,075 DEBUG [c.c.n.NetworkModelImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
> not supported in the network id=212
> 2014-09-11 08:55:29,078 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Applying userdata and
> password entry in network Ntwk[212|Guest|8]
> 2014-09-11 08:55:29,089 DEBUG [c.c.a.t.Request]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304057: Sending
> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
> [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"1
> 0.1.1.19","vmName":"giannitest","executeInSequence":false,"accessDetai
> ls":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","rout
> er.ip":"169.254.1.230","router.name":"r-60-VM"},"wait":0}},{"com.cloud
> .agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.19","vmName":
> "giannitest","executeInSequence":false,"accessDetails":{"router.guest.
> ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.1.2
> 30","router.name":"r-60-VM"},"wait":0}}] }
> 2014-09-11 08:55:29,399 DEBUG [c.c.a.t.Request]
> (AgentManager-Handler-10:null) Seq 7-564304057: Processing: { Ans: ,
> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.a
> gent.api.Answer":{"result":false,"details":"VmDataCommand failed,
> check agent logs","wait":0}}] }
> 2014-09-11 08:55:29,491 DEBUG [c.c.a.t.Request]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304057: Received:
> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { Answer,
> Answer } }
> 2014-09-11 08:55:29,491 INFO [c.c.v.VirtualMachineManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Unable to contact resource.
> com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1]
is unreachable: Unable to apply userdata and password entry on router
> at
com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyRules(Virtu
alNetworkApplianceManagerImpl.java:3915)
> at
com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyUserData(Vi
rtualNetworkApplianceManagerImpl.java:3118)
> at sun.reflect.GeneratedMethodAccessor472.invoke(Unknown
> Source) ...
> 2014-09-11 08:55:29,755 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-16:ctx-58e92382 ctx-ad8ddf67) ===END=== 192.168.130.89
> -- GET
> command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0
> &response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418
> 528731
> 2014-09-11 08:55:29,798 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Cleaning up resources for
> the vm VM[User|giannitest] in Starting state
> 2014-09-11 08:55:29,800 DEBUG [c.c.a.t.Request]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Sending
> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequenc
> e":false,"vmName":"i-2-86-VM","wait":0}}] }
> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
> (AgentManager-Handler-6:null) Seq 7-564304058: Processing: { Ans: ,
> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Received:
> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, {
> StopAnswer } }
> 2014-09-11 08:55:29,955 DEBUG [c.c.n.NetworkModelImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
> not supported in the network id=212
> 2014-09-11 08:55:29,957 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
> nics for network id=212 on -1
> 2014-09-11 08:55:30,051 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
> release
> NicProfile[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19-null
> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully released
> network resources for the vm VM[User|giannitest]
> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully cleanued up
> resources for the vm VM[User|giannitest] in Starting state
> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
> clusters: [], hosts: [7]
> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is
in avoid set, DeploymentPlanner cannot allocate the VM, returning.
> 2014-09-11 08:55:30,214 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
> :Starting to Stopped with event: OperationFailedvm's original host id:
> null new host id: null host id before state transition: 7
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total CPU:
> 36256 and CPU after applying overprovisioning: 36256
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total RAM:
> 50639785984 and RAM after applying overprovisioning: 50639785984
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release cpu from host: 7,
> old used: 26500,reserved: 0, actual total: 36256, total with
> overprovisioning: 36256; new used: 26000,reserved:0;
> movedfromreserved: false,moveToReserveredfalse
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release mem from host: 7,
> old used: 21072183296,reserved: 0, total: 50639785984; new used:
> 20535312384,reserved:0; movedfromreserved: false,moveToReserveredfalse
> 2014-09-11 08:55:30,302 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
> :Stopped to Starting with event: StartRequestedvm's original host id:
> null new host id: null host id before state transition: null
> 2014-09-11 08:55:30,302 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully transitioned
> to start state for VM[User|giannitest] reservation id =
> 4b6c2f8d-a34c-4b86-a0d4-acd5ea87353a
> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Trying to deploy VM, vm
> has dcId: 1 and podId: 1
> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
> clusters: [], hosts: [7]
> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
> clusters: [], hosts: [7]
> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is
in avoid set, DeploymentPlanner cannot allocate the VM, returning.
> 2014-09-11 08:55:30,435 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
> :Starting to Stopped with event: OperationFailedvm's original host id:
> null new host id: null host id before state transition: null
> 2014-09-11 08:55:30,477 DEBUG [c.c.v.UserVmManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Destroying vm
> VM[User|giannitest] as it failed to create on Host with Id:null
> 2014-09-11 08:55:30,609 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
> :Stopped to Error with event: OperationFailedToErrorvm's original host
> id: null new host id: null host id before state transition: null
> 2014-09-11 08:55:29,755 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-16:ctx-58e92382 ctx-ad8ddf67) ===END=== 192.168.130.89
> -- GET
> command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0
> &response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418
> 528731
> 2014-09-11 08:55:29,798 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Cleaning up resources for
> the vm VM[User|giannitest] in Starting state
> 2014-09-11 08:55:29,800 DEBUG [c.c.a.t.Request]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Sending
> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequenc
> e":false,"vmName":"i-2-86-VM","wait":0}}] }
> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
> (AgentManager-Handler-6:null) Seq 7-564304058: Processing: { Ans: ,
> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Received:
> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, {
> StopAnswer } }
> 2014-09-11 08:55:29,955 DEBUG [c.c.n.NetworkModelImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
> not supported in the network id=212
> 2014-09-11 08:55:29,957 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
> nics for network id=212 on -1
> 2014-09-11 08:55:30,051 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
> release
> NicProfile[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19-null
> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully released
> network resources for the vm VM[User|giannitest]
> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully cleanued up
> resources for the vm VM[User|giannitest] in Starting state
> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
> clusters: [], hosts: [7]
> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is
in avoid set, DeploymentPlanner cannot allocate the VM, returning.
> 2014-09-11 08:55:30,214 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
> :Starting to Stopped with event: OperationFailedvm's original host id:
> null new host id: null host id before state transition: 7
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total CPU:
> 36256 and CPU after applying overprovisioning: 36256
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total RAM:
> 50639785984 and RAM after applying overprovisioning: 50639785984
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release cpu from host: 7,
> old used: 26500,reserved: 0, actual total: 36256, total with
> overprovisioning: 36256; new used: 26000,reserved:0;
> movedfromreserved: false,moveToReserveredfalse
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release mem from host: 7,
> old used: 21072183296,reserved: 0, total: 50639785984; new used:
> 20535312384,reserved:0; movedfromreserved: false,moveToReserveredfalse
> 2014-09-11 08:55:30,302 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
> :Stopped to Starting with event: StartRequestedvm's original host id:
> null new host id: null host id before state transition: null
> 2014-09-11 08:55:30,302 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully transitioned
> to start state for VM[User|giannitest] reservation id =
> 4b6c2f8d-a34c-4b86-a0d4-acd5ea87353a
> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Trying to deploy VM, vm
> has dcId: 1 and podId: 1
> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
> clusters: [], hosts: [7]
> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
> clusters: [], hosts: [7]
> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is
in avoid set, DeploymentPlanner cannot allocate the VM, returning.
> 2014-09-11 08:55:30,435 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
> :Starting to Stopped with event: OperationFailedvm's original host id:
> null new host id: null host id before state transition: null
> 2014-09-11 08:55:30,477 DEBUG [c.c.v.UserVmManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Destroying vm
> VM[User|giannitest] as it failed to create on Host with Id:null
> 2014-09-11 08:55:30,609 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
> :Stopped to Error with event: OperationFailedToErrorvm's original host
> id: null new host id: null host id before state transition: null
> 2014-09-11 08:55:30,809 WARN [o.a.c.alerts]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) alertType:: 8 //
> dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed
> to deploy Vm with Id: 86, on Host with Id: null
> 2014-09-11 08:55:30,932 DEBUG [c.c.a.m.AgentManagerImpl]
> (AgentManager-Handler-1:null) Ping from 6
> 2014-09-11 08:55:31,078 ERROR [c.c.a.ApiAsyncJobDispatcher]
> (Job-Executor-55:ctx-b5c34ec7) Unexpected exception while executing
> org.apache.cloudstack.api.command.user.vm.DeployVMCmd
> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due
to insufficient capacity
> at
com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:
605)
> at
org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirt
ualMachine(VMEntityManagerImpl.java:237)
> at
org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deplo
y(VirtualMachineEntityImpl.java:207)
> at
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:35
81)
> at
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:31
61)
> at
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:31
47)
> at sun.reflect.GeneratedMethodAccessor587.invoke(Unknown
> Source) ...
>
>
> Il 01/08/2014 11:44, Geoff Higginbottom ha scritto:
> Ugo,
>
> Login to the VR and tail the messages log then attempt to start the VM,
you should see various messages re DHCP updating etc in the VR. If you
don't see the VR update try restarting the network Iain the 'cleanup'
option, this will create a new VR.
>
> Regards
>
> Geoff Higginbottom
> CTO / Cloud Architect
>
> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603
> 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>
> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.c
> om><ma...@shapeblue.com> |
> www.shapeblue.com<http://www.shapeblue.com><htp://www.shapeblue.com/>
> | Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
>
> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
> 4HS<x-apple-data-detectors://5>
>
>
> On 1 Aug 2014, at 09:06, "Ugo Vasi"
<ug...@procne.it>>
wrote:
>
> Hi Geoff,
> I tried restarting r-29-VM but the problem is still blocking creation of
new VM in that isolated network.
>
> Creating a new VM in another isolated network, it works. Where can I look
at to find the problem?
>
>
>
> Il 31/07/2014 21:53, Geoff Higginbottom ha scritto:
> Ugo,
>
> Looks like CS is failing to update the VR with details for the new VM, try
restarting the VR.
>
> Regards
>
> Geoff Higginbottom
> CTO / Cloud Architect
>
>
> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603
> 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>
> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.c
> om><ma...@shapeblue.com><mailto:geoff.higginbottom
> @shapeblue.com> |
> www.shapeblue.com<http://www.shapeblue.com><http://www.shapeblue.com><
> htp://www.shapeblue.com/>
>
> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
> 4HS<x-apple-data-detectors://37>
>
>
>
> On 31 Jul 2014, at 15:40, "Ugo Vasi"
<ug...@procne.it><ma
ilto:ugo.vasi@procne.it>> wrote:
>
> Hi everybody,
> I installed a CloudStack 4.3.0 system with a manager (in a virtual
machine), two NFS primary storage, one NFS secondary storare and two host
agent on ubuntu distribution.
>
> The cluster have one advanced zone without security group configuration
with KVM hipervisors.
>
> I create some VM but now does not allow me to create more giving the error
message "Unable to start a VM due to insufficient capacity".
>
> I am sure that the resources (ip, ram, cpu and storage) are enough to
create new instances. In dashboard I see all ok.
>
> >From the management-server.log I see this errors messages (see attachment
for full version) when I try to deploy a new virtual machine with 1x1GHz
cpu, 1GB or RAM and 20GB disk space:
>
> 2014-07-31 14:59:11,983 DEBUG [c.c.a.t.Request]
> (AgentManager-Handler-12:null) Seq 1-684594119: Processing: { Ans: ,
> MgmtId: 77916390353436, via: 1, Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.a
> gent.api.Answer":{"result":false,"details":"VmDataCommand failed,
> check agent logs","wait":0}}] }
> 2014-07-31 14:59:11,983 INFO [c.c.v.VirtualMachineManagerImpl]
(Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Unable to contact resource.
> com.cloud.exception.ResourceUnavailableException: Resource
> [DataCenter:1] is unreachable: Unable to apply userdata and password
> entry on router
> 2014-07-31 14:59:12,453 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from
> :Starting to Stopped with event: OperationFailedvm's original host id:
> null new host id: null host id before state transition: 7
> 2014-07-31 14:59:12,677 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from
> :Starting to Stopped with event: OperationFailedvm's original host id:
> null new host id: null host id before state transition: null
> 2014-07-31 14:59:12,708 DEBUG [c.c.v.UserVmManagerImpl]
> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Destroying vm
> VM[User|csweb2] as it failed to create on Host with Id:null
> 2014-07-31 14:59:12,738 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from
> :Stopped to Error with event: OperationFailedToErrorvm's original host
> id: null new host id: null host id before state transition: null
> 2014-07-31 14:59:12,929 WARN [o.a.c.alerts]
> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) alertType:: 8 //
> dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed
> to deploy Vm with Id: 70, on Host with Id: null
> 2014-07-31 14:59:13,159 ERROR [c.c.a.ApiAsyncJobDispatcher]
> (Job-Executor-26:ctx-ab3aee38) Unexpected exception while executing
> org.apache.cloudstack.api.command.user.vm.DeployVMCmd
> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM
> due to insufficient capacity Caused by:
> com.cloud.exception.InsufficientServerCapacityException: Unable to
> create a deployment for VM[User|csweb2]Scope=interface
> com.cloud.dc.DataCenter; id=1
> 2014-07-31 14:59:13,161 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (Job-Executor-26:ctx-ab3aee38) Complete async job-783, jobStatus:
> FAILED, resultCode: 530, result:
> org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":
> [],"errorcode":530,"errortext":"Unable to start a VM due to
> insufficient capacity"}
> 2014-07-31 14:59:46,280 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-27:ctx-82be396e ctx-41f0cf24) Stopped called on
> VM[User|csweb2] but the state is Error
> 2014-07-31 14:59:46,330 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-27:ctx-82be396e ctx-41f0cf24) VM state transitted from
> :Error to Expunging with event: DestroyRequestedvm's original host id:
> null new host id: null host id before state transition: null
>
> I tried to search in others log file ("VmDataCommand failed, check agent
logs"), but I don't found nothing...
>
> Can anyone Help me?
>
> --
>
> U g o V a s i
<ug...@procne.it><ma
ilto:ugo.vasi@procne.it>>
> P r o c n e s.r.l >)
> via Cotonificio 45 33010 Tavagnacco IT
> phone: +390432486523 fax: +390432486523
>
> Le informazioni contenute in questo messaggio sono riservate e
> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
> Qualora Lei non fosse la persona a cui il presente messaggio ?
> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
> gentilmente comunicazione.
> Per qualsiasi informazione si prega di contattare
support@procne.it<ma...@procne.it><mailto
:support@procne.it> .
> Rif. D.L. 196/2003
>
>
>
>
> <management-server.log>
> Find out more about ShapeBlue and our range of CloudStack related
> services
>
> IaaS Cloud Design &
> Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge - rapid IaaS deployment
> framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Infrastructure
> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training
> Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended
solely for the use of the individual to whom it is addressed. Any views or
opinions expressed are solely those of the author and do not necessarily
represent those of Shape Blue Ltd or related companies. If you are not the
intended recipient of this email, you must neither take any action based
upon its contents, nor copy or show it to anyone. Please contact the sender
if you believe you have received this email in error. Shape Blue Ltd is a
company incorporated in England & Wales. ShapeBlue Services India LLP is a
company incorporated in India and is operated under license from Shape Blue
Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a
company registered by The Republic of South Africa and is traded under
license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>
>
>
>
>
>
> --
>
> U g o V a s i
<ug...@procne.it>>
> P r o c n e s.r.l >)
> via Cotonificio 45 33010 Tavagnacco IT
> phone: +390432486523 fax: +390432486523
>
> Le informazioni contenute in questo messaggio sono riservate e
> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
> Qualora Lei non fosse la persona a cui il presente messaggio ?
> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
> gentilmente comunicazione.
> Per qualsiasi informazione si prega di contattare
support@procne.it<ma...@procne.it> .
> Rif. D.L. 196/2003
>
>
>
>
>
> Find out more about ShapeBlue and our range of CloudStack related
> services
>
> IaaS Cloud Design &
> Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge - rapid IaaS deployment
> framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Infrastructure
> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training
> Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended
solely for the use of the individual to whom it is addressed. Any views or
opinions expressed are solely those of the author and do not necessarily
represent those of Shape Blue Ltd or related companies. If you are not the
intended recipient of this email, you must neither take any action based
upon its contents, nor copy or show it to anyone. Please contact the sender
if you believe you have received this email in error. Shape Blue Ltd is a
company incorporated in England & Wales. ShapeBlue Services India LLP is a
company incorporated in India and is operated under license from Shape Blue
Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a
company registered by The Republic of South Africa and is traded under
license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>
>
>
>
>
>
> --
>
> U g o V a s i <ug...@procne.it>>
> P r o c n e s.r.l >)
> via Cotonificio 45 33010 Tavagnacco IT
> phone: +390432486523 fax: +390432486523
>
> Le informazioni contenute in questo messaggio sono riservate e
> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
> Qualora Lei non fosse la persona a cui il presente messaggio ?
> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
> gentilmente comunicazione.
> Per qualsiasi informazione si prega di contattare
support@procne.it<ma...@procne.it> .
> Rif. D.L. 196/2003
>
>
> Find out more about ShapeBlue and our range of CloudStack related
> services
>
> IaaS Cloud Design &
> Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge - rapid IaaS deployment
> framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Infrastructure
> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training
> Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended
solely for the use of the individual to whom it is addressed. Any views or
opinions expressed are solely those of the author and do not necessarily
represent those of Shape Blue Ltd or related companies. If you are not the
intended recipient of this email, you must neither take any action based
upon its contents, nor copy or show it to anyone. Please contact the sender
if you believe you have received this email in error. Shape Blue Ltd is a
company incorporated in England & Wales. ShapeBlue Services India LLP is a
company incorporated in India and is operated under license from Shape Blue
Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil
and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a
company registered by The Republic of South Africa and is traded under
license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>
>
>
>
--
U g o V a s i <ug...@procne.it>
P r o c n e s.r.l >)
via Cotonificio 45 33010 Tavagnacco IT
phone: +390432486523 fax: +390432486523
Le informazioni contenute in questo messaggio sono riservate e confidenziali
ed è vietata la diffusione in qualunque modo eseguita.
Qualora Lei non fosse la persona a cui il presente messaggio è destinato, La
invitiamo ad eliminarlo e a non leggerlo, dandocene gentilmente
comunicazione.
Per qualsiasi informazione si prega di contattare support@procne.it .
Rif. D.L. 196/2003
Re: Unable to start a VM due to insufficient capacity
Posted by Ugo Vasi <ug...@procne.it>.
Hi Geoff,
I restarted the network and now I can create new VM without errors.
Now, how can I prevent this issue?
Il 11/09/2014 09:28, Geoff Higginbottom ha scritto:
> Hi Ugo,
>
> Did restarting the network with cleanup option resolve your issue last time, if yes have you tried the same on this network?
>
> Regards
>
> Geoff Higginbottom
> CTO / Cloud Architect
>
> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>
> geoff.higginbottom@shapeblue.com<ma...@shapeblue.com> | www.shapeblue.com<htp://www.shapeblue.com/> | Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
>
> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N 4HS<x-apple-data-detectors://5>
>
>
> On 11 Sep 2014, at 08:17, "Ugo Vasi" <ug...@procne.it>> wrote:
>
> Hi Geoff,
> I still have the problem creating new VMs but in another isolated network. The problem seems to be the same:
>
> 2014-09-11 08:55:27,048 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM is being created in podId: 1
> 2014-09-11 08:55:27,050 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Network id=212 is already implemented
> 2014-09-11 08:55:27,118 DEBUG [c.c.n.NetworkModelImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not supported in the network id=212
> 2014-09-11 08:55:27,122 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of nics for network id=212 on 1
> 2014-09-11 08:55:27,174 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to prepare for Nic[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19]
> 2014-09-11 08:55:27,181 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is acquired for network id 212 as a part of router startup in Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(6))]
> 2014-09-11 08:55:27,183 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is released for network id 212 as a part of router startup in Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(6))]
> 2014-09-11 08:55:27,189 DEBUG [c.c.n.NetworkModelImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not supported in the network id=212
> 2014-09-11 08:55:27,198 DEBUG [c.c.n.NetworkModelImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not supported in the network id=212
> 2014-09-11 08:55:27,202 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Applying dhcp entry in network Ntwk[212|Guest|8]
> 2014-09-11 08:55:27,215 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304056: Sending { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:15:76:00:0e","vmIpAddress":"10.1.1.19","vmName":"giannitest","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:15:76:00:0e","isDefault":true,"executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.name":"r-60-VM","router.ip":"169.254.1.230"},"wait":0}}] }
> 2014-09-11 08:55:27,941 DEBUG [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-327037b2) Zone 1 is ready to launch secondary storage VM
> 2014-09-11 08:55:28,022 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-a8ba3b1e) Zone 1 is ready to launch console proxy
> 2014-09-11 08:55:28,820 DEBUG [c.c.a.ApiServlet] (catalina-exec-16:ctx-58e92382) ===START=== 192.168.130.89 -- GET command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0&response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418528731
> 2014-09-11 08:55:29,069 DEBUG [c.c.a.t.Request] (AgentManager-Handler-13:null) Seq 7-564304056: Processing: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
> 2014-09-11 08:55:29,069 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304056: Received: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { Answer } }
> 2014-09-11 08:55:29,075 DEBUG [c.c.n.NetworkModelImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not supported in the network id=212
> 2014-09-11 08:55:29,078 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Applying userdata and password entry in network Ntwk[212|Guest|8]
> 2014-09-11 08:55:29,089 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304057: Sending { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"10.1.1.19","vmName":"giannitest","executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.1.230","router.name":"r-60-VM"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.19","vmName":"giannitest","executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.1.230","router.name":"r-60-VM"},"wait":0}}] }
> 2014-09-11 08:55:29,399 DEBUG [c.c.a.t.Request] (AgentManager-Handler-10:null) Seq 7-564304057: Processing: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":false,"details":"VmDataCommand failed, check agent logs","wait":0}}] }
> 2014-09-11 08:55:29,491 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304057: Received: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { Answer, Answer } }
> 2014-09-11 08:55:29,491 INFO [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Unable to contact resource.
> com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is unreachable: Unable to apply userdata and password entry on router
> at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyRules(VirtualNetworkApplianceManagerImpl.java:3915)
> at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyUserData(VirtualNetworkApplianceManagerImpl.java:3118)
> at sun.reflect.GeneratedMethodAccessor472.invoke(Unknown Source)
> ...
> 2014-09-11 08:55:29,755 DEBUG [c.c.a.ApiServlet] (catalina-exec-16:ctx-58e92382 ctx-ad8ddf67) ===END=== 192.168.130.89 -- GET command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0&response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418528731
> 2014-09-11 08:55:29,798 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Cleaning up resources for the vm VM[User|giannitest] in Starting state
> 2014-09-11 08:55:29,800 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Sending { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"i-2-86-VM","wait":0}}] }
> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request] (AgentManager-Handler-6:null) Seq 7-564304058: Processing: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Received: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { StopAnswer } }
> 2014-09-11 08:55:29,955 DEBUG [c.c.n.NetworkModelImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not supported in the network id=212
> 2014-09-11 08:55:29,957 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of nics for network id=212 on -1
> 2014-09-11 08:55:30,051 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to release NicProfile[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19-null
> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully released network resources for the vm VM[User|giannitest]
> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully cleanued up resources for the vm VM[User|giannitest] in Starting state
> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [], clusters: [], hosts: [7]
> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
> 2014-09-11 08:55:30,214 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 7
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total CPU: 36256 and CPU after applying overprovisioning: 36256
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total RAM: 50639785984 and RAM after applying overprovisioning: 50639785984
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release cpu from host: 7, old used: 26500,reserved: 0, actual total: 36256, total with overprovisioning: 36256; new used: 26000,reserved:0; movedfromreserved: false,moveToReserveredfalse
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release mem from host: 7, old used: 21072183296,reserved: 0, total: 50639785984; new used: 20535312384,reserved:0; movedfromreserved: false,moveToReserveredfalse
> 2014-09-11 08:55:30,302 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
> 2014-09-11 08:55:30,302 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully transitioned to start state for VM[User|giannitest] reservation id = 4b6c2f8d-a34c-4b86-a0d4-acd5ea87353a
> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Trying to deploy VM, vm has dcId: 1 and podId: 1
> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [], clusters: [], hosts: [7]
> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [], clusters: [], hosts: [7]
> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
> 2014-09-11 08:55:30,435 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
> 2014-09-11 08:55:30,477 DEBUG [c.c.v.UserVmManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Destroying vm VM[User|giannitest] as it failed to create on Host with Id:null
> 2014-09-11 08:55:30,609 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Stopped to Error with event: OperationFailedToErrorvm's original host id: null new host id: null host id before state transition: null
> 2014-09-11 08:55:29,755 DEBUG [c.c.a.ApiServlet] (catalina-exec-16:ctx-58e92382 ctx-ad8ddf67) ===END=== 192.168.130.89 -- GET command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0&response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418528731
> 2014-09-11 08:55:29,798 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Cleaning up resources for the vm VM[User|giannitest] in Starting state
> 2014-09-11 08:55:29,800 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Sending { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"i-2-86-VM","wait":0}}] }
> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request] (AgentManager-Handler-6:null) Seq 7-564304058: Processing: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Received: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { StopAnswer } }
> 2014-09-11 08:55:29,955 DEBUG [c.c.n.NetworkModelImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not supported in the network id=212
> 2014-09-11 08:55:29,957 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of nics for network id=212 on -1
> 2014-09-11 08:55:30,051 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to release NicProfile[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19-null
> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully released network resources for the vm VM[User|giannitest]
> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully cleanued up resources for the vm VM[User|giannitest] in Starting state
> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [], clusters: [], hosts: [7]
> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
> 2014-09-11 08:55:30,214 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 7
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total CPU: 36256 and CPU after applying overprovisioning: 36256
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total RAM: 50639785984 and RAM after applying overprovisioning: 50639785984
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release cpu from host: 7, old used: 26500,reserved: 0, actual total: 36256, total with overprovisioning: 36256; new used: 26000,reserved:0; movedfromreserved: false,moveToReserveredfalse
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release mem from host: 7, old used: 21072183296,reserved: 0, total: 50639785984; new used: 20535312384,reserved:0; movedfromreserved: false,moveToReserveredfalse
> 2014-09-11 08:55:30,302 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
> 2014-09-11 08:55:30,302 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully transitioned to start state for VM[User|giannitest] reservation id = 4b6c2f8d-a34c-4b86-a0d4-acd5ea87353a
> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Trying to deploy VM, vm has dcId: 1 and podId: 1
> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [], clusters: [], hosts: [7]
> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [], clusters: [], hosts: [7]
> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
> 2014-09-11 08:55:30,435 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
> 2014-09-11 08:55:30,477 DEBUG [c.c.v.UserVmManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Destroying vm VM[User|giannitest] as it failed to create on Host with Id:null
> 2014-09-11 08:55:30,609 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Stopped to Error with event: OperationFailedToErrorvm's original host id: null new host id: null host id before state transition: null
> 2014-09-11 08:55:30,809 WARN [o.a.c.alerts] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) alertType:: 8 // dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed to deploy Vm with Id: 86, on Host with Id: null
> 2014-09-11 08:55:30,932 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-1:null) Ping from 6
> 2014-09-11 08:55:31,078 ERROR [c.c.a.ApiAsyncJobDispatcher] (Job-Executor-55:ctx-b5c34ec7) Unexpected exception while executing org.apache.cloudstack.api.command.user.vm.DeployVMCmd
> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due to insufficient capacity
> at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:605)
> at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:237)
> at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:207)
> at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3581)
> at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3161)
> at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3147)
> at sun.reflect.GeneratedMethodAccessor587.invoke(Unknown Source)
> ...
>
>
> Il 01/08/2014 11:44, Geoff Higginbottom ha scritto:
> Ugo,
>
> Login to the VR and tail the messages log then attempt to start the VM, you should see various messages re DHCP updating etc in the VR. If you don't see the VR update try restarting the network Iain the 'cleanup' option, this will create a new VR.
>
> Regards
>
> Geoff Higginbottom
> CTO / Cloud Architect
>
> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>
> geoff.higginbottom@shapeblue.com<ma...@shapeblue.com> | www.shapeblue.com<http://www.shapeblue.com><htp://www.shapeblue.com/> | Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
>
> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N 4HS<x-apple-data-detectors://5>
>
>
> On 1 Aug 2014, at 09:06, "Ugo Vasi" <ug...@procne.it>> wrote:
>
> Hi Geoff,
> I tried restarting r-29-VM but the problem is still blocking creation of new VM in that isolated network.
>
> Creating a new VM in another isolated network, it works. Where can I look at to find the problem?
>
>
>
> Il 31/07/2014 21:53, Geoff Higginbottom ha scritto:
> Ugo,
>
> Looks like CS is failing to update the VR with details for the new VM, try restarting the VR.
>
> Regards
>
> Geoff Higginbottom
> CTO / Cloud Architect
>
>
> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>
> geoff.higginbottom@shapeblue.com<ma...@shapeblue.com> | www.shapeblue.com<http://www.shapeblue.com><http://www.shapeblue.com><htp://www.shapeblue.com/>
>
> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N 4HS<x-apple-data-detectors://37>
>
>
>
> On 31 Jul 2014, at 15:40, "Ugo Vasi" <ug...@procne.it>> wrote:
>
> Hi everybody,
> I installed a CloudStack 4.3.0 system with a manager (in a virtual machine), two NFS primary storage, one NFS secondary storare and two host agent on ubuntu distribution.
>
> The cluster have one advanced zone without security group configuration with KVM hipervisors.
>
> I create some VM but now does not allow me to create more giving the error message "Unable to start a VM due to insufficient capacity".
>
> I am sure that the resources (ip, ram, cpu and storage) are enough to create new instances. In dashboard I see all ok.
>
> >From the management-server.log I see this errors messages (see attachment for full version) when I try to deploy a new virtual machine with 1x1GHz cpu, 1GB or RAM and 20GB disk space:
>
> 2014-07-31 14:59:11,983 DEBUG [c.c.a.t.Request] (AgentManager-Handler-12:null) Seq 1-684594119: Processing: { Ans: , MgmtId: 77916390353436, via: 1, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":false,"details":"VmDataCommand failed, check agent logs","wait":0}}] }
> 2014-07-31 14:59:11,983 INFO [c.c.v.VirtualMachineManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Unable to contact resource.
> com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is unreachable: Unable to apply userdata and password entry on router
> 2014-07-31 14:59:12,453 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 7
> 2014-07-31 14:59:12,677 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
> 2014-07-31 14:59:12,708 DEBUG [c.c.v.UserVmManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Destroying vm VM[User|csweb2] as it failed to create on Host with Id:null
> 2014-07-31 14:59:12,738 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from :Stopped to Error with event: OperationFailedToErrorvm's original host id: null new host id: null host id before state transition: null
> 2014-07-31 14:59:12,929 WARN [o.a.c.alerts] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) alertType:: 8 // dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed to deploy Vm with Id: 70, on Host with Id: null
> 2014-07-31 14:59:13,159 ERROR [c.c.a.ApiAsyncJobDispatcher] (Job-Executor-26:ctx-ab3aee38) Unexpected exception while executing org.apache.cloudstack.api.command.user.vm.DeployVMCmd
> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due to insufficient capacity
> Caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|csweb2]Scope=interface com.cloud.dc.DataCenter; id=1
> 2014-07-31 14:59:13,161 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Job-Executor-26:ctx-ab3aee38) Complete async job-783, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable to start a VM due to insufficient capacity"}
> 2014-07-31 14:59:46,280 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-27:ctx-82be396e ctx-41f0cf24) Stopped called on VM[User|csweb2] but the state is Error
> 2014-07-31 14:59:46,330 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-27:ctx-82be396e ctx-41f0cf24) VM state transitted from :Error to Expunging with event: DestroyRequestedvm's original host id: null new host id: null host id before state transition: null
>
> I tried to search in others log file ("VmDataCommand failed, check agent logs"), but I don't found nothing...
>
> Can anyone Help me?
>
> --
>
> U g o V a s i <ug...@procne.it>>
> P r o c n e s.r.l >)
> via Cotonificio 45 33010 Tavagnacco IT
> phone: +390432486523 fax: +390432486523
>
> Le informazioni contenute in questo messaggio sono riservate e
> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
> Qualora Lei non fosse la persona a cui il presente messaggio ?
> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
> gentilmente comunicazione.
> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
> Rif. D.L. 196/2003
>
>
>
>
> <management-server.log>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge - rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>
>
>
>
>
>
> --
>
> U g o V a s i <ug...@procne.it>>
> P r o c n e s.r.l >)
> via Cotonificio 45 33010 Tavagnacco IT
> phone: +390432486523 fax: +390432486523
>
> Le informazioni contenute in questo messaggio sono riservate e
> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
> Qualora Lei non fosse la persona a cui il presente messaggio ?
> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
> gentilmente comunicazione.
> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
> Rif. D.L. 196/2003
>
>
>
>
>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge - rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>
>
>
>
>
>
> --
>
> U g o V a s i <ug...@procne.it>>
> P r o c n e s.r.l >)
> via Cotonificio 45 33010 Tavagnacco IT
> phone: +390432486523 fax: +390432486523
>
> Le informazioni contenute in questo messaggio sono riservate e
> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
> Qualora Lei non fosse la persona a cui il presente messaggio ?
> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
> gentilmente comunicazione.
> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
> Rif. D.L. 196/2003
>
>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge - rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>
>
>
>
--
U g o V a s i <ug...@procne.it>
P r o c n e s.r.l >)
via Cotonificio 45 33010 Tavagnacco IT
phone: +390432486523 fax: +390432486523
Le informazioni contenute in questo messaggio sono riservate e
confidenziali ed è vietata la diffusione in qualunque modo eseguita.
Qualora Lei non fosse la persona a cui il presente messaggio è
destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
gentilmente comunicazione.
Per qualsiasi informazione si prega di contattare support@procne.it .
Rif. D.L. 196/2003
Re: Unable to start a VM due to insufficient capacity
Posted by Ugo Vasi <ug...@procne.it>.
Hi Geoff,
I used this URL:
http://download.cloud.com/templates/4.3/systemvm64template-2014-01-14-master-kvm.qcow2.bz2
Il 06/10/2014 12:55, Geoff Higginbottom ha scritto:
> Hi Ugo,
>
> What system VM template did you use? (exact download URL please)
>
> Regards
>
> Geoff Higginbottom
>
> D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
>
> geoff.higginbottom@shapeblue.com
>
> -----Original Message-----
> From: Ugo Vasi [mailto:ugo.vasi@procne.it]
> Sent: 06 October 2014 10:57
> To: users@cloudstack.apache.org
> Subject: Re: Unable to start a VM due to insufficient capacity
>
> Hi Geoff,
> the problem is occurring in different networks (all?) that are not changed.
>
> For us is a big problem because I can not predict when it occurs and the creation of new machines is blocked until a network restarts (this method, among other things, cause a small interruption of service).
>
> What can I do to fix the problem?
>
>
> Il 11/09/2014 09:28, Geoff Higginbottom ha scritto:
>> Hi Ugo,
>>
>> Did restarting the network with cleanup option resolve your issue last time, if yes have you tried the same on this network?
>>
>> Regards
>>
>> Geoff Higginbottom
>> CTO / Cloud Architect
>>
>> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603
>> 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>>
>> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.c
>> om> | www.shapeblue.com<htp://www.shapeblue.com/> |
>> Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
>>
>> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
>> 4HS<x-apple-data-detectors://5>
>>
>>
>> On 11 Sep 2014, at 08:17, "Ugo Vasi" <ug...@procne.it>> wrote:
>>
>> Hi Geoff,
>> I still have the problem creating new VMs but in another isolated network. The problem seems to be the same:
>>
>> 2014-09-11 08:55:27,048 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM is being created in
>> podId: 1
>> 2014-09-11 08:55:27,050 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Network id=212 is already
>> implemented
>> 2014-09-11 08:55:27,118 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:27,122 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
>> nics for network id=212 on 1
>> 2014-09-11 08:55:27,174 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
>> prepare for Nic[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19]
>> 2014-09-11 08:55:27,181 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is acquired for
>> network id 212 as a part of router startup in
>> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Po
>> ol(Id))] :
>> Dest[Zone(1)-Pod(1)-Cluster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(6
>> ))]
>> 2014-09-11 08:55:27,183 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is released for
>> network id 212 as a part of router startup in
>> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Po
>> ol(Id))] :
>> Dest[Zone(1)-Pod(1)-Cluster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(6
>> ))]
>> 2014-09-11 08:55:27,189 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:27,198 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:27,202 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Applying dhcp entry in
>> network Ntwk[212|Guest|8]
>> 2014-09-11 08:55:27,215 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304056: Sending
>> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
>> [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:15:76
>> :00:0e","vmIpAddress":"10.1.1.19","vmName":"giannitest","defaultRouter
>> ":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:15:76:0
>> 0:0e","isDefault":true,"executeInSequence":false,"accessDetails":{"rou
>> ter.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.name":
>> "r-60-VM","router.ip":"169.254.1.230"},"wait":0}}] }
>> 2014-09-11 08:55:27,941 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
>> (secstorage-1:ctx-327037b2) Zone 1 is ready to launch secondary
>> storage VM
>> 2014-09-11 08:55:28,022 DEBUG [c.c.c.ConsoleProxyManagerImpl]
>> (consoleproxy-1:ctx-a8ba3b1e) Zone 1 is ready to launch console proxy
>> 2014-09-11 08:55:28,820 DEBUG [c.c.a.ApiServlet]
>> (catalina-exec-16:ctx-58e92382) ===START=== 192.168.130.89 -- GET
>> command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0
>> &response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418
>> 528731
>> 2014-09-11 08:55:29,069 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-13:null) Seq 7-564304056: Processing: { Ans: ,
>> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
>> 2014-09-11 08:55:29,069 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304056: Received:
>> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { Answer
>> } }
>> 2014-09-11 08:55:29,075 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:29,078 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Applying userdata and
>> password entry in network Ntwk[212|Guest|8]
>> 2014-09-11 08:55:29,089 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304057: Sending
>> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
>> [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"1
>> 0.1.1.19","vmName":"giannitest","executeInSequence":false,"accessDetai
>> ls":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","rout
>> er.ip":"169.254.1.230","router.name":"r-60-VM"},"wait":0}},{"com.cloud
>> .agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.19","vmName":
>> "giannitest","executeInSequence":false,"accessDetails":{"router.guest.
>> ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.1.2
>> 30","router.name":"r-60-VM"},"wait":0}}] }
>> 2014-09-11 08:55:29,399 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-10:null) Seq 7-564304057: Processing: { Ans: ,
>> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.a
>> gent.api.Answer":{"result":false,"details":"VmDataCommand failed,
>> check agent logs","wait":0}}] }
>> 2014-09-11 08:55:29,491 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304057: Received:
>> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { Answer,
>> Answer } }
>> 2014-09-11 08:55:29,491 INFO [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Unable to contact resource.
>> com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is unreachable: Unable to apply userdata and password entry on router
>> at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyRules(VirtualNetworkApplianceManagerImpl.java:3915)
>> at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyUserData(VirtualNetworkApplianceManagerImpl.java:3118)
>> at sun.reflect.GeneratedMethodAccessor472.invoke(Unknown
>> Source) ...
>> 2014-09-11 08:55:29,755 DEBUG [c.c.a.ApiServlet]
>> (catalina-exec-16:ctx-58e92382 ctx-ad8ddf67) ===END=== 192.168.130.89
>> -- GET
>> command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0
>> &response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418
>> 528731
>> 2014-09-11 08:55:29,798 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Cleaning up resources for
>> the vm VM[User|giannitest] in Starting state
>> 2014-09-11 08:55:29,800 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Sending
>> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
>> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequenc
>> e":false,"vmName":"i-2-86-VM","wait":0}}] }
>> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-6:null) Seq 7-564304058: Processing: { Ans: ,
>> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
>> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Received:
>> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, {
>> StopAnswer } }
>> 2014-09-11 08:55:29,955 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:29,957 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
>> nics for network id=212 on -1
>> 2014-09-11 08:55:30,051 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
>> release
>> NicProfile[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19-null
>> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully released
>> network resources for the vm VM[User|giannitest]
>> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully cleanued up
>> resources for the vm VM[User|giannitest] in Starting state
>> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
>> 2014-09-11 08:55:30,214 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: 7
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total CPU:
>> 36256 and CPU after applying overprovisioning: 36256
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total RAM:
>> 50639785984 and RAM after applying overprovisioning: 50639785984
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release cpu from host: 7,
>> old used: 26500,reserved: 0, actual total: 36256, total with
>> overprovisioning: 36256; new used: 26000,reserved:0;
>> movedfromreserved: false,moveToReserveredfalse
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release mem from host: 7,
>> old used: 21072183296,reserved: 0, total: 50639785984; new used:
>> 20535312384,reserved:0; movedfromreserved: false,moveToReserveredfalse
>> 2014-09-11 08:55:30,302 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Stopped to Starting with event: StartRequestedvm's original host id:
>> null new host id: null host id before state transition: null
>> 2014-09-11 08:55:30,302 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully transitioned
>> to start state for VM[User|giannitest] reservation id =
>> 4b6c2f8d-a34c-4b86-a0d4-acd5ea87353a
>> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Trying to deploy VM, vm
>> has dcId: 1 and podId: 1
>> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
>> 2014-09-11 08:55:30,435 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: null
>> 2014-09-11 08:55:30,477 DEBUG [c.c.v.UserVmManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Destroying vm
>> VM[User|giannitest] as it failed to create on Host with Id:null
>> 2014-09-11 08:55:30,609 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Stopped to Error with event: OperationFailedToErrorvm's original host
>> id: null new host id: null host id before state transition: null
>> 2014-09-11 08:55:29,755 DEBUG [c.c.a.ApiServlet]
>> (catalina-exec-16:ctx-58e92382 ctx-ad8ddf67) ===END=== 192.168.130.89
>> -- GET
>> command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0
>> &response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418
>> 528731
>> 2014-09-11 08:55:29,798 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Cleaning up resources for
>> the vm VM[User|giannitest] in Starting state
>> 2014-09-11 08:55:29,800 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Sending
>> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
>> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequenc
>> e":false,"vmName":"i-2-86-VM","wait":0}}] }
>> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-6:null) Seq 7-564304058: Processing: { Ans: ,
>> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
>> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Received:
>> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, {
>> StopAnswer } }
>> 2014-09-11 08:55:29,955 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:29,957 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
>> nics for network id=212 on -1
>> 2014-09-11 08:55:30,051 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
>> release
>> NicProfile[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19-null
>> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully released
>> network resources for the vm VM[User|giannitest]
>> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully cleanued up
>> resources for the vm VM[User|giannitest] in Starting state
>> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
>> 2014-09-11 08:55:30,214 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: 7
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total CPU:
>> 36256 and CPU after applying overprovisioning: 36256
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total RAM:
>> 50639785984 and RAM after applying overprovisioning: 50639785984
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release cpu from host: 7,
>> old used: 26500,reserved: 0, actual total: 36256, total with
>> overprovisioning: 36256; new used: 26000,reserved:0;
>> movedfromreserved: false,moveToReserveredfalse
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release mem from host: 7,
>> old used: 21072183296,reserved: 0, total: 50639785984; new used:
>> 20535312384,reserved:0; movedfromreserved: false,moveToReserveredfalse
>> 2014-09-11 08:55:30,302 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Stopped to Starting with event: StartRequestedvm's original host id:
>> null new host id: null host id before state transition: null
>> 2014-09-11 08:55:30,302 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully transitioned
>> to start state for VM[User|giannitest] reservation id =
>> 4b6c2f8d-a34c-4b86-a0d4-acd5ea87353a
>> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Trying to deploy VM, vm
>> has dcId: 1 and podId: 1
>> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
>> 2014-09-11 08:55:30,435 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: null
>> 2014-09-11 08:55:30,477 DEBUG [c.c.v.UserVmManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Destroying vm
>> VM[User|giannitest] as it failed to create on Host with Id:null
>> 2014-09-11 08:55:30,609 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Stopped to Error with event: OperationFailedToErrorvm's original host
>> id: null new host id: null host id before state transition: null
>> 2014-09-11 08:55:30,809 WARN [o.a.c.alerts]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) alertType:: 8 //
>> dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed
>> to deploy Vm with Id: 86, on Host with Id: null
>> 2014-09-11 08:55:30,932 DEBUG [c.c.a.m.AgentManagerImpl]
>> (AgentManager-Handler-1:null) Ping from 6
>> 2014-09-11 08:55:31,078 ERROR [c.c.a.ApiAsyncJobDispatcher]
>> (Job-Executor-55:ctx-b5c34ec7) Unexpected exception while executing
>> org.apache.cloudstack.api.command.user.vm.DeployVMCmd
>> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due to insufficient capacity
>> at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:605)
>> at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:237)
>> at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:207)
>> at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3581)
>> at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3161)
>> at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3147)
>> at sun.reflect.GeneratedMethodAccessor587.invoke(Unknown
>> Source) ...
>>
>>
>> Il 01/08/2014 11:44, Geoff Higginbottom ha scritto:
>> Ugo,
>>
>> Login to the VR and tail the messages log then attempt to start the VM, you should see various messages re DHCP updating etc in the VR. If you don't see the VR update try restarting the network Iain the 'cleanup' option, this will create a new VR.
>>
>> Regards
>>
>> Geoff Higginbottom
>> CTO / Cloud Architect
>>
>> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603
>> 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>>
>> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.c
>> om><ma...@shapeblue.com> |
>> www.shapeblue.com<http://www.shapeblue.com><htp://www.shapeblue.com/>
>> | Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
>>
>> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
>> 4HS<x-apple-data-detectors://5>
>>
>>
>> On 1 Aug 2014, at 09:06, "Ugo Vasi" <ug...@procne.it>> wrote:
>>
>> Hi Geoff,
>> I tried restarting r-29-VM but the problem is still blocking creation of new VM in that isolated network.
>>
>> Creating a new VM in another isolated network, it works. Where can I look at to find the problem?
>>
>>
>>
>> Il 31/07/2014 21:53, Geoff Higginbottom ha scritto:
>> Ugo,
>>
>> Looks like CS is failing to update the VR with details for the new VM, try restarting the VR.
>>
>> Regards
>>
>> Geoff Higginbottom
>> CTO / Cloud Architect
>>
>>
>> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603
>> 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>>
>> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.c
>> om><ma...@shapeblue.com><mailto:geoff.higginbottom
>> @shapeblue.com> |
>> www.shapeblue.com<http://www.shapeblue.com><http://www.shapeblue.com><
>> htp://www.shapeblue.com/>
>>
>> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
>> 4HS<x-apple-data-detectors://37>
>>
>>
>>
>> On 31 Jul 2014, at 15:40, "Ugo Vasi" <ug...@procne.it>> wrote:
>>
>> Hi everybody,
>> I installed a CloudStack 4.3.0 system with a manager (in a virtual machine), two NFS primary storage, one NFS secondary storare and two host agent on ubuntu distribution.
>>
>> The cluster have one advanced zone without security group configuration with KVM hipervisors.
>>
>> I create some VM but now does not allow me to create more giving the error message "Unable to start a VM due to insufficient capacity".
>>
>> I am sure that the resources (ip, ram, cpu and storage) are enough to create new instances. In dashboard I see all ok.
>>
>> >From the management-server.log I see this errors messages (see attachment for full version) when I try to deploy a new virtual machine with 1x1GHz cpu, 1GB or RAM and 20GB disk space:
>>
>> 2014-07-31 14:59:11,983 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-12:null) Seq 1-684594119: Processing: { Ans: ,
>> MgmtId: 77916390353436, via: 1, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.a
>> gent.api.Answer":{"result":false,"details":"VmDataCommand failed,
>> check agent logs","wait":0}}] }
>> 2014-07-31 14:59:11,983 INFO [c.c.v.VirtualMachineManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Unable to contact resource.
>> com.cloud.exception.ResourceUnavailableException: Resource
>> [DataCenter:1] is unreachable: Unable to apply userdata and password
>> entry on router
>> 2014-07-31 14:59:12,453 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: 7
>> 2014-07-31 14:59:12,677 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: null
>> 2014-07-31 14:59:12,708 DEBUG [c.c.v.UserVmManagerImpl]
>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Destroying vm
>> VM[User|csweb2] as it failed to create on Host with Id:null
>> 2014-07-31 14:59:12,738 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from
>> :Stopped to Error with event: OperationFailedToErrorvm's original host
>> id: null new host id: null host id before state transition: null
>> 2014-07-31 14:59:12,929 WARN [o.a.c.alerts]
>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) alertType:: 8 //
>> dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed
>> to deploy Vm with Id: 70, on Host with Id: null
>> 2014-07-31 14:59:13,159 ERROR [c.c.a.ApiAsyncJobDispatcher]
>> (Job-Executor-26:ctx-ab3aee38) Unexpected exception while executing
>> org.apache.cloudstack.api.command.user.vm.DeployVMCmd
>> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM
>> due to insufficient capacity Caused by:
>> com.cloud.exception.InsufficientServerCapacityException: Unable to
>> create a deployment for VM[User|csweb2]Scope=interface
>> com.cloud.dc.DataCenter; id=1
>> 2014-07-31 14:59:13,161 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>> (Job-Executor-26:ctx-ab3aee38) Complete async job-783, jobStatus:
>> FAILED, resultCode: 530, result:
>> org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":
>> [],"errorcode":530,"errortext":"Unable to start a VM due to
>> insufficient capacity"}
>> 2014-07-31 14:59:46,280 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-27:ctx-82be396e ctx-41f0cf24) Stopped called on
>> VM[User|csweb2] but the state is Error
>> 2014-07-31 14:59:46,330 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-27:ctx-82be396e ctx-41f0cf24) VM state transitted from
>> :Error to Expunging with event: DestroyRequestedvm's original host id:
>> null new host id: null host id before state transition: null
>>
>> I tried to search in others log file ("VmDataCommand failed, check agent logs"), but I don't found nothing...
>>
>> Can anyone Help me?
>>
>> --
>>
>> U g o V a s i <ug...@procne.it>>
>> P r o c n e s.r.l >)
>> via Cotonificio 45 33010 Tavagnacco IT
>> phone: +390432486523 fax: +390432486523
>>
>> Le informazioni contenute in questo messaggio sono riservate e
>> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
>> Qualora Lei non fosse la persona a cui il presente messaggio ?
>> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
>> gentilmente comunicazione.
>> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
>> Rif. D.L. 196/2003
>>
>>
>>
>>
>> <management-server.log>
>> Find out more about ShapeBlue and our range of CloudStack related
>> services
>>
>> IaaS Cloud Design &
>> Build<http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge - rapid IaaS deployment
>> framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Infrastructure
>> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training
>> Courses<http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>
>>
>>
>>
>>
>>
>> --
>>
>> U g o V a s i <ug...@procne.it>>
>> P r o c n e s.r.l >)
>> via Cotonificio 45 33010 Tavagnacco IT
>> phone: +390432486523 fax: +390432486523
>>
>> Le informazioni contenute in questo messaggio sono riservate e
>> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
>> Qualora Lei non fosse la persona a cui il presente messaggio ?
>> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
>> gentilmente comunicazione.
>> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
>> Rif. D.L. 196/2003
>>
>>
>>
>>
>>
>> Find out more about ShapeBlue and our range of CloudStack related
>> services
>>
>> IaaS Cloud Design &
>> Build<http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge - rapid IaaS deployment
>> framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Infrastructure
>> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training
>> Courses<http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>
>>
>>
>>
>>
>>
>> --
>>
>> U g o V a s i <ug...@procne.it>>
>> P r o c n e s.r.l >)
>> via Cotonificio 45 33010 Tavagnacco IT
>> phone: +390432486523 fax: +390432486523
>>
>> Le informazioni contenute in questo messaggio sono riservate e
>> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
>> Qualora Lei non fosse la persona a cui il presente messaggio ?
>> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
>> gentilmente comunicazione.
>> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
>> Rif. D.L. 196/2003
>>
>>
>> Find out more about ShapeBlue and our range of CloudStack related
>> services
>>
>> IaaS Cloud Design &
>> Build<http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge - rapid IaaS deployment
>> framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Infrastructure
>> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training
>> Courses<http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>
>>
>>
>>
>
> --
>
> U g o V a s i <ug...@procne.it>
> P r o c n e s.r.l >)
> via Cotonificio 45 33010 Tavagnacco IT
> phone: +390432486523 fax: +390432486523
>
> Le informazioni contenute in questo messaggio sono riservate e confidenziali ed è vietata la diffusione in qualunque modo eseguita.
> Qualora Lei non fosse la persona a cui il presente messaggio è destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene gentilmente comunicazione.
> Per qualsiasi informazione si prega di contattare support@procne.it .
> Rif. D.L. 196/2003
>
>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>
>
>
--
U g o V a s i <ug...@procne.it>
P r o c n e s.r.l >)
via Cotonificio 45 33010 Tavagnacco IT
phone: +390432486523 fax: +390432486523
Le informazioni contenute in questo messaggio sono riservate e
confidenziali ed è vietata la diffusione in qualunque modo eseguita.
Qualora Lei non fosse la persona a cui il presente messaggio è
destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
gentilmente comunicazione.
Per qualsiasi informazione si prega di contattare support@procne.it .
Rif. D.L. 196/2003
Re: Unable to start a VM due to insufficient capacity
Posted by Ugo Vasi <ug...@procne.it>.
Hi Geoff,
so I can try adding some CPU and RAM to router VM. Can I monitor system
VM resources?
Thanks
Il 19/02/2015 16:16, Geoff Higginbottom ha scritto:
> HI Ugo,
>
> Unfortunately we still continue to run into this problem on a regular basis.
>
> I've had some success increasing the RAM & CPU allocations to the VR, especially where I was starting a large number of VMs which were all requesting new Passwords from the VR and causing it to lock up.
>
> Regards
>
> Geoff Higginbottom
>
> D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
>
> geoff.higginbottom@shapeblue.com
>
> -----Original Message-----
> From: Ugo Vasi [mailto:ugo.vasi@procne.it]
> Sent: 19 February 2015 14:09
> To: users@cloudstack.apache.org
> Subject: Re: Unable to start a VM due to insufficient capacity
>
> Hi Geoff,
> we continue to find the problem on networks in a (seemingly) random.
>
> The only solution is to do the cleaning of the network by hand, but it is not a good method, because it is not automatic and freeze for a moment all hosts on the network.
>
> I would understand if this problem is related to version 4.3.0 or if it's been fixed in some later version.
>
>
> thanks
>
>
> Il 06/10/2014 12:55, Geoff Higginbottom ha scritto:
>> Hi Ugo,
>>
>> What system VM template did you use? (exact download URL please)
>>
>> Regards
>>
>> Geoff Higginbottom
>>
>> D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
>>
>> geoff.higginbottom@shapeblue.com
>>
>> -----Original Message-----
>> From: Ugo Vasi [mailto:ugo.vasi@procne.it]
>> Sent: 06 October 2014 10:57
>> To: users@cloudstack.apache.org
>> Subject: Re: Unable to start a VM due to insufficient capacity
>>
>> Hi Geoff,
>> the problem is occurring in different networks (all?) that are not changed.
>>
>> For us is a big problem because I can not predict when it occurs and the creation of new machines is blocked until a network restarts (this method, among other things, cause a small interruption of service).
>>
>> What can I do to fix the problem?
>>
>>
>> Il 11/09/2014 09:28, Geoff Higginbottom ha scritto:
>>> Hi Ugo,
>>>
>>> Did restarting the network with cleanup option resolve your issue last time, if yes have you tried the same on this network?
>>>
>>> Regards
>>>
>>> Geoff Higginbottom
>>> CTO / Cloud Architect
>>>
>>> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603
>>> 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>>>
>>> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.c
>>> om> | www.shapeblue.com<htp://www.shapeblue.com/> |
>>> Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
>>>
>>> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
>>> 4HS<x-apple-data-detectors://5>
>>>
>>>
>>> On 11 Sep 2014, at 08:17, "Ugo Vasi" <ug...@procne.it>> wrote:
>>>
>>> Hi Geoff,
>>> I still have the problem creating new VMs but in another isolated network. The problem seems to be the same:
>>>
>>> 2014-09-11 08:55:27,048 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM is being created in
>>> podId: 1
>>> 2014-09-11 08:55:27,050 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Network id=212 is already
>>> implemented
>>> 2014-09-11 08:55:27,118 DEBUG [c.c.n.NetworkModelImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>>> not supported in the network id=212
>>> 2014-09-11 08:55:27,122 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
>>> nics for network id=212 on 1
>>> 2014-09-11 08:55:27,174 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
>>> prepare for Nic[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19]
>>> 2014-09-11 08:55:27,181 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is acquired for
>>> network id 212 as a part of router startup in
>>> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Po
>>> ol(Id))] :
>>> Dest[Zone(1)-Pod(1)-Cluster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(6
>>> ))]
>>> 2014-09-11 08:55:27,183 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is released for
>>> network id 212 as a part of router startup in
>>> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Po
>>> ol(Id))] :
>>> Dest[Zone(1)-Pod(1)-Cluster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(6
>>> ))]
>>> 2014-09-11 08:55:27,189 DEBUG [c.c.n.NetworkModelImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>>> not supported in the network id=212
>>> 2014-09-11 08:55:27,198 DEBUG [c.c.n.NetworkModelImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>>> not supported in the network id=212
>>> 2014-09-11 08:55:27,202 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Applying dhcp entry in
>>> network Ntwk[212|Guest|8]
>>> 2014-09-11 08:55:27,215 DEBUG [c.c.a.t.Request]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304056: Sending
>>> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
>>> [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:15:76
>>> :00:0e","vmIpAddress":"10.1.1.19","vmName":"giannitest","defaultRouter
>>> ":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:15:76:0
>>> 0:0e","isDefault":true,"executeInSequence":false,"accessDetails":{"rou
>>> ter.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.name":
>>> "r-60-VM","router.ip":"169.254.1.230"},"wait":0}}] }
>>> 2014-09-11 08:55:27,941 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
>>> (secstorage-1:ctx-327037b2) Zone 1 is ready to launch secondary
>>> storage VM
>>> 2014-09-11 08:55:28,022 DEBUG [c.c.c.ConsoleProxyManagerImpl]
>>> (consoleproxy-1:ctx-a8ba3b1e) Zone 1 is ready to launch console proxy
>>> 2014-09-11 08:55:28,820 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-16:ctx-58e92382) ===START=== 192.168.130.89 -- GET
>>> command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0
>>> &response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418
>>> 528731
>>> 2014-09-11 08:55:29,069 DEBUG [c.c.a.t.Request]
>>> (AgentManager-Handler-13:null) Seq 7-564304056: Processing: { Ans: ,
>>> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
>>> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
>>> 2014-09-11 08:55:29,069 DEBUG [c.c.a.t.Request]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304056: Received:
>>> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { Answer
>>> } }
>>> 2014-09-11 08:55:29,075 DEBUG [c.c.n.NetworkModelImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>>> not supported in the network id=212
>>> 2014-09-11 08:55:29,078 DEBUG
>>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Applying userdata and
>>> password entry in network Ntwk[212|Guest|8]
>>> 2014-09-11 08:55:29,089 DEBUG [c.c.a.t.Request]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304057: Sending
>>> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
>>> [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"1
>>> 0.1.1.19","vmName":"giannitest","executeInSequence":false,"accessDetai
>>> ls":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","rout
>>> er.ip":"169.254.1.230","router.name":"r-60-VM"},"wait":0}},{"com.cloud
>>> .agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.19","vmName":
>>> "giannitest","executeInSequence":false,"accessDetails":{"router.guest.
>>> ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.1.2
>>> 30","router.name":"r-60-VM"},"wait":0}}] }
>>> 2014-09-11 08:55:29,399 DEBUG [c.c.a.t.Request]
>>> (AgentManager-Handler-10:null) Seq 7-564304057: Processing: { Ans: ,
>>> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
>>> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.a
>>> gent.api.Answer":{"result":false,"details":"VmDataCommand failed,
>>> check agent logs","wait":0}}] }
>>> 2014-09-11 08:55:29,491 DEBUG [c.c.a.t.Request]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304057: Received:
>>> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { Answer,
>>> Answer } }
>>> 2014-09-11 08:55:29,491 INFO [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Unable to contact resource.
>>> com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is unreachable: Unable to apply userdata and password entry on router
>>> at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyRules(VirtualNetworkApplianceManagerImpl.java:3915)
>>> at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyUserData(VirtualNetworkApplianceManagerImpl.java:3118)
>>> at sun.reflect.GeneratedMethodAccessor472.invoke(Unknown
>>> Source) ...
>>> 2014-09-11 08:55:29,755 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-16:ctx-58e92382 ctx-ad8ddf67) ===END=== 192.168.130.89
>>> -- GET
>>> command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0
>>> &response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418
>>> 528731
>>> 2014-09-11 08:55:29,798 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Cleaning up resources for
>>> the vm VM[User|giannitest] in Starting state
>>> 2014-09-11 08:55:29,800 DEBUG [c.c.a.t.Request]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Sending
>>> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
>>> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequenc
>>> e":false,"vmName":"i-2-86-VM","wait":0}}] }
>>> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
>>> (AgentManager-Handler-6:null) Seq 7-564304058: Processing: { Ans: ,
>>> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
>>> [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
>>> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Received:
>>> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, {
>>> StopAnswer } }
>>> 2014-09-11 08:55:29,955 DEBUG [c.c.n.NetworkModelImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>>> not supported in the network id=212
>>> 2014-09-11 08:55:29,957 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
>>> nics for network id=212 on -1
>>> 2014-09-11 08:55:30,051 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
>>> release
>>> NicProfile[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19-null
>>> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully released
>>> network resources for the vm VM[User|giannitest]
>>> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully cleanued up
>>> resources for the vm VM[User|giannitest] in Starting state
>>> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>>> clusters: [], hosts: [7]
>>> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
>>> 2014-09-11 08:55:30,214 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>>> :Starting to Stopped with event: OperationFailedvm's original host id:
>>> null new host id: null host id before state transition: 7
>>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total CPU:
>>> 36256 and CPU after applying overprovisioning: 36256
>>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total RAM:
>>> 50639785984 and RAM after applying overprovisioning: 50639785984
>>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release cpu from host: 7,
>>> old used: 26500,reserved: 0, actual total: 36256, total with
>>> overprovisioning: 36256; new used: 26000,reserved:0;
>>> movedfromreserved: false,moveToReserveredfalse
>>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release mem from host: 7,
>>> old used: 21072183296,reserved: 0, total: 50639785984; new used:
>>> 20535312384,reserved:0; movedfromreserved: false,moveToReserveredfalse
>>> 2014-09-11 08:55:30,302 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>>> :Stopped to Starting with event: StartRequestedvm's original host id:
>>> null new host id: null host id before state transition: null
>>> 2014-09-11 08:55:30,302 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully transitioned
>>> to start state for VM[User|giannitest] reservation id =
>>> 4b6c2f8d-a34c-4b86-a0d4-acd5ea87353a
>>> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Trying to deploy VM, vm
>>> has dcId: 1 and podId: 1
>>> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>>> clusters: [], hosts: [7]
>>> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>>> clusters: [], hosts: [7]
>>> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
>>> 2014-09-11 08:55:30,435 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>>> :Starting to Stopped with event: OperationFailedvm's original host id:
>>> null new host id: null host id before state transition: null
>>> 2014-09-11 08:55:30,477 DEBUG [c.c.v.UserVmManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Destroying vm
>>> VM[User|giannitest] as it failed to create on Host with Id:null
>>> 2014-09-11 08:55:30,609 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>>> :Stopped to Error with event: OperationFailedToErrorvm's original host
>>> id: null new host id: null host id before state transition: null
>>> 2014-09-11 08:55:29,755 DEBUG [c.c.a.ApiServlet]
>>> (catalina-exec-16:ctx-58e92382 ctx-ad8ddf67) ===END=== 192.168.130.89
>>> -- GET
>>> command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0
>>> &response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418
>>> 528731
>>> 2014-09-11 08:55:29,798 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Cleaning up resources for
>>> the vm VM[User|giannitest] in Starting state
>>> 2014-09-11 08:55:29,800 DEBUG [c.c.a.t.Request]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Sending
>>> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
>>> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequenc
>>> e":false,"vmName":"i-2-86-VM","wait":0}}] }
>>> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
>>> (AgentManager-Handler-6:null) Seq 7-564304058: Processing: { Ans: ,
>>> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
>>> [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
>>> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Received:
>>> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, {
>>> StopAnswer } }
>>> 2014-09-11 08:55:29,955 DEBUG [c.c.n.NetworkModelImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>>> not supported in the network id=212
>>> 2014-09-11 08:55:29,957 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
>>> nics for network id=212 on -1
>>> 2014-09-11 08:55:30,051 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
>>> release
>>> NicProfile[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19-null
>>> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully released
>>> network resources for the vm VM[User|giannitest]
>>> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully cleanued up
>>> resources for the vm VM[User|giannitest] in Starting state
>>> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>>> clusters: [], hosts: [7]
>>> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
>>> 2014-09-11 08:55:30,214 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>>> :Starting to Stopped with event: OperationFailedvm's original host id:
>>> null new host id: null host id before state transition: 7
>>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total CPU:
>>> 36256 and CPU after applying overprovisioning: 36256
>>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total RAM:
>>> 50639785984 and RAM after applying overprovisioning: 50639785984
>>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release cpu from host: 7,
>>> old used: 26500,reserved: 0, actual total: 36256, total with
>>> overprovisioning: 36256; new used: 26000,reserved:0;
>>> movedfromreserved: false,moveToReserveredfalse
>>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release mem from host: 7,
>>> old used: 21072183296,reserved: 0, total: 50639785984; new used:
>>> 20535312384,reserved:0; movedfromreserved: false,moveToReserveredfalse
>>> 2014-09-11 08:55:30,302 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>>> :Stopped to Starting with event: StartRequestedvm's original host id:
>>> null new host id: null host id before state transition: null
>>> 2014-09-11 08:55:30,302 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully transitioned
>>> to start state for VM[User|giannitest] reservation id =
>>> 4b6c2f8d-a34c-4b86-a0d4-acd5ea87353a
>>> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Trying to deploy VM, vm
>>> has dcId: 1 and podId: 1
>>> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>>> clusters: [], hosts: [7]
>>> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>>> clusters: [], hosts: [7]
>>> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
>>> 2014-09-11 08:55:30,435 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>>> :Starting to Stopped with event: OperationFailedvm's original host id:
>>> null new host id: null host id before state transition: null
>>> 2014-09-11 08:55:30,477 DEBUG [c.c.v.UserVmManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Destroying vm
>>> VM[User|giannitest] as it failed to create on Host with Id:null
>>> 2014-09-11 08:55:30,609 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>>> :Stopped to Error with event: OperationFailedToErrorvm's original host
>>> id: null new host id: null host id before state transition: null
>>> 2014-09-11 08:55:30,809 WARN [o.a.c.alerts]
>>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) alertType:: 8 //
>>> dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed
>>> to deploy Vm with Id: 86, on Host with Id: null
>>> 2014-09-11 08:55:30,932 DEBUG [c.c.a.m.AgentManagerImpl]
>>> (AgentManager-Handler-1:null) Ping from 6
>>> 2014-09-11 08:55:31,078 ERROR [c.c.a.ApiAsyncJobDispatcher]
>>> (Job-Executor-55:ctx-b5c34ec7) Unexpected exception while executing
>>> org.apache.cloudstack.api.command.user.vm.DeployVMCmd
>>> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due to insufficient capacity
>>> at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:605)
>>> at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:237)
>>> at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:207)
>>> at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3581)
>>> at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3161)
>>> at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3147)
>>> at sun.reflect.GeneratedMethodAccessor587.invoke(Unknown
>>> Source) ...
>>>
>>>
>>> Il 01/08/2014 11:44, Geoff Higginbottom ha scritto:
>>> Ugo,
>>>
>>> Login to the VR and tail the messages log then attempt to start the VM, you should see various messages re DHCP updating etc in the VR. If you don't see the VR update try restarting the network Iain the 'cleanup' option, this will create a new VR.
>>>
>>> Regards
>>>
>>> Geoff Higginbottom
>>> CTO / Cloud Architect
>>>
>>> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603
>>> 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>>>
>>> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.c
>>> om><ma...@shapeblue.com> |
>>> www.shapeblue.com<http://www.shapeblue.com><htp://www.shapeblue.com/>
>>> | Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
>>>
>>> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
>>> 4HS<x-apple-data-detectors://5>
>>>
>>>
>>> On 1 Aug 2014, at 09:06, "Ugo Vasi" <ug...@procne.it>> wrote:
>>>
>>> Hi Geoff,
>>> I tried restarting r-29-VM but the problem is still blocking creation of new VM in that isolated network.
>>>
>>> Creating a new VM in another isolated network, it works. Where can I look at to find the problem?
>>>
>>>
>>>
>>> Il 31/07/2014 21:53, Geoff Higginbottom ha scritto:
>>> Ugo,
>>>
>>> Looks like CS is failing to update the VR with details for the new VM, try restarting the VR.
>>>
>>> Regards
>>>
>>> Geoff Higginbottom
>>> CTO / Cloud Architect
>>>
>>>
>>> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603
>>> 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>>>
>>> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.c
>>> om><ma...@shapeblue.com><mailto:geoff.higginbottom
>>> @shapeblue.com> |
>>> www.shapeblue.com<http://www.shapeblue.com><http://www.shapeblue.com><
>>> htp://www.shapeblue.com/>
>>>
>>> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
>>> 4HS<x-apple-data-detectors://37>
>>>
>>>
>>>
>>> On 31 Jul 2014, at 15:40, "Ugo Vasi" <ug...@procne.it>> wrote:
>>>
>>> Hi everybody,
>>> I installed a CloudStack 4.3.0 system with a manager (in a virtual machine), two NFS primary storage, one NFS secondary storare and two host agent on ubuntu distribution.
>>>
>>> The cluster have one advanced zone without security group configuration with KVM hipervisors.
>>>
>>> I create some VM but now does not allow me to create more giving the error message "Unable to start a VM due to insufficient capacity".
>>>
>>> I am sure that the resources (ip, ram, cpu and storage) are enough to create new instances. In dashboard I see all ok.
>>>
>>> >From the management-server.log I see this errors messages (see attachment for full version) when I try to deploy a new virtual machine with 1x1GHz cpu, 1GB or RAM and 20GB disk space:
>>>
>>> 2014-07-31 14:59:11,983 DEBUG [c.c.a.t.Request]
>>> (AgentManager-Handler-12:null) Seq 1-684594119: Processing: { Ans: ,
>>> MgmtId: 77916390353436, via: 1, Ver: v1, Flags: 10,
>>> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.a
>>> gent.api.Answer":{"result":false,"details":"VmDataCommand failed,
>>> check agent logs","wait":0}}] }
>>> 2014-07-31 14:59:11,983 INFO [c.c.v.VirtualMachineManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Unable to contact resource.
>>> com.cloud.exception.ResourceUnavailableException: Resource
>>> [DataCenter:1] is unreachable: Unable to apply userdata and password
>>> entry on router
>>> 2014-07-31 14:59:12,453 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from
>>> :Starting to Stopped with event: OperationFailedvm's original host id:
>>> null new host id: null host id before state transition: 7
>>> 2014-07-31 14:59:12,677 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from
>>> :Starting to Stopped with event: OperationFailedvm's original host id:
>>> null new host id: null host id before state transition: null
>>> 2014-07-31 14:59:12,708 DEBUG [c.c.v.UserVmManagerImpl]
>>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Destroying vm
>>> VM[User|csweb2] as it failed to create on Host with Id:null
>>> 2014-07-31 14:59:12,738 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from
>>> :Stopped to Error with event: OperationFailedToErrorvm's original host
>>> id: null new host id: null host id before state transition: null
>>> 2014-07-31 14:59:12,929 WARN [o.a.c.alerts]
>>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) alertType:: 8 //
>>> dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed
>>> to deploy Vm with Id: 70, on Host with Id: null
>>> 2014-07-31 14:59:13,159 ERROR [c.c.a.ApiAsyncJobDispatcher]
>>> (Job-Executor-26:ctx-ab3aee38) Unexpected exception while executing
>>> org.apache.cloudstack.api.command.user.vm.DeployVMCmd
>>> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM
>>> due to insufficient capacity Caused by:
>>> com.cloud.exception.InsufficientServerCapacityException: Unable to
>>> create a deployment for VM[User|csweb2]Scope=interface
>>> com.cloud.dc.DataCenter; id=1
>>> 2014-07-31 14:59:13,161 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> (Job-Executor-26:ctx-ab3aee38) Complete async job-783, jobStatus:
>>> FAILED, resultCode: 530, result:
>>> org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":
>>> [],"errorcode":530,"errortext":"Unable to start a VM due to
>>> insufficient capacity"}
>>> 2014-07-31 14:59:46,280 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> (Job-Executor-27:ctx-82be396e ctx-41f0cf24) Stopped called on
>>> VM[User|csweb2] but the state is Error
>>> 2014-07-31 14:59:46,330 DEBUG [c.c.c.CapacityManagerImpl]
>>> (Job-Executor-27:ctx-82be396e ctx-41f0cf24) VM state transitted from
>>> :Error to Expunging with event: DestroyRequestedvm's original host id:
>>> null new host id: null host id before state transition: null
>>>
>>> I tried to search in others log file ("VmDataCommand failed, check agent logs"), but I don't found nothing...
>>>
>>> Can anyone Help me?
>>>
>>> --
>>>
>>> U g o V a s i <ug...@procne.it>>
>>> P r o c n e s.r.l >)
>>> via Cotonificio 45 33010 Tavagnacco IT
>>> phone: +390432486523 fax: +390432486523
>>>
>>> Le informazioni contenute in questo messaggio sono riservate e
>>> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
>>> Qualora Lei non fosse la persona a cui il presente messaggio ?
>>> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
>>> gentilmente comunicazione.
>>> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
>>> Rif. D.L. 196/2003
>>>
>>>
>>>
>>>
>>> <management-server.log>
>>> Find out more about ShapeBlue and our range of CloudStack related
>>> services
>>>
>>> IaaS Cloud Design &
>>> Build<http://shapeblue.com/iaas-cloud-design-and-build//>
>>> CSForge - rapid IaaS deployment
>>> framework<http://shapeblue.com/csforge/>
>>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>>> CloudStack Infrastructure
>>> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
>>> CloudStack Bootcamp Training
>>> Courses<http://shapeblue.com/cloudstack-training/>
>>>
>>> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>>
>>>
>>>
>>>
>>>
>>>
>>> --
>>>
>>> U g o V a s i <ug...@procne.it>>
>>> P r o c n e s.r.l >)
>>> via Cotonificio 45 33010 Tavagnacco IT
>>> phone: +390432486523 fax: +390432486523
>>>
>>> Le informazioni contenute in questo messaggio sono riservate e
>>> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
>>> Qualora Lei non fosse la persona a cui il presente messaggio ?
>>> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
>>> gentilmente comunicazione.
>>> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
>>> Rif. D.L. 196/2003
>>>
>>>
>>>
>>>
>>>
>>> Find out more about ShapeBlue and our range of CloudStack related
>>> services
>>>
>>> IaaS Cloud Design &
>>> Build<http://shapeblue.com/iaas-cloud-design-and-build//>
>>> CSForge - rapid IaaS deployment
>>> framework<http://shapeblue.com/csforge/>
>>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>>> CloudStack Infrastructure
>>> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
>>> CloudStack Bootcamp Training
>>> Courses<http://shapeblue.com/cloudstack-training/>
>>>
>>> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>>
>>>
>>>
>>>
>>>
>>>
>>> --
>>>
>>> U g o V a s i <ug...@procne.it>>
>>> P r o c n e s.r.l >)
>>> via Cotonificio 45 33010 Tavagnacco IT
>>> phone: +390432486523 fax: +390432486523
>>>
>>> Le informazioni contenute in questo messaggio sono riservate e
>>> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
>>> Qualora Lei non fosse la persona a cui il presente messaggio ?
>>> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
>>> gentilmente comunicazione.
>>> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
>>> Rif. D.L. 196/2003
>>>
>>>
>>> Find out more about ShapeBlue and our range of CloudStack related
>>> services
>>>
>>> IaaS Cloud Design &
>>> Build<http://shapeblue.com/iaas-cloud-design-and-build//>
>>> CSForge - rapid IaaS deployment
>>> framework<http://shapeblue.com/csforge/>
>>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>>> CloudStack Infrastructure
>>> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
>>> CloudStack Bootcamp Training
>>> Courses<http://shapeblue.com/cloudstack-training/>
>>>
>>> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>>
>>>
>>>
>>>
>> --
>>
>> U g o V a s i <ug...@procne.it>
>> P r o c n e s.r.l >)
>> via Cotonificio 45 33010 Tavagnacco IT
>> phone: +390432486523 fax: +390432486523
>>
>> Le informazioni contenute in questo messaggio sono riservate e confidenziali ed è vietata la diffusione in qualunque modo eseguita.
>> Qualora Lei non fosse la persona a cui il presente messaggio è destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene gentilmente comunicazione.
>> Per qualsiasi informazione si prega di contattare support@procne.it .
>> Rif. D.L. 196/2003
>>
>>
>> Find out more about ShapeBlue and our range of CloudStack related services
>>
>> IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>
>>
>>
>
> --
>
> U g o V a s i <ug...@procne.it>
> P r o c n e s.r.l >)
> via Cotonificio 45 33010 Tavagnacco IT
> phone: +390432486523 fax: +390432486523
>
> Le informazioni contenute in questo messaggio sono riservate e
> confidenziali ed è vietata la diffusione in qualunque modo eseguita.
> Qualora Lei non fosse la persona a cui il presente messaggio è
> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
> gentilmente comunicazione.
> Per qualsiasi informazione si prega di contattare support@procne.it .
> Rif. D.L. 196/2003
>
>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
> CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>
>
>
--
U g o V a s i <ug...@procne.it>
P r o c n e s.r.l >)
via Cotonificio 45 33010 Tavagnacco IT
phone: +390432486523 fax: +390432486523
Le informazioni contenute in questo messaggio sono riservate e
confidenziali ed è vietata la diffusione in qualunque modo eseguita.
Qualora Lei non fosse la persona a cui il presente messaggio è
destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
gentilmente comunicazione.
Per qualsiasi informazione si prega di contattare support@procne.it .
Rif. D.L. 196/2003
RE: Unable to start a VM due to insufficient capacity
Posted by Geoff Higginbottom <ge...@shapeblue.com>.
HI Ugo,
Unfortunately we still continue to run into this problem on a regular basis.
I've had some success increasing the RAM & CPU allocations to the VR, especially where I was starting a large number of VMs which were all requesting new Passwords from the VR and causing it to lock up.
Regards
Geoff Higginbottom
D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
geoff.higginbottom@shapeblue.com
-----Original Message-----
From: Ugo Vasi [mailto:ugo.vasi@procne.it]
Sent: 19 February 2015 14:09
To: users@cloudstack.apache.org
Subject: Re: Unable to start a VM due to insufficient capacity
Hi Geoff,
we continue to find the problem on networks in a (seemingly) random.
The only solution is to do the cleaning of the network by hand, but it is not a good method, because it is not automatic and freeze for a moment all hosts on the network.
I would understand if this problem is related to version 4.3.0 or if it's been fixed in some later version.
thanks
Il 06/10/2014 12:55, Geoff Higginbottom ha scritto:
> Hi Ugo,
>
> What system VM template did you use? (exact download URL please)
>
> Regards
>
> Geoff Higginbottom
>
> D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
>
> geoff.higginbottom@shapeblue.com
>
> -----Original Message-----
> From: Ugo Vasi [mailto:ugo.vasi@procne.it]
> Sent: 06 October 2014 10:57
> To: users@cloudstack.apache.org
> Subject: Re: Unable to start a VM due to insufficient capacity
>
> Hi Geoff,
> the problem is occurring in different networks (all?) that are not changed.
>
> For us is a big problem because I can not predict when it occurs and the creation of new machines is blocked until a network restarts (this method, among other things, cause a small interruption of service).
>
> What can I do to fix the problem?
>
>
> Il 11/09/2014 09:28, Geoff Higginbottom ha scritto:
>> Hi Ugo,
>>
>> Did restarting the network with cleanup option resolve your issue last time, if yes have you tried the same on this network?
>>
>> Regards
>>
>> Geoff Higginbottom
>> CTO / Cloud Architect
>>
>> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603
>> 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>>
>> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.c
>> om> | www.shapeblue.com<htp://www.shapeblue.com/> |
>> Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
>>
>> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
>> 4HS<x-apple-data-detectors://5>
>>
>>
>> On 11 Sep 2014, at 08:17, "Ugo Vasi" <ug...@procne.it>> wrote:
>>
>> Hi Geoff,
>> I still have the problem creating new VMs but in another isolated network. The problem seems to be the same:
>>
>> 2014-09-11 08:55:27,048 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM is being created in
>> podId: 1
>> 2014-09-11 08:55:27,050 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Network id=212 is already
>> implemented
>> 2014-09-11 08:55:27,118 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:27,122 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
>> nics for network id=212 on 1
>> 2014-09-11 08:55:27,174 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
>> prepare for Nic[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19]
>> 2014-09-11 08:55:27,181 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is acquired for
>> network id 212 as a part of router startup in
>> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Po
>> ol(Id))] :
>> Dest[Zone(1)-Pod(1)-Cluster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(6
>> ))]
>> 2014-09-11 08:55:27,183 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is released for
>> network id 212 as a part of router startup in
>> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Po
>> ol(Id))] :
>> Dest[Zone(1)-Pod(1)-Cluster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(6
>> ))]
>> 2014-09-11 08:55:27,189 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:27,198 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:27,202 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Applying dhcp entry in
>> network Ntwk[212|Guest|8]
>> 2014-09-11 08:55:27,215 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304056: Sending
>> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
>> [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:15:76
>> :00:0e","vmIpAddress":"10.1.1.19","vmName":"giannitest","defaultRouter
>> ":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:15:76:0
>> 0:0e","isDefault":true,"executeInSequence":false,"accessDetails":{"rou
>> ter.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.name":
>> "r-60-VM","router.ip":"169.254.1.230"},"wait":0}}] }
>> 2014-09-11 08:55:27,941 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
>> (secstorage-1:ctx-327037b2) Zone 1 is ready to launch secondary
>> storage VM
>> 2014-09-11 08:55:28,022 DEBUG [c.c.c.ConsoleProxyManagerImpl]
>> (consoleproxy-1:ctx-a8ba3b1e) Zone 1 is ready to launch console proxy
>> 2014-09-11 08:55:28,820 DEBUG [c.c.a.ApiServlet]
>> (catalina-exec-16:ctx-58e92382) ===START=== 192.168.130.89 -- GET
>> command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0
>> &response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418
>> 528731
>> 2014-09-11 08:55:29,069 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-13:null) Seq 7-564304056: Processing: { Ans: ,
>> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
>> 2014-09-11 08:55:29,069 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304056: Received:
>> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { Answer
>> } }
>> 2014-09-11 08:55:29,075 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:29,078 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Applying userdata and
>> password entry in network Ntwk[212|Guest|8]
>> 2014-09-11 08:55:29,089 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304057: Sending
>> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
>> [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"1
>> 0.1.1.19","vmName":"giannitest","executeInSequence":false,"accessDetai
>> ls":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","rout
>> er.ip":"169.254.1.230","router.name":"r-60-VM"},"wait":0}},{"com.cloud
>> .agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.19","vmName":
>> "giannitest","executeInSequence":false,"accessDetails":{"router.guest.
>> ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.1.2
>> 30","router.name":"r-60-VM"},"wait":0}}] }
>> 2014-09-11 08:55:29,399 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-10:null) Seq 7-564304057: Processing: { Ans: ,
>> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.a
>> gent.api.Answer":{"result":false,"details":"VmDataCommand failed,
>> check agent logs","wait":0}}] }
>> 2014-09-11 08:55:29,491 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304057: Received:
>> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { Answer,
>> Answer } }
>> 2014-09-11 08:55:29,491 INFO [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Unable to contact resource.
>> com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is unreachable: Unable to apply userdata and password entry on router
>> at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyRules(VirtualNetworkApplianceManagerImpl.java:3915)
>> at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyUserData(VirtualNetworkApplianceManagerImpl.java:3118)
>> at sun.reflect.GeneratedMethodAccessor472.invoke(Unknown
>> Source) ...
>> 2014-09-11 08:55:29,755 DEBUG [c.c.a.ApiServlet]
>> (catalina-exec-16:ctx-58e92382 ctx-ad8ddf67) ===END=== 192.168.130.89
>> -- GET
>> command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0
>> &response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418
>> 528731
>> 2014-09-11 08:55:29,798 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Cleaning up resources for
>> the vm VM[User|giannitest] in Starting state
>> 2014-09-11 08:55:29,800 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Sending
>> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
>> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequenc
>> e":false,"vmName":"i-2-86-VM","wait":0}}] }
>> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-6:null) Seq 7-564304058: Processing: { Ans: ,
>> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
>> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Received:
>> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, {
>> StopAnswer } }
>> 2014-09-11 08:55:29,955 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:29,957 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
>> nics for network id=212 on -1
>> 2014-09-11 08:55:30,051 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
>> release
>> NicProfile[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19-null
>> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully released
>> network resources for the vm VM[User|giannitest]
>> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully cleanued up
>> resources for the vm VM[User|giannitest] in Starting state
>> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
>> 2014-09-11 08:55:30,214 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: 7
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total CPU:
>> 36256 and CPU after applying overprovisioning: 36256
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total RAM:
>> 50639785984 and RAM after applying overprovisioning: 50639785984
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release cpu from host: 7,
>> old used: 26500,reserved: 0, actual total: 36256, total with
>> overprovisioning: 36256; new used: 26000,reserved:0;
>> movedfromreserved: false,moveToReserveredfalse
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release mem from host: 7,
>> old used: 21072183296,reserved: 0, total: 50639785984; new used:
>> 20535312384,reserved:0; movedfromreserved: false,moveToReserveredfalse
>> 2014-09-11 08:55:30,302 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Stopped to Starting with event: StartRequestedvm's original host id:
>> null new host id: null host id before state transition: null
>> 2014-09-11 08:55:30,302 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully transitioned
>> to start state for VM[User|giannitest] reservation id =
>> 4b6c2f8d-a34c-4b86-a0d4-acd5ea87353a
>> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Trying to deploy VM, vm
>> has dcId: 1 and podId: 1
>> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
>> 2014-09-11 08:55:30,435 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: null
>> 2014-09-11 08:55:30,477 DEBUG [c.c.v.UserVmManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Destroying vm
>> VM[User|giannitest] as it failed to create on Host with Id:null
>> 2014-09-11 08:55:30,609 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Stopped to Error with event: OperationFailedToErrorvm's original host
>> id: null new host id: null host id before state transition: null
>> 2014-09-11 08:55:29,755 DEBUG [c.c.a.ApiServlet]
>> (catalina-exec-16:ctx-58e92382 ctx-ad8ddf67) ===END=== 192.168.130.89
>> -- GET
>> command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0
>> &response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418
>> 528731
>> 2014-09-11 08:55:29,798 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Cleaning up resources for
>> the vm VM[User|giannitest] in Starting state
>> 2014-09-11 08:55:29,800 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Sending
>> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
>> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequenc
>> e":false,"vmName":"i-2-86-VM","wait":0}}] }
>> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-6:null) Seq 7-564304058: Processing: { Ans: ,
>> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
>> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Received:
>> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, {
>> StopAnswer } }
>> 2014-09-11 08:55:29,955 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:29,957 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
>> nics for network id=212 on -1
>> 2014-09-11 08:55:30,051 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
>> release
>> NicProfile[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19-null
>> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully released
>> network resources for the vm VM[User|giannitest]
>> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully cleanued up
>> resources for the vm VM[User|giannitest] in Starting state
>> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
>> 2014-09-11 08:55:30,214 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: 7
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total CPU:
>> 36256 and CPU after applying overprovisioning: 36256
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total RAM:
>> 50639785984 and RAM after applying overprovisioning: 50639785984
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release cpu from host: 7,
>> old used: 26500,reserved: 0, actual total: 36256, total with
>> overprovisioning: 36256; new used: 26000,reserved:0;
>> movedfromreserved: false,moveToReserveredfalse
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release mem from host: 7,
>> old used: 21072183296,reserved: 0, total: 50639785984; new used:
>> 20535312384,reserved:0; movedfromreserved: false,moveToReserveredfalse
>> 2014-09-11 08:55:30,302 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Stopped to Starting with event: StartRequestedvm's original host id:
>> null new host id: null host id before state transition: null
>> 2014-09-11 08:55:30,302 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully transitioned
>> to start state for VM[User|giannitest] reservation id =
>> 4b6c2f8d-a34c-4b86-a0d4-acd5ea87353a
>> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Trying to deploy VM, vm
>> has dcId: 1 and podId: 1
>> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
>> 2014-09-11 08:55:30,435 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: null
>> 2014-09-11 08:55:30,477 DEBUG [c.c.v.UserVmManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Destroying vm
>> VM[User|giannitest] as it failed to create on Host with Id:null
>> 2014-09-11 08:55:30,609 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Stopped to Error with event: OperationFailedToErrorvm's original host
>> id: null new host id: null host id before state transition: null
>> 2014-09-11 08:55:30,809 WARN [o.a.c.alerts]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) alertType:: 8 //
>> dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed
>> to deploy Vm with Id: 86, on Host with Id: null
>> 2014-09-11 08:55:30,932 DEBUG [c.c.a.m.AgentManagerImpl]
>> (AgentManager-Handler-1:null) Ping from 6
>> 2014-09-11 08:55:31,078 ERROR [c.c.a.ApiAsyncJobDispatcher]
>> (Job-Executor-55:ctx-b5c34ec7) Unexpected exception while executing
>> org.apache.cloudstack.api.command.user.vm.DeployVMCmd
>> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due to insufficient capacity
>> at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:605)
>> at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:237)
>> at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:207)
>> at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3581)
>> at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3161)
>> at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3147)
>> at sun.reflect.GeneratedMethodAccessor587.invoke(Unknown
>> Source) ...
>>
>>
>> Il 01/08/2014 11:44, Geoff Higginbottom ha scritto:
>> Ugo,
>>
>> Login to the VR and tail the messages log then attempt to start the VM, you should see various messages re DHCP updating etc in the VR. If you don't see the VR update try restarting the network Iain the 'cleanup' option, this will create a new VR.
>>
>> Regards
>>
>> Geoff Higginbottom
>> CTO / Cloud Architect
>>
>> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603
>> 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>>
>> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.c
>> om><ma...@shapeblue.com> |
>> www.shapeblue.com<http://www.shapeblue.com><htp://www.shapeblue.com/>
>> | Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
>>
>> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
>> 4HS<x-apple-data-detectors://5>
>>
>>
>> On 1 Aug 2014, at 09:06, "Ugo Vasi" <ug...@procne.it>> wrote:
>>
>> Hi Geoff,
>> I tried restarting r-29-VM but the problem is still blocking creation of new VM in that isolated network.
>>
>> Creating a new VM in another isolated network, it works. Where can I look at to find the problem?
>>
>>
>>
>> Il 31/07/2014 21:53, Geoff Higginbottom ha scritto:
>> Ugo,
>>
>> Looks like CS is failing to update the VR with details for the new VM, try restarting the VR.
>>
>> Regards
>>
>> Geoff Higginbottom
>> CTO / Cloud Architect
>>
>>
>> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603
>> 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>>
>> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.c
>> om><ma...@shapeblue.com><mailto:geoff.higginbottom
>> @shapeblue.com> |
>> www.shapeblue.com<http://www.shapeblue.com><http://www.shapeblue.com><
>> htp://www.shapeblue.com/>
>>
>> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
>> 4HS<x-apple-data-detectors://37>
>>
>>
>>
>> On 31 Jul 2014, at 15:40, "Ugo Vasi" <ug...@procne.it>> wrote:
>>
>> Hi everybody,
>> I installed a CloudStack 4.3.0 system with a manager (in a virtual machine), two NFS primary storage, one NFS secondary storare and two host agent on ubuntu distribution.
>>
>> The cluster have one advanced zone without security group configuration with KVM hipervisors.
>>
>> I create some VM but now does not allow me to create more giving the error message "Unable to start a VM due to insufficient capacity".
>>
>> I am sure that the resources (ip, ram, cpu and storage) are enough to create new instances. In dashboard I see all ok.
>>
>> >From the management-server.log I see this errors messages (see attachment for full version) when I try to deploy a new virtual machine with 1x1GHz cpu, 1GB or RAM and 20GB disk space:
>>
>> 2014-07-31 14:59:11,983 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-12:null) Seq 1-684594119: Processing: { Ans: ,
>> MgmtId: 77916390353436, via: 1, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.a
>> gent.api.Answer":{"result":false,"details":"VmDataCommand failed,
>> check agent logs","wait":0}}] }
>> 2014-07-31 14:59:11,983 INFO [c.c.v.VirtualMachineManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Unable to contact resource.
>> com.cloud.exception.ResourceUnavailableException: Resource
>> [DataCenter:1] is unreachable: Unable to apply userdata and password
>> entry on router
>> 2014-07-31 14:59:12,453 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: 7
>> 2014-07-31 14:59:12,677 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: null
>> 2014-07-31 14:59:12,708 DEBUG [c.c.v.UserVmManagerImpl]
>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Destroying vm
>> VM[User|csweb2] as it failed to create on Host with Id:null
>> 2014-07-31 14:59:12,738 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from
>> :Stopped to Error with event: OperationFailedToErrorvm's original host
>> id: null new host id: null host id before state transition: null
>> 2014-07-31 14:59:12,929 WARN [o.a.c.alerts]
>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) alertType:: 8 //
>> dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed
>> to deploy Vm with Id: 70, on Host with Id: null
>> 2014-07-31 14:59:13,159 ERROR [c.c.a.ApiAsyncJobDispatcher]
>> (Job-Executor-26:ctx-ab3aee38) Unexpected exception while executing
>> org.apache.cloudstack.api.command.user.vm.DeployVMCmd
>> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM
>> due to insufficient capacity Caused by:
>> com.cloud.exception.InsufficientServerCapacityException: Unable to
>> create a deployment for VM[User|csweb2]Scope=interface
>> com.cloud.dc.DataCenter; id=1
>> 2014-07-31 14:59:13,161 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>> (Job-Executor-26:ctx-ab3aee38) Complete async job-783, jobStatus:
>> FAILED, resultCode: 530, result:
>> org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":
>> [],"errorcode":530,"errortext":"Unable to start a VM due to
>> insufficient capacity"}
>> 2014-07-31 14:59:46,280 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-27:ctx-82be396e ctx-41f0cf24) Stopped called on
>> VM[User|csweb2] but the state is Error
>> 2014-07-31 14:59:46,330 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-27:ctx-82be396e ctx-41f0cf24) VM state transitted from
>> :Error to Expunging with event: DestroyRequestedvm's original host id:
>> null new host id: null host id before state transition: null
>>
>> I tried to search in others log file ("VmDataCommand failed, check agent logs"), but I don't found nothing...
>>
>> Can anyone Help me?
>>
>> --
>>
>> U g o V a s i <ug...@procne.it>>
>> P r o c n e s.r.l >)
>> via Cotonificio 45 33010 Tavagnacco IT
>> phone: +390432486523 fax: +390432486523
>>
>> Le informazioni contenute in questo messaggio sono riservate e
>> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
>> Qualora Lei non fosse la persona a cui il presente messaggio ?
>> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
>> gentilmente comunicazione.
>> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
>> Rif. D.L. 196/2003
>>
>>
>>
>>
>> <management-server.log>
>> Find out more about ShapeBlue and our range of CloudStack related
>> services
>>
>> IaaS Cloud Design &
>> Build<http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge - rapid IaaS deployment
>> framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Infrastructure
>> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training
>> Courses<http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>
>>
>>
>>
>>
>>
>> --
>>
>> U g o V a s i <ug...@procne.it>>
>> P r o c n e s.r.l >)
>> via Cotonificio 45 33010 Tavagnacco IT
>> phone: +390432486523 fax: +390432486523
>>
>> Le informazioni contenute in questo messaggio sono riservate e
>> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
>> Qualora Lei non fosse la persona a cui il presente messaggio ?
>> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
>> gentilmente comunicazione.
>> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
>> Rif. D.L. 196/2003
>>
>>
>>
>>
>>
>> Find out more about ShapeBlue and our range of CloudStack related
>> services
>>
>> IaaS Cloud Design &
>> Build<http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge - rapid IaaS deployment
>> framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Infrastructure
>> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training
>> Courses<http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>
>>
>>
>>
>>
>>
>> --
>>
>> U g o V a s i <ug...@procne.it>>
>> P r o c n e s.r.l >)
>> via Cotonificio 45 33010 Tavagnacco IT
>> phone: +390432486523 fax: +390432486523
>>
>> Le informazioni contenute in questo messaggio sono riservate e
>> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
>> Qualora Lei non fosse la persona a cui il presente messaggio ?
>> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
>> gentilmente comunicazione.
>> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
>> Rif. D.L. 196/2003
>>
>>
>> Find out more about ShapeBlue and our range of CloudStack related
>> services
>>
>> IaaS Cloud Design &
>> Build<http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge - rapid IaaS deployment
>> framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Infrastructure
>> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training
>> Courses<http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>
>>
>>
>>
>
> --
>
> U g o V a s i <ug...@procne.it>
> P r o c n e s.r.l >)
> via Cotonificio 45 33010 Tavagnacco IT
> phone: +390432486523 fax: +390432486523
>
> Le informazioni contenute in questo messaggio sono riservate e confidenziali ed è vietata la diffusione in qualunque modo eseguita.
> Qualora Lei non fosse la persona a cui il presente messaggio è destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene gentilmente comunicazione.
> Per qualsiasi informazione si prega di contattare support@procne.it .
> Rif. D.L. 196/2003
>
>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>
>
>
--
U g o V a s i <ug...@procne.it>
P r o c n e s.r.l >)
via Cotonificio 45 33010 Tavagnacco IT
phone: +390432486523 fax: +390432486523
Le informazioni contenute in questo messaggio sono riservate e
confidenziali ed è vietata la diffusione in qualunque modo eseguita.
Qualora Lei non fosse la persona a cui il presente messaggio è
destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
gentilmente comunicazione.
Per qualsiasi informazione si prega di contattare support@procne.it .
Rif. D.L. 196/2003
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Re: Unable to start a VM due to insufficient capacity
Posted by Ugo Vasi <ug...@procne.it>.
Hi Geoff,
we continue to find the problem on networks in a (seemingly) random.
The only solution is to do the cleaning of the network by hand, but it
is not a good method, because it is not automatic and freeze for a
moment all hosts on the network.
I would understand if this problem is related to version 4.3.0 or if
it's been fixed in some later version.
thanks
Il 06/10/2014 12:55, Geoff Higginbottom ha scritto:
> Hi Ugo,
>
> What system VM template did you use? (exact download URL please)
>
> Regards
>
> Geoff Higginbottom
>
> D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
>
> geoff.higginbottom@shapeblue.com
>
> -----Original Message-----
> From: Ugo Vasi [mailto:ugo.vasi@procne.it]
> Sent: 06 October 2014 10:57
> To: users@cloudstack.apache.org
> Subject: Re: Unable to start a VM due to insufficient capacity
>
> Hi Geoff,
> the problem is occurring in different networks (all?) that are not changed.
>
> For us is a big problem because I can not predict when it occurs and the creation of new machines is blocked until a network restarts (this method, among other things, cause a small interruption of service).
>
> What can I do to fix the problem?
>
>
> Il 11/09/2014 09:28, Geoff Higginbottom ha scritto:
>> Hi Ugo,
>>
>> Did restarting the network with cleanup option resolve your issue last time, if yes have you tried the same on this network?
>>
>> Regards
>>
>> Geoff Higginbottom
>> CTO / Cloud Architect
>>
>> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603
>> 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>>
>> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.c
>> om> | www.shapeblue.com<htp://www.shapeblue.com/> |
>> Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
>>
>> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
>> 4HS<x-apple-data-detectors://5>
>>
>>
>> On 11 Sep 2014, at 08:17, "Ugo Vasi" <ug...@procne.it>> wrote:
>>
>> Hi Geoff,
>> I still have the problem creating new VMs but in another isolated network. The problem seems to be the same:
>>
>> 2014-09-11 08:55:27,048 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM is being created in
>> podId: 1
>> 2014-09-11 08:55:27,050 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Network id=212 is already
>> implemented
>> 2014-09-11 08:55:27,118 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:27,122 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
>> nics for network id=212 on 1
>> 2014-09-11 08:55:27,174 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
>> prepare for Nic[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19]
>> 2014-09-11 08:55:27,181 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is acquired for
>> network id 212 as a part of router startup in
>> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Po
>> ol(Id))] :
>> Dest[Zone(1)-Pod(1)-Cluster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(6
>> ))]
>> 2014-09-11 08:55:27,183 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is released for
>> network id 212 as a part of router startup in
>> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Po
>> ol(Id))] :
>> Dest[Zone(1)-Pod(1)-Cluster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(6
>> ))]
>> 2014-09-11 08:55:27,189 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:27,198 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:27,202 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Applying dhcp entry in
>> network Ntwk[212|Guest|8]
>> 2014-09-11 08:55:27,215 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304056: Sending
>> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
>> [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:15:76
>> :00:0e","vmIpAddress":"10.1.1.19","vmName":"giannitest","defaultRouter
>> ":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:15:76:0
>> 0:0e","isDefault":true,"executeInSequence":false,"accessDetails":{"rou
>> ter.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.name":
>> "r-60-VM","router.ip":"169.254.1.230"},"wait":0}}] }
>> 2014-09-11 08:55:27,941 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
>> (secstorage-1:ctx-327037b2) Zone 1 is ready to launch secondary
>> storage VM
>> 2014-09-11 08:55:28,022 DEBUG [c.c.c.ConsoleProxyManagerImpl]
>> (consoleproxy-1:ctx-a8ba3b1e) Zone 1 is ready to launch console proxy
>> 2014-09-11 08:55:28,820 DEBUG [c.c.a.ApiServlet]
>> (catalina-exec-16:ctx-58e92382) ===START=== 192.168.130.89 -- GET
>> command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0
>> &response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418
>> 528731
>> 2014-09-11 08:55:29,069 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-13:null) Seq 7-564304056: Processing: { Ans: ,
>> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
>> 2014-09-11 08:55:29,069 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304056: Received:
>> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { Answer
>> } }
>> 2014-09-11 08:55:29,075 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:29,078 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Applying userdata and
>> password entry in network Ntwk[212|Guest|8]
>> 2014-09-11 08:55:29,089 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304057: Sending
>> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
>> [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"1
>> 0.1.1.19","vmName":"giannitest","executeInSequence":false,"accessDetai
>> ls":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","rout
>> er.ip":"169.254.1.230","router.name":"r-60-VM"},"wait":0}},{"com.cloud
>> .agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.19","vmName":
>> "giannitest","executeInSequence":false,"accessDetails":{"router.guest.
>> ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.1.2
>> 30","router.name":"r-60-VM"},"wait":0}}] }
>> 2014-09-11 08:55:29,399 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-10:null) Seq 7-564304057: Processing: { Ans: ,
>> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.a
>> gent.api.Answer":{"result":false,"details":"VmDataCommand failed,
>> check agent logs","wait":0}}] }
>> 2014-09-11 08:55:29,491 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304057: Received:
>> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { Answer,
>> Answer } }
>> 2014-09-11 08:55:29,491 INFO [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Unable to contact resource.
>> com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is unreachable: Unable to apply userdata and password entry on router
>> at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyRules(VirtualNetworkApplianceManagerImpl.java:3915)
>> at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyUserData(VirtualNetworkApplianceManagerImpl.java:3118)
>> at sun.reflect.GeneratedMethodAccessor472.invoke(Unknown
>> Source) ...
>> 2014-09-11 08:55:29,755 DEBUG [c.c.a.ApiServlet]
>> (catalina-exec-16:ctx-58e92382 ctx-ad8ddf67) ===END=== 192.168.130.89
>> -- GET
>> command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0
>> &response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418
>> 528731
>> 2014-09-11 08:55:29,798 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Cleaning up resources for
>> the vm VM[User|giannitest] in Starting state
>> 2014-09-11 08:55:29,800 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Sending
>> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
>> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequenc
>> e":false,"vmName":"i-2-86-VM","wait":0}}] }
>> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-6:null) Seq 7-564304058: Processing: { Ans: ,
>> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
>> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Received:
>> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, {
>> StopAnswer } }
>> 2014-09-11 08:55:29,955 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:29,957 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
>> nics for network id=212 on -1
>> 2014-09-11 08:55:30,051 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
>> release
>> NicProfile[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19-null
>> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully released
>> network resources for the vm VM[User|giannitest]
>> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully cleanued up
>> resources for the vm VM[User|giannitest] in Starting state
>> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
>> 2014-09-11 08:55:30,214 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: 7
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total CPU:
>> 36256 and CPU after applying overprovisioning: 36256
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total RAM:
>> 50639785984 and RAM after applying overprovisioning: 50639785984
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release cpu from host: 7,
>> old used: 26500,reserved: 0, actual total: 36256, total with
>> overprovisioning: 36256; new used: 26000,reserved:0;
>> movedfromreserved: false,moveToReserveredfalse
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release mem from host: 7,
>> old used: 21072183296,reserved: 0, total: 50639785984; new used:
>> 20535312384,reserved:0; movedfromreserved: false,moveToReserveredfalse
>> 2014-09-11 08:55:30,302 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Stopped to Starting with event: StartRequestedvm's original host id:
>> null new host id: null host id before state transition: null
>> 2014-09-11 08:55:30,302 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully transitioned
>> to start state for VM[User|giannitest] reservation id =
>> 4b6c2f8d-a34c-4b86-a0d4-acd5ea87353a
>> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Trying to deploy VM, vm
>> has dcId: 1 and podId: 1
>> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
>> 2014-09-11 08:55:30,435 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: null
>> 2014-09-11 08:55:30,477 DEBUG [c.c.v.UserVmManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Destroying vm
>> VM[User|giannitest] as it failed to create on Host with Id:null
>> 2014-09-11 08:55:30,609 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Stopped to Error with event: OperationFailedToErrorvm's original host
>> id: null new host id: null host id before state transition: null
>> 2014-09-11 08:55:29,755 DEBUG [c.c.a.ApiServlet]
>> (catalina-exec-16:ctx-58e92382 ctx-ad8ddf67) ===END=== 192.168.130.89
>> -- GET
>> command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0
>> &response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418
>> 528731
>> 2014-09-11 08:55:29,798 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Cleaning up resources for
>> the vm VM[User|giannitest] in Starting state
>> 2014-09-11 08:55:29,800 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Sending
>> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
>> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequenc
>> e":false,"vmName":"i-2-86-VM","wait":0}}] }
>> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-6:null) Seq 7-564304058: Processing: { Ans: ,
>> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
>> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Received:
>> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, {
>> StopAnswer } }
>> 2014-09-11 08:55:29,955 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:29,957 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
>> nics for network id=212 on -1
>> 2014-09-11 08:55:30,051 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
>> release
>> NicProfile[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19-null
>> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully released
>> network resources for the vm VM[User|giannitest]
>> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully cleanued up
>> resources for the vm VM[User|giannitest] in Starting state
>> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
>> 2014-09-11 08:55:30,214 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: 7
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total CPU:
>> 36256 and CPU after applying overprovisioning: 36256
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total RAM:
>> 50639785984 and RAM after applying overprovisioning: 50639785984
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release cpu from host: 7,
>> old used: 26500,reserved: 0, actual total: 36256, total with
>> overprovisioning: 36256; new used: 26000,reserved:0;
>> movedfromreserved: false,moveToReserveredfalse
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release mem from host: 7,
>> old used: 21072183296,reserved: 0, total: 50639785984; new used:
>> 20535312384,reserved:0; movedfromreserved: false,moveToReserveredfalse
>> 2014-09-11 08:55:30,302 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Stopped to Starting with event: StartRequestedvm's original host id:
>> null new host id: null host id before state transition: null
>> 2014-09-11 08:55:30,302 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully transitioned
>> to start state for VM[User|giannitest] reservation id =
>> 4b6c2f8d-a34c-4b86-a0d4-acd5ea87353a
>> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Trying to deploy VM, vm
>> has dcId: 1 and podId: 1
>> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
>> 2014-09-11 08:55:30,435 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: null
>> 2014-09-11 08:55:30,477 DEBUG [c.c.v.UserVmManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Destroying vm
>> VM[User|giannitest] as it failed to create on Host with Id:null
>> 2014-09-11 08:55:30,609 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Stopped to Error with event: OperationFailedToErrorvm's original host
>> id: null new host id: null host id before state transition: null
>> 2014-09-11 08:55:30,809 WARN [o.a.c.alerts]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) alertType:: 8 //
>> dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed
>> to deploy Vm with Id: 86, on Host with Id: null
>> 2014-09-11 08:55:30,932 DEBUG [c.c.a.m.AgentManagerImpl]
>> (AgentManager-Handler-1:null) Ping from 6
>> 2014-09-11 08:55:31,078 ERROR [c.c.a.ApiAsyncJobDispatcher]
>> (Job-Executor-55:ctx-b5c34ec7) Unexpected exception while executing
>> org.apache.cloudstack.api.command.user.vm.DeployVMCmd
>> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due to insufficient capacity
>> at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:605)
>> at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:237)
>> at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:207)
>> at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3581)
>> at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3161)
>> at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3147)
>> at sun.reflect.GeneratedMethodAccessor587.invoke(Unknown
>> Source) ...
>>
>>
>> Il 01/08/2014 11:44, Geoff Higginbottom ha scritto:
>> Ugo,
>>
>> Login to the VR and tail the messages log then attempt to start the VM, you should see various messages re DHCP updating etc in the VR. If you don't see the VR update try restarting the network Iain the 'cleanup' option, this will create a new VR.
>>
>> Regards
>>
>> Geoff Higginbottom
>> CTO / Cloud Architect
>>
>> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603
>> 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>>
>> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.c
>> om><ma...@shapeblue.com> |
>> www.shapeblue.com<http://www.shapeblue.com><htp://www.shapeblue.com/>
>> | Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
>>
>> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
>> 4HS<x-apple-data-detectors://5>
>>
>>
>> On 1 Aug 2014, at 09:06, "Ugo Vasi" <ug...@procne.it>> wrote:
>>
>> Hi Geoff,
>> I tried restarting r-29-VM but the problem is still blocking creation of new VM in that isolated network.
>>
>> Creating a new VM in another isolated network, it works. Where can I look at to find the problem?
>>
>>
>>
>> Il 31/07/2014 21:53, Geoff Higginbottom ha scritto:
>> Ugo,
>>
>> Looks like CS is failing to update the VR with details for the new VM, try restarting the VR.
>>
>> Regards
>>
>> Geoff Higginbottom
>> CTO / Cloud Architect
>>
>>
>> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603
>> 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>>
>> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.c
>> om><ma...@shapeblue.com><mailto:geoff.higginbottom
>> @shapeblue.com> |
>> www.shapeblue.com<http://www.shapeblue.com><http://www.shapeblue.com><
>> htp://www.shapeblue.com/>
>>
>> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
>> 4HS<x-apple-data-detectors://37>
>>
>>
>>
>> On 31 Jul 2014, at 15:40, "Ugo Vasi" <ug...@procne.it>> wrote:
>>
>> Hi everybody,
>> I installed a CloudStack 4.3.0 system with a manager (in a virtual machine), two NFS primary storage, one NFS secondary storare and two host agent on ubuntu distribution.
>>
>> The cluster have one advanced zone without security group configuration with KVM hipervisors.
>>
>> I create some VM but now does not allow me to create more giving the error message "Unable to start a VM due to insufficient capacity".
>>
>> I am sure that the resources (ip, ram, cpu and storage) are enough to create new instances. In dashboard I see all ok.
>>
>> >From the management-server.log I see this errors messages (see attachment for full version) when I try to deploy a new virtual machine with 1x1GHz cpu, 1GB or RAM and 20GB disk space:
>>
>> 2014-07-31 14:59:11,983 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-12:null) Seq 1-684594119: Processing: { Ans: ,
>> MgmtId: 77916390353436, via: 1, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.a
>> gent.api.Answer":{"result":false,"details":"VmDataCommand failed,
>> check agent logs","wait":0}}] }
>> 2014-07-31 14:59:11,983 INFO [c.c.v.VirtualMachineManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Unable to contact resource.
>> com.cloud.exception.ResourceUnavailableException: Resource
>> [DataCenter:1] is unreachable: Unable to apply userdata and password
>> entry on router
>> 2014-07-31 14:59:12,453 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: 7
>> 2014-07-31 14:59:12,677 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: null
>> 2014-07-31 14:59:12,708 DEBUG [c.c.v.UserVmManagerImpl]
>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Destroying vm
>> VM[User|csweb2] as it failed to create on Host with Id:null
>> 2014-07-31 14:59:12,738 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from
>> :Stopped to Error with event: OperationFailedToErrorvm's original host
>> id: null new host id: null host id before state transition: null
>> 2014-07-31 14:59:12,929 WARN [o.a.c.alerts]
>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) alertType:: 8 //
>> dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed
>> to deploy Vm with Id: 70, on Host with Id: null
>> 2014-07-31 14:59:13,159 ERROR [c.c.a.ApiAsyncJobDispatcher]
>> (Job-Executor-26:ctx-ab3aee38) Unexpected exception while executing
>> org.apache.cloudstack.api.command.user.vm.DeployVMCmd
>> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM
>> due to insufficient capacity Caused by:
>> com.cloud.exception.InsufficientServerCapacityException: Unable to
>> create a deployment for VM[User|csweb2]Scope=interface
>> com.cloud.dc.DataCenter; id=1
>> 2014-07-31 14:59:13,161 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>> (Job-Executor-26:ctx-ab3aee38) Complete async job-783, jobStatus:
>> FAILED, resultCode: 530, result:
>> org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":
>> [],"errorcode":530,"errortext":"Unable to start a VM due to
>> insufficient capacity"}
>> 2014-07-31 14:59:46,280 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-27:ctx-82be396e ctx-41f0cf24) Stopped called on
>> VM[User|csweb2] but the state is Error
>> 2014-07-31 14:59:46,330 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-27:ctx-82be396e ctx-41f0cf24) VM state transitted from
>> :Error to Expunging with event: DestroyRequestedvm's original host id:
>> null new host id: null host id before state transition: null
>>
>> I tried to search in others log file ("VmDataCommand failed, check agent logs"), but I don't found nothing...
>>
>> Can anyone Help me?
>>
>> --
>>
>> U g o V a s i <ug...@procne.it>>
>> P r o c n e s.r.l >)
>> via Cotonificio 45 33010 Tavagnacco IT
>> phone: +390432486523 fax: +390432486523
>>
>> Le informazioni contenute in questo messaggio sono riservate e
>> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
>> Qualora Lei non fosse la persona a cui il presente messaggio ?
>> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
>> gentilmente comunicazione.
>> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
>> Rif. D.L. 196/2003
>>
>>
>>
>>
>> <management-server.log>
>> Find out more about ShapeBlue and our range of CloudStack related
>> services
>>
>> IaaS Cloud Design &
>> Build<http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge - rapid IaaS deployment
>> framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Infrastructure
>> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training
>> Courses<http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>
>>
>>
>>
>>
>>
>> --
>>
>> U g o V a s i <ug...@procne.it>>
>> P r o c n e s.r.l >)
>> via Cotonificio 45 33010 Tavagnacco IT
>> phone: +390432486523 fax: +390432486523
>>
>> Le informazioni contenute in questo messaggio sono riservate e
>> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
>> Qualora Lei non fosse la persona a cui il presente messaggio ?
>> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
>> gentilmente comunicazione.
>> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
>> Rif. D.L. 196/2003
>>
>>
>>
>>
>>
>> Find out more about ShapeBlue and our range of CloudStack related
>> services
>>
>> IaaS Cloud Design &
>> Build<http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge - rapid IaaS deployment
>> framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Infrastructure
>> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training
>> Courses<http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>
>>
>>
>>
>>
>>
>> --
>>
>> U g o V a s i <ug...@procne.it>>
>> P r o c n e s.r.l >)
>> via Cotonificio 45 33010 Tavagnacco IT
>> phone: +390432486523 fax: +390432486523
>>
>> Le informazioni contenute in questo messaggio sono riservate e
>> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
>> Qualora Lei non fosse la persona a cui il presente messaggio ?
>> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
>> gentilmente comunicazione.
>> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
>> Rif. D.L. 196/2003
>>
>>
>> Find out more about ShapeBlue and our range of CloudStack related
>> services
>>
>> IaaS Cloud Design &
>> Build<http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge - rapid IaaS deployment
>> framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Infrastructure
>> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training
>> Courses<http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>
>>
>>
>>
>
> --
>
> U g o V a s i <ug...@procne.it>
> P r o c n e s.r.l >)
> via Cotonificio 45 33010 Tavagnacco IT
> phone: +390432486523 fax: +390432486523
>
> Le informazioni contenute in questo messaggio sono riservate e confidenziali ed è vietata la diffusione in qualunque modo eseguita.
> Qualora Lei non fosse la persona a cui il presente messaggio è destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene gentilmente comunicazione.
> Per qualsiasi informazione si prega di contattare support@procne.it .
> Rif. D.L. 196/2003
>
>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>
>
>
--
U g o V a s i <ug...@procne.it>
P r o c n e s.r.l >)
via Cotonificio 45 33010 Tavagnacco IT
phone: +390432486523 fax: +390432486523
Le informazioni contenute in questo messaggio sono riservate e
confidenziali ed è vietata la diffusione in qualunque modo eseguita.
Qualora Lei non fosse la persona a cui il presente messaggio è
destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
gentilmente comunicazione.
Per qualsiasi informazione si prega di contattare support@procne.it .
Rif. D.L. 196/2003
Re: Unable to start a VM due to insufficient capacity
Posted by Ugo Vasi <ug...@procne.it>.
Hi Geoff,
We still have problems with the networks and we don't understand what
causes them, it seems to be randomly generate.
Thanks
Il 06/10/2014 12:55, Geoff Higginbottom ha scritto:
> Hi Ugo,
>
> What system VM template did you use? (exact download URL please)
>
> Regards
>
> Geoff Higginbottom
>
> D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
>
> geoff.higginbottom@shapeblue.com
>
> -----Original Message-----
> From: Ugo Vasi [mailto:ugo.vasi@procne.it]
> Sent: 06 October 2014 10:57
> To: users@cloudstack.apache.org
> Subject: Re: Unable to start a VM due to insufficient capacity
>
> Hi Geoff,
> the problem is occurring in different networks (all?) that are not changed.
>
> For us is a big problem because I can not predict when it occurs and the creation of new machines is blocked until a network restarts (this method, among other things, cause a small interruption of service).
>
> What can I do to fix the problem?
>
>
> Il 11/09/2014 09:28, Geoff Higginbottom ha scritto:
>> Hi Ugo,
>>
>> Did restarting the network with cleanup option resolve your issue last time, if yes have you tried the same on this network?
>>
>> Regards
>>
>> Geoff Higginbottom
>> CTO / Cloud Architect
>>
>> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603
>> 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>>
>> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.c
>> om> | www.shapeblue.com<htp://www.shapeblue.com/> |
>> Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
>>
>> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
>> 4HS<x-apple-data-detectors://5>
>>
>>
>> On 11 Sep 2014, at 08:17, "Ugo Vasi" <ug...@procne.it>> wrote:
>>
>> Hi Geoff,
>> I still have the problem creating new VMs but in another isolated network. The problem seems to be the same:
>>
>> 2014-09-11 08:55:27,048 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM is being created in
>> podId: 1
>> 2014-09-11 08:55:27,050 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Network id=212 is already
>> implemented
>> 2014-09-11 08:55:27,118 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:27,122 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
>> nics for network id=212 on 1
>> 2014-09-11 08:55:27,174 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
>> prepare for Nic[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19]
>> 2014-09-11 08:55:27,181 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is acquired for
>> network id 212 as a part of router startup in
>> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Po
>> ol(Id))] :
>> Dest[Zone(1)-Pod(1)-Cluster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(6
>> ))]
>> 2014-09-11 08:55:27,183 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is released for
>> network id 212 as a part of router startup in
>> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Po
>> ol(Id))] :
>> Dest[Zone(1)-Pod(1)-Cluster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(6
>> ))]
>> 2014-09-11 08:55:27,189 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:27,198 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:27,202 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Applying dhcp entry in
>> network Ntwk[212|Guest|8]
>> 2014-09-11 08:55:27,215 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304056: Sending
>> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
>> [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:15:76
>> :00:0e","vmIpAddress":"10.1.1.19","vmName":"giannitest","defaultRouter
>> ":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:15:76:0
>> 0:0e","isDefault":true,"executeInSequence":false,"accessDetails":{"rou
>> ter.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.name":
>> "r-60-VM","router.ip":"169.254.1.230"},"wait":0}}] }
>> 2014-09-11 08:55:27,941 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
>> (secstorage-1:ctx-327037b2) Zone 1 is ready to launch secondary
>> storage VM
>> 2014-09-11 08:55:28,022 DEBUG [c.c.c.ConsoleProxyManagerImpl]
>> (consoleproxy-1:ctx-a8ba3b1e) Zone 1 is ready to launch console proxy
>> 2014-09-11 08:55:28,820 DEBUG [c.c.a.ApiServlet]
>> (catalina-exec-16:ctx-58e92382) ===START=== 192.168.130.89 -- GET
>> command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0
>> &response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418
>> 528731
>> 2014-09-11 08:55:29,069 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-13:null) Seq 7-564304056: Processing: { Ans: ,
>> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
>> 2014-09-11 08:55:29,069 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304056: Received:
>> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { Answer
>> } }
>> 2014-09-11 08:55:29,075 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:29,078 DEBUG
>> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Applying userdata and
>> password entry in network Ntwk[212|Guest|8]
>> 2014-09-11 08:55:29,089 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304057: Sending
>> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
>> [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"1
>> 0.1.1.19","vmName":"giannitest","executeInSequence":false,"accessDetai
>> ls":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","rout
>> er.ip":"169.254.1.230","router.name":"r-60-VM"},"wait":0}},{"com.cloud
>> .agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.19","vmName":
>> "giannitest","executeInSequence":false,"accessDetails":{"router.guest.
>> ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.1.2
>> 30","router.name":"r-60-VM"},"wait":0}}] }
>> 2014-09-11 08:55:29,399 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-10:null) Seq 7-564304057: Processing: { Ans: ,
>> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.a
>> gent.api.Answer":{"result":false,"details":"VmDataCommand failed,
>> check agent logs","wait":0}}] }
>> 2014-09-11 08:55:29,491 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304057: Received:
>> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { Answer,
>> Answer } }
>> 2014-09-11 08:55:29,491 INFO [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Unable to contact resource.
>> com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is unreachable: Unable to apply userdata and password entry on router
>> at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyRules(VirtualNetworkApplianceManagerImpl.java:3915)
>> at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyUserData(VirtualNetworkApplianceManagerImpl.java:3118)
>> at sun.reflect.GeneratedMethodAccessor472.invoke(Unknown
>> Source) ...
>> 2014-09-11 08:55:29,755 DEBUG [c.c.a.ApiServlet]
>> (catalina-exec-16:ctx-58e92382 ctx-ad8ddf67) ===END=== 192.168.130.89
>> -- GET
>> command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0
>> &response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418
>> 528731
>> 2014-09-11 08:55:29,798 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Cleaning up resources for
>> the vm VM[User|giannitest] in Starting state
>> 2014-09-11 08:55:29,800 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Sending
>> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
>> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequenc
>> e":false,"vmName":"i-2-86-VM","wait":0}}] }
>> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-6:null) Seq 7-564304058: Processing: { Ans: ,
>> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
>> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Received:
>> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, {
>> StopAnswer } }
>> 2014-09-11 08:55:29,955 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:29,957 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
>> nics for network id=212 on -1
>> 2014-09-11 08:55:30,051 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
>> release
>> NicProfile[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19-null
>> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully released
>> network resources for the vm VM[User|giannitest]
>> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully cleanued up
>> resources for the vm VM[User|giannitest] in Starting state
>> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
>> 2014-09-11 08:55:30,214 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: 7
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total CPU:
>> 36256 and CPU after applying overprovisioning: 36256
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total RAM:
>> 50639785984 and RAM after applying overprovisioning: 50639785984
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release cpu from host: 7,
>> old used: 26500,reserved: 0, actual total: 36256, total with
>> overprovisioning: 36256; new used: 26000,reserved:0;
>> movedfromreserved: false,moveToReserveredfalse
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release mem from host: 7,
>> old used: 21072183296,reserved: 0, total: 50639785984; new used:
>> 20535312384,reserved:0; movedfromreserved: false,moveToReserveredfalse
>> 2014-09-11 08:55:30,302 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Stopped to Starting with event: StartRequestedvm's original host id:
>> null new host id: null host id before state transition: null
>> 2014-09-11 08:55:30,302 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully transitioned
>> to start state for VM[User|giannitest] reservation id =
>> 4b6c2f8d-a34c-4b86-a0d4-acd5ea87353a
>> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Trying to deploy VM, vm
>> has dcId: 1 and podId: 1
>> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
>> 2014-09-11 08:55:30,435 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: null
>> 2014-09-11 08:55:30,477 DEBUG [c.c.v.UserVmManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Destroying vm
>> VM[User|giannitest] as it failed to create on Host with Id:null
>> 2014-09-11 08:55:30,609 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Stopped to Error with event: OperationFailedToErrorvm's original host
>> id: null new host id: null host id before state transition: null
>> 2014-09-11 08:55:29,755 DEBUG [c.c.a.ApiServlet]
>> (catalina-exec-16:ctx-58e92382 ctx-ad8ddf67) ===END=== 192.168.130.89
>> -- GET
>> command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0
>> &response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418
>> 528731
>> 2014-09-11 08:55:29,798 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Cleaning up resources for
>> the vm VM[User|giannitest] in Starting state
>> 2014-09-11 08:55:29,800 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Sending
>> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
>> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequenc
>> e":false,"vmName":"i-2-86-VM","wait":0}}] }
>> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-6:null) Seq 7-564304058: Processing: { Ans: ,
>> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
>> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Received:
>> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, {
>> StopAnswer } }
>> 2014-09-11 08:55:29,955 DEBUG [c.c.n.NetworkModelImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
>> not supported in the network id=212
>> 2014-09-11 08:55:29,957 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
>> nics for network id=212 on -1
>> 2014-09-11 08:55:30,051 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
>> release
>> NicProfile[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19-null
>> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully released
>> network resources for the vm VM[User|giannitest]
>> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully cleanued up
>> resources for the vm VM[User|giannitest] in Starting state
>> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
>> 2014-09-11 08:55:30,214 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: 7
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total CPU:
>> 36256 and CPU after applying overprovisioning: 36256
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total RAM:
>> 50639785984 and RAM after applying overprovisioning: 50639785984
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release cpu from host: 7,
>> old used: 26500,reserved: 0, actual total: 36256, total with
>> overprovisioning: 36256; new used: 26000,reserved:0;
>> movedfromreserved: false,moveToReserveredfalse
>> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release mem from host: 7,
>> old used: 21072183296,reserved: 0, total: 50639785984; new used:
>> 20535312384,reserved:0; movedfromreserved: false,moveToReserveredfalse
>> 2014-09-11 08:55:30,302 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Stopped to Starting with event: StartRequestedvm's original host id:
>> null new host id: null host id before state transition: null
>> 2014-09-11 08:55:30,302 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully transitioned
>> to start state for VM[User|giannitest] reservation id =
>> 4b6c2f8d-a34c-4b86-a0d4-acd5ea87353a
>> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Trying to deploy VM, vm
>> has dcId: 1 and podId: 1
>> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
>> clusters: [], hosts: [7]
>> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
>> 2014-09-11 08:55:30,435 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: null
>> 2014-09-11 08:55:30,477 DEBUG [c.c.v.UserVmManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Destroying vm
>> VM[User|giannitest] as it failed to create on Host with Id:null
>> 2014-09-11 08:55:30,609 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
>> :Stopped to Error with event: OperationFailedToErrorvm's original host
>> id: null new host id: null host id before state transition: null
>> 2014-09-11 08:55:30,809 WARN [o.a.c.alerts]
>> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) alertType:: 8 //
>> dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed
>> to deploy Vm with Id: 86, on Host with Id: null
>> 2014-09-11 08:55:30,932 DEBUG [c.c.a.m.AgentManagerImpl]
>> (AgentManager-Handler-1:null) Ping from 6
>> 2014-09-11 08:55:31,078 ERROR [c.c.a.ApiAsyncJobDispatcher]
>> (Job-Executor-55:ctx-b5c34ec7) Unexpected exception while executing
>> org.apache.cloudstack.api.command.user.vm.DeployVMCmd
>> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due to insufficient capacity
>> at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:605)
>> at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:237)
>> at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:207)
>> at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3581)
>> at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3161)
>> at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3147)
>> at sun.reflect.GeneratedMethodAccessor587.invoke(Unknown
>> Source) ...
>>
>>
>> Il 01/08/2014 11:44, Geoff Higginbottom ha scritto:
>> Ugo,
>>
>> Login to the VR and tail the messages log then attempt to start the VM, you should see various messages re DHCP updating etc in the VR. If you don't see the VR update try restarting the network Iain the 'cleanup' option, this will create a new VR.
>>
>> Regards
>>
>> Geoff Higginbottom
>> CTO / Cloud Architect
>>
>> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603
>> 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>>
>> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.c
>> om><ma...@shapeblue.com> |
>> www.shapeblue.com<http://www.shapeblue.com><htp://www.shapeblue.com/>
>> | Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
>>
>> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
>> 4HS<x-apple-data-detectors://5>
>>
>>
>> On 1 Aug 2014, at 09:06, "Ugo Vasi" <ug...@procne.it>> wrote:
>>
>> Hi Geoff,
>> I tried restarting r-29-VM but the problem is still blocking creation of new VM in that isolated network.
>>
>> Creating a new VM in another isolated network, it works. Where can I look at to find the problem?
>>
>>
>>
>> Il 31/07/2014 21:53, Geoff Higginbottom ha scritto:
>> Ugo,
>>
>> Looks like CS is failing to update the VR with details for the new VM, try restarting the VR.
>>
>> Regards
>>
>> Geoff Higginbottom
>> CTO / Cloud Architect
>>
>>
>> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603
>> 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>>
>> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.c
>> om><ma...@shapeblue.com><mailto:geoff.higginbottom
>> @shapeblue.com> |
>> www.shapeblue.com<http://www.shapeblue.com><http://www.shapeblue.com><
>> htp://www.shapeblue.com/>
>>
>> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
>> 4HS<x-apple-data-detectors://37>
>>
>>
>>
>> On 31 Jul 2014, at 15:40, "Ugo Vasi" <ug...@procne.it>> wrote:
>>
>> Hi everybody,
>> I installed a CloudStack 4.3.0 system with a manager (in a virtual machine), two NFS primary storage, one NFS secondary storare and two host agent on ubuntu distribution.
>>
>> The cluster have one advanced zone without security group configuration with KVM hipervisors.
>>
>> I create some VM but now does not allow me to create more giving the error message "Unable to start a VM due to insufficient capacity".
>>
>> I am sure that the resources (ip, ram, cpu and storage) are enough to create new instances. In dashboard I see all ok.
>>
>> >From the management-server.log I see this errors messages (see attachment for full version) when I try to deploy a new virtual machine with 1x1GHz cpu, 1GB or RAM and 20GB disk space:
>>
>> 2014-07-31 14:59:11,983 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-12:null) Seq 1-684594119: Processing: { Ans: ,
>> MgmtId: 77916390353436, via: 1, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.a
>> gent.api.Answer":{"result":false,"details":"VmDataCommand failed,
>> check agent logs","wait":0}}] }
>> 2014-07-31 14:59:11,983 INFO [c.c.v.VirtualMachineManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Unable to contact resource.
>> com.cloud.exception.ResourceUnavailableException: Resource
>> [DataCenter:1] is unreachable: Unable to apply userdata and password
>> entry on router
>> 2014-07-31 14:59:12,453 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: 7
>> 2014-07-31 14:59:12,677 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from
>> :Starting to Stopped with event: OperationFailedvm's original host id:
>> null new host id: null host id before state transition: null
>> 2014-07-31 14:59:12,708 DEBUG [c.c.v.UserVmManagerImpl]
>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Destroying vm
>> VM[User|csweb2] as it failed to create on Host with Id:null
>> 2014-07-31 14:59:12,738 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from
>> :Stopped to Error with event: OperationFailedToErrorvm's original host
>> id: null new host id: null host id before state transition: null
>> 2014-07-31 14:59:12,929 WARN [o.a.c.alerts]
>> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) alertType:: 8 //
>> dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed
>> to deploy Vm with Id: 70, on Host with Id: null
>> 2014-07-31 14:59:13,159 ERROR [c.c.a.ApiAsyncJobDispatcher]
>> (Job-Executor-26:ctx-ab3aee38) Unexpected exception while executing
>> org.apache.cloudstack.api.command.user.vm.DeployVMCmd
>> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM
>> due to insufficient capacity Caused by:
>> com.cloud.exception.InsufficientServerCapacityException: Unable to
>> create a deployment for VM[User|csweb2]Scope=interface
>> com.cloud.dc.DataCenter; id=1
>> 2014-07-31 14:59:13,161 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>> (Job-Executor-26:ctx-ab3aee38) Complete async job-783, jobStatus:
>> FAILED, resultCode: 530, result:
>> org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":
>> [],"errorcode":530,"errortext":"Unable to start a VM due to
>> insufficient capacity"}
>> 2014-07-31 14:59:46,280 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> (Job-Executor-27:ctx-82be396e ctx-41f0cf24) Stopped called on
>> VM[User|csweb2] but the state is Error
>> 2014-07-31 14:59:46,330 DEBUG [c.c.c.CapacityManagerImpl]
>> (Job-Executor-27:ctx-82be396e ctx-41f0cf24) VM state transitted from
>> :Error to Expunging with event: DestroyRequestedvm's original host id:
>> null new host id: null host id before state transition: null
>>
>> I tried to search in others log file ("VmDataCommand failed, check agent logs"), but I don't found nothing...
>>
>> Can anyone Help me?
>>
>> --
>>
>> U g o V a s i <ug...@procne.it>>
>> P r o c n e s.r.l >)
>> via Cotonificio 45 33010 Tavagnacco IT
>> phone: +390432486523 fax: +390432486523
>>
>> Le informazioni contenute in questo messaggio sono riservate e
>> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
>> Qualora Lei non fosse la persona a cui il presente messaggio ?
>> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
>> gentilmente comunicazione.
>> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
>> Rif. D.L. 196/2003
>>
>>
>>
>>
>> <management-server.log>
>> Find out more about ShapeBlue and our range of CloudStack related
>> services
>>
>> IaaS Cloud Design &
>> Build<http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge - rapid IaaS deployment
>> framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Infrastructure
>> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training
>> Courses<http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>
>>
>>
>>
>>
>>
>> --
>>
>> U g o V a s i <ug...@procne.it>>
>> P r o c n e s.r.l >)
>> via Cotonificio 45 33010 Tavagnacco IT
>> phone: +390432486523 fax: +390432486523
>>
>> Le informazioni contenute in questo messaggio sono riservate e
>> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
>> Qualora Lei non fosse la persona a cui il presente messaggio ?
>> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
>> gentilmente comunicazione.
>> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
>> Rif. D.L. 196/2003
>>
>>
>>
>>
>>
>> Find out more about ShapeBlue and our range of CloudStack related
>> services
>>
>> IaaS Cloud Design &
>> Build<http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge - rapid IaaS deployment
>> framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Infrastructure
>> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training
>> Courses<http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>
>>
>>
>>
>>
>>
>> --
>>
>> U g o V a s i <ug...@procne.it>>
>> P r o c n e s.r.l >)
>> via Cotonificio 45 33010 Tavagnacco IT
>> phone: +390432486523 fax: +390432486523
>>
>> Le informazioni contenute in questo messaggio sono riservate e
>> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
>> Qualora Lei non fosse la persona a cui il presente messaggio ?
>> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
>> gentilmente comunicazione.
>> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
>> Rif. D.L. 196/2003
>>
>>
>> Find out more about ShapeBlue and our range of CloudStack related
>> services
>>
>> IaaS Cloud Design &
>> Build<http://shapeblue.com/iaas-cloud-design-and-build//>
>> CSForge - rapid IaaS deployment
>> framework<http://shapeblue.com/csforge/>
>> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
>> CloudStack Infrastructure
>> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
>> CloudStack Bootcamp Training
>> Courses<http://shapeblue.com/cloudstack-training/>
>>
>> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>>
>>
>>
>>
>
> --
>
> U g o V a s i <ug...@procne.it>
> P r o c n e s.r.l >)
> via Cotonificio 45 33010 Tavagnacco IT
> phone: +390432486523 fax: +390432486523
>
> Le informazioni contenute in questo messaggio sono riservate e confidenziali ed è vietata la diffusione in qualunque modo eseguita.
> Qualora Lei non fosse la persona a cui il presente messaggio è destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene gentilmente comunicazione.
> Per qualsiasi informazione si prega di contattare support@procne.it .
> Rif. D.L. 196/2003
>
>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>
>
>
--
U g o V a s i <ug...@procne.it>
P r o c n e s.r.l >)
via Cotonificio 45 33010 Tavagnacco IT
phone: +390432486523 fax: +390432486523
Le informazioni contenute in questo messaggio sono riservate e
confidenziali ed è vietata la diffusione in qualunque modo eseguita.
Qualora Lei non fosse la persona a cui il presente messaggio è
destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
gentilmente comunicazione.
Per qualsiasi informazione si prega di contattare support@procne.it .
Rif. D.L. 196/2003
RE: Unable to start a VM due to insufficient capacity
Posted by Geoff Higginbottom <ge...@shapeblue.com>.
Hi Ugo,
What system VM template did you use? (exact download URL please)
Regards
Geoff Higginbottom
D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
geoff.higginbottom@shapeblue.com
-----Original Message-----
From: Ugo Vasi [mailto:ugo.vasi@procne.it]
Sent: 06 October 2014 10:57
To: users@cloudstack.apache.org
Subject: Re: Unable to start a VM due to insufficient capacity
Hi Geoff,
the problem is occurring in different networks (all?) that are not changed.
For us is a big problem because I can not predict when it occurs and the creation of new machines is blocked until a network restarts (this method, among other things, cause a small interruption of service).
What can I do to fix the problem?
Il 11/09/2014 09:28, Geoff Higginbottom ha scritto:
> Hi Ugo,
>
> Did restarting the network with cleanup option resolve your issue last time, if yes have you tried the same on this network?
>
> Regards
>
> Geoff Higginbottom
> CTO / Cloud Architect
>
> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603
> 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>
> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.c
> om> | www.shapeblue.com<htp://www.shapeblue.com/> |
> Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
>
> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
> 4HS<x-apple-data-detectors://5>
>
>
> On 11 Sep 2014, at 08:17, "Ugo Vasi" <ug...@procne.it>> wrote:
>
> Hi Geoff,
> I still have the problem creating new VMs but in another isolated network. The problem seems to be the same:
>
> 2014-09-11 08:55:27,048 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM is being created in
> podId: 1
> 2014-09-11 08:55:27,050 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Network id=212 is already
> implemented
> 2014-09-11 08:55:27,118 DEBUG [c.c.n.NetworkModelImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
> not supported in the network id=212
> 2014-09-11 08:55:27,122 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
> nics for network id=212 on 1
> 2014-09-11 08:55:27,174 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
> prepare for Nic[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19]
> 2014-09-11 08:55:27,181 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is acquired for
> network id 212 as a part of router startup in
> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Po
> ol(Id))] :
> Dest[Zone(1)-Pod(1)-Cluster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(6
> ))]
> 2014-09-11 08:55:27,183 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is released for
> network id 212 as a part of router startup in
> Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Po
> ol(Id))] :
> Dest[Zone(1)-Pod(1)-Cluster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(6
> ))]
> 2014-09-11 08:55:27,189 DEBUG [c.c.n.NetworkModelImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
> not supported in the network id=212
> 2014-09-11 08:55:27,198 DEBUG [c.c.n.NetworkModelImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
> not supported in the network id=212
> 2014-09-11 08:55:27,202 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Applying dhcp entry in
> network Ntwk[212|Guest|8]
> 2014-09-11 08:55:27,215 DEBUG [c.c.a.t.Request]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304056: Sending
> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
> [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:15:76
> :00:0e","vmIpAddress":"10.1.1.19","vmName":"giannitest","defaultRouter
> ":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:15:76:0
> 0:0e","isDefault":true,"executeInSequence":false,"accessDetails":{"rou
> ter.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.name":
> "r-60-VM","router.ip":"169.254.1.230"},"wait":0}}] }
> 2014-09-11 08:55:27,941 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
> (secstorage-1:ctx-327037b2) Zone 1 is ready to launch secondary
> storage VM
> 2014-09-11 08:55:28,022 DEBUG [c.c.c.ConsoleProxyManagerImpl]
> (consoleproxy-1:ctx-a8ba3b1e) Zone 1 is ready to launch console proxy
> 2014-09-11 08:55:28,820 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-16:ctx-58e92382) ===START=== 192.168.130.89 -- GET
> command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0
> &response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418
> 528731
> 2014-09-11 08:55:29,069 DEBUG [c.c.a.t.Request]
> (AgentManager-Handler-13:null) Seq 7-564304056: Processing: { Ans: ,
> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
> 2014-09-11 08:55:29,069 DEBUG [c.c.a.t.Request]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304056: Received:
> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { Answer
> } }
> 2014-09-11 08:55:29,075 DEBUG [c.c.n.NetworkModelImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
> not supported in the network id=212
> 2014-09-11 08:55:29,078 DEBUG
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Applying userdata and
> password entry in network Ntwk[212|Guest|8]
> 2014-09-11 08:55:29,089 DEBUG [c.c.a.t.Request]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304057: Sending
> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
> [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"1
> 0.1.1.19","vmName":"giannitest","executeInSequence":false,"accessDetai
> ls":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","rout
> er.ip":"169.254.1.230","router.name":"r-60-VM"},"wait":0}},{"com.cloud
> .agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.19","vmName":
> "giannitest","executeInSequence":false,"accessDetails":{"router.guest.
> ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.1.2
> 30","router.name":"r-60-VM"},"wait":0}}] }
> 2014-09-11 08:55:29,399 DEBUG [c.c.a.t.Request]
> (AgentManager-Handler-10:null) Seq 7-564304057: Processing: { Ans: ,
> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.a
> gent.api.Answer":{"result":false,"details":"VmDataCommand failed,
> check agent logs","wait":0}}] }
> 2014-09-11 08:55:29,491 DEBUG [c.c.a.t.Request]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304057: Received:
> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { Answer,
> Answer } }
> 2014-09-11 08:55:29,491 INFO [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Unable to contact resource.
> com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is unreachable: Unable to apply userdata and password entry on router
> at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyRules(VirtualNetworkApplianceManagerImpl.java:3915)
> at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyUserData(VirtualNetworkApplianceManagerImpl.java:3118)
> at sun.reflect.GeneratedMethodAccessor472.invoke(Unknown
> Source) ...
> 2014-09-11 08:55:29,755 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-16:ctx-58e92382 ctx-ad8ddf67) ===END=== 192.168.130.89
> -- GET
> command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0
> &response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418
> 528731
> 2014-09-11 08:55:29,798 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Cleaning up resources for
> the vm VM[User|giannitest] in Starting state
> 2014-09-11 08:55:29,800 DEBUG [c.c.a.t.Request]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Sending
> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequenc
> e":false,"vmName":"i-2-86-VM","wait":0}}] }
> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
> (AgentManager-Handler-6:null) Seq 7-564304058: Processing: { Ans: ,
> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Received:
> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, {
> StopAnswer } }
> 2014-09-11 08:55:29,955 DEBUG [c.c.n.NetworkModelImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
> not supported in the network id=212
> 2014-09-11 08:55:29,957 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
> nics for network id=212 on -1
> 2014-09-11 08:55:30,051 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
> release
> NicProfile[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19-null
> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully released
> network resources for the vm VM[User|giannitest]
> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully cleanued up
> resources for the vm VM[User|giannitest] in Starting state
> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
> clusters: [], hosts: [7]
> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
> 2014-09-11 08:55:30,214 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
> :Starting to Stopped with event: OperationFailedvm's original host id:
> null new host id: null host id before state transition: 7
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total CPU:
> 36256 and CPU after applying overprovisioning: 36256
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total RAM:
> 50639785984 and RAM after applying overprovisioning: 50639785984
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release cpu from host: 7,
> old used: 26500,reserved: 0, actual total: 36256, total with
> overprovisioning: 36256; new used: 26000,reserved:0;
> movedfromreserved: false,moveToReserveredfalse
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release mem from host: 7,
> old used: 21072183296,reserved: 0, total: 50639785984; new used:
> 20535312384,reserved:0; movedfromreserved: false,moveToReserveredfalse
> 2014-09-11 08:55:30,302 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
> :Stopped to Starting with event: StartRequestedvm's original host id:
> null new host id: null host id before state transition: null
> 2014-09-11 08:55:30,302 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully transitioned
> to start state for VM[User|giannitest] reservation id =
> 4b6c2f8d-a34c-4b86-a0d4-acd5ea87353a
> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Trying to deploy VM, vm
> has dcId: 1 and podId: 1
> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
> clusters: [], hosts: [7]
> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
> clusters: [], hosts: [7]
> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
> 2014-09-11 08:55:30,435 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
> :Starting to Stopped with event: OperationFailedvm's original host id:
> null new host id: null host id before state transition: null
> 2014-09-11 08:55:30,477 DEBUG [c.c.v.UserVmManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Destroying vm
> VM[User|giannitest] as it failed to create on Host with Id:null
> 2014-09-11 08:55:30,609 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
> :Stopped to Error with event: OperationFailedToErrorvm's original host
> id: null new host id: null host id before state transition: null
> 2014-09-11 08:55:29,755 DEBUG [c.c.a.ApiServlet]
> (catalina-exec-16:ctx-58e92382 ctx-ad8ddf67) ===END=== 192.168.130.89
> -- GET
> command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0
> &response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418
> 528731
> 2014-09-11 08:55:29,798 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Cleaning up resources for
> the vm VM[User|giannitest] in Starting state
> 2014-09-11 08:55:29,800 DEBUG [c.c.a.t.Request]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Sending
> { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequenc
> e":false,"vmName":"i-2-86-VM","wait":0}}] }
> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
> (AgentManager-Handler-6:null) Seq 7-564304058: Processing: { Ans: ,
> MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Received:
> { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, {
> StopAnswer } }
> 2014-09-11 08:55:29,955 DEBUG [c.c.n.NetworkModelImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is
> not supported in the network id=212
> 2014-09-11 08:55:29,957 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
> nics for network id=212 on -1
> 2014-09-11 08:55:30,051 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
> release
> NicProfile[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19-null
> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully released
> network resources for the vm VM[User|giannitest]
> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully cleanued up
> resources for the vm VM[User|giannitest] in Starting state
> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
> clusters: [], hosts: [7]
> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
> 2014-09-11 08:55:30,214 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
> :Starting to Stopped with event: OperationFailedvm's original host id:
> null new host id: null host id before state transition: 7
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total CPU:
> 36256 and CPU after applying overprovisioning: 36256
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total RAM:
> 50639785984 and RAM after applying overprovisioning: 50639785984
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release cpu from host: 7,
> old used: 26500,reserved: 0, actual total: 36256, total with
> overprovisioning: 36256; new used: 26000,reserved:0;
> movedfromreserved: false,moveToReserveredfalse
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release mem from host: 7,
> old used: 21072183296,reserved: 0, total: 50639785984; new used:
> 20535312384,reserved:0; movedfromreserved: false,moveToReserveredfalse
> 2014-09-11 08:55:30,302 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
> :Stopped to Starting with event: StartRequestedvm's original host id:
> null new host id: null host id before state transition: null
> 2014-09-11 08:55:30,302 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully transitioned
> to start state for VM[User|giannitest] reservation id =
> 4b6c2f8d-a34c-4b86-a0d4-acd5ea87353a
> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Trying to deploy VM, vm
> has dcId: 1 and podId: 1
> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
> clusters: [], hosts: [7]
> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
> clusters: [], hosts: [7]
> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
> 2014-09-11 08:55:30,435 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
> :Starting to Stopped with event: OperationFailedvm's original host id:
> null new host id: null host id before state transition: null
> 2014-09-11 08:55:30,477 DEBUG [c.c.v.UserVmManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Destroying vm
> VM[User|giannitest] as it failed to create on Host with Id:null
> 2014-09-11 08:55:30,609 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
> :Stopped to Error with event: OperationFailedToErrorvm's original host
> id: null new host id: null host id before state transition: null
> 2014-09-11 08:55:30,809 WARN [o.a.c.alerts]
> (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) alertType:: 8 //
> dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed
> to deploy Vm with Id: 86, on Host with Id: null
> 2014-09-11 08:55:30,932 DEBUG [c.c.a.m.AgentManagerImpl]
> (AgentManager-Handler-1:null) Ping from 6
> 2014-09-11 08:55:31,078 ERROR [c.c.a.ApiAsyncJobDispatcher]
> (Job-Executor-55:ctx-b5c34ec7) Unexpected exception while executing
> org.apache.cloudstack.api.command.user.vm.DeployVMCmd
> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due to insufficient capacity
> at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:605)
> at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:237)
> at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:207)
> at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3581)
> at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3161)
> at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3147)
> at sun.reflect.GeneratedMethodAccessor587.invoke(Unknown
> Source) ...
>
>
> Il 01/08/2014 11:44, Geoff Higginbottom ha scritto:
> Ugo,
>
> Login to the VR and tail the messages log then attempt to start the VM, you should see various messages re DHCP updating etc in the VR. If you don't see the VR update try restarting the network Iain the 'cleanup' option, this will create a new VR.
>
> Regards
>
> Geoff Higginbottom
> CTO / Cloud Architect
>
> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603
> 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>
> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.c
> om><ma...@shapeblue.com> |
> www.shapeblue.com<http://www.shapeblue.com><htp://www.shapeblue.com/>
> | Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
>
> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
> 4HS<x-apple-data-detectors://5>
>
>
> On 1 Aug 2014, at 09:06, "Ugo Vasi" <ug...@procne.it>> wrote:
>
> Hi Geoff,
> I tried restarting r-29-VM but the problem is still blocking creation of new VM in that isolated network.
>
> Creating a new VM in another isolated network, it works. Where can I look at to find the problem?
>
>
>
> Il 31/07/2014 21:53, Geoff Higginbottom ha scritto:
> Ugo,
>
> Looks like CS is failing to update the VR with details for the new VM, try restarting the VR.
>
> Regards
>
> Geoff Higginbottom
> CTO / Cloud Architect
>
>
> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603
> 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>
> geoff.higginbottom@shapeblue.com<mailto:geoff.higginbottom@shapeblue.c
> om><ma...@shapeblue.com><mailto:geoff.higginbottom
> @shapeblue.com> |
> www.shapeblue.com<http://www.shapeblue.com><http://www.shapeblue.com><
> htp://www.shapeblue.com/>
>
> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N
> 4HS<x-apple-data-detectors://37>
>
>
>
> On 31 Jul 2014, at 15:40, "Ugo Vasi" <ug...@procne.it>> wrote:
>
> Hi everybody,
> I installed a CloudStack 4.3.0 system with a manager (in a virtual machine), two NFS primary storage, one NFS secondary storare and two host agent on ubuntu distribution.
>
> The cluster have one advanced zone without security group configuration with KVM hipervisors.
>
> I create some VM but now does not allow me to create more giving the error message "Unable to start a VM due to insufficient capacity".
>
> I am sure that the resources (ip, ram, cpu and storage) are enough to create new instances. In dashboard I see all ok.
>
> >From the management-server.log I see this errors messages (see attachment for full version) when I try to deploy a new virtual machine with 1x1GHz cpu, 1GB or RAM and 20GB disk space:
>
> 2014-07-31 14:59:11,983 DEBUG [c.c.a.t.Request]
> (AgentManager-Handler-12:null) Seq 1-684594119: Processing: { Ans: ,
> MgmtId: 77916390353436, via: 1, Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.a
> gent.api.Answer":{"result":false,"details":"VmDataCommand failed,
> check agent logs","wait":0}}] }
> 2014-07-31 14:59:11,983 INFO [c.c.v.VirtualMachineManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Unable to contact resource.
> com.cloud.exception.ResourceUnavailableException: Resource
> [DataCenter:1] is unreachable: Unable to apply userdata and password
> entry on router
> 2014-07-31 14:59:12,453 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from
> :Starting to Stopped with event: OperationFailedvm's original host id:
> null new host id: null host id before state transition: 7
> 2014-07-31 14:59:12,677 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from
> :Starting to Stopped with event: OperationFailedvm's original host id:
> null new host id: null host id before state transition: null
> 2014-07-31 14:59:12,708 DEBUG [c.c.v.UserVmManagerImpl]
> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Destroying vm
> VM[User|csweb2] as it failed to create on Host with Id:null
> 2014-07-31 14:59:12,738 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from
> :Stopped to Error with event: OperationFailedToErrorvm's original host
> id: null new host id: null host id before state transition: null
> 2014-07-31 14:59:12,929 WARN [o.a.c.alerts]
> (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) alertType:: 8 //
> dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed
> to deploy Vm with Id: 70, on Host with Id: null
> 2014-07-31 14:59:13,159 ERROR [c.c.a.ApiAsyncJobDispatcher]
> (Job-Executor-26:ctx-ab3aee38) Unexpected exception while executing
> org.apache.cloudstack.api.command.user.vm.DeployVMCmd
> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM
> due to insufficient capacity Caused by:
> com.cloud.exception.InsufficientServerCapacityException: Unable to
> create a deployment for VM[User|csweb2]Scope=interface
> com.cloud.dc.DataCenter; id=1
> 2014-07-31 14:59:13,161 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (Job-Executor-26:ctx-ab3aee38) Complete async job-783, jobStatus:
> FAILED, resultCode: 530, result:
> org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":
> [],"errorcode":530,"errortext":"Unable to start a VM due to
> insufficient capacity"}
> 2014-07-31 14:59:46,280 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (Job-Executor-27:ctx-82be396e ctx-41f0cf24) Stopped called on
> VM[User|csweb2] but the state is Error
> 2014-07-31 14:59:46,330 DEBUG [c.c.c.CapacityManagerImpl]
> (Job-Executor-27:ctx-82be396e ctx-41f0cf24) VM state transitted from
> :Error to Expunging with event: DestroyRequestedvm's original host id:
> null new host id: null host id before state transition: null
>
> I tried to search in others log file ("VmDataCommand failed, check agent logs"), but I don't found nothing...
>
> Can anyone Help me?
>
> --
>
> U g o V a s i <ug...@procne.it>>
> P r o c n e s.r.l >)
> via Cotonificio 45 33010 Tavagnacco IT
> phone: +390432486523 fax: +390432486523
>
> Le informazioni contenute in questo messaggio sono riservate e
> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
> Qualora Lei non fosse la persona a cui il presente messaggio ?
> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
> gentilmente comunicazione.
> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
> Rif. D.L. 196/2003
>
>
>
>
> <management-server.log>
> Find out more about ShapeBlue and our range of CloudStack related
> services
>
> IaaS Cloud Design &
> Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge - rapid IaaS deployment
> framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Infrastructure
> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training
> Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>
>
>
>
>
>
> --
>
> U g o V a s i <ug...@procne.it>>
> P r o c n e s.r.l >)
> via Cotonificio 45 33010 Tavagnacco IT
> phone: +390432486523 fax: +390432486523
>
> Le informazioni contenute in questo messaggio sono riservate e
> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
> Qualora Lei non fosse la persona a cui il presente messaggio ?
> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
> gentilmente comunicazione.
> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
> Rif. D.L. 196/2003
>
>
>
>
>
> Find out more about ShapeBlue and our range of CloudStack related
> services
>
> IaaS Cloud Design &
> Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge - rapid IaaS deployment
> framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Infrastructure
> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training
> Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>
>
>
>
>
>
> --
>
> U g o V a s i <ug...@procne.it>>
> P r o c n e s.r.l >)
> via Cotonificio 45 33010 Tavagnacco IT
> phone: +390432486523 fax: +390432486523
>
> Le informazioni contenute in questo messaggio sono riservate e
> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
> Qualora Lei non fosse la persona a cui il presente messaggio ?
> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
> gentilmente comunicazione.
> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
> Rif. D.L. 196/2003
>
>
> Find out more about ShapeBlue and our range of CloudStack related
> services
>
> IaaS Cloud Design &
> Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge - rapid IaaS deployment
> framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Infrastructure
> Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training
> Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>
>
>
>
--
U g o V a s i <ug...@procne.it>
P r o c n e s.r.l >)
via Cotonificio 45 33010 Tavagnacco IT
phone: +390432486523 fax: +390432486523
Le informazioni contenute in questo messaggio sono riservate e confidenziali ed è vietata la diffusione in qualunque modo eseguita.
Qualora Lei non fosse la persona a cui il presente messaggio è destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene gentilmente comunicazione.
Per qualsiasi informazione si prega di contattare support@procne.it .
Rif. D.L. 196/2003
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Re: Unable to start a VM due to insufficient capacity
Posted by Ugo Vasi <ug...@procne.it>.
Hi Geoff,
the problem is occurring in different networks (all?) that are not changed.
For us is a big problem because I can not predict when it occurs and the
creation of new machines is blocked until a network restarts (this
method, among other things, cause a small interruption of service).
What can I do to fix the problem?
Il 11/09/2014 09:28, Geoff Higginbottom ha scritto:
> Hi Ugo,
>
> Did restarting the network with cleanup option resolve your issue last time, if yes have you tried the same on this network?
>
> Regards
>
> Geoff Higginbottom
> CTO / Cloud Architect
>
> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>
> geoff.higginbottom@shapeblue.com<ma...@shapeblue.com> | www.shapeblue.com<htp://www.shapeblue.com/> | Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
>
> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N 4HS<x-apple-data-detectors://5>
>
>
> On 11 Sep 2014, at 08:17, "Ugo Vasi" <ug...@procne.it>> wrote:
>
> Hi Geoff,
> I still have the problem creating new VMs but in another isolated network. The problem seems to be the same:
>
> 2014-09-11 08:55:27,048 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM is being created in podId: 1
> 2014-09-11 08:55:27,050 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Network id=212 is already implemented
> 2014-09-11 08:55:27,118 DEBUG [c.c.n.NetworkModelImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not supported in the network id=212
> 2014-09-11 08:55:27,122 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of nics for network id=212 on 1
> 2014-09-11 08:55:27,174 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to prepare for Nic[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19]
> 2014-09-11 08:55:27,181 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is acquired for network id 212 as a part of router startup in Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(6))]
> 2014-09-11 08:55:27,183 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is released for network id 212 as a part of router startup in Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(6))]
> 2014-09-11 08:55:27,189 DEBUG [c.c.n.NetworkModelImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not supported in the network id=212
> 2014-09-11 08:55:27,198 DEBUG [c.c.n.NetworkModelImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not supported in the network id=212
> 2014-09-11 08:55:27,202 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Applying dhcp entry in network Ntwk[212|Guest|8]
> 2014-09-11 08:55:27,215 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304056: Sending { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:15:76:00:0e","vmIpAddress":"10.1.1.19","vmName":"giannitest","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:15:76:00:0e","isDefault":true,"executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.name":"r-60-VM","router.ip":"169.254.1.230"},"wait":0}}] }
> 2014-09-11 08:55:27,941 DEBUG [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-327037b2) Zone 1 is ready to launch secondary storage VM
> 2014-09-11 08:55:28,022 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-a8ba3b1e) Zone 1 is ready to launch console proxy
> 2014-09-11 08:55:28,820 DEBUG [c.c.a.ApiServlet] (catalina-exec-16:ctx-58e92382) ===START=== 192.168.130.89 -- GET command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0&response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418528731
> 2014-09-11 08:55:29,069 DEBUG [c.c.a.t.Request] (AgentManager-Handler-13:null) Seq 7-564304056: Processing: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
> 2014-09-11 08:55:29,069 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304056: Received: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { Answer } }
> 2014-09-11 08:55:29,075 DEBUG [c.c.n.NetworkModelImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not supported in the network id=212
> 2014-09-11 08:55:29,078 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Applying userdata and password entry in network Ntwk[212|Guest|8]
> 2014-09-11 08:55:29,089 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304057: Sending { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"10.1.1.19","vmName":"giannitest","executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.1.230","router.name":"r-60-VM"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.19","vmName":"giannitest","executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.1.230","router.name":"r-60-VM"},"wait":0}}] }
> 2014-09-11 08:55:29,399 DEBUG [c.c.a.t.Request] (AgentManager-Handler-10:null) Seq 7-564304057: Processing: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":false,"details":"VmDataCommand failed, check agent logs","wait":0}}] }
> 2014-09-11 08:55:29,491 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304057: Received: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { Answer, Answer } }
> 2014-09-11 08:55:29,491 INFO [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Unable to contact resource.
> com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is unreachable: Unable to apply userdata and password entry on router
> at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyRules(VirtualNetworkApplianceManagerImpl.java:3915)
> at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyUserData(VirtualNetworkApplianceManagerImpl.java:3118)
> at sun.reflect.GeneratedMethodAccessor472.invoke(Unknown Source)
> ...
> 2014-09-11 08:55:29,755 DEBUG [c.c.a.ApiServlet] (catalina-exec-16:ctx-58e92382 ctx-ad8ddf67) ===END=== 192.168.130.89 -- GET command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0&response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418528731
> 2014-09-11 08:55:29,798 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Cleaning up resources for the vm VM[User|giannitest] in Starting state
> 2014-09-11 08:55:29,800 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Sending { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"i-2-86-VM","wait":0}}] }
> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request] (AgentManager-Handler-6:null) Seq 7-564304058: Processing: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Received: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { StopAnswer } }
> 2014-09-11 08:55:29,955 DEBUG [c.c.n.NetworkModelImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not supported in the network id=212
> 2014-09-11 08:55:29,957 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of nics for network id=212 on -1
> 2014-09-11 08:55:30,051 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to release NicProfile[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19-null
> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully released network resources for the vm VM[User|giannitest]
> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully cleanued up resources for the vm VM[User|giannitest] in Starting state
> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [], clusters: [], hosts: [7]
> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
> 2014-09-11 08:55:30,214 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 7
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total CPU: 36256 and CPU after applying overprovisioning: 36256
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total RAM: 50639785984 and RAM after applying overprovisioning: 50639785984
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release cpu from host: 7, old used: 26500,reserved: 0, actual total: 36256, total with overprovisioning: 36256; new used: 26000,reserved:0; movedfromreserved: false,moveToReserveredfalse
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release mem from host: 7, old used: 21072183296,reserved: 0, total: 50639785984; new used: 20535312384,reserved:0; movedfromreserved: false,moveToReserveredfalse
> 2014-09-11 08:55:30,302 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
> 2014-09-11 08:55:30,302 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully transitioned to start state for VM[User|giannitest] reservation id = 4b6c2f8d-a34c-4b86-a0d4-acd5ea87353a
> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Trying to deploy VM, vm has dcId: 1 and podId: 1
> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [], clusters: [], hosts: [7]
> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [], clusters: [], hosts: [7]
> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
> 2014-09-11 08:55:30,435 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
> 2014-09-11 08:55:30,477 DEBUG [c.c.v.UserVmManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Destroying vm VM[User|giannitest] as it failed to create on Host with Id:null
> 2014-09-11 08:55:30,609 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Stopped to Error with event: OperationFailedToErrorvm's original host id: null new host id: null host id before state transition: null
> 2014-09-11 08:55:29,755 DEBUG [c.c.a.ApiServlet] (catalina-exec-16:ctx-58e92382 ctx-ad8ddf67) ===END=== 192.168.130.89 -- GET command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0&response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418528731
> 2014-09-11 08:55:29,798 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Cleaning up resources for the vm VM[User|giannitest] in Starting state
> 2014-09-11 08:55:29,800 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Sending { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"i-2-86-VM","wait":0}}] }
> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request] (AgentManager-Handler-6:null) Seq 7-564304058: Processing: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Received: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { StopAnswer } }
> 2014-09-11 08:55:29,955 DEBUG [c.c.n.NetworkModelImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not supported in the network id=212
> 2014-09-11 08:55:29,957 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of nics for network id=212 on -1
> 2014-09-11 08:55:30,051 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to release NicProfile[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19-null
> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully released network resources for the vm VM[User|giannitest]
> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully cleanued up resources for the vm VM[User|giannitest] in Starting state
> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [], clusters: [], hosts: [7]
> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
> 2014-09-11 08:55:30,214 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 7
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total CPU: 36256 and CPU after applying overprovisioning: 36256
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total RAM: 50639785984 and RAM after applying overprovisioning: 50639785984
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release cpu from host: 7, old used: 26500,reserved: 0, actual total: 36256, total with overprovisioning: 36256; new used: 26000,reserved:0; movedfromreserved: false,moveToReserveredfalse
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release mem from host: 7, old used: 21072183296,reserved: 0, total: 50639785984; new used: 20535312384,reserved:0; movedfromreserved: false,moveToReserveredfalse
> 2014-09-11 08:55:30,302 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
> 2014-09-11 08:55:30,302 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully transitioned to start state for VM[User|giannitest] reservation id = 4b6c2f8d-a34c-4b86-a0d4-acd5ea87353a
> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Trying to deploy VM, vm has dcId: 1 and podId: 1
> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [], clusters: [], hosts: [7]
> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [], clusters: [], hosts: [7]
> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
> 2014-09-11 08:55:30,435 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
> 2014-09-11 08:55:30,477 DEBUG [c.c.v.UserVmManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Destroying vm VM[User|giannitest] as it failed to create on Host with Id:null
> 2014-09-11 08:55:30,609 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Stopped to Error with event: OperationFailedToErrorvm's original host id: null new host id: null host id before state transition: null
> 2014-09-11 08:55:30,809 WARN [o.a.c.alerts] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) alertType:: 8 // dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed to deploy Vm with Id: 86, on Host with Id: null
> 2014-09-11 08:55:30,932 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-1:null) Ping from 6
> 2014-09-11 08:55:31,078 ERROR [c.c.a.ApiAsyncJobDispatcher] (Job-Executor-55:ctx-b5c34ec7) Unexpected exception while executing org.apache.cloudstack.api.command.user.vm.DeployVMCmd
> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due to insufficient capacity
> at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:605)
> at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:237)
> at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:207)
> at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3581)
> at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3161)
> at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3147)
> at sun.reflect.GeneratedMethodAccessor587.invoke(Unknown Source)
> ...
>
>
> Il 01/08/2014 11:44, Geoff Higginbottom ha scritto:
> Ugo,
>
> Login to the VR and tail the messages log then attempt to start the VM, you should see various messages re DHCP updating etc in the VR. If you don't see the VR update try restarting the network Iain the 'cleanup' option, this will create a new VR.
>
> Regards
>
> Geoff Higginbottom
> CTO / Cloud Architect
>
> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>
> geoff.higginbottom@shapeblue.com<ma...@shapeblue.com> | www.shapeblue.com<http://www.shapeblue.com><htp://www.shapeblue.com/> | Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
>
> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N 4HS<x-apple-data-detectors://5>
>
>
> On 1 Aug 2014, at 09:06, "Ugo Vasi" <ug...@procne.it>> wrote:
>
> Hi Geoff,
> I tried restarting r-29-VM but the problem is still blocking creation of new VM in that isolated network.
>
> Creating a new VM in another isolated network, it works. Where can I look at to find the problem?
>
>
>
> Il 31/07/2014 21:53, Geoff Higginbottom ha scritto:
> Ugo,
>
> Looks like CS is failing to update the VR with details for the new VM, try restarting the VR.
>
> Regards
>
> Geoff Higginbottom
> CTO / Cloud Architect
>
>
> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>
> geoff.higginbottom@shapeblue.com<ma...@shapeblue.com> | www.shapeblue.com<http://www.shapeblue.com><http://www.shapeblue.com><htp://www.shapeblue.com/>
>
> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N 4HS<x-apple-data-detectors://37>
>
>
>
> On 31 Jul 2014, at 15:40, "Ugo Vasi" <ug...@procne.it>> wrote:
>
> Hi everybody,
> I installed a CloudStack 4.3.0 system with a manager (in a virtual machine), two NFS primary storage, one NFS secondary storare and two host agent on ubuntu distribution.
>
> The cluster have one advanced zone without security group configuration with KVM hipervisors.
>
> I create some VM but now does not allow me to create more giving the error message "Unable to start a VM due to insufficient capacity".
>
> I am sure that the resources (ip, ram, cpu and storage) are enough to create new instances. In dashboard I see all ok.
>
> >From the management-server.log I see this errors messages (see attachment for full version) when I try to deploy a new virtual machine with 1x1GHz cpu, 1GB or RAM and 20GB disk space:
>
> 2014-07-31 14:59:11,983 DEBUG [c.c.a.t.Request] (AgentManager-Handler-12:null) Seq 1-684594119: Processing: { Ans: , MgmtId: 77916390353436, via: 1, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":false,"details":"VmDataCommand failed, check agent logs","wait":0}}] }
> 2014-07-31 14:59:11,983 INFO [c.c.v.VirtualMachineManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Unable to contact resource.
> com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is unreachable: Unable to apply userdata and password entry on router
> 2014-07-31 14:59:12,453 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 7
> 2014-07-31 14:59:12,677 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
> 2014-07-31 14:59:12,708 DEBUG [c.c.v.UserVmManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Destroying vm VM[User|csweb2] as it failed to create on Host with Id:null
> 2014-07-31 14:59:12,738 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from :Stopped to Error with event: OperationFailedToErrorvm's original host id: null new host id: null host id before state transition: null
> 2014-07-31 14:59:12,929 WARN [o.a.c.alerts] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) alertType:: 8 // dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed to deploy Vm with Id: 70, on Host with Id: null
> 2014-07-31 14:59:13,159 ERROR [c.c.a.ApiAsyncJobDispatcher] (Job-Executor-26:ctx-ab3aee38) Unexpected exception while executing org.apache.cloudstack.api.command.user.vm.DeployVMCmd
> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due to insufficient capacity
> Caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|csweb2]Scope=interface com.cloud.dc.DataCenter; id=1
> 2014-07-31 14:59:13,161 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Job-Executor-26:ctx-ab3aee38) Complete async job-783, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable to start a VM due to insufficient capacity"}
> 2014-07-31 14:59:46,280 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-27:ctx-82be396e ctx-41f0cf24) Stopped called on VM[User|csweb2] but the state is Error
> 2014-07-31 14:59:46,330 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-27:ctx-82be396e ctx-41f0cf24) VM state transitted from :Error to Expunging with event: DestroyRequestedvm's original host id: null new host id: null host id before state transition: null
>
> I tried to search in others log file ("VmDataCommand failed, check agent logs"), but I don't found nothing...
>
> Can anyone Help me?
>
> --
>
> U g o V a s i <ug...@procne.it>>
> P r o c n e s.r.l >)
> via Cotonificio 45 33010 Tavagnacco IT
> phone: +390432486523 fax: +390432486523
>
> Le informazioni contenute in questo messaggio sono riservate e
> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
> Qualora Lei non fosse la persona a cui il presente messaggio ?
> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
> gentilmente comunicazione.
> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
> Rif. D.L. 196/2003
>
>
>
>
> <management-server.log>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge - rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>
>
>
>
>
>
> --
>
> U g o V a s i <ug...@procne.it>>
> P r o c n e s.r.l >)
> via Cotonificio 45 33010 Tavagnacco IT
> phone: +390432486523 fax: +390432486523
>
> Le informazioni contenute in questo messaggio sono riservate e
> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
> Qualora Lei non fosse la persona a cui il presente messaggio ?
> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
> gentilmente comunicazione.
> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
> Rif. D.L. 196/2003
>
>
>
>
>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge - rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>
>
>
>
>
>
> --
>
> U g o V a s i <ug...@procne.it>>
> P r o c n e s.r.l >)
> via Cotonificio 45 33010 Tavagnacco IT
> phone: +390432486523 fax: +390432486523
>
> Le informazioni contenute in questo messaggio sono riservate e
> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
> Qualora Lei non fosse la persona a cui il presente messaggio ?
> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
> gentilmente comunicazione.
> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
> Rif. D.L. 196/2003
>
>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge - rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>
>
>
>
--
U g o V a s i <ug...@procne.it>
P r o c n e s.r.l >)
via Cotonificio 45 33010 Tavagnacco IT
phone: +390432486523 fax: +390432486523
Le informazioni contenute in questo messaggio sono riservate e
confidenziali ed è vietata la diffusione in qualunque modo eseguita.
Qualora Lei non fosse la persona a cui il presente messaggio è
destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
gentilmente comunicazione.
Per qualsiasi informazione si prega di contattare support@procne.it .
Rif. D.L. 196/2003
Re: Unable to start a VM due to insufficient capacity
Posted by Ugo Vasi <ug...@procne.it>.
Hi Geoff,
I had not tried to restart the network, I just restarted the virtual router.
I'll try tomorrow morning when the network server is not used, and I
will tell you.
thanks
Il 11/09/2014 09:28, Geoff Higginbottom ha scritto:
> Hi Ugo,
>
> Did restarting the network with cleanup option resolve your issue last time, if yes have you tried the same on this network?
>
> Regards
>
> Geoff Higginbottom
> CTO / Cloud Architect
>
> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>
> geoff.higginbottom@shapeblue.com<ma...@shapeblue.com> | www.shapeblue.com<htp://www.shapeblue.com/> | Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
>
> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N 4HS<x-apple-data-detectors://5>
>
>
> On 11 Sep 2014, at 08:17, "Ugo Vasi" <ug...@procne.it>> wrote:
>
> Hi Geoff,
> I still have the problem creating new VMs but in another isolated network. The problem seems to be the same:
>
> 2014-09-11 08:55:27,048 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM is being created in podId: 1
> 2014-09-11 08:55:27,050 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Network id=212 is already implemented
> 2014-09-11 08:55:27,118 DEBUG [c.c.n.NetworkModelImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not supported in the network id=212
> 2014-09-11 08:55:27,122 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of nics for network id=212 on 1
> 2014-09-11 08:55:27,174 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to prepare for Nic[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19]
> 2014-09-11 08:55:27,181 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is acquired for network id 212 as a part of router startup in Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(6))]
> 2014-09-11 08:55:27,183 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is released for network id 212 as a part of router startup in Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(6))]
> 2014-09-11 08:55:27,189 DEBUG [c.c.n.NetworkModelImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not supported in the network id=212
> 2014-09-11 08:55:27,198 DEBUG [c.c.n.NetworkModelImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not supported in the network id=212
> 2014-09-11 08:55:27,202 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Applying dhcp entry in network Ntwk[212|Guest|8]
> 2014-09-11 08:55:27,215 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304056: Sending { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:15:76:00:0e","vmIpAddress":"10.1.1.19","vmName":"giannitest","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:15:76:00:0e","isDefault":true,"executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.name":"r-60-VM","router.ip":"169.254.1.230"},"wait":0}}] }
> 2014-09-11 08:55:27,941 DEBUG [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-327037b2) Zone 1 is ready to launch secondary storage VM
> 2014-09-11 08:55:28,022 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-a8ba3b1e) Zone 1 is ready to launch console proxy
> 2014-09-11 08:55:28,820 DEBUG [c.c.a.ApiServlet] (catalina-exec-16:ctx-58e92382) ===START=== 192.168.130.89 -- GET command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0&response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418528731
> 2014-09-11 08:55:29,069 DEBUG [c.c.a.t.Request] (AgentManager-Handler-13:null) Seq 7-564304056: Processing: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
> 2014-09-11 08:55:29,069 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304056: Received: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { Answer } }
> 2014-09-11 08:55:29,075 DEBUG [c.c.n.NetworkModelImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not supported in the network id=212
> 2014-09-11 08:55:29,078 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Applying userdata and password entry in network Ntwk[212|Guest|8]
> 2014-09-11 08:55:29,089 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304057: Sending { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"10.1.1.19","vmName":"giannitest","executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.1.230","router.name":"r-60-VM"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.19","vmName":"giannitest","executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.1.230","router.name":"r-60-VM"},"wait":0}}] }
> 2014-09-11 08:55:29,399 DEBUG [c.c.a.t.Request] (AgentManager-Handler-10:null) Seq 7-564304057: Processing: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":false,"details":"VmDataCommand failed, check agent logs","wait":0}}] }
> 2014-09-11 08:55:29,491 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304057: Received: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { Answer, Answer } }
> 2014-09-11 08:55:29,491 INFO [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Unable to contact resource.
> com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is unreachable: Unable to apply userdata and password entry on router
> at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyRules(VirtualNetworkApplianceManagerImpl.java:3915)
> at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyUserData(VirtualNetworkApplianceManagerImpl.java:3118)
> at sun.reflect.GeneratedMethodAccessor472.invoke(Unknown Source)
> ...
> 2014-09-11 08:55:29,755 DEBUG [c.c.a.ApiServlet] (catalina-exec-16:ctx-58e92382 ctx-ad8ddf67) ===END=== 192.168.130.89 -- GET command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0&response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418528731
> 2014-09-11 08:55:29,798 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Cleaning up resources for the vm VM[User|giannitest] in Starting state
> 2014-09-11 08:55:29,800 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Sending { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"i-2-86-VM","wait":0}}] }
> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request] (AgentManager-Handler-6:null) Seq 7-564304058: Processing: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Received: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { StopAnswer } }
> 2014-09-11 08:55:29,955 DEBUG [c.c.n.NetworkModelImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not supported in the network id=212
> 2014-09-11 08:55:29,957 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of nics for network id=212 on -1
> 2014-09-11 08:55:30,051 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to release NicProfile[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19-null
> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully released network resources for the vm VM[User|giannitest]
> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully cleanued up resources for the vm VM[User|giannitest] in Starting state
> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [], clusters: [], hosts: [7]
> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
> 2014-09-11 08:55:30,214 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 7
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total CPU: 36256 and CPU after applying overprovisioning: 36256
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total RAM: 50639785984 and RAM after applying overprovisioning: 50639785984
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release cpu from host: 7, old used: 26500,reserved: 0, actual total: 36256, total with overprovisioning: 36256; new used: 26000,reserved:0; movedfromreserved: false,moveToReserveredfalse
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release mem from host: 7, old used: 21072183296,reserved: 0, total: 50639785984; new used: 20535312384,reserved:0; movedfromreserved: false,moveToReserveredfalse
> 2014-09-11 08:55:30,302 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
> 2014-09-11 08:55:30,302 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully transitioned to start state for VM[User|giannitest] reservation id = 4b6c2f8d-a34c-4b86-a0d4-acd5ea87353a
> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Trying to deploy VM, vm has dcId: 1 and podId: 1
> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [], clusters: [], hosts: [7]
> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [], clusters: [], hosts: [7]
> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
> 2014-09-11 08:55:30,435 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
> 2014-09-11 08:55:30,477 DEBUG [c.c.v.UserVmManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Destroying vm VM[User|giannitest] as it failed to create on Host with Id:null
> 2014-09-11 08:55:30,609 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Stopped to Error with event: OperationFailedToErrorvm's original host id: null new host id: null host id before state transition: null
> 2014-09-11 08:55:29,755 DEBUG [c.c.a.ApiServlet] (catalina-exec-16:ctx-58e92382 ctx-ad8ddf67) ===END=== 192.168.130.89 -- GET command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0&response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418528731
> 2014-09-11 08:55:29,798 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Cleaning up resources for the vm VM[User|giannitest] in Starting state
> 2014-09-11 08:55:29,800 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Sending { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"i-2-86-VM","wait":0}}] }
> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request] (AgentManager-Handler-6:null) Seq 7-564304058: Processing: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
> 2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Received: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { StopAnswer } }
> 2014-09-11 08:55:29,955 DEBUG [c.c.n.NetworkModelImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not supported in the network id=212
> 2014-09-11 08:55:29,957 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of nics for network id=212 on -1
> 2014-09-11 08:55:30,051 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to release NicProfile[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19-null
> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully released network resources for the vm VM[User|giannitest]
> 2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully cleanued up resources for the vm VM[User|giannitest] in Starting state
> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [], clusters: [], hosts: [7]
> 2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
> 2014-09-11 08:55:30,214 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 7
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total CPU: 36256 and CPU after applying overprovisioning: 36256
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total RAM: 50639785984 and RAM after applying overprovisioning: 50639785984
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release cpu from host: 7, old used: 26500,reserved: 0, actual total: 36256, total with overprovisioning: 36256; new used: 26000,reserved:0; movedfromreserved: false,moveToReserveredfalse
> 2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release mem from host: 7, old used: 21072183296,reserved: 0, total: 50639785984; new used: 20535312384,reserved:0; movedfromreserved: false,moveToReserveredfalse
> 2014-09-11 08:55:30,302 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
> 2014-09-11 08:55:30,302 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully transitioned to start state for VM[User|giannitest] reservation id = 4b6c2f8d-a34c-4b86-a0d4-acd5ea87353a
> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Trying to deploy VM, vm has dcId: 1 and podId: 1
> 2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [], clusters: [], hosts: [7]
> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [], clusters: [], hosts: [7]
> 2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
> 2014-09-11 08:55:30,435 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
> 2014-09-11 08:55:30,477 DEBUG [c.c.v.UserVmManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Destroying vm VM[User|giannitest] as it failed to create on Host with Id:null
> 2014-09-11 08:55:30,609 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Stopped to Error with event: OperationFailedToErrorvm's original host id: null new host id: null host id before state transition: null
> 2014-09-11 08:55:30,809 WARN [o.a.c.alerts] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) alertType:: 8 // dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed to deploy Vm with Id: 86, on Host with Id: null
> 2014-09-11 08:55:30,932 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-1:null) Ping from 6
> 2014-09-11 08:55:31,078 ERROR [c.c.a.ApiAsyncJobDispatcher] (Job-Executor-55:ctx-b5c34ec7) Unexpected exception while executing org.apache.cloudstack.api.command.user.vm.DeployVMCmd
> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due to insufficient capacity
> at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:605)
> at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:237)
> at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:207)
> at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3581)
> at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3161)
> at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3147)
> at sun.reflect.GeneratedMethodAccessor587.invoke(Unknown Source)
> ...
>
>
> Il 01/08/2014 11:44, Geoff Higginbottom ha scritto:
> Ugo,
>
> Login to the VR and tail the messages log then attempt to start the VM, you should see various messages re DHCP updating etc in the VR. If you don't see the VR update try restarting the network Iain the 'cleanup' option, this will create a new VR.
>
> Regards
>
> Geoff Higginbottom
> CTO / Cloud Architect
>
> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>
> geoff.higginbottom@shapeblue.com<ma...@shapeblue.com> | www.shapeblue.com<http://www.shapeblue.com><htp://www.shapeblue.com/> | Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
>
> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N 4HS<x-apple-data-detectors://5>
>
>
> On 1 Aug 2014, at 09:06, "Ugo Vasi" <ug...@procne.it>> wrote:
>
> Hi Geoff,
> I tried restarting r-29-VM but the problem is still blocking creation of new VM in that isolated network.
>
> Creating a new VM in another isolated network, it works. Where can I look at to find the problem?
>
>
>
> Il 31/07/2014 21:53, Geoff Higginbottom ha scritto:
> Ugo,
>
> Looks like CS is failing to update the VR with details for the new VM, try restarting the VR.
>
> Regards
>
> Geoff Higginbottom
> CTO / Cloud Architect
>
>
> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>
> geoff.higginbottom@shapeblue.com<ma...@shapeblue.com> | www.shapeblue.com<http://www.shapeblue.com><http://www.shapeblue.com><htp://www.shapeblue.com/>
>
> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N 4HS<x-apple-data-detectors://37>
>
>
>
> On 31 Jul 2014, at 15:40, "Ugo Vasi" <ug...@procne.it>> wrote:
>
> Hi everybody,
> I installed a CloudStack 4.3.0 system with a manager (in a virtual machine), two NFS primary storage, one NFS secondary storare and two host agent on ubuntu distribution.
>
> The cluster have one advanced zone without security group configuration with KVM hipervisors.
>
> I create some VM but now does not allow me to create more giving the error message "Unable to start a VM due to insufficient capacity".
>
> I am sure that the resources (ip, ram, cpu and storage) are enough to create new instances. In dashboard I see all ok.
>
> >From the management-server.log I see this errors messages (see attachment for full version) when I try to deploy a new virtual machine with 1x1GHz cpu, 1GB or RAM and 20GB disk space:
>
> 2014-07-31 14:59:11,983 DEBUG [c.c.a.t.Request] (AgentManager-Handler-12:null) Seq 1-684594119: Processing: { Ans: , MgmtId: 77916390353436, via: 1, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":false,"details":"VmDataCommand failed, check agent logs","wait":0}}] }
> 2014-07-31 14:59:11,983 INFO [c.c.v.VirtualMachineManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Unable to contact resource.
> com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is unreachable: Unable to apply userdata and password entry on router
> 2014-07-31 14:59:12,453 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 7
> 2014-07-31 14:59:12,677 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
> 2014-07-31 14:59:12,708 DEBUG [c.c.v.UserVmManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Destroying vm VM[User|csweb2] as it failed to create on Host with Id:null
> 2014-07-31 14:59:12,738 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from :Stopped to Error with event: OperationFailedToErrorvm's original host id: null new host id: null host id before state transition: null
> 2014-07-31 14:59:12,929 WARN [o.a.c.alerts] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) alertType:: 8 // dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed to deploy Vm with Id: 70, on Host with Id: null
> 2014-07-31 14:59:13,159 ERROR [c.c.a.ApiAsyncJobDispatcher] (Job-Executor-26:ctx-ab3aee38) Unexpected exception while executing org.apache.cloudstack.api.command.user.vm.DeployVMCmd
> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due to insufficient capacity
> Caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|csweb2]Scope=interface com.cloud.dc.DataCenter; id=1
> 2014-07-31 14:59:13,161 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Job-Executor-26:ctx-ab3aee38) Complete async job-783, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable to start a VM due to insufficient capacity"}
> 2014-07-31 14:59:46,280 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-27:ctx-82be396e ctx-41f0cf24) Stopped called on VM[User|csweb2] but the state is Error
> 2014-07-31 14:59:46,330 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-27:ctx-82be396e ctx-41f0cf24) VM state transitted from :Error to Expunging with event: DestroyRequestedvm's original host id: null new host id: null host id before state transition: null
>
> I tried to search in others log file ("VmDataCommand failed, check agent logs"), but I don't found nothing...
>
> Can anyone Help me?
>
> --
>
> U g o V a s i <ug...@procne.it>>
> P r o c n e s.r.l >)
> via Cotonificio 45 33010 Tavagnacco IT
> phone: +390432486523 fax: +390432486523
>
> Le informazioni contenute in questo messaggio sono riservate e
> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
> Qualora Lei non fosse la persona a cui il presente messaggio ?
> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
> gentilmente comunicazione.
> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
> Rif. D.L. 196/2003
>
>
>
>
> <management-server.log>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge - rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>
>
>
>
>
>
> --
>
> U g o V a s i <ug...@procne.it>>
> P r o c n e s.r.l >)
> via Cotonificio 45 33010 Tavagnacco IT
> phone: +390432486523 fax: +390432486523
>
> Le informazioni contenute in questo messaggio sono riservate e
> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
> Qualora Lei non fosse la persona a cui il presente messaggio ?
> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
> gentilmente comunicazione.
> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
> Rif. D.L. 196/2003
>
>
>
>
>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge - rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>
>
>
>
>
>
> --
>
> U g o V a s i <ug...@procne.it>>
> P r o c n e s.r.l >)
> via Cotonificio 45 33010 Tavagnacco IT
> phone: +390432486523 fax: +390432486523
>
> Le informazioni contenute in questo messaggio sono riservate e
> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
> Qualora Lei non fosse la persona a cui il presente messaggio ?
> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
> gentilmente comunicazione.
> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
> Rif. D.L. 196/2003
>
>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge - rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>
>
>
>
--
U g o V a s i <ug...@procne.it>
P r o c n e s.r.l >)
via Cotonificio 45 33010 Tavagnacco IT
phone: +390432486523 fax: +390432486523
Le informazioni contenute in questo messaggio sono riservate e
confidenziali ed è vietata la diffusione in qualunque modo eseguita.
Qualora Lei non fosse la persona a cui il presente messaggio è
destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
gentilmente comunicazione.
Per qualsiasi informazione si prega di contattare support@procne.it .
Rif. D.L. 196/2003
Re: Unable to start a VM due to insufficient capacity
Posted by Geoff Higginbottom <ge...@shapeblue.com>.
Hi Ugo,
Did restarting the network with cleanup option resolve your issue last time, if yes have you tried the same on this network?
Regards
Geoff Higginbottom
CTO / Cloud Architect
D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
geoff.higginbottom@shapeblue.com<ma...@shapeblue.com> | www.shapeblue.com<htp://www.shapeblue.com/> | Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N 4HS<x-apple-data-detectors://5>
On 11 Sep 2014, at 08:17, "Ugo Vasi" <ug...@procne.it>> wrote:
Hi Geoff,
I still have the problem creating new VMs but in another isolated network. The problem seems to be the same:
2014-09-11 08:55:27,048 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM is being created in podId: 1
2014-09-11 08:55:27,050 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Network id=212 is already implemented
2014-09-11 08:55:27,118 DEBUG [c.c.n.NetworkModelImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not supported in the network id=212
2014-09-11 08:55:27,122 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of nics for network id=212 on 1
2014-09-11 08:55:27,174 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to prepare for Nic[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19]
2014-09-11 08:55:27,181 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is acquired for network id 212 as a part of router startup in Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(6))]
2014-09-11 08:55:27,183 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is released for network id 212 as a part of router startup in Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(6))]
2014-09-11 08:55:27,189 DEBUG [c.c.n.NetworkModelImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not supported in the network id=212
2014-09-11 08:55:27,198 DEBUG [c.c.n.NetworkModelImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not supported in the network id=212
2014-09-11 08:55:27,202 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Applying dhcp entry in network Ntwk[212|Guest|8]
2014-09-11 08:55:27,215 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304056: Sending { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:15:76:00:0e","vmIpAddress":"10.1.1.19","vmName":"giannitest","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:15:76:00:0e","isDefault":true,"executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.name":"r-60-VM","router.ip":"169.254.1.230"},"wait":0}}] }
2014-09-11 08:55:27,941 DEBUG [c.c.s.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-327037b2) Zone 1 is ready to launch secondary storage VM
2014-09-11 08:55:28,022 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-a8ba3b1e) Zone 1 is ready to launch console proxy
2014-09-11 08:55:28,820 DEBUG [c.c.a.ApiServlet] (catalina-exec-16:ctx-58e92382) ===START=== 192.168.130.89 -- GET command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0&response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418528731
2014-09-11 08:55:29,069 DEBUG [c.c.a.t.Request] (AgentManager-Handler-13:null) Seq 7-564304056: Processing: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
2014-09-11 08:55:29,069 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304056: Received: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { Answer } }
2014-09-11 08:55:29,075 DEBUG [c.c.n.NetworkModelImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not supported in the network id=212
2014-09-11 08:55:29,078 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Applying userdata and password entry in network Ntwk[212|Guest|8]
2014-09-11 08:55:29,089 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304057: Sending { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"10.1.1.19","vmName":"giannitest","executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.1.230","router.name":"r-60-VM"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.19","vmName":"giannitest","executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.1.230","router.name":"r-60-VM"},"wait":0}}] }
2014-09-11 08:55:29,399 DEBUG [c.c.a.t.Request] (AgentManager-Handler-10:null) Seq 7-564304057: Processing: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":false,"details":"VmDataCommand failed, check agent logs","wait":0}}] }
2014-09-11 08:55:29,491 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304057: Received: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { Answer, Answer } }
2014-09-11 08:55:29,491 INFO [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Unable to contact resource.
com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is unreachable: Unable to apply userdata and password entry on router
at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyRules(VirtualNetworkApplianceManagerImpl.java:3915)
at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyUserData(VirtualNetworkApplianceManagerImpl.java:3118)
at sun.reflect.GeneratedMethodAccessor472.invoke(Unknown Source)
...
2014-09-11 08:55:29,755 DEBUG [c.c.a.ApiServlet] (catalina-exec-16:ctx-58e92382 ctx-ad8ddf67) ===END=== 192.168.130.89 -- GET command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0&response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418528731
2014-09-11 08:55:29,798 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Cleaning up resources for the vm VM[User|giannitest] in Starting state
2014-09-11 08:55:29,800 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Sending { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"i-2-86-VM","wait":0}}] }
2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request] (AgentManager-Handler-6:null) Seq 7-564304058: Processing: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Received: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { StopAnswer } }
2014-09-11 08:55:29,955 DEBUG [c.c.n.NetworkModelImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not supported in the network id=212
2014-09-11 08:55:29,957 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of nics for network id=212 on -1
2014-09-11 08:55:30,051 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to release NicProfile[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19-null
2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully released network resources for the vm VM[User|giannitest]
2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully cleanued up resources for the vm VM[User|giannitest] in Starting state
2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [], clusters: [], hosts: [7]
2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
2014-09-11 08:55:30,214 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 7
2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total CPU: 36256 and CPU after applying overprovisioning: 36256
2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total RAM: 50639785984 and RAM after applying overprovisioning: 50639785984
2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release cpu from host: 7, old used: 26500,reserved: 0, actual total: 36256, total with overprovisioning: 36256; new used: 26000,reserved:0; movedfromreserved: false,moveToReserveredfalse
2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release mem from host: 7, old used: 21072183296,reserved: 0, total: 50639785984; new used: 20535312384,reserved:0; movedfromreserved: false,moveToReserveredfalse
2014-09-11 08:55:30,302 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
2014-09-11 08:55:30,302 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully transitioned to start state for VM[User|giannitest] reservation id = 4b6c2f8d-a34c-4b86-a0d4-acd5ea87353a
2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Trying to deploy VM, vm has dcId: 1 and podId: 1
2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [], clusters: [], hosts: [7]
2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [], clusters: [], hosts: [7]
2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
2014-09-11 08:55:30,435 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
2014-09-11 08:55:30,477 DEBUG [c.c.v.UserVmManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Destroying vm VM[User|giannitest] as it failed to create on Host with Id:null
2014-09-11 08:55:30,609 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Stopped to Error with event: OperationFailedToErrorvm's original host id: null new host id: null host id before state transition: null
2014-09-11 08:55:29,755 DEBUG [c.c.a.ApiServlet] (catalina-exec-16:ctx-58e92382 ctx-ad8ddf67) ===END=== 192.168.130.89 -- GET command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0&response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418528731
2014-09-11 08:55:29,798 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Cleaning up resources for the vm VM[User|giannitest] in Starting state
2014-09-11 08:55:29,800 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Sending { Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"i-2-86-VM","wait":0}}] }
2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request] (AgentManager-Handler-6:null) Seq 7-564304058: Processing: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, [{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Received: { Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { StopAnswer } }
2014-09-11 08:55:29,955 DEBUG [c.c.n.NetworkModelImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not supported in the network id=212
2014-09-11 08:55:29,957 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of nics for network id=212 on -1
2014-09-11 08:55:30,051 DEBUG [o.a.c.e.o.NetworkOrchestrator] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to release NicProfile[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19-null
2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully released network resources for the vm VM[User|giannitest]
2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully cleanued up resources for the vm VM[User|giannitest] in Starting state
2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [], clusters: [], hosts: [7]
2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
2014-09-11 08:55:30,214 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 7
2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total CPU: 36256 and CPU after applying overprovisioning: 36256
2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total RAM: 50639785984 and RAM after applying overprovisioning: 50639785984
2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release cpu from host: 7, old used: 26500,reserved: 0, actual total: 36256, total with overprovisioning: 36256; new used: 26000,reserved:0; movedfromreserved: false,moveToReserveredfalse
2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release mem from host: 7, old used: 21072183296,reserved: 0, total: 50639785984; new used: 20535312384,reserved:0; movedfromreserved: false,moveToReserveredfalse
2014-09-11 08:55:30,302 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Stopped to Starting with event: StartRequestedvm's original host id: null new host id: null host id before state transition: null
2014-09-11 08:55:30,302 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully transitioned to start state for VM[User|giannitest] reservation id = 4b6c2f8d-a34c-4b86-a0d4-acd5ea87353a
2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Trying to deploy VM, vm has dcId: 1 and podId: 1
2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [], clusters: [], hosts: [7]
2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [], clusters: [], hosts: [7]
2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
2014-09-11 08:55:30,435 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
2014-09-11 08:55:30,477 DEBUG [c.c.v.UserVmManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Destroying vm VM[User|giannitest] as it failed to create on Host with Id:null
2014-09-11 08:55:30,609 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from :Stopped to Error with event: OperationFailedToErrorvm's original host id: null new host id: null host id before state transition: null
2014-09-11 08:55:30,809 WARN [o.a.c.alerts] (Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) alertType:: 8 // dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed to deploy Vm with Id: 86, on Host with Id: null
2014-09-11 08:55:30,932 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-1:null) Ping from 6
2014-09-11 08:55:31,078 ERROR [c.c.a.ApiAsyncJobDispatcher] (Job-Executor-55:ctx-b5c34ec7) Unexpected exception while executing org.apache.cloudstack.api.command.user.vm.DeployVMCmd
com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due to insufficient capacity
at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:605)
at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:237)
at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:207)
at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3581)
at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3161)
at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3147)
at sun.reflect.GeneratedMethodAccessor587.invoke(Unknown Source)
...
Il 01/08/2014 11:44, Geoff Higginbottom ha scritto:
Ugo,
Login to the VR and tail the messages log then attempt to start the VM, you should see various messages re DHCP updating etc in the VR. If you don't see the VR update try restarting the network Iain the 'cleanup' option, this will create a new VR.
Regards
Geoff Higginbottom
CTO / Cloud Architect
D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
geoff.higginbottom@shapeblue.com<ma...@shapeblue.com> | www.shapeblue.com<http://www.shapeblue.com><htp://www.shapeblue.com/> | Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N 4HS<x-apple-data-detectors://5>
On 1 Aug 2014, at 09:06, "Ugo Vasi" <ug...@procne.it>> wrote:
Hi Geoff,
I tried restarting r-29-VM but the problem is still blocking creation of new VM in that isolated network.
Creating a new VM in another isolated network, it works. Where can I look at to find the problem?
Il 31/07/2014 21:53, Geoff Higginbottom ha scritto:
Ugo,
Looks like CS is failing to update the VR with details for the new VM, try restarting the VR.
Regards
Geoff Higginbottom
CTO / Cloud Architect
D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
geoff.higginbottom@shapeblue.com<ma...@shapeblue.com> | www.shapeblue.com<http://www.shapeblue.com><http://www.shapeblue.com><htp://www.shapeblue.com/>
ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N 4HS<x-apple-data-detectors://37>
On 31 Jul 2014, at 15:40, "Ugo Vasi" <ug...@procne.it>> wrote:
Hi everybody,
I installed a CloudStack 4.3.0 system with a manager (in a virtual machine), two NFS primary storage, one NFS secondary storare and two host agent on ubuntu distribution.
The cluster have one advanced zone without security group configuration with KVM hipervisors.
I create some VM but now does not allow me to create more giving the error message "Unable to start a VM due to insufficient capacity".
I am sure that the resources (ip, ram, cpu and storage) are enough to create new instances. In dashboard I see all ok.
>From the management-server.log I see this errors messages (see attachment for full version) when I try to deploy a new virtual machine with 1x1GHz cpu, 1GB or RAM and 20GB disk space:
2014-07-31 14:59:11,983 DEBUG [c.c.a.t.Request] (AgentManager-Handler-12:null) Seq 1-684594119: Processing: { Ans: , MgmtId: 77916390353436, via: 1, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":false,"details":"VmDataCommand failed, check agent logs","wait":0}}] }
2014-07-31 14:59:11,983 INFO [c.c.v.VirtualMachineManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Unable to contact resource.
com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is unreachable: Unable to apply userdata and password entry on router
2014-07-31 14:59:12,453 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 7
2014-07-31 14:59:12,677 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
2014-07-31 14:59:12,708 DEBUG [c.c.v.UserVmManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Destroying vm VM[User|csweb2] as it failed to create on Host with Id:null
2014-07-31 14:59:12,738 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from :Stopped to Error with event: OperationFailedToErrorvm's original host id: null new host id: null host id before state transition: null
2014-07-31 14:59:12,929 WARN [o.a.c.alerts] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) alertType:: 8 // dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed to deploy Vm with Id: 70, on Host with Id: null
2014-07-31 14:59:13,159 ERROR [c.c.a.ApiAsyncJobDispatcher] (Job-Executor-26:ctx-ab3aee38) Unexpected exception while executing org.apache.cloudstack.api.command.user.vm.DeployVMCmd
com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due to insufficient capacity
Caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|csweb2]Scope=interface com.cloud.dc.DataCenter; id=1
2014-07-31 14:59:13,161 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Job-Executor-26:ctx-ab3aee38) Complete async job-783, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable to start a VM due to insufficient capacity"}
2014-07-31 14:59:46,280 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-27:ctx-82be396e ctx-41f0cf24) Stopped called on VM[User|csweb2] but the state is Error
2014-07-31 14:59:46,330 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-27:ctx-82be396e ctx-41f0cf24) VM state transitted from :Error to Expunging with event: DestroyRequestedvm's original host id: null new host id: null host id before state transition: null
I tried to search in others log file ("VmDataCommand failed, check agent logs"), but I don't found nothing...
Can anyone Help me?
--
U g o V a s i <ug...@procne.it>>
P r o c n e s.r.l >)
via Cotonificio 45 33010 Tavagnacco IT
phone: +390432486523 fax: +390432486523
Le informazioni contenute in questo messaggio sono riservate e
confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
Qualora Lei non fosse la persona a cui il presente messaggio ?
destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
gentilmente comunicazione.
Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
Rif. D.L. 196/2003
<management-server.log>
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge - rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
--
U g o V a s i <ug...@procne.it>>
P r o c n e s.r.l >)
via Cotonificio 45 33010 Tavagnacco IT
phone: +390432486523 fax: +390432486523
Le informazioni contenute in questo messaggio sono riservate e
confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
Qualora Lei non fosse la persona a cui il presente messaggio ?
destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
gentilmente comunicazione.
Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
Rif. D.L. 196/2003
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge - rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
--
U g o V a s i <ug...@procne.it>>
P r o c n e s.r.l >)
via Cotonificio 45 33010 Tavagnacco IT
phone: +390432486523 fax: +390432486523
Le informazioni contenute in questo messaggio sono riservate e
confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
Qualora Lei non fosse la persona a cui il presente messaggio ?
destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
gentilmente comunicazione.
Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
Rif. D.L. 196/2003
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge - rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Re: Unable to start a VM due to insufficient capacity
Posted by Ugo Vasi <ug...@procne.it>.
Hi Geoff,
I still have the problem creating new VMs but in another isolated
network. The problem seems to be the same:
2014-09-11 08:55:27,048 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM is being created in podId: 1
2014-09-11 08:55:27,050 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Network id=212 is already
implemented
2014-09-11 08:55:27,118 DEBUG [c.c.n.NetworkModelImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not
supported in the network id=212
2014-09-11 08:55:27,122 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
nics for network id=212 on 1
2014-09-11 08:55:27,174 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
prepare for Nic[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19]
2014-09-11 08:55:27,181 DEBUG
[c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is acquired for network
id 212 as a part of router startup in
Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
: Dest[Zone(1)-Pod(1)-Cluster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(6))]
2014-09-11 08:55:27,183 DEBUG
[c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Lock is released for network
id 212 as a part of router startup in
Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
: Dest[Zone(1)-Pod(1)-Cluster(1)-Host(7)-Storage(Volume(98|ROOT-->Pool(6))]
2014-09-11 08:55:27,189 DEBUG [c.c.n.NetworkModelImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not
supported in the network id=212
2014-09-11 08:55:27,198 DEBUG [c.c.n.NetworkModelImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not
supported in the network id=212
2014-09-11 08:55:27,202 DEBUG
[c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Applying dhcp entry in
network Ntwk[212|Guest|8]
2014-09-11 08:55:27,215 DEBUG [c.c.a.t.Request]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304056: Sending {
Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
[{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:15:76:00:0e","vmIpAddress":"10.1.1.19","vmName":"giannitest","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:15:76:00:0e","isDefault":true,"executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.name":"r-60-VM","router.ip":"169.254.1.230"},"wait":0}}]
}
2014-09-11 08:55:27,941 DEBUG [c.c.s.s.SecondaryStorageManagerImpl]
(secstorage-1:ctx-327037b2) Zone 1 is ready to launch secondary storage VM
2014-09-11 08:55:28,022 DEBUG [c.c.c.ConsoleProxyManagerImpl]
(consoleproxy-1:ctx-a8ba3b1e) Zone 1 is ready to launch console proxy
2014-09-11 08:55:28,820 DEBUG [c.c.a.ApiServlet]
(catalina-exec-16:ctx-58e92382) ===START=== 192.168.130.89 -- GET
command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0&response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418528731
2014-09-11 08:55:29,069 DEBUG [c.c.a.t.Request]
(AgentManager-Handler-13:null) Seq 7-564304056: Processing: { Ans: ,
MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
[{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
2014-09-11 08:55:29,069 DEBUG [c.c.a.t.Request]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304056: Received:
{ Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { Answer } }
2014-09-11 08:55:29,075 DEBUG [c.c.n.NetworkModelImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not
supported in the network id=212
2014-09-11 08:55:29,078 DEBUG
[c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Applying userdata and
password entry in network Ntwk[212|Guest|8]
2014-09-11 08:55:29,089 DEBUG [c.c.a.t.Request]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304057: Sending {
Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
[{"com.cloud.agent.api.routing.SavePasswordCommand":{,"vmIpAddress":"10.1.1.19","vmName":"giannitest","executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.1.230","router.name":"r-60-VM"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.19","vmName":"giannitest","executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.1.230","router.name":"r-60-VM"},"wait":0}}]
}
2014-09-11 08:55:29,399 DEBUG [c.c.a.t.Request]
(AgentManager-Handler-10:null) Seq 7-564304057: Processing: { Ans: ,
MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
[{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":false,"details":"VmDataCommand
failed, check agent logs","wait":0}}] }
2014-09-11 08:55:29,491 DEBUG [c.c.a.t.Request]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304057: Received:
{ Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, { Answer,
Answer } }
2014-09-11 08:55:29,491 INFO [c.c.v.VirtualMachineManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Unable to contact resource.
com.cloud.exception.ResourceUnavailableException: Resource
[DataCenter:1] is unreachable: Unable to apply userdata and password
entry on router
at
com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyRules(VirtualNetworkApplianceManagerImpl.java:3915)
at
com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyUserData(VirtualNetworkApplianceManagerImpl.java:3118)
at sun.reflect.GeneratedMethodAccessor472.invoke(Unknown Source)
...
2014-09-11 08:55:29,755 DEBUG [c.c.a.ApiServlet]
(catalina-exec-16:ctx-58e92382 ctx-ad8ddf67) ===END=== 192.168.130.89 --
GET
command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0&response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418528731
2014-09-11 08:55:29,798 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Cleaning up resources for
the vm VM[User|giannitest] in Starting state
2014-09-11 08:55:29,800 DEBUG [c.c.a.t.Request]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Sending {
Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
[{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"i-2-86-VM","wait":0}}]
}
2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
(AgentManager-Handler-6:null) Seq 7-564304058: Processing: { Ans: ,
MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
[{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Received:
{ Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, {
StopAnswer } }
2014-09-11 08:55:29,955 DEBUG [c.c.n.NetworkModelImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not
supported in the network id=212
2014-09-11 08:55:29,957 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
nics for network id=212 on -1
2014-09-11 08:55:30,051 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
release
NicProfile[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19-null
2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully released
network resources for the vm VM[User|giannitest]
2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully cleanued up
resources for the vm VM[User|giannitest] in Starting state
2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
clusters: [], hosts: [7]
2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided
is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
2014-09-11 08:55:30,214 DEBUG [c.c.c.CapacityManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
:Starting to Stopped with event: OperationFailedvm's original host id:
null new host id: null host id before state transition: 7
2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total CPU:
36256 and CPU after applying overprovisioning: 36256
2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total RAM:
50639785984 and RAM after applying overprovisioning: 50639785984
2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release cpu from host: 7,
old used: 26500,reserved: 0, actual total: 36256, total with
overprovisioning: 36256; new used: 26000,reserved:0; movedfromreserved:
false,moveToReserveredfalse
2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release mem from host: 7,
old used: 21072183296,reserved: 0, total: 50639785984; new used:
20535312384,reserved:0; movedfromreserved: false,moveToReserveredfalse
2014-09-11 08:55:30,302 DEBUG [c.c.c.CapacityManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
:Stopped to Starting with event: StartRequestedvm's original host id:
null new host id: null host id before state transition: null
2014-09-11 08:55:30,302 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully transitioned to
start state for VM[User|giannitest] reservation id =
4b6c2f8d-a34c-4b86-a0d4-acd5ea87353a
2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Trying to deploy VM, vm has
dcId: 1 and podId: 1
2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
clusters: [], hosts: [7]
2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
clusters: [], hosts: [7]
2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided
is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
2014-09-11 08:55:30,435 DEBUG [c.c.c.CapacityManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
:Starting to Stopped with event: OperationFailedvm's original host id:
null new host id: null host id before state transition: null
2014-09-11 08:55:30,477 DEBUG [c.c.v.UserVmManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Destroying vm
VM[User|giannitest] as it failed to create on Host with Id:null
2014-09-11 08:55:30,609 DEBUG [c.c.c.CapacityManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
:Stopped to Error with event: OperationFailedToErrorvm's original host
id: null new host id: null host id before state transition: null
2014-09-11 08:55:29,755 DEBUG [c.c.a.ApiServlet]
(catalina-exec-16:ctx-58e92382 ctx-ad8ddf67) ===END=== 192.168.130.89 --
GET
command=queryAsyncJobResult&jobId=195bf80a-9823-4ec3-add4-8907b98fbaf0&response=json&sessionkey=qGZA6KYoc1SB%2Bq2k70HoM%2BBBQTU%3D&_=1410418528731
2014-09-11 08:55:29,798 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Cleaning up resources for
the vm VM[User|giannitest] in Starting state
2014-09-11 08:55:29,800 DEBUG [c.c.a.t.Request]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Sending {
Cmd , MgmtId: 77916390353436, via: 7(csh1b), Ver: v1, Flags: 100011,
[{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"i-2-86-VM","wait":0}}]
}
2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
(AgentManager-Handler-6:null) Seq 7-564304058: Processing: { Ans: ,
MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10,
[{"com.cloud.agent.api.StopAnswer":{"result":true,"wait":0}}] }
2014-09-11 08:55:29,950 DEBUG [c.c.a.t.Request]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Seq 7-564304058: Received:
{ Ans: , MgmtId: 77916390353436, via: 7, Ver: v1, Flags: 10, {
StopAnswer } }
2014-09-11 08:55:29,955 DEBUG [c.c.n.NetworkModelImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Service SecurityGroup is not
supported in the network id=212
2014-09-11 08:55:29,957 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Changing active number of
nics for network id=212 on -1
2014-09-11 08:55:30,051 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Asking VirtualRouter to
release
NicProfile[116-86-8429f13f-7c3b-4b8a-aea3-9b8e9a3f4c03-10.1.1.19-null
2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully released
network resources for the vm VM[User|giannitest]
2014-09-11 08:55:30,051 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully cleanued up
resources for the vm VM[User|giannitest] in Starting state
2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
clusters: [], hosts: [7]
2014-09-11 08:55:30,058 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided
is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
2014-09-11 08:55:30,214 DEBUG [c.c.c.CapacityManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
:Starting to Stopped with event: OperationFailedvm's original host id:
null new host id: null host id before state transition: 7
2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total CPU:
36256 and CPU after applying overprovisioning: 36256
2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Hosts's actual total RAM:
50639785984 and RAM after applying overprovisioning: 50639785984
2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release cpu from host: 7,
old used: 26500,reserved: 0, actual total: 36256, total with
overprovisioning: 36256; new used: 26000,reserved:0; movedfromreserved:
false,moveToReserveredfalse
2014-09-11 08:55:30,218 DEBUG [c.c.c.CapacityManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) release mem from host: 7,
old used: 21072183296,reserved: 0, total: 50639785984; new used:
20535312384,reserved:0; movedfromreserved: false,moveToReserveredfalse
2014-09-11 08:55:30,302 DEBUG [c.c.c.CapacityManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
:Stopped to Starting with event: StartRequestedvm's original host id:
null new host id: null host id before state transition: null
2014-09-11 08:55:30,302 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Successfully transitioned to
start state for VM[User|giannitest] reservation id =
4b6c2f8d-a34c-4b86-a0d4-acd5ea87353a
2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Trying to deploy VM, vm has
dcId: 1 and podId: 1
2014-09-11 08:55:30,340 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
clusters: [], hosts: [7]
2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Deploy avoids pods: [],
clusters: [], hosts: [7]
2014-09-11 08:55:30,348 DEBUG [c.c.d.DeploymentPlanningManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) DataCenter id = '1' provided
is in avoid set, DeploymentPlanner cannot allocate the VM, returning.
2014-09-11 08:55:30,435 DEBUG [c.c.c.CapacityManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
:Starting to Stopped with event: OperationFailedvm's original host id:
null new host id: null host id before state transition: null
2014-09-11 08:55:30,477 DEBUG [c.c.v.UserVmManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) Destroying vm
VM[User|giannitest] as it failed to create on Host with Id:null
2014-09-11 08:55:30,609 DEBUG [c.c.c.CapacityManagerImpl]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) VM state transitted from
:Stopped to Error with event: OperationFailedToErrorvm's original host
id: null new host id: null host id before state transition: null
2014-09-11 08:55:30,809 WARN [o.a.c.alerts]
(Job-Executor-55:ctx-b5c34ec7 ctx-3715f5de) alertType:: 8 //
dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed to
deploy Vm with Id: 86, on Host with Id: null
2014-09-11 08:55:30,932 DEBUG [c.c.a.m.AgentManagerImpl]
(AgentManager-Handler-1:null) Ping from 6
2014-09-11 08:55:31,078 ERROR [c.c.a.ApiAsyncJobDispatcher]
(Job-Executor-55:ctx-b5c34ec7) Unexpected exception while executing
org.apache.cloudstack.api.command.user.vm.DeployVMCmd
com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM
due to insufficient capacity
at
com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:605)
at
org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:237)
at
org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:207)
at
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3581)
at
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3161)
at
com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3147)
at sun.reflect.GeneratedMethodAccessor587.invoke(Unknown Source)
...
Il 01/08/2014 11:44, Geoff Higginbottom ha scritto:
> Ugo,
>
> Login to the VR and tail the messages log then attempt to start the VM, you should see various messages re DHCP updating etc in the VR. If you don't see the VR update try restarting the network Iain the 'cleanup' option, this will create a new VR.
>
> Regards
>
> Geoff Higginbottom
> CTO / Cloud Architect
>
> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>
> geoff.higginbottom@shapeblue.com<ma...@shapeblue.com> | www.shapeblue.com<htp://www.shapeblue.com/> | Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
>
> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N 4HS<x-apple-data-detectors://5>
>
>
> On 1 Aug 2014, at 09:06, "Ugo Vasi" <ug...@procne.it>> wrote:
>
> Hi Geoff,
> I tried restarting r-29-VM but the problem is still blocking creation of new VM in that isolated network.
>
> Creating a new VM in another isolated network, it works. Where can I look at to find the problem?
>
>
>
> Il 31/07/2014 21:53, Geoff Higginbottom ha scritto:
> Ugo,
>
> Looks like CS is failing to update the VR with details for the new VM, try restarting the VR.
>
> Regards
>
> Geoff Higginbottom
> CTO / Cloud Architect
>
>
> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>
> geoff.higginbottom@shapeblue.com<ma...@shapeblue.com> | www.shapeblue.com<http://www.shapeblue.com><htp://www.shapeblue.com/>
>
> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N 4HS<x-apple-data-detectors://37>
>
>
>
> On 31 Jul 2014, at 15:40, "Ugo Vasi" <ug...@procne.it>> wrote:
>
> Hi everybody,
> I installed a CloudStack 4.3.0 system with a manager (in a virtual machine), two NFS primary storage, one NFS secondary storare and two host agent on ubuntu distribution.
>
> The cluster have one advanced zone without security group configuration with KVM hipervisors.
>
> I create some VM but now does not allow me to create more giving the error message "Unable to start a VM due to insufficient capacity".
>
> I am sure that the resources (ip, ram, cpu and storage) are enough to create new instances. In dashboard I see all ok.
>
> >From the management-server.log I see this errors messages (see attachment for full version) when I try to deploy a new virtual machine with 1x1GHz cpu, 1GB or RAM and 20GB disk space:
>
> 2014-07-31 14:59:11,983 DEBUG [c.c.a.t.Request] (AgentManager-Handler-12:null) Seq 1-684594119: Processing: { Ans: , MgmtId: 77916390353436, via: 1, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":false,"details":"VmDataCommand failed, check agent logs","wait":0}}] }
> 2014-07-31 14:59:11,983 INFO [c.c.v.VirtualMachineManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Unable to contact resource.
> com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is unreachable: Unable to apply userdata and password entry on router
> 2014-07-31 14:59:12,453 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 7
> 2014-07-31 14:59:12,677 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
> 2014-07-31 14:59:12,708 DEBUG [c.c.v.UserVmManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Destroying vm VM[User|csweb2] as it failed to create on Host with Id:null
> 2014-07-31 14:59:12,738 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from :Stopped to Error with event: OperationFailedToErrorvm's original host id: null new host id: null host id before state transition: null
> 2014-07-31 14:59:12,929 WARN [o.a.c.alerts] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) alertType:: 8 // dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed to deploy Vm with Id: 70, on Host with Id: null
> 2014-07-31 14:59:13,159 ERROR [c.c.a.ApiAsyncJobDispatcher] (Job-Executor-26:ctx-ab3aee38) Unexpected exception while executing org.apache.cloudstack.api.command.user.vm.DeployVMCmd
> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due to insufficient capacity
> Caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|csweb2]Scope=interface com.cloud.dc.DataCenter; id=1
> 2014-07-31 14:59:13,161 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Job-Executor-26:ctx-ab3aee38) Complete async job-783, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable to start a VM due to insufficient capacity"}
> 2014-07-31 14:59:46,280 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-27:ctx-82be396e ctx-41f0cf24) Stopped called on VM[User|csweb2] but the state is Error
> 2014-07-31 14:59:46,330 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-27:ctx-82be396e ctx-41f0cf24) VM state transitted from :Error to Expunging with event: DestroyRequestedvm's original host id: null new host id: null host id before state transition: null
>
> I tried to search in others log file ("VmDataCommand failed, check agent logs"), but I don't found nothing...
>
> Can anyone Help me?
>
> --
>
> U g o V a s i <ug...@procne.it>>
> P r o c n e s.r.l >)
> via Cotonificio 45 33010 Tavagnacco IT
> phone: +390432486523 fax: +390432486523
>
> Le informazioni contenute in questo messaggio sono riservate e
> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
> Qualora Lei non fosse la persona a cui il presente messaggio ?
> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
> gentilmente comunicazione.
> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
> Rif. D.L. 196/2003
>
>
>
>
> <management-server.log>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge - rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>
>
>
>
>
>
> --
>
> U g o V a s i <ug...@procne.it>>
> P r o c n e s.r.l >)
> via Cotonificio 45 33010 Tavagnacco IT
> phone: +390432486523 fax: +390432486523
>
> Le informazioni contenute in questo messaggio sono riservate e
> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
> Qualora Lei non fosse la persona a cui il presente messaggio ?
> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
> gentilmente comunicazione.
> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
> Rif. D.L. 196/2003
>
>
>
>
>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge - rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>
>
>
>
--
U g o V a s i <ug...@procne.it>
P r o c n e s.r.l >)
via Cotonificio 45 33010 Tavagnacco IT
phone: +390432486523 fax: +390432486523
Le informazioni contenute in questo messaggio sono riservate e
confidenziali ed è vietata la diffusione in qualunque modo eseguita.
Qualora Lei non fosse la persona a cui il presente messaggio è
destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
gentilmente comunicazione.
Per qualsiasi informazione si prega di contattare support@procne.it .
Rif. D.L. 196/2003
Re: Unable to start a VM due to insufficient capacity
Posted by Ugo Vasi <ug...@procne.it>.
Hi,
after that error, I can only destroy the virtual machine, I cannot
restart it via web interface.
I had looked inside the log files any trace of the error but have not
found anything.
These are the files I see, which of these I should see in the next test?
root@r-29-VM:~# ls -ltr /var/log/
total 212373
drwxr-xr-x 2 ntp ntp 1024 May 12 2012 ntpstats
drwxr-x--- 2 root adm 1024 Dec 3 2013 samba
-rw-rw---- 1 root utmp 0 Jan 15 2014 btmp-20140701
drwxr-xr-x 2 root root 1024 Jan 15 2014 fsck
-rw-r----- 1 root adm 59 Jan 15 2014 dmesg.3.gz
-rw-r--r-- 1 root root 531 Jan 15 2014 aptitude-20140701.gz
drwxr-xr-x 3 root root 1024 Jan 15 2014 installer
drwxr-xr-x 2 root root 1024 Jan 15 2014 news
-rw-r----- 1 root adm 0 Jan 15 2014 mail.warn
-rw-r----- 1 root adm 0 Jan 15 2014 mail.log
-rw-r----- 1 root adm 0 Jan 15 2014 mail.info
-rw-r----- 1 root adm 0 Jan 15 2014 mail.err
-rw-r----- 1 root adm 0 Jan 15 2014 lpr.log
-rw-r----- 1 root adm 7136 Jan 15 2014 dmesg.2.gz
-rw-r----- 1 root adm 8647 Jan 15 2014 debug-20140626
-rw-r--r-- 1 root root 32032 Jan 15 2014 faillog
-rw-r--r-- 1 root root 18329 Jan 15 2014 alternatives.log-20140701
-rw-r--r-- 1 root root 258369 Jan 15 2014 dpkg.log-20140701
-rw-r----- 1 root adm 11920 Jan 15 2014 user.log-20140626
-rw-r----- 1 root adm 51165 Jan 15 2014 syslog-20140626
-rw-r----- 1 root adm 498 Jan 15 2014 monit.log
-rw-r----- 1 root adm 0 Jun 24 14:51 haproxy.log
-rw-r----- 1 root adm 27326 Jun 24 15:25 dmesg.0
-rw-rw-r-- 1 root utmp 43776 Jun 24 15:25 wtmp-20140701
-rw-r----- 1 dnsmasq root 2885 Jun 24 15:26 dnsmasq.log-20140626
-rw-r----- 1 root adm 0 Jun 26 06:25 user.log
-rw-r----- 1 root adm 0 Jun 26 06:25 syslog
-rw-r----- 1 root adm 0 Jun 26 06:25 debug
-rw-r----- 1 root adm 118687 Jun 29 06:25 kern.log-20140626
-rw-r--r-- 1 root root 0 Jul 1 06:25 dpkg.log
-rw------- 1 root utmp 0 Jul 1 06:25 btmp
-rw-r--r-- 1 root root 0 Jul 1 06:25 aptitude
drwxr-xr-x 2 root root 1024 Jul 1 06:25 apt
-rw-r--r-- 1 root root 0 Jul 1 06:25 alternatives.log
-rw------- 1 root root 88352117 Jul 6 06:25
conntrackd-stats.log-20140706
drwxr-x--- 2 root adm 1024 Jul 9 06:25 apache2
-rw------- 1 root root 119645113 Jul 13 06:25
conntrackd-stats.log-20140713
drwxr-xr-x 2 root root 1024 Aug 1 06:25 sysstat
-rw-r----- 1 root adm 976874 Aug 1 06:27 cron.log-20140626
-rw-r----- 1 root adm 325622 Aug 1 06:29 messages-20140626
-rw-r--r-- 1 root root 5091 Aug 1 06:29 cloud.log-20140626
-rw------- 1 root root 2758246 Aug 1 06:30 conntrackd-stats.log
-rw-r----- 1 root adm 145694 Aug 1 06:30 daemon.log-20140626
-rw-r----- 1 root adm 4623344 Aug 1 06:30 auth.log-20140626
-rw-r--r-- 1 root root 1021 Aug 1 06:30 cloud.log
-rw-r----- 1 root adm 0 Aug 1 06:30 kern.log
-rw-r----- 1 root adm 27326 Aug 1 06:30 dmesg
-rw-r----- 1 dnsmasq root 0 Aug 1 06:30 dnsmasq.log
-rw-r----- 1 root adm 0 Aug 1 07:56 messages
-rw-r----- 1 root adm 0 Aug 1 07:56 daemon.log
-rw-r----- 1 root adm 0 Aug 1 10:17 cron.log
-rw-rw-r-- 1 root utmp 0 Aug 1 10:17 wtmp
-rw-rw-r-- 1 root utmp 292292 Aug 1 10:17 lastlog
-rw-r----- 1 root adm 0 Aug 1 10:17 auth.log
Il 01/08/2014 11:44, Geoff Higginbottom ha scritto:
> Ugo,
>
> Login to the VR and tail the messages log then attempt to start the VM, you should see various messages re DHCP updating etc in the VR. If you don't see the VR update try restarting the network Iain the 'cleanup' option, this will create a new VR.
>
> Regards
>
> Geoff Higginbottom
> CTO / Cloud Architect
>
> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>
> geoff.higginbottom@shapeblue.com<ma...@shapeblue.com> | www.shapeblue.com<htp://www.shapeblue.com/> | Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
>
> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N 4HS<x-apple-data-detectors://5>
>
>
> On 1 Aug 2014, at 09:06, "Ugo Vasi" <ug...@procne.it>> wrote:
>
> Hi Geoff,
> I tried restarting r-29-VM but the problem is still blocking creation of new VM in that isolated network.
>
> Creating a new VM in another isolated network, it works. Where can I look at to find the problem?
>
>
>
> Il 31/07/2014 21:53, Geoff Higginbottom ha scritto:
> Ugo,
>
> Looks like CS is failing to update the VR with details for the new VM, try restarting the VR.
>
> Regards
>
> Geoff Higginbottom
> CTO / Cloud Architect
>
>
> D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
>
> geoff.higginbottom@shapeblue.com<ma...@shapeblue.com> | www.shapeblue.com<http://www.shapeblue.com><htp://www.shapeblue.com/>
>
> ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N 4HS<x-apple-data-detectors://37>
>
>
>
> On 31 Jul 2014, at 15:40, "Ugo Vasi" <ug...@procne.it>> wrote:
>
> Hi everybody,
> I installed a CloudStack 4.3.0 system with a manager (in a virtual machine), two NFS primary storage, one NFS secondary storare and two host agent on ubuntu distribution.
>
> The cluster have one advanced zone without security group configuration with KVM hipervisors.
>
> I create some VM but now does not allow me to create more giving the error message "Unable to start a VM due to insufficient capacity".
>
> I am sure that the resources (ip, ram, cpu and storage) are enough to create new instances. In dashboard I see all ok.
>
> >From the management-server.log I see this errors messages (see attachment for full version) when I try to deploy a new virtual machine with 1x1GHz cpu, 1GB or RAM and 20GB disk space:
>
> 2014-07-31 14:59:11,983 DEBUG [c.c.a.t.Request] (AgentManager-Handler-12:null) Seq 1-684594119: Processing: { Ans: , MgmtId: 77916390353436, via: 1, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":false,"details":"VmDataCommand failed, check agent logs","wait":0}}] }
> 2014-07-31 14:59:11,983 INFO [c.c.v.VirtualMachineManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Unable to contact resource.
> com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is unreachable: Unable to apply userdata and password entry on router
> 2014-07-31 14:59:12,453 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 7
> 2014-07-31 14:59:12,677 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
> 2014-07-31 14:59:12,708 DEBUG [c.c.v.UserVmManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Destroying vm VM[User|csweb2] as it failed to create on Host with Id:null
> 2014-07-31 14:59:12,738 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from :Stopped to Error with event: OperationFailedToErrorvm's original host id: null new host id: null host id before state transition: null
> 2014-07-31 14:59:12,929 WARN [o.a.c.alerts] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) alertType:: 8 // dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed to deploy Vm with Id: 70, on Host with Id: null
> 2014-07-31 14:59:13,159 ERROR [c.c.a.ApiAsyncJobDispatcher] (Job-Executor-26:ctx-ab3aee38) Unexpected exception while executing org.apache.cloudstack.api.command.user.vm.DeployVMCmd
> com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due to insufficient capacity
> Caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|csweb2]Scope=interface com.cloud.dc.DataCenter; id=1
> 2014-07-31 14:59:13,161 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Job-Executor-26:ctx-ab3aee38) Complete async job-783, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable to start a VM due to insufficient capacity"}
> 2014-07-31 14:59:46,280 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-27:ctx-82be396e ctx-41f0cf24) Stopped called on VM[User|csweb2] but the state is Error
> 2014-07-31 14:59:46,330 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-27:ctx-82be396e ctx-41f0cf24) VM state transitted from :Error to Expunging with event: DestroyRequestedvm's original host id: null new host id: null host id before state transition: null
>
> I tried to search in others log file ("VmDataCommand failed, check agent logs"), but I don't found nothing...
>
> Can anyone Help me?
>
> --
>
> U g o V a s i <ug...@procne.it>>
> P r o c n e s.r.l >)
> via Cotonificio 45 33010 Tavagnacco IT
> phone: +390432486523 fax: +390432486523
>
> Le informazioni contenute in questo messaggio sono riservate e
> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
> Qualora Lei non fosse la persona a cui il presente messaggio ?
> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
> gentilmente comunicazione.
> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
> Rif. D.L. 196/2003
>
>
>
>
> <management-server.log>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge - rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>
>
>
>
>
>
> --
>
> U g o V a s i <ug...@procne.it>>
> P r o c n e s.r.l >)
> via Cotonificio 45 33010 Tavagnacco IT
> phone: +390432486523 fax: +390432486523
>
> Le informazioni contenute in questo messaggio sono riservate e
> confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
> Qualora Lei non fosse la persona a cui il presente messaggio ?
> destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
> gentilmente comunicazione.
> Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
> Rif. D.L. 196/2003
>
>
>
>
>
> Find out more about ShapeBlue and our range of CloudStack related services
>
> IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
> CSForge - rapid IaaS deployment framework<http://shapeblue.com/csforge/>
> CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
> CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
> CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
>
> This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
>
>
>
>
--
U g o V a s i <ug...@procne.it>
P r o c n e s.r.l >)
via Cotonificio 45 33010 Tavagnacco IT
phone: +390432486523 fax: +390432486523
Le informazioni contenute in questo messaggio sono riservate e
confidenziali ed è vietata la diffusione in qualunque modo eseguita.
Qualora Lei non fosse la persona a cui il presente messaggio è
destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
gentilmente comunicazione.
Per qualsiasi informazione si prega di contattare support@procne.it .
Rif. D.L. 196/2003
Re: Unable to start a VM due to insufficient capacity
Posted by Geoff Higginbottom <ge...@shapeblue.com>.
Ugo,
Login to the VR and tail the messages log then attempt to start the VM, you should see various messages re DHCP updating etc in the VR. If you don't see the VR update try restarting the network Iain the 'cleanup' option, this will create a new VR.
Regards
Geoff Higginbottom
CTO / Cloud Architect
D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
geoff.higginbottom@shapeblue.com<ma...@shapeblue.com> | www.shapeblue.com<htp://www.shapeblue.com/> | Twitter:@cloudstackguru<https://twitter.com/#!/cloudstackguru>
ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N 4HS<x-apple-data-detectors://5>
On 1 Aug 2014, at 09:06, "Ugo Vasi" <ug...@procne.it>> wrote:
Hi Geoff,
I tried restarting r-29-VM but the problem is still blocking creation of new VM in that isolated network.
Creating a new VM in another isolated network, it works. Where can I look at to find the problem?
Il 31/07/2014 21:53, Geoff Higginbottom ha scritto:
Ugo,
Looks like CS is failing to update the VR with details for the new VM, try restarting the VR.
Regards
Geoff Higginbottom
CTO / Cloud Architect
D: +44 20 3603 0542<tel:+442036030542> | S: +44 20 3603 0540<tel:+442036030540> | M: +447968161581<tel:+447968161581>
geoff.higginbottom@shapeblue.com<ma...@shapeblue.com> | www.shapeblue.com<http://www.shapeblue.com><htp://www.shapeblue.com/>
ShapeBlue Ltd, 53 Chandos Place, Covent Garden, London, WC2N 4HS<x-apple-data-detectors://37>
On 31 Jul 2014, at 15:40, "Ugo Vasi" <ug...@procne.it>> wrote:
Hi everybody,
I installed a CloudStack 4.3.0 system with a manager (in a virtual machine), two NFS primary storage, one NFS secondary storare and two host agent on ubuntu distribution.
The cluster have one advanced zone without security group configuration with KVM hipervisors.
I create some VM but now does not allow me to create more giving the error message "Unable to start a VM due to insufficient capacity".
I am sure that the resources (ip, ram, cpu and storage) are enough to create new instances. In dashboard I see all ok.
>From the management-server.log I see this errors messages (see attachment for full version) when I try to deploy a new virtual machine with 1x1GHz cpu, 1GB or RAM and 20GB disk space:
2014-07-31 14:59:11,983 DEBUG [c.c.a.t.Request] (AgentManager-Handler-12:null) Seq 1-684594119: Processing: { Ans: , MgmtId: 77916390353436, via: 1, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":false,"details":"VmDataCommand failed, check agent logs","wait":0}}] }
2014-07-31 14:59:11,983 INFO [c.c.v.VirtualMachineManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Unable to contact resource.
com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is unreachable: Unable to apply userdata and password entry on router
2014-07-31 14:59:12,453 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 7
2014-07-31 14:59:12,677 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: null
2014-07-31 14:59:12,708 DEBUG [c.c.v.UserVmManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) Destroying vm VM[User|csweb2] as it failed to create on Host with Id:null
2014-07-31 14:59:12,738 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) VM state transitted from :Stopped to Error with event: OperationFailedToErrorvm's original host id: null new host id: null host id before state transition: null
2014-07-31 14:59:12,929 WARN [o.a.c.alerts] (Job-Executor-26:ctx-ab3aee38 ctx-d8600c16) alertType:: 8 // dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Failed to deploy Vm with Id: 70, on Host with Id: null
2014-07-31 14:59:13,159 ERROR [c.c.a.ApiAsyncJobDispatcher] (Job-Executor-26:ctx-ab3aee38) Unexpected exception while executing org.apache.cloudstack.api.command.user.vm.DeployVMCmd
com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due to insufficient capacity
Caused by: com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|csweb2]Scope=interface com.cloud.dc.DataCenter; id=1
2014-07-31 14:59:13,161 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (Job-Executor-26:ctx-ab3aee38) Complete async job-783, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable to start a VM due to insufficient capacity"}
2014-07-31 14:59:46,280 DEBUG [c.c.v.VirtualMachineManagerImpl] (Job-Executor-27:ctx-82be396e ctx-41f0cf24) Stopped called on VM[User|csweb2] but the state is Error
2014-07-31 14:59:46,330 DEBUG [c.c.c.CapacityManagerImpl] (Job-Executor-27:ctx-82be396e ctx-41f0cf24) VM state transitted from :Error to Expunging with event: DestroyRequestedvm's original host id: null new host id: null host id before state transition: null
I tried to search in others log file ("VmDataCommand failed, check agent logs"), but I don't found nothing...
Can anyone Help me?
--
U g o V a s i <ug...@procne.it>>
P r o c n e s.r.l >)
via Cotonificio 45 33010 Tavagnacco IT
phone: +390432486523 fax: +390432486523
Le informazioni contenute in questo messaggio sono riservate e
confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
Qualora Lei non fosse la persona a cui il presente messaggio ?
destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
gentilmente comunicazione.
Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
Rif. D.L. 196/2003
<management-server.log>
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge - rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
--
U g o V a s i <ug...@procne.it>>
P r o c n e s.r.l >)
via Cotonificio 45 33010 Tavagnacco IT
phone: +390432486523 fax: +390432486523
Le informazioni contenute in questo messaggio sono riservate e
confidenziali ed ? vietata la diffusione in qualunque modo eseguita.
Qualora Lei non fosse la persona a cui il presente messaggio ?
destinato, La invitiamo ad eliminarlo e a non leggerlo, dandocene
gentilmente comunicazione.
Per qualsiasi informazione si prega di contattare support@procne.it<ma...@procne.it> .
Rif. D.L. 196/2003
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge - rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.