Problem with new CloudStack Install

[Ben Doherty <be...@orbital.net>]

Hi Guys,

I am having issues with a brand new install of Cloudstack on Centos 6.4 and
a separate XCP 1.5 hypervisor server. 

The System VM and the Storage VM will not start and the errors from the
managementserver.log seem to be saying
the below:

2013-04-03 11:22:17,732 DEBUG [xen.resource.CitrixResourceBase]
(DirectAgent-217:null) 1. The VM s-2290-VM is in Starting state.
2013-04-03 11:22:17,744 WARN  [xen.resource.CitrixResourceBase]
(DirectAgent-217:null) Catch Exception: class
java.util.NoSuchElementException due to java.util.NoSuchElementException
java.util.NoSuchElementException
	at
java.util.LinkedHashMap$LinkedHashIterator.nextEntry(LinkedHashMap.java:392)
	at java.util.LinkedHashMap$KeyIterator.next(LinkedHashMap.java:401)
	at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.createVmFromTemplate(Ci
trixResourceBase.java:969)
	at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceB
ase.java:1278)
	at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixRe
sourceBase.java:497)
	at
com.cloud.hypervisor.xen.resource.XcpServerResource.executeRequest(XcpServer
Resource.java:52)
	at
com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:
191)
	at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	at
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
	at java.util.concurrent.FutureTask.run(FutureTask.java:166)
	at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$
101(ScheduledThreadPoolExecutor.java:165)
	at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Sch
eduledThreadPoolExecutor.java:266)
	at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:11
46)
	at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:6
15)
	at java.lang.Thread.run(Thread.java:679)
2013-04-03 11:22:17,744 WARN  [xen.resource.CitrixResourceBase]
(DirectAgent-217:null) Unable to start s-2290-VM due to 
java.util.NoSuchElementException
	at
java.util.LinkedHashMap$LinkedHashIterator.nextEntry(LinkedHashMap.java:392)
	at java.util.LinkedHashMap$KeyIterator.next(LinkedHashMap.java:401)
	at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.createVmFromTemplate(Ci
trixResourceBase.java:969)
	at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceB
ase.java:1278)
	at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixRe
sourceBase.java:497)
	at
com.cloud.hypervisor.xen.resource.XcpServerResource.executeRequest(XcpServer
Resource.java:52)
	at
com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:
191)
	at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
	at
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
	at java.util.concurrent.FutureTask.run(FutureTask.java:166)
	at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$
101(ScheduledThreadPoolExecutor.java:165)
	at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Sch
eduledThreadPoolExecutor.java:266)
	at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:11
46)
	at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:6
15)
	at java.lang.Thread.run(Thread.java:679)
2013-04-03 11:22:17,745 DEBUG [xen.resource.CitrixResourceBase]
(DirectAgent-217:null) The VM is in stopped state, detected problem during
startup : s-2290-VM
2013-04-03 11:22:17,746 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-217:null) Seq 1-1738212644: Cancelling because one of the
answers is false and it is stop on error.
2013-04-03 11:22:17,746 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-217:null) Seq 1-1738212644: Response Received:
2013-04-03 11:22:17,747 DEBUG [agent.transport.Request]
(DirectAgent-217:null) Seq 1-1738212644: Processing:  { Ans: , MgmtId:
8796747386426, via: 1, Ver: v1, Flags: 110,
[{"StartAnswer":{"vm":{"id":2290,"name":"s-2290-VM","bootloader":"PyGrub","t
ype":"SecondaryStorageVm","cpus":1,"speed":500,"minRam":268435456,"maxRam":2
68435456,"arch":"x86_64","os":"Debian GNU/Linux 6(64-bit)","bootArgs":"
template=domP type=secstorage host=192.168.2.46 port=8250 name=s-2290-VM
zone=1 pod=1 guid=s-2290-VM
resource=com.cloud.storage.resource.NfsSecondaryStorageResource
instance=SecStorage sslcopy=true role=templateProcessor mtu=1500
eth2ip=192.168.2.140 eth2mask=255.255.255.0 gateway=192.168.2.1
eth0ip=169.254.0.176 eth0mask=255.255.0.0 eth1ip=192.168.2.137
eth1mask=255.255.255.0 mgmtcidr=192.168.2.0/24 localgw=192.168.2.1
private.network.device=eth1 eth3ip=192.168.2.136 eth3mask=255.255.255.0
storageip=192.168.2.136 storagenetmask=255.255.255.0
storagegateway=192.168.2.1 internaldns1=80.88.200.119 dns1=80.88.200.119
dns2=80.88.192.2","rebootOnCrash":false,"enableHA":false,"limitCpuUse":false
,"vncPassword":"3635073de64fc4cf","params":{},"uuid":"1386e448-74ff-451c-858
1-31d0b8441229","disks":[{"id":2290,"name":"ROOT-2290","mountPoint":"/export
/primary","path":"aeef0360-870a-492a-88a7-f05aa1630e38","size":2147483648,"t
ype":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"9ae701a
5-64bb-33a7-a9cf-83f3b000614a","deviceId":0}],"nics":[{"deviceId":2,"network
RateMbps":200,"defaultNic":true,"uuid":"f8ece133-09a4-4463-9e63-53a66af80a69
","ip":"192.168.2.140","netmask":"255.255.255.0","gateway":"192.168.2.1","ma
c":"06:4b:42:00:00:0c","dns1":"80.88.200.119","dns2":"80.88.192.2","broadcas
tType":"Vlan","type":"Guest","broadcastUri":"vlan://untagged","isolationUri"
:"ec2://untagged","isSecurityGroupEnabled":false},{"deviceId":0,"networkRate
Mbps":-1,"defaultNic":false,"uuid":"cdb38064-7ee7-4d1c-b16c-aa664517d8ea","i
p":"169.254.0.176","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e
:00:a9:fe:00:b0","broadcastType":"LinkLocal","type":"Control","isSecurityGro
upEnabled":false},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"uui
d":"f572336b-567b-4ffa-96a2-363939f6f640","ip":"192.168.2.137","netmask":"25
5.255.255.0","gateway":"192.168.2.1","mac":"06:b2:b2:00:00:0a","broadcastTyp
e":"Native","type":"Management","isSecurityGroupEnabled":false},{"deviceId":
3,"networkRateMbps":-1,"defaultNic":false,"uuid":"6d474400-ee2e-46b5-a57a-55
6f13e78822","ip":"192.168.2.136","netmask":"255.255.255.0","gateway":"192.16
8.2.1","mac":"06:98:8a:00:00:09","broadcastType":"Native","type":"Storage","
isSecurityGroupEnabled":false}]},"result":false,"details":"Unable to start
s-2290-VM due to ","wait":0}}] }
2013-04-03 11:22:17,748 DEBUG [agent.transport.Request] (secstorage-1:null)
Seq 1-1738212644: Received:  { Ans: , MgmtId: 8796747386426, via: 1, Ver:
v1, Flags: 110, { StartAnswer } }
2013-04-03 11:22:17,749 DEBUG [agent.manager.AgentAttache]
(DirectAgent-217:null) Seq 1-1738212644: No more commands found
2013-04-03 11:22:17,755 INFO  [cloud.vm.VirtualMachineManagerImpl]
(secstorage-1:null) Unable to start VM on Host[-1-Routing] due to Unable to
start s-2290-VM due to 
2013-04-03 11:22:17,763 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(secstorage-1:null) Cleaning up resources for the vm
VM[SecondaryStorageVm|s-2290-VM] in Starting state
2013-04-03 11:22:17,767 DEBUG [agent.transport.Request] (secstorage-1:null)
Seq 1-1738212645: Sending  { Cmd , MgmtId: 8796747386426, via: 1, Ver: v1,
Flags: 100111,
[{"StopCommand":{"isProxy":false,"vmName":"s-2290-VM","wait":0}}] }
2013-04-03 11:22:17,767 DEBUG [agent.transport.Request] (secstorage-1:null)
Seq 1-1738212645: Executing:  { Cmd , MgmtId: 8796747386426, via: 1, Ver:
v1, Flags: 100111,
[{"StopCommand":{"isProxy":false,"vmName":"s-2290-VM","wait":0}}] }
2013-04-03 11:22:17,767 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-326:null) Seq 1-1738212645: Executing request

Any help is much appreciated!

Thank you!

Warm Regards,
Ben