You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by Enrique Ladrón de Guevara Hernández <en...@hotmail.com> on 2013/08/26 00:46:07 UTC
VPC virtual router fails to start up - no route to CS Management
Server.
Hi,
I'm carrying out my End of Career Project related to CloudStack deployment. I got issues when I try to deploy a VPC, the VPC virtual router isn't deployed completely and It's destroyed after timeout.
The rest of SSVMs (Console Proxy VM, Storage VM and Guest Network VM) are deployed correctly. I can access to the instance console, put into guest network a instance, connect to it, etc ...
Could you help me to resolve this issue? I don't know which is the thing that I'm doing wrong ...
This is the context:
CloudStack Version: 4.1.1 (upgraded from 4.0.2)Num. of Management Server: 1 (under CentOS 6.4) [physical server]. The MS has this network configuration:IP: 10.10.10.110/24GW: 10.10.10.254DNS server: 10.10.10.116/24Hypervisor: VMWARE 4.1:2 ESXi hosts:IPs: 10.10.1.101 & .102/24GW: 10.10.1.254vCenter: 10.10.1.100Standard Virtual Switches.
Virtual Network Architecture:VmWare Virtual Switch CS Physical Network Network Subnet Gateway VLAN TAG CS Traffic Type Start IP Range End IP RangevSwitch0 PhysNet-mgmt-svm 10.10.1.0 255.255.255.0 10.10.1.254 NONE CS Management 10.10.1.120 10.10.1.240vSwitch1 PhysNet-storage 10.10.2.0 255.255.255.0 10.10.2.254 NONE Storage 10.10.2.120 10.10.2.240vSwitch2 PhysNet-guest-1 10.10.3.0 255.255.255.0 10.10.3.254 NONE Guest 10.10.3.1 10.10.3.254vSwitch3 PhysNet-public 10.10.4.0 255.255.255.0 10.10.4.254 NONE Public 10.10.4.1 10.10.4.240
I log in to ssvm consoles and I can see the following:vRouter (VPC) System VM - doesn't have a specific route to MS:root@r-53-VM:~# netstat -nrKernel IP routing tableDestination Gateway Genmask Flags MSS Window irtt Iface10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0 eth3root@r-53-VM:~#
CS management server:[root@cs-1 ~]# netstat -nrKernel IP routing tableDestination Gateway Genmask Flags MSS Window irtt Iface10.10.10.0 0.0.0.0 255.255.255.0 U 0 0 0 eth0169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0 eth00.0.0.0 10.10.10.254 0.0.0.0 UG 0 0 0 eth0[root@cs-1 ~]#
Console Proxy System VM:root@v-50-VM:~# netstat -nrKernel IP routing tableDestination Gateway Genmask Flags MSS Window irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0 0 eth110.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0 0 eth110.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0 eth210.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0 eth110.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0 eth10.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0 eth2root@v-50-VM:~#
vRouter (no VPC- Guest Network) System VM:root@r-49-VM:~# netstat -nrKernel IP routing tableDestination Gateway Genmask Flags MSS Window irtt Iface10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0 eth210.10.3.0 0.0.0.0 255.255.255.0 U 0 0 0 eth010.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0 eth110.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0 eth10.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0 eth2root@r-49-VM:~#
Secondary Storage System VMroot@s-28-VM:~# netstat -nrKernel IP routing tableDestination Gateway Genmask Flags MSS Window irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0 0 eth110.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0 0 eth110.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0 eth210.10.2.0 0.0.0.0 255.255.255.0 U 0 0 0 eth310.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0 eth110.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0 eth10.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0 eth2root@s-28-VM:~# management-server.log (filtered by r-53-VM):
[root@cs-1 ~]# grep -i r-53-VM management-server.log.2013-08-25 2013-08-25 11:34:24,164 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) Allocating entries for VM: VM[DomainRouter|r-53-VM]2013-08-25 11:34:24,167 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) Allocating nics for VM[DomainRouter|r-53-VM]2013-08-25 11:34:24,168 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-13:job-11) Allocating nic for vm VM[DomainRouter|r-53-VM] in network Ntwk[202|Control|3] with requested profile null2013-08-25 11:34:24,176 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-13:job-11) Allocating nic for vm VM[DomainRouter|r-53-VM] in network Ntwk[200|Public|1] with requested profile NicProfile[0-0-null-10.10.4.78-vlan://untagged2013-08-25 11:34:24,185 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) Allocaing disks for VM[DomainRouter|r-53-VM]2013-08-25 11:34:24,191 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) Allocation completed for VM: VM[DomainRouter|r-53-VM]2013-08-25 11:34:24,191 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (Job-Executor-13:job-11) Starting router VM[DomainRouter|r-53-VM]2013-08-25 11:34:24,195 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) Successfully transitioned to start state for VM[DomainRouter|r-53-VM] reservation id = b4039e49-0c0a-455b-ba6a-7fde25ea27382013-08-25 11:34:24,233 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) Deployment found - P0=VM[DomainRouter|r-53-VM], P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))] : Dest[Zone(1)-Pod(1)-Cluster(1)-Host(1)-Storage(Volume(54|ROOT-->Pool(200))]2013-08-25 11:34:24,275 DEBUG [network.guru.PodBasedNetworkGuru] (Job-Executor-13:job-11) Allocated a nic NicProfile[166-53-b4039e49-0c0a-455b-ba6a-7fde25ea2738-10.10.1.238-null for VM[DomainRouter|r-53-VM]2013-08-25 11:34:24,281 DEBUG [cloud.storage.StorageManagerImpl] (Job-Executor-13:job-11) Checking if we need to prepare 1 volumes for VM[DomainRouter|r-53-VM]2013-08-25 11:34:47,940 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (Job-Executor-13:job-11) Boot Args for VM[DomainRouter|r-53-VM]: vpccidr=192.168.0.0/22 domain=cs2cloud.internal dns1=10.10.10.116 template=domP name=r-53-VM eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=10.10.10.0/24 localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true extra_pubnics=22013-08-25 11:34:47,994 DEBUG [network.router.VpcVirtualNetworkApplianceManagerImpl] (Job-Executor-13:job-11) Found 0 static routes to apply as a part of vpc route VM[DomainRouter|r-53-VM] start2013-08-25 11:34:48,000 DEBUG [agent.transport.Request] (Job-Executor-13:job-11) Seq 1-1308430869: Sending { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags: 100111, [{"StartCommand":{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter","cpus":1,"speed":500,"minRam":134217728,"maxRam":134217728,"arch":"i686","os":"Debian GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=192.168.0.0/22 domain=cs2cloud.internal dns1=10.10.10.116 template=domP name=r-53-VM eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=10.10.10.0/24 localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true extra_pubnics=2 nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}},{"check.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":100,"name":"r-53-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.1.238","router.name":"r-53-VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbps":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"10.10.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"router.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"10.10.1.238","router.name":"r-53-VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessDetails":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","router.name":"r-53-VM"},"wait":0}},{}] }2013-08-25 11:34:48,001 DEBUG [agent.transport.Request] (Job-Executor-13:job-11) Seq 1-1308430869: Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags: 100111, [{"StartCommand":{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter","cpus":1,"speed":500,"minRam":134217728,"maxRam":134217728,"arch":"i686","os":"Debian GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=192.168.0.0/22 domain=cs2cloud.internal dns1=10.10.10.116 template=domP name=r-53-VM eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=10.10.10.0/24 localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true extra_pubnics=2 nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}},{"check.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":100,"name":"r-53-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.1.238","router.name":"r-53-VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbps":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"10.10.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"router.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"10.10.1.238","router.name":"r-53-VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessDetails":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","router.name":"r-53-VM"},"wait":0}},{}] }2013-08-25 11:34:48,002 INFO [vmware.resource.VmwareResource] (DirectAgent-142:10.10.1.101) Executing resource StartCommand: {"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter","cpus":1,"speed":500,"minRam":134217728,"maxRam":134217728,"arch":"i686","os":"Debian GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=192.168.0.0/22 domain=cs2cloud.internal dns1=10.10.10.116 template=domP name=r-53-VM eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=10.10.10.0/24 localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true extra_pubnics=2 nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}2013-08-25 11:34:48,157 DEBUG [vmware.resource.VmwareResource] (DirectAgent-142:10.10.1.101) VM r-53-VM will be started with NIC device type: E10002013-08-25 11:34:48,810 DEBUG [vmware.mo.HostMO] (DirectAgent-142:10.10.1.101) find VM r-53-VM on host2013-08-25 11:34:53,628 DEBUG [vmware.mo.HostMO] (DirectAgent-142:10.10.1.101) find VM r-53-VM on host2013-08-25 11:34:54,068 INFO [vmware.mo.HypervisorHostHelper] (DirectAgent-142:10.10.1.101) Blank VM: r-53-VM is ready for use2013-08-25 11:34:54,068 DEBUG [vmware.mo.HostMO] (DirectAgent-142:10.10.1.101) find VM r-53-VM on host2013-08-25 11:34:54,068 DEBUG [vmware.mo.HostMO] (DirectAgent-142:10.10.1.101) VM r-53-VM found in host cache2013-08-25 11:34:57,182 DEBUG [vmware.mo.HostMO] (DirectAgent-142:10.10.1.101) find VM r-53-VM on host2013-08-25 11:34:57,182 DEBUG [vmware.mo.HostMO] (DirectAgent-142:10.10.1.101) VM r-53-VM found in host cache2013-08-25 11:34:58,056 INFO [vmware.resource.VmwareResource] (DirectAgent-142:10.10.1.101) Configure VNC port for VM r-53-VM, port: 5929, host: 10.10.1.1012013-08-25 12:17:13,198 ERROR [vmware.resource.VmwareResource] (DirectAgent-142:10.10.1.101) Can not ping System vm r-53-VMdue to:Unable to connect2013-08-25 12:17:13,201 DEBUG [agent.transport.Request] (DirectAgent-142:null) Seq 1-1308430869: Processing: { Ans: , MgmtId: 52244109874, via: 1, Ver: v1, Flags: 110, [{"StartAnswer":{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter","cpus":1,"speed":500,"minRam":134217728,"maxRam":134217728,"arch":"i686","os":"Debian GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=192.168.0.0/22 domain=cs2cloud.internal dns1=10.10.10.116 template=domP name=r-53-VM eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=10.10.10.0/24 localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true extra_pubnics=2 nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"result":true,"wait":0}},{"check.CheckSshAnswer":{"result":false,"details":"Can not ping System vm r-53-VMdue to:Unable to connect","wait":0}}] }2013-08-25 12:17:13,209 WARN [network.router.VirtualNetworkApplianceManagerImpl] (Job-Executor-13:job-11) Unable to ssh to the VM: Can not ping System vm r-53-VMdue to:Unable to connect2013-08-25 12:17:13,210 INFO [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) The guru did not like the answers so stopping VM[DomainRouter|r-53-VM]2013-08-25 12:17:13,212 DEBUG [agent.transport.Request] (Job-Executor-13:job-11) Seq 1-1308430987: Sending { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags: 100111, [{"StopCommand":{"isProxy":false,"vmName":"r-53-VM","wait":0}}] }2013-08-25 12:17:13,212 DEBUG [agent.transport.Request] (Job-Executor-13:job-11) Seq 1-1308430987: Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags: 100111, [{"StopCommand":{"isProxy":false,"vmName":"r-53-VM","wait":0}}] }2013-08-25 12:17:13,213 INFO [vmware.resource.VmwareResource] (DirectAgent-484:10.10.1.101) Executing resource StopCommand: {"isProxy":false,"vmName":"r-53-VM","wait":0}2013-08-25 12:17:13,213 DEBUG [vmware.mo.HostMO] (DirectAgent-484:10.10.1.101) find VM r-53-VM on host2013-08-25 12:17:14,111 INFO [vmware.resource.VmwareResource] (DirectAgent-484:10.10.1.101) Remove all snapshot before stopping VM r-53-VM2013-08-25 12:17:14,980 INFO [vmware.mo.VirtualMachineMO] (DirectAgent-484:10.10.1.101) Try gracefully shut down VM r-53-VM2013-08-25 12:17:25,148 DEBUG [vmware.resource.VmwareResource] (DirectAgent-142:null) Ignoring vm r-53-VM because of a lag in stopping the vm. 2013-08-25 12:17:34,694 DEBUG [agent.transport.Request] (DirectAgent-484:null) Seq 1-1308430987: Processing: { Ans: , MgmtId: 52244109874, via: 1, Ver: v1, Flags: 110, [{"StopAnswer":{"vncPort":0,"result":true,"details":"Stop VM r-53-VM Succeed","wait":0}}] }2013-08-25 12:17:34,695 DEBUG [agent.manager.AgentManagerImpl] (Job-Executor-13:job-11) Details from executing class com.cloud.agent.api.StopCommand: Stop VM r-53-VM Succeed2013-08-25 12:17:34,702 ERROR [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) Failed to start instance VM[DomainRouter|r-53-VM]com.cloud.utils.exception.ExecutionException: Unable to start VM[DomainRouter|r-53-VM] due to error in finalizeStart, not retrying2013-08-25 12:17:34,707 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) Cleaning up resources for the vm VM[DomainRouter|r-53-VM] in Starting state2013-08-25 12:17:34,708 DEBUG [agent.transport.Request] (Job-Executor-13:job-11) Seq 1-1308430989: Sending { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags: 100111, [{"StopCommand":{"isProxy":false,"vmName":"r-53-VM","wait":0}}] }2013-08-25 12:17:34,708 DEBUG [agent.transport.Request] (Job-Executor-13:job-11) Seq 1-1308430989: Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags: 100111, [{"StopCommand":{"isProxy":false,"vmName":"r-53-VM","wait":0}}] }2013-08-25 12:17:34,709 INFO [vmware.resource.VmwareResource] (DirectAgent-453:10.10.1.101) Executing resource StopCommand: {"isProxy":false,"vmName":"r-53-VM","wait":0}2013-08-25 12:17:34,709 DEBUG [vmware.mo.HostMO] (DirectAgent-453:10.10.1.101) find VM r-53-VM on host2013-08-25 12:17:35,596 INFO [vmware.resource.VmwareResource] (DirectAgent-453:10.10.1.101) VM r-53-VM is already in stopped state2013-08-25 12:17:35,598 DEBUG [agent.transport.Request] (DirectAgent-453:null) Seq 1-1308430989: Processing: { Ans: , MgmtId: 52244109874, via: 1, Ver: v1, Flags: 110, [{"StopAnswer":{"vncPort":0,"result":true,"details":"VM r-53-VM is already in stopped state","wait":0}}] }2013-08-25 12:17:35,619 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) Successfully released network resources for the vm VM[DomainRouter|r-53-VM]2013-08-25 12:17:35,619 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) Successfully cleanued up resources for the vm VM[DomainRouter|r-53-VM] in Starting statecom.cloud.exception.AgentUnavailableException: Resource [Host:1] is unreachable: Host 1: Unable to start instance due to Unable to start VM[DomainRouter|r-53-VM] due to error in finalizeStart, not retryingCaused by: com.cloud.utils.exception.ExecutionException: Unable to start VM[DomainRouter|r-53-VM] due to error in finalizeStart, not retrying2013-08-25 12:17:35,667 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) VM is already stopped: VM[DomainRouter|r-53-VM]2013-08-25 12:17:35,671 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) Destroying vm VM[DomainRouter|r-53-VM]2013-08-25 12:17:35,701 DEBUG [agent.transport.Request] (Job-Executor-13:job-11) Seq 1-1308430990: Sending { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags: 100111, [{"storage.DestroyCommand":{"vmName":"r-53-VM","volume":{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0},"wait":0}}] }2013-08-25 12:17:35,701 DEBUG [agent.transport.Request] (Job-Executor-13:job-11) Seq 1-1308430990: Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags: 100111, [{"storage.DestroyCommand":{"vmName":"r-53-VM","volume":{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0},"wait":0}}] }2013-08-25 12:17:35,702 INFO [vmware.resource.VmwareResource] (DirectAgent-106:10.10.1.101) Executing resource DestroyCommand: {"vmName":"r-53-VM","volume":{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0},"wait":0}2013-08-25 12:17:37,006 INFO [vmware.resource.VmwareResource] (DirectAgent-106:10.10.1.101) Destroy root volume and VM itself. vmName r-53-VM2013-08-25 12:17:48,412 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) Expunged VM[DomainRouter|r-53-VM]2013-08-25 12:18:25,563 DEBUG [vmware.resource.VmwareResource] (DirectAgent-105:null) VM r-53-VM is now missing from host report[root@cs-1 ~]#
Please, if you need more info to debug don't hesitate request it to me.
Many Thanks for you help.Regards.
RE: VPC virtual router fails to start up - no route to CS
Management Server.
Posted by "Musayev, Ilya" <im...@webmd.net>.
Both eth0 and eth1 must be up. In your case only eth0 is up (guest network) and eth1 is down (link local).
Inspect the contents on /var/cache/cloud/cmdline
Attempt to setup IP manually to see if it helps for eth1. Default GW must be on eth0/guest network.
Check vSphere to confirm both eth0 and eth1 are on proper vswitches.
> -----Original Message-----
> From: Musayev, Ilya [mailto:imusayev@webmd.net]
> Sent: Friday, September 06, 2013 2:19 PM
> To: users@cloudstack.apache.org
> Cc: dev@cloudstack.apache.org
> Subject: RE: VPC virtual router fails to start up - no route to CS Management
> Server.
>
> What stops you from adding a route as test on RVM?
>
>
>
> > -----Original Message-----
> > From: COCHE Sébastien [mailto:SCOCHE@sigma.fr]
> > Sent: Friday, September 06, 2013 12:49 PM
> > To: users@cloudstack.apache.org
> > Cc: dev@cloudstack.apache.org
> > Subject: RE: VPC virtual router fails to start up - no route to CS
> > Management Server.
> >
> > Hi Enrique,
> >
> > I had the same issue on 4.0, 4.0.1 and 4.1 CloudStack's releases.
> > I followed the documentation for complex deployment (CloudStack
> > Manager and hypervisor (ESX) on a different networks) After some
> > research it seems that the VPC's vRouter do not have a route to
> > communicate with CloudStack server. On a VPC vRouter, the default route
> is set on the public network.
> > I already post on this issue, and I did not have any feedback (my
> > question could be not clear).
> > I hope you will be luckiest.
> >
> > Best regards
> >
> > -----Message d'origine-----
> > De : Enrique Ladrón de Guevara Hernández
> > [mailto:enriquelgh@hotmail.com] Envoyé : mercredi 4 septembre 2013
> > 00:23 À : users@cloudstack.apache.org Cc : dev@cloudstack.apache.org
> Objet : RE:
> > VPC virtual router fails to start up - no route to CS Management Server.
> >
> > Hi,
> >
> > I don't know why but don't achive to insert the tar file ...
> >
> > You can download it in this link: http://we.tl/kHJtO3BK3f
> >
> > Regards.
> >
> >
> > ----------------------------------------
> > > From: enriquelgh@hotmail.com
> > > To: users@cloudstack.apache.org
> > > CC: dev@cloudstack.apache.org
> > > Subject: RE: VPC virtual router fails to start up - no route to CS
> > Management Server.
> > > Date: Wed, 4 Sep 2013 00:15:10 +0200
> > >
> > > Hi,
> > >
> > > Logs and screenshots attached in a tar file.
> > >
> > > In my case, the type of the first interface is "Control", as you can
> > > see in the
> > screenshots.
> > >
> > > @developers, if you need more info let me know.
> > >
> > > Thanks to everyone,
> > > Regards.
> > >
> > >
> > >>> Date: Tue, 3 Sep 2013 08:05:10 +0100
> > >>> Subject: Re: VPC virtual router fails to start up - no route to CS
> > >> Management Server.
> > >>> From: msweet.dev@gmail.com
> > >>> To: users@cloudstack.apache.org
> > >>> CC: dev@cloudstack.apache.org
> > >>>
> > >>> Hi,
> > >>>
> > >>> I couldn't find any screenshots in the string of messages.
> > >>> Looking at the logs it almost seems as like the VPC is stopping
> > >>> unexpectedly.
> > >>>
> > >>> Looking at my VPC, the first interface is a Link Local for Control
> > >>> type traffic, which is running on KVM.
> > >>> I will CC this into the dev mailinglist in search for a developer
> > >>> who knows more about VMWare and VPCs.
> > >>>
> > >>> In the meantime, please could you attach (in a tar), the
> > >>> screenshots of the VPC interfaces from the cloudstack interfaces.
> > >>>
> > >>> Thanks,
> > >>> Marty
> > >>>
> > >>>
> > >>>
> > >>>
> > >>> On Mon, Sep 2, 2013 at 6:28 PM, Enrique Ladrón de Guevara
> > >>> Hernández < enriquelgh@hotmail.com> wrote:
> > >>>
> > >>>> Hi Marty,
> > >>>>
> > >>>> Sorry, could you look at the logs and screenshots?? Do you need
> > >>>> more info to debug the issue??
> > >>>>
> > >>>> Do you know if there is a bug related to this scenario??
> > >>>>
> > >>>> I try to find any information on Internet and check my config but
> > >>>> I don't know how to continue go ahead ...
> > >>>>
> > >>>> Do you recommend re-installing CS software with other version or
> > >>>> the same version ....??
> > >>>>
> > >>>> Thanks in advanced for your help.
> > >>>> Regards.
> > >>>>
> > >>>>
> > >>>> ----------------------------------------
> > >>>>> From: enriquelgh@hotmail.com
> > >>>>> To: users@cloudstack.apache.org
> > >>>>> Subject: RE: VPC virtual router fails to start up - no route to
> > >>>>> CS
> > >>>> Management Server.
> > >>>>> Date: Wed, 28 Aug 2013 20:16:26 +0200
> > >>>>>
> > >>>>> Now better!
> > >>>>>
> > >>>>> Regards.
> > >>>>>
> > >>>>> ----------------------------------------
> > >>>>>> From: enriquelgh@hotmail.com
> > >>>>>> To: users@cloudstack.apache.org
> > >>>>>> Subject: RE: VPC virtual router fails to start up - no route to
> > >>>>>> CS
> > >>>> Management Server.
> > >>>>>> Date: Wed, 28 Aug 2013 20:09:39 +0200
> > >>>>>>
> > >>>>>> Hi Marty,
> > >>>>>>
> > >>>>>> I have used a new test to capture screenshots and logs:
> > >>>>>>
> > >>>>>> VPC Name: VPC-Test
> > >>>>>> Job: job-69
> > >>>>>> vrsm: r-59-VM
> > >>>>>>
> > >>>>>> you can find files attached.
> > >>>>>>
> > >>>>>> Thanks,
> > >>>>>> Regards.
> > >>>>>>
> > >>>>>> -
> > >>>>>> ----------------------------------------
> > >>>>>>> Date: Wed, 28 Aug 2013 10:16:23 +0100
> > >>>>>>> Subject: Re: VPC virtual router fails to start up - no route
> > >>>>>>> to CS
> > >>>> Management Server.
> > >>>>>>> From: msweet.dev@gmail.com
> > >>>>>>> To: users@cloudstack.apache.org
> > >>>>>>>
> > >>>>>>> Hi,
> > >>>>>>>
> > >>>>>>> Could you let me know the IP addresses listed in the
> > >>>>>>> cloudstack
> > >>>> interface
> > >>>>>>> under Infrastructure> Virtual Routers> VPC
> > >>>>>>>
> > >>>>>>> Marty
> > >>>>>>>
> > >>>>>>>
> > >>>>>>> On Tue, Aug 27, 2013 at 11:11 PM, Enrique Ladrón de Guevara
> > >> Hernández <
> > >>>>>>> enriquelgh@hotmail.com> wrote:
> > >>>>>>>
> > >>>>>>>> Hi Marty,
> > >>>>>>>>
> > >>>>>>>> Yes, I have still got this issue ... :S I'm very lost ...
> > >>>>>>>>
> > >>>>>>>> Guest Networks are working fine, but in VPC nop ...
> > >>>>>>>>
> > >>>>>>>> If you need more info, please let me know.
> > >>>>>>>>
> > >>>>>>>> Thanks a lot for your time,
> > >>>>>>>> Regards.
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>> ----------------------------------------
> > >>>>>>>>> Date: Tue, 27 Aug 2013 22:54:11 +0100
> > >>>>>>>>> Subject: Re: VPC virtual router fails to start up - no route
> > >>>>>>>>> to CS
> > >>>>>>>> Management Server.
> > >>>>>>>>> From: msweet.dev@gmail.com
> > >>>>>>>>> To: users@cloudstack.apache.org
> > >>>>>>>>>
> > >>>>>>>>> Hi Enrique,
> > >>>>>>>>>
> > >>>>>>>>> Sorry I haven't got back to you, is this still an issue?
> > >>>>>>>>> If so, I will take a look at it and get back to you in the morning.
> > >>>>>>>>>
> > >>>>>>>>> Thanks,
> > >>>>>>>>> Marty
> > >>>>>>>>>
> > >>>>>>>>> On Monday, August 26, 2013, Enrique Ladrón de Guevara
> > >>>>>>>>> Hernández
> > >>>> wrote:
> > >>>>>>>>>
> > >>>>>>>>>> Hi Marty,
> > >>>>>>>>>>
> > >>>>>>>>>> My apologies for the format. I hope this time the email
> > >> format will
> > >>>> be
> > >>>>>>>>>> better. You can find the logs attached.
> > >>>>>>>>>>
> > >>>>>>>>>> In this log you can see several VPC deployment tests. One
> > >>>>>>>>>> of them
> > >>>> is:
> > >>>>>>>>>> - VPC name: VPC-Prueba-1
> > >>>>>>>>>> - job: job-11
> > >>>>>>>>>> - ssvm: r-53-VM.
> > >>>>>>>>>>
> > >>>>>>>>>> I use GUI to create VPC. The system VM (virutal router) is
> > >>>>>>>>>> created
> > >>>> and I
> > >>>>>>>>>> can log in by console (VNC or VMWARE console), but after 40
> > >>>>>>>>>> min
> > >>>> (aprox)
> > >>>>>>>>>> this SSVM are destroyed because the MS is not able to
> > >> connect with.
> > >>>>>>>>>>
> > >>>>>>>>>> I think the System VM needs default gateway route or static
> > >>>>>>>>>> route
> > >>>> to MS
> > >>>>>>>>>> server like the rest of SystemVMs (Console, Sec. Storage or
> > >>>>>>>>>> Guest
> > >>>> Net.).
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)
> > >>>>>>>>>>
> > >>>>>>>>>> Num. of Management Server: 1 (under CentOS 6.4) [physical
> > server].
> > >>>>>>>>>>
> > >>>>>>>>>> The MS has this network configuration: IP: 10.10.10.110/24
> GW:
> > >>>>>>>>>> 10.10.10.254
> > >>>>>>>>>>
> > >>>>>>>>>> DNS server:10.10.10.116/24
> > >>>>>>>>>>
> > >>>>>>>>>> Hypervisor: VMWARE 4.1 (with Standard Virtual Switches), 2
> > >>>>>>>>>> ESXi
> > >>>> hosts:
> > >>>>>>>>>> IPs: 10.10.1.101 & .102/24 GW: 10.10.1.254
> > >>>>>>>>>>
> > >>>>>>>>>> vCenter: 10.10.1.100/24.
> > >>>>>>>>>>
> > >>>>>>>>>> Virtual Network Architecture:
> > >>>>>>>>>>
> > >>>>>>>>>> CS Traffic Type:CS Management VmWare Virtual
> > Switch:vSwitch0
> > >>>>>>>>>> CS Physical Network:PhysNet-mgmt-svm
> > >>>>>>>>>> Network:10.10.1.0
> > >>>>>>>>>> Subnet:/24
> > >>>>>>>>>> Gateway:10.10.1.254
> > >>>>>>>>>> VLAN TAG: NONE
> > >>>>>>>>>> Start IP Range:10.10.1.120
> > >>>>>>>>>> End IP Range: 10.10.1.240
> > >>>>>>>>>>
> > >>>>>>>>>> CS Traffic Type: Storage
> > >>>>>>>>>> VmWare Virtual Switch:vSwitch1 CS Physical
> > >>>>>>>>>> Network:PhysNet-storage
> > >>>>>>>>>> Network:10.10.2.0
> > >>>>>>>>>> Subnet:/24
> > >>>>>>>>>> Gateway:10.10.2.254
> > >>>>>>>>>> VLAN TAG: NONE
> > >>>>>>>>>> Start IP Range:10.10.2.120
> > >>>>>>>>>> End IP Range: 10.10.2.240
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> CS Traffic Type:Guest
> > >>>>>>>>>> VmWare Virtual Switch:vSwitch2 CS Physical
> > >>>>>>>>>> Network:PhysNet-guest-1
> > >>>>>>>>>> Network:10.10.3.0
> > >>>>>>>>>> Subnet:/24
> > >>>>>>>>>> Gateway:10.10.3.254
> > >>>>>>>>>> VLAN TAG: NONE
> > >>>>>>>>>> Start IP Range:10.10.3.1
> > >>>>>>>>>> End IP Range: 10.10.3.254
> > >>>>>>>>>>
> > >>>>>>>>>> CS Traffic Type:Public
> > >>>>>>>>>> VmWare Virtual Switch:vSwitch3 CS Physical
> > >>>>>>>>>> Network:PhysNet-public
> > >>>>>>>>>> Network:10.10.4.0
> > >>>>>>>>>> Subnet:/24
> > >>>>>>>>>> Gateway:10.10.4.254
> > >>>>>>>>>> VLAN TAG: NONE
> > >>>>>>>>>> Start IP Range:10.10.4.1
> > >>>>>>>>>> End IP Range: 10.10.4.240
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> vRouter (VPC) System VM - doesn't have a specific route to
> > MS:
> > >>>>>>>>>>
> > >>>>>>>>>> root@r-53-VM:~# netstat -nr Kernel IP routing table
> > >>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
> > >>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>>>>>> eth3
> > >>>>>>>>>> root@r-53-VM:~#
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> CS management server:
> > >>>>>>>>>>
> > >>>>>>>>>> [root@cs-1 ~]# netstat -nr
> > >>>>>>>>>> Kernel IP routing table
> > >>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
> > >>>>>>>>>> 10.10.10.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>>>>>> eth0
> > >>>>>>>>>> 169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0
> > >>>>>>>>>> eth0
> > >>>>>>>>>> 0.0.0.0 10.10.10.254 0.0.0.0 UG 0 0 0
> > >>>>>>>>>> eth0
> > >>>>>>>>>> [root@cs-1 ~]#
> > >>>>>>>>>>
> > >>>>>>>>>> Console Proxy System VM:
> > >>>>>>>>>>
> > >>>>>>>>>> root@v-50-VM:~# netstat -nr Kernel IP routing table
> > >>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
> > >>>>>>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0 0
> > >>>>>>>>>> eth1
> > >>>>>>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0 0
> > >>>>>>>>>> eth1
> > >>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>>>>>> eth2
> > >>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>>>>>> eth1
> > >>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
> > >>>>>>>>>> eth1
> > >>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
> > >>>>>>>>>> eth2
> > >>>>>>>>>> root@v-50-VM:~#
> > >>>>>>>>>>
> > >>>>>>>>>> vRouter (no VPC- Guest Network) System VM:
> > >>>>>>>>>>
> > >>>>>>>>>> root@r-49-VM:~# netstat -nr Kernel IP routing table
> > >>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
> > >>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>>>>>> eth2
> > >>>>>>>>>> 10.10.3.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>>>>>> eth0
> > >>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>>>>>> eth1
> > >>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
> > >>>>>>>>>> eth1
> > >>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
> > >>>>>>>>>> eth2
> > >>>>>>>>>> root@r-49-VM:~#
> > >>>>>>>>>>
> > >>>>>>>>>> Secondary Storage System VM:
> > >>>>>>>>>>
> > >>>>>>>>>> root@s-28-VM:~# netstat -nr Kernel IP routing table
> > >>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
> > >>>>>>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
> > >>>>>>>>>> 0 eth1
> > >>>>>>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
> > >>>>>>>>>> 0 eth1
> > >>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0
> > >>>>>>>>>> 0 0 eth2
> > >>>>>>>>>> 10.10.2.0 0.0.0.0 255.255.255.0 U 0
> > >>>>>>>>>> 0 0 eth3
> > >>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0
> > >>>>>>>>>> 0 0 eth1
> > >>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0
> > >>>>>>>>>> 0 eth1
> > >>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG
> > >>>>>>>>>> 0 0 0 eth2
> > >>>>>>>>>> root@s-28-VM:~#
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> Thanks,
> > >>>>>>>>>> Regards.
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>
> > >>>>
> > >> -------------------------------------------------------------------
> > >> -----------------------
> > ---
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>
> > >>>>
> > >> -------------------------------------------------------------------
> > >> -----------------------
> > ---
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>>> Date: Mon, 26 Aug 2013 15:19:06 +0100
> > >>>>>>>>>>> Subject: Re: VPC virtual router fails to start up - no
> > >> route to CS
> > >>>>>>>>>> Management Server.
> > >>>>>>>>>>> From: msweet.dev@gmail.com <javascript:;>
> > >>>>>>>>>>> To: users@cloudstack.apache.org <javascript:;>
> > >>>>>>>>>>>
> > >>>>>>>>>>> Hi,
> > >>>>>>>>>>>
> > >>>>>>>>>>> I don't think this has got a response because of the poor
> > >>>> formatting of
> > >>>>>>>>>> the
> > >>>>>>>>>>> log. Please could you attach the log in a separate file
> > >>>>>>>>>>> and
> > >> I will
> > >>>>>>>> take a
> > >>>>>>>>>>> look?
> > >>>>>>>>>>> Am I correct in thinking that it is creating the system
> > >>>>>>>>>>> VM, and
> > >>>> then
> > >>>>>>>>>>> destroying it?
> > >>>>>>>>>>>
> > >>>>>>>>>>> Thanks,
> > >>>>>>>>>>> Marty
> > >>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>>> On Sun, Aug 25, 2013 at 11:46 PM, Enrique Ladrón de
> > >>>>>>>>>>> Guevara
> > >>>> Hernández <
> > >>>>>>>>>>> enriquelgh@hotmail.com> wrote:
> > >>>>>>>>>>>
> > >>>>>>>>>>>> Hi,
> > >>>>>>>>>>>> I'm carrying out my End of Career Project related to
> > CloudStack
> > >>>>>>>>>>>> deployment. I got issues when I try to deploy a VPC, the
> > >>>>>>>>>>>> VPC
> > >>>> virtual
> > >>>>>>>>>> router
> > >>>>>>>>>>>> isn't deployed completely and It's destroyed after timeout.
> > >>>>>>>>>>>> The rest of SSVMs (Console Proxy VM, Storage VM and
> > Guest
> > >> Network
> > >>>> VM)
> > >>>>>>>>>> are
> > >>>>>>>>>>>> deployed correctly. I can access to the instance console,
> > >> put into
> > >>>>>>>> guest
> > >>>>>>>>>>>> network a instance, connect to it, etc ...
> > >>>>>>>>>>>> Could you help me to resolve this issue? I don't know
> > >> which is the
> > >>>>>>>> thing
> > >>>>>>>>>>>> that I'm doing wrong ...
> > >>>>>>>>>>>> This is the context:
> > >>>>>>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)Num. of
> > >> Management
> > >>>>>>>>>> Server:
> > >>>>>>>>>>>> 1 (under CentOS 6.4) [physical server]. The MS has this
> > network
> > >>>>>>>>>>>> configuration:IP: 10.10.10.110/24GW: 10.10.10.254DNS
> > server:
> > >>>>>>>>>>>> 10.10.10.116/24Hypervisor: VMWARE 4.1:2 ESXi hosts:IPs:
> > >>>> 10.10.1.101 &
> > >>>>>>>>>>>> .102/24GW: 10.10.1.254vCenter: 10.10.1.100Standard
> > >>>>>>>>>>>> Virtual
> > >>>> Switches.
> > >>>>>>>>>>>> Virtual Network Architecture:VmWare Virtual Switch CS
> > Physical
> > >>>>>>>>>>>> Network Network Subnet Gateway VLAN TAG CS Traffic
> Type
> > >>>>>>>>>>>> Start IP Range End IP RangevSwitch0 PhysNet-mgmt-svm
> > >>>>>>>>>>>> 10.10.1.0
> > >>>>>>>>>>>> 255.255.255.0 10.10.1.254 NONE CS Management
> 10.10.1.120
> > >>>>>>>>>>>> 10.10.1.240vSwitch1
> > >>>>>>>>>>>> PhysNet-storage 10.10.2.0 255.255.255.0 10.10.2.254 NONE
> > >>>>>>>>>>>> Storage 10.10.2.120
> > >>>>>>>>>>>> 10.10.2.240vSwitch2 PhysNet-guest-1
> > >>>>>>>>>>>> 10.10.3.0 255.255.255.0 10.10.3.254 NONE Guest 10.10.3.1
> > >>>>>>>>>>>> 10.10.3.254vSwitch3 PhysNet-public 10.10.4.0
> > >>>>>>>>>>>> 255.255.255.0 10.10.4.254 NONE Public
> > >>>>>>>>>>>> 10.10.4.1 10.10.4.240
> > >>>>>>>>>>>> I log in to ssvm consoles and I can see the
> > >>>>>>>>>>>> following:vRouter
> > >>>> (VPC)
> > >>>>>>>>>> System
> > >>>>>>>>>>>> VM - doesn't have a specific route to MS:root@r-53-VM:~#
> > netstat
> > >>>>>>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
> > >>>>>>>>>>>> Flags MSS Window irtt Iface10.10.1.0 0.0.0.0
> > >>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth3root@r-53-VM:~# CS
> management
> > >>>>>>>>>>>> server:[root@cs-1 ~]# netstat -nrKernel IP
> > routing
> > >>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS Window irtt
> > >>>>>>>>>>>> Iface10.10.10.0 0.0.0.0 255.255.255.0 U 0 0
> > >>>>>>>>>>>> 0 eth0169.254.0.0 0.0.0.0 255.255.0.0 U 0 0
> > >>>>>>>>>>>> 0 eth00.0.0.0 10.10.10.254 0.0.0.0 UG 0
> > >>>>>>>>>>>> 0 0 eth0[root@cs-1 ~]#
> > >>>>>>>>>>>> Console Proxy System VM:root@v-50-VM:~# netstat -
> > nrKernel IP
> > >>>> routing
> > >>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS Window irtt
> > >>>>>>>>>>>> Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
> > >>>>>>>>>>>> 0 eth110.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
> > >>>>>>>>>>>> 0 eth110.10.4.0 0.0.0.0 255.255.255.0 U 0
> > >>>>>>>>>>>> 0 0 eth210.10.1.0 0.0.0.0 255.255.255.0 U
> > >>>>>>>>>>>> 0 0 0 eth110.10.10.0 10.10.1.254 255.255.255.0 UG
> > >>>>>>>>>>>> 0 0 0 eth10.0.0.0 10.10.4.254 0.0.0.0 UG
> > >>>>>>>>>>>> 0 0 0 eth2root@v-50-VM:~# vRouter (no VPC- Guest
> Network)
> > >>>>>>>>>>>> System VM:root@r-49-
> > VM:~#
> > >> netstat
> > >>>>>>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
> > >>>>>>>>>>>> Flags MSS Window irtt Iface10.10.4.0 0.0.0.0
> > >>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth210.10.3.0 0.0.0.0
> > >>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth010.10.1.0 0.0.0.0
> > >>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0 10.10.1.254
> > >>>>>>>>>>>> 255.255.255.0 UG 0 0 0 eth10.0.0.0
> > >>>>>>>>>>>> 10.10.4.254 0.0.0.0 UG 0 0 0 eth2root@r-49-VM :~#
> > >>>>>>>>>>>> Secondary Storage System VMroot@s-28-VM:~# netstat -
> > nrKernel IP
> > >>>>>>>> routing
> > >>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS Window irtt
> > >>>>>>>>>>>> Iface10.10.10.116 10.10.1.254 255.255.255.255
> > UGH
> > >>>>>>>>>>>> 0 0 0 eth110.10.10.110 10.10.1.254
> > >>>>>>>>>>>> 255.255.255.255 UGH 0 0 0 eth110.10.4.0
> > >>>>>>>>>>>> 0.0.0.0 255.255.255.0 U 0 0
> > >>>>>>>>>>>> 0 eth210.10.2.0 0.0.0.0 255.255.255.0 U
> > >>>>>>>>>>>> 0 0 0 eth310.10.1.0 0.0.0.0
> > >>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0
> > >>>>>>>>>>>> 10.10.1.254 255.255.255.0 UG 0 0 0
> > >>>>>>>>>>>> eth10.0.0.0 10.10.4.254 0.0.0.0 UG
> > >>>>>>>>>>>> 0 0 0 eth2root@s-28-VM:~# management-server.log
> (filtered
> > >>>>>>>>>>>> by r-53-VM):
> > >>>>>>>>>>>> [root@cs-1 ~]# g>> GNU/Linux 5.0 (32-bit)","bootArgs":"
> > vpccidr=
> > >>>>>>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
> > >>>> template=domP
> > >>>>>>>>>> name=r-53-VM
> > >>>>>>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
> > >>>>>>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
> > >>>> disable_rp_filter=true
> > >>>>>>>>>> extra_pubnics=2
> > >>>>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>
> > >>>>
> > >>
> > nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"lim
> > itC
> >
> puUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"
> > E
> > 1000"},"uuid":"c71fdb8a-7392-4491-8fa7-
> > dc1074149871","disks":[{"id":54,"name":"ROOT-
> >
> 53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path"
> > :"ROOT-53-
> > 54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesyst
> > e
> > m","storagePoolUuid":"961a0972-5d85-3a20-a3ab-
> > 98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-
> > 1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-
> >
> ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.
> > 10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"C
> > ontr
> > ol","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}
> > },{"che
> >
> ck.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":
> > 100,"name":"r-53-
> >
> VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.
> > 1.238","
> > >>>>>>>>>>>> router.name
> > >>>>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>
> > >>>>
> > >> ":"r-53-
> >
> VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbp
> > s":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-
> > 1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"1
> > 0.1
> >
> 0.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","
> > broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSe
> > curity
> > GroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-
> >
> VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountI
> > d
> > ":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":
> > fals
> > e,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vla
> > nNetm
> > ask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate"
> > :20
> > 0,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"
> > rout
> > er.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"
> > 10.1
> > 0.1.238","
> > >>>>>>>>>>>> router.name
> > >>>>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>
> > >>>>
> > >> ":"r-53-
> >
> VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountI
> > d
> > ":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":
> > fals
> > e,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vla
> > nNetm
> > ask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate"
> > :20
> > 0,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessD
> > eta ils":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","
> > >>>>>>>>>>>> router.name":"r-53-VM"},"wait":0}},{}] }2013-08-25
> > 11:34:48,001
> > >>>> DEBUG
> > >>>>>>>>>>>> [agent.transport.Request] (Job-Executor-13:job-11) Seq
> > >>>> 1-1308430869:
> > >>>>>>>>>>>> Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1,
> > Flags:
> > >>>>>>>> 100111,
> > >>>>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>
> > >>>>
> > >> [{"StartCommand":{"vm":{"id":53,"name":"r-53-
> > VM","bootloader":"HVM","type":"DomainRouter">>
> > >>>>>>>>>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
> > >>>>>>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
> > >>>> template=domP
> > >>>>>>>>>> name=r-53-VM
> > >>>>>>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
> > >>>>>>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
> > >>>> disable_rp_filter=true
> > >>>>>>>>>> extra_pubnics=2
> > >>>>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>
> > >>>>
> > >>
> > nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"lim
> > itC
> >
> puUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"
> > E
> > 1000"},"uuid":"c71fdb8a-7392-4491-8fa7-
> > dc1074149871","disks":[{"id":54,"name":"ROOT-
> >
> 53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path"
> > :"ROOT-53-
> > 54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesyst
> > e
> > m","storagePoolUuid":"961a0972-5d85-3a20-a3ab-
> > 98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":>
> > >
> > >>>>>>>>>> GNU/Linux 5.0 (32-bit)",
> > >>>>>>>>
> > >>>>
>
>
RE: VPC virtual router fails to start up - no route to CS
Management Server.
Posted by "Musayev, Ilya" <im...@webmd.net>.
Both eth0 and eth1 must be up. In your case only eth0 is up (guest network) and eth1 is down (link local).
Inspect the contents on /var/cache/cloud/cmdline
Attempt to setup IP manually to see if it helps for eth1. Default GW must be on eth0/guest network.
Check vSphere to confirm both eth0 and eth1 are on proper vswitches.
> -----Original Message-----
> From: Musayev, Ilya [mailto:imusayev@webmd.net]
> Sent: Friday, September 06, 2013 2:19 PM
> To: users@cloudstack.apache.org
> Cc: dev@cloudstack.apache.org
> Subject: RE: VPC virtual router fails to start up - no route to CS Management
> Server.
>
> What stops you from adding a route as test on RVM?
>
>
>
> > -----Original Message-----
> > From: COCHE Sébastien [mailto:SCOCHE@sigma.fr]
> > Sent: Friday, September 06, 2013 12:49 PM
> > To: users@cloudstack.apache.org
> > Cc: dev@cloudstack.apache.org
> > Subject: RE: VPC virtual router fails to start up - no route to CS
> > Management Server.
> >
> > Hi Enrique,
> >
> > I had the same issue on 4.0, 4.0.1 and 4.1 CloudStack's releases.
> > I followed the documentation for complex deployment (CloudStack
> > Manager and hypervisor (ESX) on a different networks) After some
> > research it seems that the VPC's vRouter do not have a route to
> > communicate with CloudStack server. On a VPC vRouter, the default route
> is set on the public network.
> > I already post on this issue, and I did not have any feedback (my
> > question could be not clear).
> > I hope you will be luckiest.
> >
> > Best regards
> >
> > -----Message d'origine-----
> > De : Enrique Ladrón de Guevara Hernández
> > [mailto:enriquelgh@hotmail.com] Envoyé : mercredi 4 septembre 2013
> > 00:23 À : users@cloudstack.apache.org Cc : dev@cloudstack.apache.org
> Objet : RE:
> > VPC virtual router fails to start up - no route to CS Management Server.
> >
> > Hi,
> >
> > I don't know why but don't achive to insert the tar file ...
> >
> > You can download it in this link: http://we.tl/kHJtO3BK3f
> >
> > Regards.
> >
> >
> > ----------------------------------------
> > > From: enriquelgh@hotmail.com
> > > To: users@cloudstack.apache.org
> > > CC: dev@cloudstack.apache.org
> > > Subject: RE: VPC virtual router fails to start up - no route to CS
> > Management Server.
> > > Date: Wed, 4 Sep 2013 00:15:10 +0200
> > >
> > > Hi,
> > >
> > > Logs and screenshots attached in a tar file.
> > >
> > > In my case, the type of the first interface is "Control", as you can
> > > see in the
> > screenshots.
> > >
> > > @developers, if you need more info let me know.
> > >
> > > Thanks to everyone,
> > > Regards.
> > >
> > >
> > >>> Date: Tue, 3 Sep 2013 08:05:10 +0100
> > >>> Subject: Re: VPC virtual router fails to start up - no route to CS
> > >> Management Server.
> > >>> From: msweet.dev@gmail.com
> > >>> To: users@cloudstack.apache.org
> > >>> CC: dev@cloudstack.apache.org
> > >>>
> > >>> Hi,
> > >>>
> > >>> I couldn't find any screenshots in the string of messages.
> > >>> Looking at the logs it almost seems as like the VPC is stopping
> > >>> unexpectedly.
> > >>>
> > >>> Looking at my VPC, the first interface is a Link Local for Control
> > >>> type traffic, which is running on KVM.
> > >>> I will CC this into the dev mailinglist in search for a developer
> > >>> who knows more about VMWare and VPCs.
> > >>>
> > >>> In the meantime, please could you attach (in a tar), the
> > >>> screenshots of the VPC interfaces from the cloudstack interfaces.
> > >>>
> > >>> Thanks,
> > >>> Marty
> > >>>
> > >>>
> > >>>
> > >>>
> > >>> On Mon, Sep 2, 2013 at 6:28 PM, Enrique Ladrón de Guevara
> > >>> Hernández < enriquelgh@hotmail.com> wrote:
> > >>>
> > >>>> Hi Marty,
> > >>>>
> > >>>> Sorry, could you look at the logs and screenshots?? Do you need
> > >>>> more info to debug the issue??
> > >>>>
> > >>>> Do you know if there is a bug related to this scenario??
> > >>>>
> > >>>> I try to find any information on Internet and check my config but
> > >>>> I don't know how to continue go ahead ...
> > >>>>
> > >>>> Do you recommend re-installing CS software with other version or
> > >>>> the same version ....??
> > >>>>
> > >>>> Thanks in advanced for your help.
> > >>>> Regards.
> > >>>>
> > >>>>
> > >>>> ----------------------------------------
> > >>>>> From: enriquelgh@hotmail.com
> > >>>>> To: users@cloudstack.apache.org
> > >>>>> Subject: RE: VPC virtual router fails to start up - no route to
> > >>>>> CS
> > >>>> Management Server.
> > >>>>> Date: Wed, 28 Aug 2013 20:16:26 +0200
> > >>>>>
> > >>>>> Now better!
> > >>>>>
> > >>>>> Regards.
> > >>>>>
> > >>>>> ----------------------------------------
> > >>>>>> From: enriquelgh@hotmail.com
> > >>>>>> To: users@cloudstack.apache.org
> > >>>>>> Subject: RE: VPC virtual router fails to start up - no route to
> > >>>>>> CS
> > >>>> Management Server.
> > >>>>>> Date: Wed, 28 Aug 2013 20:09:39 +0200
> > >>>>>>
> > >>>>>> Hi Marty,
> > >>>>>>
> > >>>>>> I have used a new test to capture screenshots and logs:
> > >>>>>>
> > >>>>>> VPC Name: VPC-Test
> > >>>>>> Job: job-69
> > >>>>>> vrsm: r-59-VM
> > >>>>>>
> > >>>>>> you can find files attached.
> > >>>>>>
> > >>>>>> Thanks,
> > >>>>>> Regards.
> > >>>>>>
> > >>>>>> -
> > >>>>>> ----------------------------------------
> > >>>>>>> Date: Wed, 28 Aug 2013 10:16:23 +0100
> > >>>>>>> Subject: Re: VPC virtual router fails to start up - no route
> > >>>>>>> to CS
> > >>>> Management Server.
> > >>>>>>> From: msweet.dev@gmail.com
> > >>>>>>> To: users@cloudstack.apache.org
> > >>>>>>>
> > >>>>>>> Hi,
> > >>>>>>>
> > >>>>>>> Could you let me know the IP addresses listed in the
> > >>>>>>> cloudstack
> > >>>> interface
> > >>>>>>> under Infrastructure> Virtual Routers> VPC
> > >>>>>>>
> > >>>>>>> Marty
> > >>>>>>>
> > >>>>>>>
> > >>>>>>> On Tue, Aug 27, 2013 at 11:11 PM, Enrique Ladrón de Guevara
> > >> Hernández <
> > >>>>>>> enriquelgh@hotmail.com> wrote:
> > >>>>>>>
> > >>>>>>>> Hi Marty,
> > >>>>>>>>
> > >>>>>>>> Yes, I have still got this issue ... :S I'm very lost ...
> > >>>>>>>>
> > >>>>>>>> Guest Networks are working fine, but in VPC nop ...
> > >>>>>>>>
> > >>>>>>>> If you need more info, please let me know.
> > >>>>>>>>
> > >>>>>>>> Thanks a lot for your time,
> > >>>>>>>> Regards.
> > >>>>>>>>
> > >>>>>>>>
> > >>>>>>>> ----------------------------------------
> > >>>>>>>>> Date: Tue, 27 Aug 2013 22:54:11 +0100
> > >>>>>>>>> Subject: Re: VPC virtual router fails to start up - no route
> > >>>>>>>>> to CS
> > >>>>>>>> Management Server.
> > >>>>>>>>> From: msweet.dev@gmail.com
> > >>>>>>>>> To: users@cloudstack.apache.org
> > >>>>>>>>>
> > >>>>>>>>> Hi Enrique,
> > >>>>>>>>>
> > >>>>>>>>> Sorry I haven't got back to you, is this still an issue?
> > >>>>>>>>> If so, I will take a look at it and get back to you in the morning.
> > >>>>>>>>>
> > >>>>>>>>> Thanks,
> > >>>>>>>>> Marty
> > >>>>>>>>>
> > >>>>>>>>> On Monday, August 26, 2013, Enrique Ladrón de Guevara
> > >>>>>>>>> Hernández
> > >>>> wrote:
> > >>>>>>>>>
> > >>>>>>>>>> Hi Marty,
> > >>>>>>>>>>
> > >>>>>>>>>> My apologies for the format. I hope this time the email
> > >> format will
> > >>>> be
> > >>>>>>>>>> better. You can find the logs attached.
> > >>>>>>>>>>
> > >>>>>>>>>> In this log you can see several VPC deployment tests. One
> > >>>>>>>>>> of them
> > >>>> is:
> > >>>>>>>>>> - VPC name: VPC-Prueba-1
> > >>>>>>>>>> - job: job-11
> > >>>>>>>>>> - ssvm: r-53-VM.
> > >>>>>>>>>>
> > >>>>>>>>>> I use GUI to create VPC. The system VM (virutal router) is
> > >>>>>>>>>> created
> > >>>> and I
> > >>>>>>>>>> can log in by console (VNC or VMWARE console), but after 40
> > >>>>>>>>>> min
> > >>>> (aprox)
> > >>>>>>>>>> this SSVM are destroyed because the MS is not able to
> > >> connect with.
> > >>>>>>>>>>
> > >>>>>>>>>> I think the System VM needs default gateway route or static
> > >>>>>>>>>> route
> > >>>> to MS
> > >>>>>>>>>> server like the rest of SystemVMs (Console, Sec. Storage or
> > >>>>>>>>>> Guest
> > >>>> Net.).
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)
> > >>>>>>>>>>
> > >>>>>>>>>> Num. of Management Server: 1 (under CentOS 6.4) [physical
> > server].
> > >>>>>>>>>>
> > >>>>>>>>>> The MS has this network configuration: IP: 10.10.10.110/24
> GW:
> > >>>>>>>>>> 10.10.10.254
> > >>>>>>>>>>
> > >>>>>>>>>> DNS server:10.10.10.116/24
> > >>>>>>>>>>
> > >>>>>>>>>> Hypervisor: VMWARE 4.1 (with Standard Virtual Switches), 2
> > >>>>>>>>>> ESXi
> > >>>> hosts:
> > >>>>>>>>>> IPs: 10.10.1.101 & .102/24 GW: 10.10.1.254
> > >>>>>>>>>>
> > >>>>>>>>>> vCenter: 10.10.1.100/24.
> > >>>>>>>>>>
> > >>>>>>>>>> Virtual Network Architecture:
> > >>>>>>>>>>
> > >>>>>>>>>> CS Traffic Type:CS Management VmWare Virtual
> > Switch:vSwitch0
> > >>>>>>>>>> CS Physical Network:PhysNet-mgmt-svm
> > >>>>>>>>>> Network:10.10.1.0
> > >>>>>>>>>> Subnet:/24
> > >>>>>>>>>> Gateway:10.10.1.254
> > >>>>>>>>>> VLAN TAG: NONE
> > >>>>>>>>>> Start IP Range:10.10.1.120
> > >>>>>>>>>> End IP Range: 10.10.1.240
> > >>>>>>>>>>
> > >>>>>>>>>> CS Traffic Type: Storage
> > >>>>>>>>>> VmWare Virtual Switch:vSwitch1 CS Physical
> > >>>>>>>>>> Network:PhysNet-storage
> > >>>>>>>>>> Network:10.10.2.0
> > >>>>>>>>>> Subnet:/24
> > >>>>>>>>>> Gateway:10.10.2.254
> > >>>>>>>>>> VLAN TAG: NONE
> > >>>>>>>>>> Start IP Range:10.10.2.120
> > >>>>>>>>>> End IP Range: 10.10.2.240
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> CS Traffic Type:Guest
> > >>>>>>>>>> VmWare Virtual Switch:vSwitch2 CS Physical
> > >>>>>>>>>> Network:PhysNet-guest-1
> > >>>>>>>>>> Network:10.10.3.0
> > >>>>>>>>>> Subnet:/24
> > >>>>>>>>>> Gateway:10.10.3.254
> > >>>>>>>>>> VLAN TAG: NONE
> > >>>>>>>>>> Start IP Range:10.10.3.1
> > >>>>>>>>>> End IP Range: 10.10.3.254
> > >>>>>>>>>>
> > >>>>>>>>>> CS Traffic Type:Public
> > >>>>>>>>>> VmWare Virtual Switch:vSwitch3 CS Physical
> > >>>>>>>>>> Network:PhysNet-public
> > >>>>>>>>>> Network:10.10.4.0
> > >>>>>>>>>> Subnet:/24
> > >>>>>>>>>> Gateway:10.10.4.254
> > >>>>>>>>>> VLAN TAG: NONE
> > >>>>>>>>>> Start IP Range:10.10.4.1
> > >>>>>>>>>> End IP Range: 10.10.4.240
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> vRouter (VPC) System VM - doesn't have a specific route to
> > MS:
> > >>>>>>>>>>
> > >>>>>>>>>> root@r-53-VM:~# netstat -nr Kernel IP routing table
> > >>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
> > >>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>>>>>> eth3
> > >>>>>>>>>> root@r-53-VM:~#
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> CS management server:
> > >>>>>>>>>>
> > >>>>>>>>>> [root@cs-1 ~]# netstat -nr
> > >>>>>>>>>> Kernel IP routing table
> > >>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
> > >>>>>>>>>> 10.10.10.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>>>>>> eth0
> > >>>>>>>>>> 169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0
> > >>>>>>>>>> eth0
> > >>>>>>>>>> 0.0.0.0 10.10.10.254 0.0.0.0 UG 0 0 0
> > >>>>>>>>>> eth0
> > >>>>>>>>>> [root@cs-1 ~]#
> > >>>>>>>>>>
> > >>>>>>>>>> Console Proxy System VM:
> > >>>>>>>>>>
> > >>>>>>>>>> root@v-50-VM:~# netstat -nr Kernel IP routing table
> > >>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
> > >>>>>>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0 0
> > >>>>>>>>>> eth1
> > >>>>>>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0 0
> > >>>>>>>>>> eth1
> > >>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>>>>>> eth2
> > >>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>>>>>> eth1
> > >>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
> > >>>>>>>>>> eth1
> > >>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
> > >>>>>>>>>> eth2
> > >>>>>>>>>> root@v-50-VM:~#
> > >>>>>>>>>>
> > >>>>>>>>>> vRouter (no VPC- Guest Network) System VM:
> > >>>>>>>>>>
> > >>>>>>>>>> root@r-49-VM:~# netstat -nr Kernel IP routing table
> > >>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
> > >>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>>>>>> eth2
> > >>>>>>>>>> 10.10.3.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>>>>>> eth0
> > >>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>>>>>> eth1
> > >>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
> > >>>>>>>>>> eth1
> > >>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
> > >>>>>>>>>> eth2
> > >>>>>>>>>> root@r-49-VM:~#
> > >>>>>>>>>>
> > >>>>>>>>>> Secondary Storage System VM:
> > >>>>>>>>>>
> > >>>>>>>>>> root@s-28-VM:~# netstat -nr Kernel IP routing table
> > >>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
> > >>>>>>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
> > >>>>>>>>>> 0 eth1
> > >>>>>>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
> > >>>>>>>>>> 0 eth1
> > >>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0
> > >>>>>>>>>> 0 0 eth2
> > >>>>>>>>>> 10.10.2.0 0.0.0.0 255.255.255.0 U 0
> > >>>>>>>>>> 0 0 eth3
> > >>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0
> > >>>>>>>>>> 0 0 eth1
> > >>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0
> > >>>>>>>>>> 0 eth1
> > >>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG
> > >>>>>>>>>> 0 0 0 eth2
> > >>>>>>>>>> root@s-28-VM:~#
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>> Thanks,
> > >>>>>>>>>> Regards.
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>
> > >>>>
> > >> -------------------------------------------------------------------
> > >> -----------------------
> > ---
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>
> > >>>>
> > >> -------------------------------------------------------------------
> > >> -----------------------
> > ---
> > >>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>>>> Date: Mon, 26 Aug 2013 15:19:06 +0100
> > >>>>>>>>>>> Subject: Re: VPC virtual router fails to start up - no
> > >> route to CS
> > >>>>>>>>>> Management Server.
> > >>>>>>>>>>> From: msweet.dev@gmail.com <javascript:;>
> > >>>>>>>>>>> To: users@cloudstack.apache.org <javascript:;>
> > >>>>>>>>>>>
> > >>>>>>>>>>> Hi,
> > >>>>>>>>>>>
> > >>>>>>>>>>> I don't think this has got a response because of the poor
> > >>>> formatting of
> > >>>>>>>>>> the
> > >>>>>>>>>>> log. Please could you attach the log in a separate file
> > >>>>>>>>>>> and
> > >> I will
> > >>>>>>>> take a
> > >>>>>>>>>>> look?
> > >>>>>>>>>>> Am I correct in thinking that it is creating the system
> > >>>>>>>>>>> VM, and
> > >>>> then
> > >>>>>>>>>>> destroying it?
> > >>>>>>>>>>>
> > >>>>>>>>>>> Thanks,
> > >>>>>>>>>>> Marty
> > >>>>>>>>>>>
> > >>>>>>>>>>>
> > >>>>>>>>>>> On Sun, Aug 25, 2013 at 11:46 PM, Enrique Ladrón de
> > >>>>>>>>>>> Guevara
> > >>>> Hernández <
> > >>>>>>>>>>> enriquelgh@hotmail.com> wrote:
> > >>>>>>>>>>>
> > >>>>>>>>>>>> Hi,
> > >>>>>>>>>>>> I'm carrying out my End of Career Project related to
> > CloudStack
> > >>>>>>>>>>>> deployment. I got issues when I try to deploy a VPC, the
> > >>>>>>>>>>>> VPC
> > >>>> virtual
> > >>>>>>>>>> router
> > >>>>>>>>>>>> isn't deployed completely and It's destroyed after timeout.
> > >>>>>>>>>>>> The rest of SSVMs (Console Proxy VM, Storage VM and
> > Guest
> > >> Network
> > >>>> VM)
> > >>>>>>>>>> are
> > >>>>>>>>>>>> deployed correctly. I can access to the instance console,
> > >> put into
> > >>>>>>>> guest
> > >>>>>>>>>>>> network a instance, connect to it, etc ...
> > >>>>>>>>>>>> Could you help me to resolve this issue? I don't know
> > >> which is the
> > >>>>>>>> thing
> > >>>>>>>>>>>> that I'm doing wrong ...
> > >>>>>>>>>>>> This is the context:
> > >>>>>>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)Num. of
> > >> Management
> > >>>>>>>>>> Server:
> > >>>>>>>>>>>> 1 (under CentOS 6.4) [physical server]. The MS has this
> > network
> > >>>>>>>>>>>> configuration:IP: 10.10.10.110/24GW: 10.10.10.254DNS
> > server:
> > >>>>>>>>>>>> 10.10.10.116/24Hypervisor: VMWARE 4.1:2 ESXi hosts:IPs:
> > >>>> 10.10.1.101 &
> > >>>>>>>>>>>> .102/24GW: 10.10.1.254vCenter: 10.10.1.100Standard
> > >>>>>>>>>>>> Virtual
> > >>>> Switches.
> > >>>>>>>>>>>> Virtual Network Architecture:VmWare Virtual Switch CS
> > Physical
> > >>>>>>>>>>>> Network Network Subnet Gateway VLAN TAG CS Traffic
> Type
> > >>>>>>>>>>>> Start IP Range End IP RangevSwitch0 PhysNet-mgmt-svm
> > >>>>>>>>>>>> 10.10.1.0
> > >>>>>>>>>>>> 255.255.255.0 10.10.1.254 NONE CS Management
> 10.10.1.120
> > >>>>>>>>>>>> 10.10.1.240vSwitch1
> > >>>>>>>>>>>> PhysNet-storage 10.10.2.0 255.255.255.0 10.10.2.254 NONE
> > >>>>>>>>>>>> Storage 10.10.2.120
> > >>>>>>>>>>>> 10.10.2.240vSwitch2 PhysNet-guest-1
> > >>>>>>>>>>>> 10.10.3.0 255.255.255.0 10.10.3.254 NONE Guest 10.10.3.1
> > >>>>>>>>>>>> 10.10.3.254vSwitch3 PhysNet-public 10.10.4.0
> > >>>>>>>>>>>> 255.255.255.0 10.10.4.254 NONE Public
> > >>>>>>>>>>>> 10.10.4.1 10.10.4.240
> > >>>>>>>>>>>> I log in to ssvm consoles and I can see the
> > >>>>>>>>>>>> following:vRouter
> > >>>> (VPC)
> > >>>>>>>>>> System
> > >>>>>>>>>>>> VM - doesn't have a specific route to MS:root@r-53-VM:~#
> > netstat
> > >>>>>>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
> > >>>>>>>>>>>> Flags MSS Window irtt Iface10.10.1.0 0.0.0.0
> > >>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth3root@r-53-VM:~# CS
> management
> > >>>>>>>>>>>> server:[root@cs-1 ~]# netstat -nrKernel IP
> > routing
> > >>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS Window irtt
> > >>>>>>>>>>>> Iface10.10.10.0 0.0.0.0 255.255.255.0 U 0 0
> > >>>>>>>>>>>> 0 eth0169.254.0.0 0.0.0.0 255.255.0.0 U 0 0
> > >>>>>>>>>>>> 0 eth00.0.0.0 10.10.10.254 0.0.0.0 UG 0
> > >>>>>>>>>>>> 0 0 eth0[root@cs-1 ~]#
> > >>>>>>>>>>>> Console Proxy System VM:root@v-50-VM:~# netstat -
> > nrKernel IP
> > >>>> routing
> > >>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS Window irtt
> > >>>>>>>>>>>> Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
> > >>>>>>>>>>>> 0 eth110.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
> > >>>>>>>>>>>> 0 eth110.10.4.0 0.0.0.0 255.255.255.0 U 0
> > >>>>>>>>>>>> 0 0 eth210.10.1.0 0.0.0.0 255.255.255.0 U
> > >>>>>>>>>>>> 0 0 0 eth110.10.10.0 10.10.1.254 255.255.255.0 UG
> > >>>>>>>>>>>> 0 0 0 eth10.0.0.0 10.10.4.254 0.0.0.0 UG
> > >>>>>>>>>>>> 0 0 0 eth2root@v-50-VM:~# vRouter (no VPC- Guest
> Network)
> > >>>>>>>>>>>> System VM:root@r-49-
> > VM:~#
> > >> netstat
> > >>>>>>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
> > >>>>>>>>>>>> Flags MSS Window irtt Iface10.10.4.0 0.0.0.0
> > >>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth210.10.3.0 0.0.0.0
> > >>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth010.10.1.0 0.0.0.0
> > >>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0 10.10.1.254
> > >>>>>>>>>>>> 255.255.255.0 UG 0 0 0 eth10.0.0.0
> > >>>>>>>>>>>> 10.10.4.254 0.0.0.0 UG 0 0 0 eth2root@r-49-VM :~#
> > >>>>>>>>>>>> Secondary Storage System VMroot@s-28-VM:~# netstat -
> > nrKernel IP
> > >>>>>>>> routing
> > >>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS Window irtt
> > >>>>>>>>>>>> Iface10.10.10.116 10.10.1.254 255.255.255.255
> > UGH
> > >>>>>>>>>>>> 0 0 0 eth110.10.10.110 10.10.1.254
> > >>>>>>>>>>>> 255.255.255.255 UGH 0 0 0 eth110.10.4.0
> > >>>>>>>>>>>> 0.0.0.0 255.255.255.0 U 0 0
> > >>>>>>>>>>>> 0 eth210.10.2.0 0.0.0.0 255.255.255.0 U
> > >>>>>>>>>>>> 0 0 0 eth310.10.1.0 0.0.0.0
> > >>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0
> > >>>>>>>>>>>> 10.10.1.254 255.255.255.0 UG 0 0 0
> > >>>>>>>>>>>> eth10.0.0.0 10.10.4.254 0.0.0.0 UG
> > >>>>>>>>>>>> 0 0 0 eth2root@s-28-VM:~# management-server.log
> (filtered
> > >>>>>>>>>>>> by r-53-VM):
> > >>>>>>>>>>>> [root@cs-1 ~]# g>> GNU/Linux 5.0 (32-bit)","bootArgs":"
> > vpccidr=
> > >>>>>>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
> > >>>> template=domP
> > >>>>>>>>>> name=r-53-VM
> > >>>>>>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
> > >>>>>>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
> > >>>> disable_rp_filter=true
> > >>>>>>>>>> extra_pubnics=2
> > >>>>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>
> > >>>>
> > >>
> > nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"lim
> > itC
> >
> puUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"
> > E
> > 1000"},"uuid":"c71fdb8a-7392-4491-8fa7-
> > dc1074149871","disks":[{"id":54,"name":"ROOT-
> >
> 53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path"
> > :"ROOT-53-
> > 54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesyst
> > e
> > m","storagePoolUuid":"961a0972-5d85-3a20-a3ab-
> > 98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-
> > 1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-
> >
> ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.
> > 10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"C
> > ontr
> > ol","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}
> > },{"che
> >
> ck.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":
> > 100,"name":"r-53-
> >
> VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.
> > 1.238","
> > >>>>>>>>>>>> router.name
> > >>>>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>
> > >>>>
> > >> ":"r-53-
> >
> VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbp
> > s":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-
> > 1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"1
> > 0.1
> >
> 0.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","
> > broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSe
> > curity
> > GroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-
> >
> VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountI
> > d
> > ":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":
> > fals
> > e,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vla
> > nNetm
> > ask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate"
> > :20
> > 0,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"
> > rout
> > er.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"
> > 10.1
> > 0.1.238","
> > >>>>>>>>>>>> router.name
> > >>>>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>
> > >>>>
> > >> ":"r-53-
> >
> VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountI
> > d
> > ":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":
> > fals
> > e,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vla
> > nNetm
> > ask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate"
> > :20
> > 0,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessD
> > eta ils":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","
> > >>>>>>>>>>>> router.name":"r-53-VM"},"wait":0}},{}] }2013-08-25
> > 11:34:48,001
> > >>>> DEBUG
> > >>>>>>>>>>>> [agent.transport.Request] (Job-Executor-13:job-11) Seq
> > >>>> 1-1308430869:
> > >>>>>>>>>>>> Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1,
> > Flags:
> > >>>>>>>> 100111,
> > >>>>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>
> > >>>>
> > >> [{"StartCommand":{"vm":{"id":53,"name":"r-53-
> > VM","bootloader":"HVM","type":"DomainRouter">>
> > >>>>>>>>>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
> > >>>>>>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
> > >>>> template=domP
> > >>>>>>>>>> name=r-53-VM
> > >>>>>>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
> > >>>>>>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
> > >>>> disable_rp_filter=true
> > >>>>>>>>>> extra_pubnics=2
> > >>>>>>>>>>>>
> > >>>>>>>>>>
> > >>>>>>>>
> > >>>>
> > >>
> > nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"lim
> > itC
> >
> puUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"
> > E
> > 1000"},"uuid":"c71fdb8a-7392-4491-8fa7-
> > dc1074149871","disks":[{"id":54,"name":"ROOT-
> >
> 53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path"
> > :"ROOT-53-
> > 54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesyst
> > e
> > m","storagePoolUuid":"961a0972-5d85-3a20-a3ab-
> > 98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":>
> > >
> > >>>>>>>>>> GNU/Linux 5.0 (32-bit)",
> > >>>>>>>>
> > >>>>
>
>
RE: VPC virtual router fails to start up - no route to CS
Management Server.
Posted by Enrique Ladrón de Guevara Hernández <en...@hotmail.com>.
Thanks to everyone. CS 4.2 fixed this issue in my case ...!!
Regards.
> From: imusayev@webmd.net
> To: dev@cloudstack.apache.org; users@cloudstack.apache.org
> Subject: RE: VPC virtual router fails to start up - no route to CS Management Server.
> Date: Fri, 6 Sep 2013 18:36:43 +0000
>
> Both eth0 and eth1 must be up. In your case only eth0 is up (guest network) and eth1 is down (link local).
>
> Inspect the contents on /var/cache/cloud/cmdline
>
> Attempt to setup IP manually to see if it helps for eth1. Default GW must be on eth0/guest network.
>
> Check vSphere to confirm both eth0 and eth1 are on proper vswitches.
>
> > -----Original Message-----
> > From: Musayev, Ilya [mailto:imusayev@webmd.net]
> > Sent: Friday, September 06, 2013 2:19 PM
> > To: users@cloudstack.apache.org
> > Cc: dev@cloudstack.apache.org
> > Subject: RE: VPC virtual router fails to start up - no route to CS Management
> > Server.
> >
> > What stops you from adding a route as test on RVM?
> >
> >
> >
> > > -----Original Message-----
> > > From: COCHE Sébastien [mailto:SCOCHE@sigma.fr]
> > > Sent: Friday, September 06, 2013 12:49 PM
> > > To: users@cloudstack.apache.org
> > > Cc: dev@cloudstack.apache.org
> > > Subject: RE: VPC virtual router fails to start up - no route to CS
> > > Management Server.
> > >
> > > Hi Enrique,
> > >
> > > I had the same issue on 4.0, 4.0.1 and 4.1 CloudStack's releases.
> > > I followed the documentation for complex deployment (CloudStack
> > > Manager and hypervisor (ESX) on a different networks) After some
> > > research it seems that the VPC's vRouter do not have a route to
> > > communicate with CloudStack server. On a VPC vRouter, the default route
> > is set on the public network.
> > > I already post on this issue, and I did not have any feedback (my
> > > question could be not clear).
> > > I hope you will be luckiest.
> > >
> > > Best regards
> > >
> > > -----Message d'origine-----
> > > De : Enrique Ladrón de Guevara Hernández
> > > [mailto:enriquelgh@hotmail.com] Envoyé : mercredi 4 septembre 2013
> > > 00:23 À : users@cloudstack.apache.org Cc : dev@cloudstack.apache.org
> > Objet : RE:
> > > VPC virtual router fails to start up - no route to CS Management Server.
> > >
> > > Hi,
> > >
> > > I don't know why but don't achive to insert the tar file ...
> > >
> > > You can download it in this link: http://we.tl/kHJtO3BK3f
> > >
> > > Regards.
> > >
> > >
> > > ----------------------------------------
> > > > From: enriquelgh@hotmail.com
> > > > To: users@cloudstack.apache.org
> > > > CC: dev@cloudstack.apache.org
> > > > Subject: RE: VPC virtual router fails to start up - no route to CS
> > > Management Server.
> > > > Date: Wed, 4 Sep 2013 00:15:10 +0200
> > > >
> > > > Hi,
> > > >
> > > > Logs and screenshots attached in a tar file.
> > > >
> > > > In my case, the type of the first interface is "Control", as you can
> > > > see in the
> > > screenshots.
> > > >
> > > > @developers, if you need more info let me know.
> > > >
> > > > Thanks to everyone,
> > > > Regards.
> > > >
> > > >
> > > >>> Date: Tue, 3 Sep 2013 08:05:10 +0100
> > > >>> Subject: Re: VPC virtual router fails to start up - no route to CS
> > > >> Management Server.
> > > >>> From: msweet.dev@gmail.com
> > > >>> To: users@cloudstack.apache.org
> > > >>> CC: dev@cloudstack.apache.org
> > > >>>
> > > >>> Hi,
> > > >>>
> > > >>> I couldn't find any screenshots in the string of messages.
> > > >>> Looking at the logs it almost seems as like the VPC is stopping
> > > >>> unexpectedly.
> > > >>>
> > > >>> Looking at my VPC, the first interface is a Link Local for Control
> > > >>> type traffic, which is running on KVM.
> > > >>> I will CC this into the dev mailinglist in search for a developer
> > > >>> who knows more about VMWare and VPCs.
> > > >>>
> > > >>> In the meantime, please could you attach (in a tar), the
> > > >>> screenshots of the VPC interfaces from the cloudstack interfaces.
> > > >>>
> > > >>> Thanks,
> > > >>> Marty
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > > >>> On Mon, Sep 2, 2013 at 6:28 PM, Enrique Ladrón de Guevara
> > > >>> Hernández < enriquelgh@hotmail.com> wrote:
> > > >>>
> > > >>>> Hi Marty,
> > > >>>>
> > > >>>> Sorry, could you look at the logs and screenshots?? Do you need
> > > >>>> more info to debug the issue??
> > > >>>>
> > > >>>> Do you know if there is a bug related to this scenario??
> > > >>>>
> > > >>>> I try to find any information on Internet and check my config but
> > > >>>> I don't know how to continue go ahead ...
> > > >>>>
> > > >>>> Do you recommend re-installing CS software with other version or
> > > >>>> the same version ....??
> > > >>>>
> > > >>>> Thanks in advanced for your help.
> > > >>>> Regards.
> > > >>>>
> > > >>>>
> > > >>>> ----------------------------------------
> > > >>>>> From: enriquelgh@hotmail.com
> > > >>>>> To: users@cloudstack.apache.org
> > > >>>>> Subject: RE: VPC virtual router fails to start up - no route to
> > > >>>>> CS
> > > >>>> Management Server.
> > > >>>>> Date: Wed, 28 Aug 2013 20:16:26 +0200
> > > >>>>>
> > > >>>>> Now better!
> > > >>>>>
> > > >>>>> Regards.
> > > >>>>>
> > > >>>>> ----------------------------------------
> > > >>>>>> From: enriquelgh@hotmail.com
> > > >>>>>> To: users@cloudstack.apache.org
> > > >>>>>> Subject: RE: VPC virtual router fails to start up - no route to
> > > >>>>>> CS
> > > >>>> Management Server.
> > > >>>>>> Date: Wed, 28 Aug 2013 20:09:39 +0200
> > > >>>>>>
> > > >>>>>> Hi Marty,
> > > >>>>>>
> > > >>>>>> I have used a new test to capture screenshots and logs:
> > > >>>>>>
> > > >>>>>> VPC Name: VPC-Test
> > > >>>>>> Job: job-69
> > > >>>>>> vrsm: r-59-VM
> > > >>>>>>
> > > >>>>>> you can find files attached.
> > > >>>>>>
> > > >>>>>> Thanks,
> > > >>>>>> Regards.
> > > >>>>>>
> > > >>>>>> -
> > > >>>>>> ----------------------------------------
> > > >>>>>>> Date: Wed, 28 Aug 2013 10:16:23 +0100
> > > >>>>>>> Subject: Re: VPC virtual router fails to start up - no route
> > > >>>>>>> to CS
> > > >>>> Management Server.
> > > >>>>>>> From: msweet.dev@gmail.com
> > > >>>>>>> To: users@cloudstack.apache.org
> > > >>>>>>>
> > > >>>>>>> Hi,
> > > >>>>>>>
> > > >>>>>>> Could you let me know the IP addresses listed in the
> > > >>>>>>> cloudstack
> > > >>>> interface
> > > >>>>>>> under Infrastructure> Virtual Routers> VPC
> > > >>>>>>>
> > > >>>>>>> Marty
> > > >>>>>>>
> > > >>>>>>>
> > > >>>>>>> On Tue, Aug 27, 2013 at 11:11 PM, Enrique Ladrón de Guevara
> > > >> Hernández <
> > > >>>>>>> enriquelgh@hotmail.com> wrote:
> > > >>>>>>>
> > > >>>>>>>> Hi Marty,
> > > >>>>>>>>
> > > >>>>>>>> Yes, I have still got this issue ... :S I'm very lost ...
> > > >>>>>>>>
> > > >>>>>>>> Guest Networks are working fine, but in VPC nop ...
> > > >>>>>>>>
> > > >>>>>>>> If you need more info, please let me know.
> > > >>>>>>>>
> > > >>>>>>>> Thanks a lot for your time,
> > > >>>>>>>> Regards.
> > > >>>>>>>>
> > > >>>>>>>>
> > > >>>>>>>> ----------------------------------------
> > > >>>>>>>>> Date: Tue, 27 Aug 2013 22:54:11 +0100
> > > >>>>>>>>> Subject: Re: VPC virtual router fails to start up - no route
> > > >>>>>>>>> to CS
> > > >>>>>>>> Management Server.
> > > >>>>>>>>> From: msweet.dev@gmail.com
> > > >>>>>>>>> To: users@cloudstack.apache.org
> > > >>>>>>>>>
> > > >>>>>>>>> Hi Enrique,
> > > >>>>>>>>>
> > > >>>>>>>>> Sorry I haven't got back to you, is this still an issue?
> > > >>>>>>>>> If so, I will take a look at it and get back to you in the morning.
> > > >>>>>>>>>
> > > >>>>>>>>> Thanks,
> > > >>>>>>>>> Marty
> > > >>>>>>>>>
> > > >>>>>>>>> On Monday, August 26, 2013, Enrique Ladrón de Guevara
> > > >>>>>>>>> Hernández
> > > >>>> wrote:
> > > >>>>>>>>>
> > > >>>>>>>>>> Hi Marty,
> > > >>>>>>>>>>
> > > >>>>>>>>>> My apologies for the format. I hope this time the email
> > > >> format will
> > > >>>> be
> > > >>>>>>>>>> better. You can find the logs attached.
> > > >>>>>>>>>>
> > > >>>>>>>>>> In this log you can see several VPC deployment tests. One
> > > >>>>>>>>>> of them
> > > >>>> is:
> > > >>>>>>>>>> - VPC name: VPC-Prueba-1
> > > >>>>>>>>>> - job: job-11
> > > >>>>>>>>>> - ssvm: r-53-VM.
> > > >>>>>>>>>>
> > > >>>>>>>>>> I use GUI to create VPC. The system VM (virutal router) is
> > > >>>>>>>>>> created
> > > >>>> and I
> > > >>>>>>>>>> can log in by console (VNC or VMWARE console), but after 40
> > > >>>>>>>>>> min
> > > >>>> (aprox)
> > > >>>>>>>>>> this SSVM are destroyed because the MS is not able to
> > > >> connect with.
> > > >>>>>>>>>>
> > > >>>>>>>>>> I think the System VM needs default gateway route or static
> > > >>>>>>>>>> route
> > > >>>> to MS
> > > >>>>>>>>>> server like the rest of SystemVMs (Console, Sec. Storage or
> > > >>>>>>>>>> Guest
> > > >>>> Net.).
> > > >>>>>>>>>>
> > > >>>>>>>>>>
> > > >>>>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)
> > > >>>>>>>>>>
> > > >>>>>>>>>> Num. of Management Server: 1 (under CentOS 6.4) [physical
> > > server].
> > > >>>>>>>>>>
> > > >>>>>>>>>> The MS has this network configuration: IP: 10.10.10.110/24
> > GW:
> > > >>>>>>>>>> 10.10.10.254
> > > >>>>>>>>>>
> > > >>>>>>>>>> DNS server:10.10.10.116/24
> > > >>>>>>>>>>
> > > >>>>>>>>>> Hypervisor: VMWARE 4.1 (with Standard Virtual Switches), 2
> > > >>>>>>>>>> ESXi
> > > >>>> hosts:
> > > >>>>>>>>>> IPs: 10.10.1.101 & .102/24 GW: 10.10.1.254
> > > >>>>>>>>>>
> > > >>>>>>>>>> vCenter: 10.10.1.100/24.
> > > >>>>>>>>>>
> > > >>>>>>>>>> Virtual Network Architecture:
> > > >>>>>>>>>>
> > > >>>>>>>>>> CS Traffic Type:CS Management VmWare Virtual
> > > Switch:vSwitch0
> > > >>>>>>>>>> CS Physical Network:PhysNet-mgmt-svm
> > > >>>>>>>>>> Network:10.10.1.0
> > > >>>>>>>>>> Subnet:/24
> > > >>>>>>>>>> Gateway:10.10.1.254
> > > >>>>>>>>>> VLAN TAG: NONE
> > > >>>>>>>>>> Start IP Range:10.10.1.120
> > > >>>>>>>>>> End IP Range: 10.10.1.240
> > > >>>>>>>>>>
> > > >>>>>>>>>> CS Traffic Type: Storage
> > > >>>>>>>>>> VmWare Virtual Switch:vSwitch1 CS Physical
> > > >>>>>>>>>> Network:PhysNet-storage
> > > >>>>>>>>>> Network:10.10.2.0
> > > >>>>>>>>>> Subnet:/24
> > > >>>>>>>>>> Gateway:10.10.2.254
> > > >>>>>>>>>> VLAN TAG: NONE
> > > >>>>>>>>>> Start IP Range:10.10.2.120
> > > >>>>>>>>>> End IP Range: 10.10.2.240
> > > >>>>>>>>>>
> > > >>>>>>>>>>
> > > >>>>>>>>>> CS Traffic Type:Guest
> > > >>>>>>>>>> VmWare Virtual Switch:vSwitch2 CS Physical
> > > >>>>>>>>>> Network:PhysNet-guest-1
> > > >>>>>>>>>> Network:10.10.3.0
> > > >>>>>>>>>> Subnet:/24
> > > >>>>>>>>>> Gateway:10.10.3.254
> > > >>>>>>>>>> VLAN TAG: NONE
> > > >>>>>>>>>> Start IP Range:10.10.3.1
> > > >>>>>>>>>> End IP Range: 10.10.3.254
> > > >>>>>>>>>>
> > > >>>>>>>>>> CS Traffic Type:Public
> > > >>>>>>>>>> VmWare Virtual Switch:vSwitch3 CS Physical
> > > >>>>>>>>>> Network:PhysNet-public
> > > >>>>>>>>>> Network:10.10.4.0
> > > >>>>>>>>>> Subnet:/24
> > > >>>>>>>>>> Gateway:10.10.4.254
> > > >>>>>>>>>> VLAN TAG: NONE
> > > >>>>>>>>>> Start IP Range:10.10.4.1
> > > >>>>>>>>>> End IP Range: 10.10.4.240
> > > >>>>>>>>>>
> > > >>>>>>>>>>
> > > >>>>>>>>>> vRouter (VPC) System VM - doesn't have a specific route to
> > > MS:
> > > >>>>>>>>>>
> > > >>>>>>>>>> root@r-53-VM:~# netstat -nr Kernel IP routing table
> > > >>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
> > > >>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> > > >>>>>>>>>> eth3
> > > >>>>>>>>>> root@r-53-VM:~#
> > > >>>>>>>>>>
> > > >>>>>>>>>>
> > > >>>>>>>>>> CS management server:
> > > >>>>>>>>>>
> > > >>>>>>>>>> [root@cs-1 ~]# netstat -nr
> > > >>>>>>>>>> Kernel IP routing table
> > > >>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
> > > >>>>>>>>>> 10.10.10.0 0.0.0.0 255.255.255.0 U 0 0 0
> > > >>>>>>>>>> eth0
> > > >>>>>>>>>> 169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0
> > > >>>>>>>>>> eth0
> > > >>>>>>>>>> 0.0.0.0 10.10.10.254 0.0.0.0 UG 0 0 0
> > > >>>>>>>>>> eth0
> > > >>>>>>>>>> [root@cs-1 ~]#
> > > >>>>>>>>>>
> > > >>>>>>>>>> Console Proxy System VM:
> > > >>>>>>>>>>
> > > >>>>>>>>>> root@v-50-VM:~# netstat -nr Kernel IP routing table
> > > >>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
> > > >>>>>>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0 0
> > > >>>>>>>>>> eth1
> > > >>>>>>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0 0
> > > >>>>>>>>>> eth1
> > > >>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
> > > >>>>>>>>>> eth2
> > > >>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> > > >>>>>>>>>> eth1
> > > >>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
> > > >>>>>>>>>> eth1
> > > >>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
> > > >>>>>>>>>> eth2
> > > >>>>>>>>>> root@v-50-VM:~#
> > > >>>>>>>>>>
> > > >>>>>>>>>> vRouter (no VPC- Guest Network) System VM:
> > > >>>>>>>>>>
> > > >>>>>>>>>> root@r-49-VM:~# netstat -nr Kernel IP routing table
> > > >>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
> > > >>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
> > > >>>>>>>>>> eth2
> > > >>>>>>>>>> 10.10.3.0 0.0.0.0 255.255.255.0 U 0 0 0
> > > >>>>>>>>>> eth0
> > > >>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> > > >>>>>>>>>> eth1
> > > >>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
> > > >>>>>>>>>> eth1
> > > >>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
> > > >>>>>>>>>> eth2
> > > >>>>>>>>>> root@r-49-VM:~#
> > > >>>>>>>>>>
> > > >>>>>>>>>> Secondary Storage System VM:
> > > >>>>>>>>>>
> > > >>>>>>>>>> root@s-28-VM:~# netstat -nr Kernel IP routing table
> > > >>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
> > > >>>>>>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
> > > >>>>>>>>>> 0 eth1
> > > >>>>>>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
> > > >>>>>>>>>> 0 eth1
> > > >>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0
> > > >>>>>>>>>> 0 0 eth2
> > > >>>>>>>>>> 10.10.2.0 0.0.0.0 255.255.255.0 U 0
> > > >>>>>>>>>> 0 0 eth3
> > > >>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0
> > > >>>>>>>>>> 0 0 eth1
> > > >>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0
> > > >>>>>>>>>> 0 eth1
> > > >>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG
> > > >>>>>>>>>> 0 0 0 eth2
> > > >>>>>>>>>> root@s-28-VM:~#
> > > >>>>>>>>>>
> > > >>>>>>>>>>
> > > >>>>>>>>>> Thanks,
> > > >>>>>>>>>> Regards.
> > > >>>>>>>>>>
> > > >>>>>>>>>>
> > > >>>>>>>>>>
> > > >>>>>>>>
> > > >>>>
> > > >> -------------------------------------------------------------------
> > > >> -----------------------
> > > ---
> > > >>>>>>>>>>
> > > >>>>>>>>>>
> > > >>>>>>>>
> > > >>>>
> > > >> -------------------------------------------------------------------
> > > >> -----------------------
> > > ---
> > > >>>>>>>>>>
> > > >>>>>>>>>>
> > > >>>>>>>>>>> Date: Mon, 26 Aug 2013 15:19:06 +0100
> > > >>>>>>>>>>> Subject: Re: VPC virtual router fails to start up - no
> > > >> route to CS
> > > >>>>>>>>>> Management Server.
> > > >>>>>>>>>>> From: msweet.dev@gmail.com <javascript:;>
> > > >>>>>>>>>>> To: users@cloudstack.apache.org <javascript:;>
> > > >>>>>>>>>>>
> > > >>>>>>>>>>> Hi,
> > > >>>>>>>>>>>
> > > >>>>>>>>>>> I don't think this has got a response because of the poor
> > > >>>> formatting of
> > > >>>>>>>>>> the
> > > >>>>>>>>>>> log. Please could you attach the log in a separate file
> > > >>>>>>>>>>> and
> > > >> I will
> > > >>>>>>>> take a
> > > >>>>>>>>>>> look?
> > > >>>>>>>>>>> Am I correct in thinking that it is creating the system
> > > >>>>>>>>>>> VM, and
> > > >>>> then
> > > >>>>>>>>>>> destroying it?
> > > >>>>>>>>>>>
> > > >>>>>>>>>>> Thanks,
> > > >>>>>>>>>>> Marty
> > > >>>>>>>>>>>
> > > >>>>>>>>>>>
> > > >>>>>>>>>>> On Sun, Aug 25, 2013 at 11:46 PM, Enrique Ladrón de
> > > >>>>>>>>>>> Guevara
> > > >>>> Hernández <
> > > >>>>>>>>>>> enriquelgh@hotmail.com> wrote:
> > > >>>>>>>>>>>
> > > >>>>>>>>>>>> Hi,
> > > >>>>>>>>>>>> I'm carrying out my End of Career Project related to
> > > CloudStack
> > > >>>>>>>>>>>> deployment. I got issues when I try to deploy a VPC, the
> > > >>>>>>>>>>>> VPC
> > > >>>> virtual
> > > >>>>>>>>>> router
> > > >>>>>>>>>>>> isn't deployed completely and It's destroyed after timeout.
> > > >>>>>>>>>>>> The rest of SSVMs (Console Proxy VM, Storage VM and
> > > Guest
> > > >> Network
> > > >>>> VM)
> > > >>>>>>>>>> are
> > > >>>>>>>>>>>> deployed correctly. I can access to the instance console,
> > > >> put into
> > > >>>>>>>> guest
> > > >>>>>>>>>>>> network a instance, connect to it, etc ...
> > > >>>>>>>>>>>> Could you help me to resolve this issue? I don't know
> > > >> which is the
> > > >>>>>>>> thing
> > > >>>>>>>>>>>> that I'm doing wrong ...
> > > >>>>>>>>>>>> This is the context:
> > > >>>>>>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)Num. of
> > > >> Management
> > > >>>>>>>>>> Server:
> > > >>>>>>>>>>>> 1 (under CentOS 6.4) [physical server]. The MS has this
> > > network
> > > >>>>>>>>>>>> configuration:IP: 10.10.10.110/24GW: 10.10.10.254DNS
> > > server:
> > > >>>>>>>>>>>> 10.10.10.116/24Hypervisor: VMWARE 4.1:2 ESXi hosts:IPs:
> > > >>>> 10.10.1.101 &
> > > >>>>>>>>>>>> .102/24GW: 10.10.1.254vCenter: 10.10.1.100Standard
> > > >>>>>>>>>>>> Virtual
> > > >>>> Switches.
> > > >>>>>>>>>>>> Virtual Network Architecture:VmWare Virtual Switch CS
> > > Physical
> > > >>>>>>>>>>>> Network Network Subnet Gateway VLAN TAG CS Traffic
> > Type
> > > >>>>>>>>>>>> Start IP Range End IP RangevSwitch0 PhysNet-mgmt-svm
> > > >>>>>>>>>>>> 10.10.1.0
> > > >>>>>>>>>>>> 255.255.255.0 10.10.1.254 NONE CS Management
> > 10.10.1.120
> > > >>>>>>>>>>>> 10.10.1.240vSwitch1
> > > >>>>>>>>>>>> PhysNet-storage 10.10.2.0 255.255.255.0 10.10.2.254 NONE
> > > >>>>>>>>>>>> Storage 10.10.2.120
> > > >>>>>>>>>>>> 10.10.2.240vSwitch2 PhysNet-guest-1
> > > >>>>>>>>>>>> 10.10.3.0 255.255.255.0 10.10.3.254 NONE Guest 10.10.3.1
> > > >>>>>>>>>>>> 10.10.3.254vSwitch3 PhysNet-public 10.10.4.0
> > > >>>>>>>>>>>> 255.255.255.0 10.10.4.254 NONE Public
> > > >>>>>>>>>>>> 10.10.4.1 10.10.4.240
> > > >>>>>>>>>>>> I log in to ssvm consoles and I can see the
> > > >>>>>>>>>>>> following:vRouter
> > > >>>> (VPC)
> > > >>>>>>>>>> System
> > > >>>>>>>>>>>> VM - doesn't have a specific route to MS:root@r-53-VM:~#
> > > netstat
> > > >>>>>>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
> > > >>>>>>>>>>>> Flags MSS Window irtt Iface10.10.1.0 0.0.0.0
> > > >>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth3root@r-53-VM:~# CS
> > management
> > > >>>>>>>>>>>> server:[root@cs-1 ~]# netstat -nrKernel IP
> > > routing
> > > >>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS Window irtt
> > > >>>>>>>>>>>> Iface10.10.10.0 0.0.0.0 255.255.255.0 U 0 0
> > > >>>>>>>>>>>> 0 eth0169.254.0.0 0.0.0.0 255.255.0.0 U 0 0
> > > >>>>>>>>>>>> 0 eth00.0.0.0 10.10.10.254 0.0.0.0 UG 0
> > > >>>>>>>>>>>> 0 0 eth0[root@cs-1 ~]#
> > > >>>>>>>>>>>> Console Proxy System VM:root@v-50-VM:~# netstat -
> > > nrKernel IP
> > > >>>> routing
> > > >>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS Window irtt
> > > >>>>>>>>>>>> Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
> > > >>>>>>>>>>>> 0 eth110.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
> > > >>>>>>>>>>>> 0 eth110.10.4.0 0.0.0.0 255.255.255.0 U 0
> > > >>>>>>>>>>>> 0 0 eth210.10.1.0 0.0.0.0 255.255.255.0 U
> > > >>>>>>>>>>>> 0 0 0 eth110.10.10.0 10.10.1.254 255.255.255.0 UG
> > > >>>>>>>>>>>> 0 0 0 eth10.0.0.0 10.10.4.254 0.0.0.0 UG
> > > >>>>>>>>>>>> 0 0 0 eth2root@v-50-VM:~# vRouter (no VPC- Guest
> > Network)
> > > >>>>>>>>>>>> System VM:root@r-49-
> > > VM:~#
> > > >> netstat
> > > >>>>>>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
> > > >>>>>>>>>>>> Flags MSS Window irtt Iface10.10.4.0 0.0.0.0
> > > >>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth210.10.3.0 0.0.0.0
> > > >>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth010.10.1.0 0.0.0.0
> > > >>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0 10.10.1.254
> > > >>>>>>>>>>>> 255.255.255.0 UG 0 0 0 eth10.0.0.0
> > > >>>>>>>>>>>> 10.10.4.254 0.0.0.0 UG 0 0 0 eth2root@r-49-VM :~#
> > > >>>>>>>>>>>> Secondary Storage System VMroot@s-28-VM:~# netstat -
> > > nrKernel IP
> > > >>>>>>>> routing
> > > >>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS Window irtt
> > > >>>>>>>>>>>> Iface10.10.10.116 10.10.1.254 255.255.255.255
> > > UGH
> > > >>>>>>>>>>>> 0 0 0 eth110.10.10.110 10.10.1.254
> > > >>>>>>>>>>>> 255.255.255.255 UGH 0 0 0 eth110.10.4.0
> > > >>>>>>>>>>>> 0.0.0.0 255.255.255.0 U 0 0
> > > >>>>>>>>>>>> 0 eth210.10.2.0 0.0.0.0 255.255.255.0 U
> > > >>>>>>>>>>>> 0 0 0 eth310.10.1.0 0.0.0.0
> > > >>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0
> > > >>>>>>>>>>>> 10.10.1.254 255.255.255.0 UG 0 0 0
> > > >>>>>>>>>>>> eth10.0.0.0 10.10.4.254 0.0.0.0 UG
> > > >>>>>>>>>>>> 0 0 0 eth2root@s-28-VM:~# management-server.log
> > (filtered
> > > >>>>>>>>>>>> by r-53-VM):
> > > >>>>>>>>>>>> [root@cs-1 ~]# g>> GNU/Linux 5.0 (32-bit)","bootArgs":"
> > > vpccidr=
> > > >>>>>>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
> > > >>>> template=domP
> > > >>>>>>>>>> name=r-53-VM
> > > >>>>>>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
> > > >>>>>>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
> > > >>>> disable_rp_filter=true
> > > >>>>>>>>>> extra_pubnics=2
> > > >>>>>>>>>>>>
> > > >>>>>>>>>>
> > > >>>>>>>>
> > > >>>>
> > > >>
> > > nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"lim
> > > itC
> > >
> > puUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"
> > > E
> > > 1000"},"uuid":"c71fdb8a-7392-4491-8fa7-
> > > dc1074149871","disks":[{"id":54,"name":"ROOT-
> > >
> > 53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path"
> > > :"ROOT-53-
> > > 54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesyst
> > > e
> > > m","storagePoolUuid":"961a0972-5d85-3a20-a3ab-
> > > 98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-
> > > 1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-
> > >
> > ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.
> > > 10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"C
> > > ontr
> > > ol","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}
> > > },{"che
> > >
> > ck.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":
> > > 100,"name":"r-53-
> > >
> > VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.
> > > 1.238","
> > > >>>>>>>>>>>> router.name
> > > >>>>>>>>>>>>
> > > >>>>>>>>>>
> > > >>>>>>>>
> > > >>>>
> > > >> ":"r-53-
> > >
> > VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbp
> > > s":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-
> > > 1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"1
> > > 0.1
> > >
> > 0.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","
> > > broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSe
> > > curity
> > > GroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-
> > >
> > VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountI
> > > d
> > > ":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":
> > > fals
> > > e,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vla
> > > nNetm
> > > ask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate"
> > > :20
> > > 0,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"
> > > rout
> > > er.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"
> > > 10.1
> > > 0.1.238","
> > > >>>>>>>>>>>> router.name
> > > >>>>>>>>>>>>
> > > >>>>>>>>>>
> > > >>>>>>>>
> > > >>>>
> > > >> ":"r-53-
> > >
> > VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountI
> > > d
> > > ":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":
> > > fals
> > > e,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vla
> > > nNetm
> > > ask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate"
> > > :20
> > > 0,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessD
> > > eta ils":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","
> > > >>>>>>>>>>>> router.name":"r-53-VM"},"wait":0}},{}] }2013-08-25
> > > 11:34:48,001
> > > >>>> DEBUG
> > > >>>>>>>>>>>> [agent.transport.Request] (Job-Executor-13:job-11) Seq
> > > >>>> 1-1308430869:
> > > >>>>>>>>>>>> Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1,
> > > Flags:
> > > >>>>>>>> 100111,
> > > >>>>>>>>>>>>
> > > >>>>>>>>>>
> > > >>>>>>>>
> > > >>>>
> > > >> [{"StartCommand":{"vm":{"id":53,"name":"r-53-
> > > VM","bootloader":"HVM","type":"DomainRouter">>
> > > >>>>>>>>>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
> > > >>>>>>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
> > > >>>> template=domP
> > > >>>>>>>>>> name=r-53-VM
> > > >>>>>>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
> > > >>>>>>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
> > > >>>> disable_rp_filter=true
> > > >>>>>>>>>> extra_pubnics=2
> > > >>>>>>>>>>>>
> > > >>>>>>>>>>
> > > >>>>>>>>
> > > >>>>
> > > >>
> > > nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"lim
> > > itC
> > >
> > puUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"
> > > E
> > > 1000"},"uuid":"c71fdb8a-7392-4491-8fa7-
> > > dc1074149871","disks":[{"id":54,"name":"ROOT-
> > >
> > 53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path"
> > > :"ROOT-53-
> > > 54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesyst
> > > e
> > > m","storagePoolUuid":"961a0972-5d85-3a20-a3ab-
> > > 98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":>
> > > >
> > > >>>>>>>>>> GNU/Linux 5.0 (32-bit)",
> > > >>>>>>>>
> > > >>>>
> >
> >
>
>
RE: VPC virtual router fails to start up - no route to CS
Management Server.
Posted by Enrique Ladrón de Guevara Hernández <en...@hotmail.com>.
Thanks to everyone. CS 4.2 fixed this issue in my case ...!!
Regards.
> From: imusayev@webmd.net
> To: dev@cloudstack.apache.org; users@cloudstack.apache.org
> Subject: RE: VPC virtual router fails to start up - no route to CS Management Server.
> Date: Fri, 6 Sep 2013 18:36:43 +0000
>
> Both eth0 and eth1 must be up. In your case only eth0 is up (guest network) and eth1 is down (link local).
>
> Inspect the contents on /var/cache/cloud/cmdline
>
> Attempt to setup IP manually to see if it helps for eth1. Default GW must be on eth0/guest network.
>
> Check vSphere to confirm both eth0 and eth1 are on proper vswitches.
>
> > -----Original Message-----
> > From: Musayev, Ilya [mailto:imusayev@webmd.net]
> > Sent: Friday, September 06, 2013 2:19 PM
> > To: users@cloudstack.apache.org
> > Cc: dev@cloudstack.apache.org
> > Subject: RE: VPC virtual router fails to start up - no route to CS Management
> > Server.
> >
> > What stops you from adding a route as test on RVM?
> >
> >
> >
> > > -----Original Message-----
> > > From: COCHE Sébastien [mailto:SCOCHE@sigma.fr]
> > > Sent: Friday, September 06, 2013 12:49 PM
> > > To: users@cloudstack.apache.org
> > > Cc: dev@cloudstack.apache.org
> > > Subject: RE: VPC virtual router fails to start up - no route to CS
> > > Management Server.
> > >
> > > Hi Enrique,
> > >
> > > I had the same issue on 4.0, 4.0.1 and 4.1 CloudStack's releases.
> > > I followed the documentation for complex deployment (CloudStack
> > > Manager and hypervisor (ESX) on a different networks) After some
> > > research it seems that the VPC's vRouter do not have a route to
> > > communicate with CloudStack server. On a VPC vRouter, the default route
> > is set on the public network.
> > > I already post on this issue, and I did not have any feedback (my
> > > question could be not clear).
> > > I hope you will be luckiest.
> > >
> > > Best regards
> > >
> > > -----Message d'origine-----
> > > De : Enrique Ladrón de Guevara Hernández
> > > [mailto:enriquelgh@hotmail.com] Envoyé : mercredi 4 septembre 2013
> > > 00:23 À : users@cloudstack.apache.org Cc : dev@cloudstack.apache.org
> > Objet : RE:
> > > VPC virtual router fails to start up - no route to CS Management Server.
> > >
> > > Hi,
> > >
> > > I don't know why but don't achive to insert the tar file ...
> > >
> > > You can download it in this link: http://we.tl/kHJtO3BK3f
> > >
> > > Regards.
> > >
> > >
> > > ----------------------------------------
> > > > From: enriquelgh@hotmail.com
> > > > To: users@cloudstack.apache.org
> > > > CC: dev@cloudstack.apache.org
> > > > Subject: RE: VPC virtual router fails to start up - no route to CS
> > > Management Server.
> > > > Date: Wed, 4 Sep 2013 00:15:10 +0200
> > > >
> > > > Hi,
> > > >
> > > > Logs and screenshots attached in a tar file.
> > > >
> > > > In my case, the type of the first interface is "Control", as you can
> > > > see in the
> > > screenshots.
> > > >
> > > > @developers, if you need more info let me know.
> > > >
> > > > Thanks to everyone,
> > > > Regards.
> > > >
> > > >
> > > >>> Date: Tue, 3 Sep 2013 08:05:10 +0100
> > > >>> Subject: Re: VPC virtual router fails to start up - no route to CS
> > > >> Management Server.
> > > >>> From: msweet.dev@gmail.com
> > > >>> To: users@cloudstack.apache.org
> > > >>> CC: dev@cloudstack.apache.org
> > > >>>
> > > >>> Hi,
> > > >>>
> > > >>> I couldn't find any screenshots in the string of messages.
> > > >>> Looking at the logs it almost seems as like the VPC is stopping
> > > >>> unexpectedly.
> > > >>>
> > > >>> Looking at my VPC, the first interface is a Link Local for Control
> > > >>> type traffic, which is running on KVM.
> > > >>> I will CC this into the dev mailinglist in search for a developer
> > > >>> who knows more about VMWare and VPCs.
> > > >>>
> > > >>> In the meantime, please could you attach (in a tar), the
> > > >>> screenshots of the VPC interfaces from the cloudstack interfaces.
> > > >>>
> > > >>> Thanks,
> > > >>> Marty
> > > >>>
> > > >>>
> > > >>>
> > > >>>
> > > >>> On Mon, Sep 2, 2013 at 6:28 PM, Enrique Ladrón de Guevara
> > > >>> Hernández < enriquelgh@hotmail.com> wrote:
> > > >>>
> > > >>>> Hi Marty,
> > > >>>>
> > > >>>> Sorry, could you look at the logs and screenshots?? Do you need
> > > >>>> more info to debug the issue??
> > > >>>>
> > > >>>> Do you know if there is a bug related to this scenario??
> > > >>>>
> > > >>>> I try to find any information on Internet and check my config but
> > > >>>> I don't know how to continue go ahead ...
> > > >>>>
> > > >>>> Do you recommend re-installing CS software with other version or
> > > >>>> the same version ....??
> > > >>>>
> > > >>>> Thanks in advanced for your help.
> > > >>>> Regards.
> > > >>>>
> > > >>>>
> > > >>>> ----------------------------------------
> > > >>>>> From: enriquelgh@hotmail.com
> > > >>>>> To: users@cloudstack.apache.org
> > > >>>>> Subject: RE: VPC virtual router fails to start up - no route to
> > > >>>>> CS
> > > >>>> Management Server.
> > > >>>>> Date: Wed, 28 Aug 2013 20:16:26 +0200
> > > >>>>>
> > > >>>>> Now better!
> > > >>>>>
> > > >>>>> Regards.
> > > >>>>>
> > > >>>>> ----------------------------------------
> > > >>>>>> From: enriquelgh@hotmail.com
> > > >>>>>> To: users@cloudstack.apache.org
> > > >>>>>> Subject: RE: VPC virtual router fails to start up - no route to
> > > >>>>>> CS
> > > >>>> Management Server.
> > > >>>>>> Date: Wed, 28 Aug 2013 20:09:39 +0200
> > > >>>>>>
> > > >>>>>> Hi Marty,
> > > >>>>>>
> > > >>>>>> I have used a new test to capture screenshots and logs:
> > > >>>>>>
> > > >>>>>> VPC Name: VPC-Test
> > > >>>>>> Job: job-69
> > > >>>>>> vrsm: r-59-VM
> > > >>>>>>
> > > >>>>>> you can find files attached.
> > > >>>>>>
> > > >>>>>> Thanks,
> > > >>>>>> Regards.
> > > >>>>>>
> > > >>>>>> -
> > > >>>>>> ----------------------------------------
> > > >>>>>>> Date: Wed, 28 Aug 2013 10:16:23 +0100
> > > >>>>>>> Subject: Re: VPC virtual router fails to start up - no route
> > > >>>>>>> to CS
> > > >>>> Management Server.
> > > >>>>>>> From: msweet.dev@gmail.com
> > > >>>>>>> To: users@cloudstack.apache.org
> > > >>>>>>>
> > > >>>>>>> Hi,
> > > >>>>>>>
> > > >>>>>>> Could you let me know the IP addresses listed in the
> > > >>>>>>> cloudstack
> > > >>>> interface
> > > >>>>>>> under Infrastructure> Virtual Routers> VPC
> > > >>>>>>>
> > > >>>>>>> Marty
> > > >>>>>>>
> > > >>>>>>>
> > > >>>>>>> On Tue, Aug 27, 2013 at 11:11 PM, Enrique Ladrón de Guevara
> > > >> Hernández <
> > > >>>>>>> enriquelgh@hotmail.com> wrote:
> > > >>>>>>>
> > > >>>>>>>> Hi Marty,
> > > >>>>>>>>
> > > >>>>>>>> Yes, I have still got this issue ... :S I'm very lost ...
> > > >>>>>>>>
> > > >>>>>>>> Guest Networks are working fine, but in VPC nop ...
> > > >>>>>>>>
> > > >>>>>>>> If you need more info, please let me know.
> > > >>>>>>>>
> > > >>>>>>>> Thanks a lot for your time,
> > > >>>>>>>> Regards.
> > > >>>>>>>>
> > > >>>>>>>>
> > > >>>>>>>> ----------------------------------------
> > > >>>>>>>>> Date: Tue, 27 Aug 2013 22:54:11 +0100
> > > >>>>>>>>> Subject: Re: VPC virtual router fails to start up - no route
> > > >>>>>>>>> to CS
> > > >>>>>>>> Management Server.
> > > >>>>>>>>> From: msweet.dev@gmail.com
> > > >>>>>>>>> To: users@cloudstack.apache.org
> > > >>>>>>>>>
> > > >>>>>>>>> Hi Enrique,
> > > >>>>>>>>>
> > > >>>>>>>>> Sorry I haven't got back to you, is this still an issue?
> > > >>>>>>>>> If so, I will take a look at it and get back to you in the morning.
> > > >>>>>>>>>
> > > >>>>>>>>> Thanks,
> > > >>>>>>>>> Marty
> > > >>>>>>>>>
> > > >>>>>>>>> On Monday, August 26, 2013, Enrique Ladrón de Guevara
> > > >>>>>>>>> Hernández
> > > >>>> wrote:
> > > >>>>>>>>>
> > > >>>>>>>>>> Hi Marty,
> > > >>>>>>>>>>
> > > >>>>>>>>>> My apologies for the format. I hope this time the email
> > > >> format will
> > > >>>> be
> > > >>>>>>>>>> better. You can find the logs attached.
> > > >>>>>>>>>>
> > > >>>>>>>>>> In this log you can see several VPC deployment tests. One
> > > >>>>>>>>>> of them
> > > >>>> is:
> > > >>>>>>>>>> - VPC name: VPC-Prueba-1
> > > >>>>>>>>>> - job: job-11
> > > >>>>>>>>>> - ssvm: r-53-VM.
> > > >>>>>>>>>>
> > > >>>>>>>>>> I use GUI to create VPC. The system VM (virutal router) is
> > > >>>>>>>>>> created
> > > >>>> and I
> > > >>>>>>>>>> can log in by console (VNC or VMWARE console), but after 40
> > > >>>>>>>>>> min
> > > >>>> (aprox)
> > > >>>>>>>>>> this SSVM are destroyed because the MS is not able to
> > > >> connect with.
> > > >>>>>>>>>>
> > > >>>>>>>>>> I think the System VM needs default gateway route or static
> > > >>>>>>>>>> route
> > > >>>> to MS
> > > >>>>>>>>>> server like the rest of SystemVMs (Console, Sec. Storage or
> > > >>>>>>>>>> Guest
> > > >>>> Net.).
> > > >>>>>>>>>>
> > > >>>>>>>>>>
> > > >>>>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)
> > > >>>>>>>>>>
> > > >>>>>>>>>> Num. of Management Server: 1 (under CentOS 6.4) [physical
> > > server].
> > > >>>>>>>>>>
> > > >>>>>>>>>> The MS has this network configuration: IP: 10.10.10.110/24
> > GW:
> > > >>>>>>>>>> 10.10.10.254
> > > >>>>>>>>>>
> > > >>>>>>>>>> DNS server:10.10.10.116/24
> > > >>>>>>>>>>
> > > >>>>>>>>>> Hypervisor: VMWARE 4.1 (with Standard Virtual Switches), 2
> > > >>>>>>>>>> ESXi
> > > >>>> hosts:
> > > >>>>>>>>>> IPs: 10.10.1.101 & .102/24 GW: 10.10.1.254
> > > >>>>>>>>>>
> > > >>>>>>>>>> vCenter: 10.10.1.100/24.
> > > >>>>>>>>>>
> > > >>>>>>>>>> Virtual Network Architecture:
> > > >>>>>>>>>>
> > > >>>>>>>>>> CS Traffic Type:CS Management VmWare Virtual
> > > Switch:vSwitch0
> > > >>>>>>>>>> CS Physical Network:PhysNet-mgmt-svm
> > > >>>>>>>>>> Network:10.10.1.0
> > > >>>>>>>>>> Subnet:/24
> > > >>>>>>>>>> Gateway:10.10.1.254
> > > >>>>>>>>>> VLAN TAG: NONE
> > > >>>>>>>>>> Start IP Range:10.10.1.120
> > > >>>>>>>>>> End IP Range: 10.10.1.240
> > > >>>>>>>>>>
> > > >>>>>>>>>> CS Traffic Type: Storage
> > > >>>>>>>>>> VmWare Virtual Switch:vSwitch1 CS Physical
> > > >>>>>>>>>> Network:PhysNet-storage
> > > >>>>>>>>>> Network:10.10.2.0
> > > >>>>>>>>>> Subnet:/24
> > > >>>>>>>>>> Gateway:10.10.2.254
> > > >>>>>>>>>> VLAN TAG: NONE
> > > >>>>>>>>>> Start IP Range:10.10.2.120
> > > >>>>>>>>>> End IP Range: 10.10.2.240
> > > >>>>>>>>>>
> > > >>>>>>>>>>
> > > >>>>>>>>>> CS Traffic Type:Guest
> > > >>>>>>>>>> VmWare Virtual Switch:vSwitch2 CS Physical
> > > >>>>>>>>>> Network:PhysNet-guest-1
> > > >>>>>>>>>> Network:10.10.3.0
> > > >>>>>>>>>> Subnet:/24
> > > >>>>>>>>>> Gateway:10.10.3.254
> > > >>>>>>>>>> VLAN TAG: NONE
> > > >>>>>>>>>> Start IP Range:10.10.3.1
> > > >>>>>>>>>> End IP Range: 10.10.3.254
> > > >>>>>>>>>>
> > > >>>>>>>>>> CS Traffic Type:Public
> > > >>>>>>>>>> VmWare Virtual Switch:vSwitch3 CS Physical
> > > >>>>>>>>>> Network:PhysNet-public
> > > >>>>>>>>>> Network:10.10.4.0
> > > >>>>>>>>>> Subnet:/24
> > > >>>>>>>>>> Gateway:10.10.4.254
> > > >>>>>>>>>> VLAN TAG: NONE
> > > >>>>>>>>>> Start IP Range:10.10.4.1
> > > >>>>>>>>>> End IP Range: 10.10.4.240
> > > >>>>>>>>>>
> > > >>>>>>>>>>
> > > >>>>>>>>>> vRouter (VPC) System VM - doesn't have a specific route to
> > > MS:
> > > >>>>>>>>>>
> > > >>>>>>>>>> root@r-53-VM:~# netstat -nr Kernel IP routing table
> > > >>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
> > > >>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> > > >>>>>>>>>> eth3
> > > >>>>>>>>>> root@r-53-VM:~#
> > > >>>>>>>>>>
> > > >>>>>>>>>>
> > > >>>>>>>>>> CS management server:
> > > >>>>>>>>>>
> > > >>>>>>>>>> [root@cs-1 ~]# netstat -nr
> > > >>>>>>>>>> Kernel IP routing table
> > > >>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
> > > >>>>>>>>>> 10.10.10.0 0.0.0.0 255.255.255.0 U 0 0 0
> > > >>>>>>>>>> eth0
> > > >>>>>>>>>> 169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0
> > > >>>>>>>>>> eth0
> > > >>>>>>>>>> 0.0.0.0 10.10.10.254 0.0.0.0 UG 0 0 0
> > > >>>>>>>>>> eth0
> > > >>>>>>>>>> [root@cs-1 ~]#
> > > >>>>>>>>>>
> > > >>>>>>>>>> Console Proxy System VM:
> > > >>>>>>>>>>
> > > >>>>>>>>>> root@v-50-VM:~# netstat -nr Kernel IP routing table
> > > >>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
> > > >>>>>>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0 0
> > > >>>>>>>>>> eth1
> > > >>>>>>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0 0
> > > >>>>>>>>>> eth1
> > > >>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
> > > >>>>>>>>>> eth2
> > > >>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> > > >>>>>>>>>> eth1
> > > >>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
> > > >>>>>>>>>> eth1
> > > >>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
> > > >>>>>>>>>> eth2
> > > >>>>>>>>>> root@v-50-VM:~#
> > > >>>>>>>>>>
> > > >>>>>>>>>> vRouter (no VPC- Guest Network) System VM:
> > > >>>>>>>>>>
> > > >>>>>>>>>> root@r-49-VM:~# netstat -nr Kernel IP routing table
> > > >>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
> > > >>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
> > > >>>>>>>>>> eth2
> > > >>>>>>>>>> 10.10.3.0 0.0.0.0 255.255.255.0 U 0 0 0
> > > >>>>>>>>>> eth0
> > > >>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> > > >>>>>>>>>> eth1
> > > >>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
> > > >>>>>>>>>> eth1
> > > >>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
> > > >>>>>>>>>> eth2
> > > >>>>>>>>>> root@r-49-VM:~#
> > > >>>>>>>>>>
> > > >>>>>>>>>> Secondary Storage System VM:
> > > >>>>>>>>>>
> > > >>>>>>>>>> root@s-28-VM:~# netstat -nr Kernel IP routing table
> > > >>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
> > > >>>>>>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
> > > >>>>>>>>>> 0 eth1
> > > >>>>>>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
> > > >>>>>>>>>> 0 eth1
> > > >>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0
> > > >>>>>>>>>> 0 0 eth2
> > > >>>>>>>>>> 10.10.2.0 0.0.0.0 255.255.255.0 U 0
> > > >>>>>>>>>> 0 0 eth3
> > > >>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0
> > > >>>>>>>>>> 0 0 eth1
> > > >>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0
> > > >>>>>>>>>> 0 eth1
> > > >>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG
> > > >>>>>>>>>> 0 0 0 eth2
> > > >>>>>>>>>> root@s-28-VM:~#
> > > >>>>>>>>>>
> > > >>>>>>>>>>
> > > >>>>>>>>>> Thanks,
> > > >>>>>>>>>> Regards.
> > > >>>>>>>>>>
> > > >>>>>>>>>>
> > > >>>>>>>>>>
> > > >>>>>>>>
> > > >>>>
> > > >> -------------------------------------------------------------------
> > > >> -----------------------
> > > ---
> > > >>>>>>>>>>
> > > >>>>>>>>>>
> > > >>>>>>>>
> > > >>>>
> > > >> -------------------------------------------------------------------
> > > >> -----------------------
> > > ---
> > > >>>>>>>>>>
> > > >>>>>>>>>>
> > > >>>>>>>>>>> Date: Mon, 26 Aug 2013 15:19:06 +0100
> > > >>>>>>>>>>> Subject: Re: VPC virtual router fails to start up - no
> > > >> route to CS
> > > >>>>>>>>>> Management Server.
> > > >>>>>>>>>>> From: msweet.dev@gmail.com <javascript:;>
> > > >>>>>>>>>>> To: users@cloudstack.apache.org <javascript:;>
> > > >>>>>>>>>>>
> > > >>>>>>>>>>> Hi,
> > > >>>>>>>>>>>
> > > >>>>>>>>>>> I don't think this has got a response because of the poor
> > > >>>> formatting of
> > > >>>>>>>>>> the
> > > >>>>>>>>>>> log. Please could you attach the log in a separate file
> > > >>>>>>>>>>> and
> > > >> I will
> > > >>>>>>>> take a
> > > >>>>>>>>>>> look?
> > > >>>>>>>>>>> Am I correct in thinking that it is creating the system
> > > >>>>>>>>>>> VM, and
> > > >>>> then
> > > >>>>>>>>>>> destroying it?
> > > >>>>>>>>>>>
> > > >>>>>>>>>>> Thanks,
> > > >>>>>>>>>>> Marty
> > > >>>>>>>>>>>
> > > >>>>>>>>>>>
> > > >>>>>>>>>>> On Sun, Aug 25, 2013 at 11:46 PM, Enrique Ladrón de
> > > >>>>>>>>>>> Guevara
> > > >>>> Hernández <
> > > >>>>>>>>>>> enriquelgh@hotmail.com> wrote:
> > > >>>>>>>>>>>
> > > >>>>>>>>>>>> Hi,
> > > >>>>>>>>>>>> I'm carrying out my End of Career Project related to
> > > CloudStack
> > > >>>>>>>>>>>> deployment. I got issues when I try to deploy a VPC, the
> > > >>>>>>>>>>>> VPC
> > > >>>> virtual
> > > >>>>>>>>>> router
> > > >>>>>>>>>>>> isn't deployed completely and It's destroyed after timeout.
> > > >>>>>>>>>>>> The rest of SSVMs (Console Proxy VM, Storage VM and
> > > Guest
> > > >> Network
> > > >>>> VM)
> > > >>>>>>>>>> are
> > > >>>>>>>>>>>> deployed correctly. I can access to the instance console,
> > > >> put into
> > > >>>>>>>> guest
> > > >>>>>>>>>>>> network a instance, connect to it, etc ...
> > > >>>>>>>>>>>> Could you help me to resolve this issue? I don't know
> > > >> which is the
> > > >>>>>>>> thing
> > > >>>>>>>>>>>> that I'm doing wrong ...
> > > >>>>>>>>>>>> This is the context:
> > > >>>>>>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)Num. of
> > > >> Management
> > > >>>>>>>>>> Server:
> > > >>>>>>>>>>>> 1 (under CentOS 6.4) [physical server]. The MS has this
> > > network
> > > >>>>>>>>>>>> configuration:IP: 10.10.10.110/24GW: 10.10.10.254DNS
> > > server:
> > > >>>>>>>>>>>> 10.10.10.116/24Hypervisor: VMWARE 4.1:2 ESXi hosts:IPs:
> > > >>>> 10.10.1.101 &
> > > >>>>>>>>>>>> .102/24GW: 10.10.1.254vCenter: 10.10.1.100Standard
> > > >>>>>>>>>>>> Virtual
> > > >>>> Switches.
> > > >>>>>>>>>>>> Virtual Network Architecture:VmWare Virtual Switch CS
> > > Physical
> > > >>>>>>>>>>>> Network Network Subnet Gateway VLAN TAG CS Traffic
> > Type
> > > >>>>>>>>>>>> Start IP Range End IP RangevSwitch0 PhysNet-mgmt-svm
> > > >>>>>>>>>>>> 10.10.1.0
> > > >>>>>>>>>>>> 255.255.255.0 10.10.1.254 NONE CS Management
> > 10.10.1.120
> > > >>>>>>>>>>>> 10.10.1.240vSwitch1
> > > >>>>>>>>>>>> PhysNet-storage 10.10.2.0 255.255.255.0 10.10.2.254 NONE
> > > >>>>>>>>>>>> Storage 10.10.2.120
> > > >>>>>>>>>>>> 10.10.2.240vSwitch2 PhysNet-guest-1
> > > >>>>>>>>>>>> 10.10.3.0 255.255.255.0 10.10.3.254 NONE Guest 10.10.3.1
> > > >>>>>>>>>>>> 10.10.3.254vSwitch3 PhysNet-public 10.10.4.0
> > > >>>>>>>>>>>> 255.255.255.0 10.10.4.254 NONE Public
> > > >>>>>>>>>>>> 10.10.4.1 10.10.4.240
> > > >>>>>>>>>>>> I log in to ssvm consoles and I can see the
> > > >>>>>>>>>>>> following:vRouter
> > > >>>> (VPC)
> > > >>>>>>>>>> System
> > > >>>>>>>>>>>> VM - doesn't have a specific route to MS:root@r-53-VM:~#
> > > netstat
> > > >>>>>>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
> > > >>>>>>>>>>>> Flags MSS Window irtt Iface10.10.1.0 0.0.0.0
> > > >>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth3root@r-53-VM:~# CS
> > management
> > > >>>>>>>>>>>> server:[root@cs-1 ~]# netstat -nrKernel IP
> > > routing
> > > >>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS Window irtt
> > > >>>>>>>>>>>> Iface10.10.10.0 0.0.0.0 255.255.255.0 U 0 0
> > > >>>>>>>>>>>> 0 eth0169.254.0.0 0.0.0.0 255.255.0.0 U 0 0
> > > >>>>>>>>>>>> 0 eth00.0.0.0 10.10.10.254 0.0.0.0 UG 0
> > > >>>>>>>>>>>> 0 0 eth0[root@cs-1 ~]#
> > > >>>>>>>>>>>> Console Proxy System VM:root@v-50-VM:~# netstat -
> > > nrKernel IP
> > > >>>> routing
> > > >>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS Window irtt
> > > >>>>>>>>>>>> Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
> > > >>>>>>>>>>>> 0 eth110.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
> > > >>>>>>>>>>>> 0 eth110.10.4.0 0.0.0.0 255.255.255.0 U 0
> > > >>>>>>>>>>>> 0 0 eth210.10.1.0 0.0.0.0 255.255.255.0 U
> > > >>>>>>>>>>>> 0 0 0 eth110.10.10.0 10.10.1.254 255.255.255.0 UG
> > > >>>>>>>>>>>> 0 0 0 eth10.0.0.0 10.10.4.254 0.0.0.0 UG
> > > >>>>>>>>>>>> 0 0 0 eth2root@v-50-VM:~# vRouter (no VPC- Guest
> > Network)
> > > >>>>>>>>>>>> System VM:root@r-49-
> > > VM:~#
> > > >> netstat
> > > >>>>>>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
> > > >>>>>>>>>>>> Flags MSS Window irtt Iface10.10.4.0 0.0.0.0
> > > >>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth210.10.3.0 0.0.0.0
> > > >>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth010.10.1.0 0.0.0.0
> > > >>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0 10.10.1.254
> > > >>>>>>>>>>>> 255.255.255.0 UG 0 0 0 eth10.0.0.0
> > > >>>>>>>>>>>> 10.10.4.254 0.0.0.0 UG 0 0 0 eth2root@r-49-VM :~#
> > > >>>>>>>>>>>> Secondary Storage System VMroot@s-28-VM:~# netstat -
> > > nrKernel IP
> > > >>>>>>>> routing
> > > >>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS Window irtt
> > > >>>>>>>>>>>> Iface10.10.10.116 10.10.1.254 255.255.255.255
> > > UGH
> > > >>>>>>>>>>>> 0 0 0 eth110.10.10.110 10.10.1.254
> > > >>>>>>>>>>>> 255.255.255.255 UGH 0 0 0 eth110.10.4.0
> > > >>>>>>>>>>>> 0.0.0.0 255.255.255.0 U 0 0
> > > >>>>>>>>>>>> 0 eth210.10.2.0 0.0.0.0 255.255.255.0 U
> > > >>>>>>>>>>>> 0 0 0 eth310.10.1.0 0.0.0.0
> > > >>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0
> > > >>>>>>>>>>>> 10.10.1.254 255.255.255.0 UG 0 0 0
> > > >>>>>>>>>>>> eth10.0.0.0 10.10.4.254 0.0.0.0 UG
> > > >>>>>>>>>>>> 0 0 0 eth2root@s-28-VM:~# management-server.log
> > (filtered
> > > >>>>>>>>>>>> by r-53-VM):
> > > >>>>>>>>>>>> [root@cs-1 ~]# g>> GNU/Linux 5.0 (32-bit)","bootArgs":"
> > > vpccidr=
> > > >>>>>>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
> > > >>>> template=domP
> > > >>>>>>>>>> name=r-53-VM
> > > >>>>>>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
> > > >>>>>>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
> > > >>>> disable_rp_filter=true
> > > >>>>>>>>>> extra_pubnics=2
> > > >>>>>>>>>>>>
> > > >>>>>>>>>>
> > > >>>>>>>>
> > > >>>>
> > > >>
> > > nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"lim
> > > itC
> > >
> > puUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"
> > > E
> > > 1000"},"uuid":"c71fdb8a-7392-4491-8fa7-
> > > dc1074149871","disks":[{"id":54,"name":"ROOT-
> > >
> > 53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path"
> > > :"ROOT-53-
> > > 54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesyst
> > > e
> > > m","storagePoolUuid":"961a0972-5d85-3a20-a3ab-
> > > 98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-
> > > 1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-
> > >
> > ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.
> > > 10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"C
> > > ontr
> > > ol","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}
> > > },{"che
> > >
> > ck.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":
> > > 100,"name":"r-53-
> > >
> > VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.
> > > 1.238","
> > > >>>>>>>>>>>> router.name
> > > >>>>>>>>>>>>
> > > >>>>>>>>>>
> > > >>>>>>>>
> > > >>>>
> > > >> ":"r-53-
> > >
> > VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbp
> > > s":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-
> > > 1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"1
> > > 0.1
> > >
> > 0.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","
> > > broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSe
> > > curity
> > > GroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-
> > >
> > VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountI
> > > d
> > > ":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":
> > > fals
> > > e,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vla
> > > nNetm
> > > ask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate"
> > > :20
> > > 0,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"
> > > rout
> > > er.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"
> > > 10.1
> > > 0.1.238","
> > > >>>>>>>>>>>> router.name
> > > >>>>>>>>>>>>
> > > >>>>>>>>>>
> > > >>>>>>>>
> > > >>>>
> > > >> ":"r-53-
> > >
> > VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountI
> > > d
> > > ":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":
> > > fals
> > > e,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vla
> > > nNetm
> > > ask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate"
> > > :20
> > > 0,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessD
> > > eta ils":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","
> > > >>>>>>>>>>>> router.name":"r-53-VM"},"wait":0}},{}] }2013-08-25
> > > 11:34:48,001
> > > >>>> DEBUG
> > > >>>>>>>>>>>> [agent.transport.Request] (Job-Executor-13:job-11) Seq
> > > >>>> 1-1308430869:
> > > >>>>>>>>>>>> Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1,
> > > Flags:
> > > >>>>>>>> 100111,
> > > >>>>>>>>>>>>
> > > >>>>>>>>>>
> > > >>>>>>>>
> > > >>>>
> > > >> [{"StartCommand":{"vm":{"id":53,"name":"r-53-
> > > VM","bootloader":"HVM","type":"DomainRouter">>
> > > >>>>>>>>>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
> > > >>>>>>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
> > > >>>> template=domP
> > > >>>>>>>>>> name=r-53-VM
> > > >>>>>>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
> > > >>>>>>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
> > > >>>> disable_rp_filter=true
> > > >>>>>>>>>> extra_pubnics=2
> > > >>>>>>>>>>>>
> > > >>>>>>>>>>
> > > >>>>>>>>
> > > >>>>
> > > >>
> > > nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"lim
> > > itC
> > >
> > puUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"
> > > E
> > > 1000"},"uuid":"c71fdb8a-7392-4491-8fa7-
> > > dc1074149871","disks":[{"id":54,"name":"ROOT-
> > >
> > 53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path"
> > > :"ROOT-53-
> > > 54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesyst
> > > e
> > > m","storagePoolUuid":"961a0972-5d85-3a20-a3ab-
> > > 98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":>
> > > >
> > > >>>>>>>>>> GNU/Linux 5.0 (32-bit)",
> > > >>>>>>>>
> > > >>>>
> >
> >
>
>
RE: VPC virtual router fails to start up - no route to CS
Management Server.
Posted by "Musayev, Ilya" <im...@webmd.net>.
What stops you from adding a route as test on RVM?
> -----Original Message-----
> From: COCHE Sébastien [mailto:SCOCHE@sigma.fr]
> Sent: Friday, September 06, 2013 12:49 PM
> To: users@cloudstack.apache.org
> Cc: dev@cloudstack.apache.org
> Subject: RE: VPC virtual router fails to start up - no route to CS Management
> Server.
>
> Hi Enrique,
>
> I had the same issue on 4.0, 4.0.1 and 4.1 CloudStack's releases.
> I followed the documentation for complex deployment (CloudStack Manager
> and hypervisor (ESX) on a different networks) After some research it seems
> that the VPC's vRouter do not have a route to communicate with CloudStack
> server. On a VPC vRouter, the default route is set on the public network.
> I already post on this issue, and I did not have any feedback (my question
> could be not clear).
> I hope you will be luckiest.
>
> Best regards
>
> -----Message d'origine-----
> De : Enrique Ladrón de Guevara Hernández
> [mailto:enriquelgh@hotmail.com] Envoyé : mercredi 4 septembre 2013 00:23
> À : users@cloudstack.apache.org Cc : dev@cloudstack.apache.org Objet : RE:
> VPC virtual router fails to start up - no route to CS Management Server.
>
> Hi,
>
> I don't know why but don't achive to insert the tar file ...
>
> You can download it in this link: http://we.tl/kHJtO3BK3f
>
> Regards.
>
>
> ----------------------------------------
> > From: enriquelgh@hotmail.com
> > To: users@cloudstack.apache.org
> > CC: dev@cloudstack.apache.org
> > Subject: RE: VPC virtual router fails to start up - no route to CS
> Management Server.
> > Date: Wed, 4 Sep 2013 00:15:10 +0200
> >
> > Hi,
> >
> > Logs and screenshots attached in a tar file.
> >
> > In my case, the type of the first interface is "Control", as you can see in the
> screenshots.
> >
> > @developers, if you need more info let me know.
> >
> > Thanks to everyone,
> > Regards.
> >
> >
> >>> Date: Tue, 3 Sep 2013 08:05:10 +0100
> >>> Subject: Re: VPC virtual router fails to start up - no route to CS
> >> Management Server.
> >>> From: msweet.dev@gmail.com
> >>> To: users@cloudstack.apache.org
> >>> CC: dev@cloudstack.apache.org
> >>>
> >>> Hi,
> >>>
> >>> I couldn't find any screenshots in the string of messages.
> >>> Looking at the logs it almost seems as like the VPC is stopping
> >>> unexpectedly.
> >>>
> >>> Looking at my VPC, the first interface is a Link Local for Control
> >>> type traffic, which is running on KVM.
> >>> I will CC this into the dev mailinglist in search for a developer
> >>> who knows more about VMWare and VPCs.
> >>>
> >>> In the meantime, please could you attach (in a tar), the screenshots
> >>> of the VPC interfaces from the cloudstack interfaces.
> >>>
> >>> Thanks,
> >>> Marty
> >>>
> >>>
> >>>
> >>>
> >>> On Mon, Sep 2, 2013 at 6:28 PM, Enrique Ladrón de Guevara Hernández
> >>> < enriquelgh@hotmail.com> wrote:
> >>>
> >>>> Hi Marty,
> >>>>
> >>>> Sorry, could you look at the logs and screenshots?? Do you need
> >>>> more info to debug the issue??
> >>>>
> >>>> Do you know if there is a bug related to this scenario??
> >>>>
> >>>> I try to find any information on Internet and check my config but I
> >>>> don't know how to continue go ahead ...
> >>>>
> >>>> Do you recommend re-installing CS software with other version or
> >>>> the same version ....??
> >>>>
> >>>> Thanks in advanced for your help.
> >>>> Regards.
> >>>>
> >>>>
> >>>> ----------------------------------------
> >>>>> From: enriquelgh@hotmail.com
> >>>>> To: users@cloudstack.apache.org
> >>>>> Subject: RE: VPC virtual router fails to start up - no route to CS
> >>>> Management Server.
> >>>>> Date: Wed, 28 Aug 2013 20:16:26 +0200
> >>>>>
> >>>>> Now better!
> >>>>>
> >>>>> Regards.
> >>>>>
> >>>>> ----------------------------------------
> >>>>>> From: enriquelgh@hotmail.com
> >>>>>> To: users@cloudstack.apache.org
> >>>>>> Subject: RE: VPC virtual router fails to start up - no route to
> >>>>>> CS
> >>>> Management Server.
> >>>>>> Date: Wed, 28 Aug 2013 20:09:39 +0200
> >>>>>>
> >>>>>> Hi Marty,
> >>>>>>
> >>>>>> I have used a new test to capture screenshots and logs:
> >>>>>>
> >>>>>> VPC Name: VPC-Test
> >>>>>> Job: job-69
> >>>>>> vrsm: r-59-VM
> >>>>>>
> >>>>>> you can find files attached.
> >>>>>>
> >>>>>> Thanks,
> >>>>>> Regards.
> >>>>>>
> >>>>>> -
> >>>>>> ----------------------------------------
> >>>>>>> Date: Wed, 28 Aug 2013 10:16:23 +0100
> >>>>>>> Subject: Re: VPC virtual router fails to start up - no route to
> >>>>>>> CS
> >>>> Management Server.
> >>>>>>> From: msweet.dev@gmail.com
> >>>>>>> To: users@cloudstack.apache.org
> >>>>>>>
> >>>>>>> Hi,
> >>>>>>>
> >>>>>>> Could you let me know the IP addresses listed in the cloudstack
> >>>> interface
> >>>>>>> under Infrastructure> Virtual Routers> VPC
> >>>>>>>
> >>>>>>> Marty
> >>>>>>>
> >>>>>>>
> >>>>>>> On Tue, Aug 27, 2013 at 11:11 PM, Enrique Ladrón de Guevara
> >> Hernández <
> >>>>>>> enriquelgh@hotmail.com> wrote:
> >>>>>>>
> >>>>>>>> Hi Marty,
> >>>>>>>>
> >>>>>>>> Yes, I have still got this issue ... :S I'm very lost ...
> >>>>>>>>
> >>>>>>>> Guest Networks are working fine, but in VPC nop ...
> >>>>>>>>
> >>>>>>>> If you need more info, please let me know.
> >>>>>>>>
> >>>>>>>> Thanks a lot for your time,
> >>>>>>>> Regards.
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> ----------------------------------------
> >>>>>>>>> Date: Tue, 27 Aug 2013 22:54:11 +0100
> >>>>>>>>> Subject: Re: VPC virtual router fails to start up - no route
> >>>>>>>>> to CS
> >>>>>>>> Management Server.
> >>>>>>>>> From: msweet.dev@gmail.com
> >>>>>>>>> To: users@cloudstack.apache.org
> >>>>>>>>>
> >>>>>>>>> Hi Enrique,
> >>>>>>>>>
> >>>>>>>>> Sorry I haven't got back to you, is this still an issue?
> >>>>>>>>> If so, I will take a look at it and get back to you in the morning.
> >>>>>>>>>
> >>>>>>>>> Thanks,
> >>>>>>>>> Marty
> >>>>>>>>>
> >>>>>>>>> On Monday, August 26, 2013, Enrique Ladrón de Guevara
> >>>>>>>>> Hernández
> >>>> wrote:
> >>>>>>>>>
> >>>>>>>>>> Hi Marty,
> >>>>>>>>>>
> >>>>>>>>>> My apologies for the format. I hope this time the email
> >> format will
> >>>> be
> >>>>>>>>>> better. You can find the logs attached.
> >>>>>>>>>>
> >>>>>>>>>> In this log you can see several VPC deployment tests. One of
> >>>>>>>>>> them
> >>>> is:
> >>>>>>>>>> - VPC name: VPC-Prueba-1
> >>>>>>>>>> - job: job-11
> >>>>>>>>>> - ssvm: r-53-VM.
> >>>>>>>>>>
> >>>>>>>>>> I use GUI to create VPC. The system VM (virutal router) is
> >>>>>>>>>> created
> >>>> and I
> >>>>>>>>>> can log in by console (VNC or VMWARE console), but after 40
> >>>>>>>>>> min
> >>>> (aprox)
> >>>>>>>>>> this SSVM are destroyed because the MS is not able to
> >> connect with.
> >>>>>>>>>>
> >>>>>>>>>> I think the System VM needs default gateway route or static
> >>>>>>>>>> route
> >>>> to MS
> >>>>>>>>>> server like the rest of SystemVMs (Console, Sec. Storage or
> >>>>>>>>>> Guest
> >>>> Net.).
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)
> >>>>>>>>>>
> >>>>>>>>>> Num. of Management Server: 1 (under CentOS 6.4) [physical
> server].
> >>>>>>>>>>
> >>>>>>>>>> The MS has this network configuration: IP: 10.10.10.110/24 GW:
> >>>>>>>>>> 10.10.10.254
> >>>>>>>>>>
> >>>>>>>>>> DNS server:10.10.10.116/24
> >>>>>>>>>>
> >>>>>>>>>> Hypervisor: VMWARE 4.1 (with Standard Virtual Switches), 2
> >>>>>>>>>> ESXi
> >>>> hosts:
> >>>>>>>>>> IPs: 10.10.1.101 & .102/24 GW: 10.10.1.254
> >>>>>>>>>>
> >>>>>>>>>> vCenter: 10.10.1.100/24.
> >>>>>>>>>>
> >>>>>>>>>> Virtual Network Architecture:
> >>>>>>>>>>
> >>>>>>>>>> CS Traffic Type:CS Management VmWare Virtual
> Switch:vSwitch0
> >>>>>>>>>> CS Physical Network:PhysNet-mgmt-svm
> >>>>>>>>>> Network:10.10.1.0
> >>>>>>>>>> Subnet:/24
> >>>>>>>>>> Gateway:10.10.1.254
> >>>>>>>>>> VLAN TAG: NONE
> >>>>>>>>>> Start IP Range:10.10.1.120
> >>>>>>>>>> End IP Range: 10.10.1.240
> >>>>>>>>>>
> >>>>>>>>>> CS Traffic Type: Storage
> >>>>>>>>>> VmWare Virtual Switch:vSwitch1 CS Physical
> >>>>>>>>>> Network:PhysNet-storage
> >>>>>>>>>> Network:10.10.2.0
> >>>>>>>>>> Subnet:/24
> >>>>>>>>>> Gateway:10.10.2.254
> >>>>>>>>>> VLAN TAG: NONE
> >>>>>>>>>> Start IP Range:10.10.2.120
> >>>>>>>>>> End IP Range: 10.10.2.240
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> CS Traffic Type:Guest
> >>>>>>>>>> VmWare Virtual Switch:vSwitch2 CS Physical
> >>>>>>>>>> Network:PhysNet-guest-1
> >>>>>>>>>> Network:10.10.3.0
> >>>>>>>>>> Subnet:/24
> >>>>>>>>>> Gateway:10.10.3.254
> >>>>>>>>>> VLAN TAG: NONE
> >>>>>>>>>> Start IP Range:10.10.3.1
> >>>>>>>>>> End IP Range: 10.10.3.254
> >>>>>>>>>>
> >>>>>>>>>> CS Traffic Type:Public
> >>>>>>>>>> VmWare Virtual Switch:vSwitch3 CS Physical
> >>>>>>>>>> Network:PhysNet-public
> >>>>>>>>>> Network:10.10.4.0
> >>>>>>>>>> Subnet:/24
> >>>>>>>>>> Gateway:10.10.4.254
> >>>>>>>>>> VLAN TAG: NONE
> >>>>>>>>>> Start IP Range:10.10.4.1
> >>>>>>>>>> End IP Range: 10.10.4.240
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> vRouter (VPC) System VM - doesn't have a specific route to
> MS:
> >>>>>>>>>>
> >>>>>>>>>> root@r-53-VM:~# netstat -nr
> >>>>>>>>>> Kernel IP routing table
> >>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
> >>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> >>>>>>>>>> eth3
> >>>>>>>>>> root@r-53-VM:~#
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> CS management server:
> >>>>>>>>>>
> >>>>>>>>>> [root@cs-1 ~]# netstat -nr
> >>>>>>>>>> Kernel IP routing table
> >>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
> >>>>>>>>>> 10.10.10.0 0.0.0.0 255.255.255.0 U 0 0 0
> >>>>>>>>>> eth0
> >>>>>>>>>> 169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0
> >>>>>>>>>> eth0
> >>>>>>>>>> 0.0.0.0 10.10.10.254 0.0.0.0 UG 0 0 0
> >>>>>>>>>> eth0
> >>>>>>>>>> [root@cs-1 ~]#
> >>>>>>>>>>
> >>>>>>>>>> Console Proxy System VM:
> >>>>>>>>>>
> >>>>>>>>>> root@v-50-VM:~# netstat -nr
> >>>>>>>>>> Kernel IP routing table
> >>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
> >>>>>>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0 0
> >>>>>>>>>> eth1
> >>>>>>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0 0
> >>>>>>>>>> eth1
> >>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
> >>>>>>>>>> eth2
> >>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> >>>>>>>>>> eth1
> >>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
> >>>>>>>>>> eth1
> >>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
> >>>>>>>>>> eth2
> >>>>>>>>>> root@v-50-VM:~#
> >>>>>>>>>>
> >>>>>>>>>> vRouter (no VPC- Guest Network) System VM:
> >>>>>>>>>>
> >>>>>>>>>> root@r-49-VM:~# netstat -nr
> >>>>>>>>>> Kernel IP routing table
> >>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
> >>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
> >>>>>>>>>> eth2
> >>>>>>>>>> 10.10.3.0 0.0.0.0 255.255.255.0 U 0 0 0
> >>>>>>>>>> eth0
> >>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> >>>>>>>>>> eth1
> >>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
> >>>>>>>>>> eth1
> >>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
> >>>>>>>>>> eth2
> >>>>>>>>>> root@r-49-VM:~#
> >>>>>>>>>>
> >>>>>>>>>> Secondary Storage System VM:
> >>>>>>>>>>
> >>>>>>>>>> root@s-28-VM:~# netstat -nr
> >>>>>>>>>> Kernel IP routing table
> >>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
> >>>>>>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
> >>>>>>>>>> 0 eth1
> >>>>>>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
> >>>>>>>>>> 0 eth1
> >>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0
> >>>>>>>>>> 0 0 eth2
> >>>>>>>>>> 10.10.2.0 0.0.0.0 255.255.255.0 U 0
> >>>>>>>>>> 0 0 eth3
> >>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0
> >>>>>>>>>> 0 0 eth1
> >>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0
> >>>>>>>>>> 0 eth1
> >>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG
> >>>>>>>>>> 0 0 0 eth2
> >>>>>>>>>> root@s-28-VM:~#
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> Thanks,
> >>>>>>>>>> Regards.
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>
> >>>>
> >> ------------------------------------------------------------------------------------------
> ---
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>
> >>>>
> >> ------------------------------------------------------------------------------------------
> ---
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>> Date: Mon, 26 Aug 2013 15:19:06 +0100
> >>>>>>>>>>> Subject: Re: VPC virtual router fails to start up - no
> >> route to CS
> >>>>>>>>>> Management Server.
> >>>>>>>>>>> From: msweet.dev@gmail.com <javascript:;>
> >>>>>>>>>>> To: users@cloudstack.apache.org <javascript:;>
> >>>>>>>>>>>
> >>>>>>>>>>> Hi,
> >>>>>>>>>>>
> >>>>>>>>>>> I don't think this has got a response because of the poor
> >>>> formatting of
> >>>>>>>>>> the
> >>>>>>>>>>> log. Please could you attach the log in a separate file and
> >> I will
> >>>>>>>> take a
> >>>>>>>>>>> look?
> >>>>>>>>>>> Am I correct in thinking that it is creating the system VM, and
> >>>> then
> >>>>>>>>>>> destroying it?
> >>>>>>>>>>>
> >>>>>>>>>>> Thanks,
> >>>>>>>>>>> Marty
> >>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>> On Sun, Aug 25, 2013 at 11:46 PM, Enrique Ladrón de Guevara
> >>>> Hernández <
> >>>>>>>>>>> enriquelgh@hotmail.com> wrote:
> >>>>>>>>>>>
> >>>>>>>>>>>> Hi,
> >>>>>>>>>>>> I'm carrying out my End of Career Project related to
> CloudStack
> >>>>>>>>>>>> deployment. I got issues when I try to deploy a VPC, the VPC
> >>>> virtual
> >>>>>>>>>> router
> >>>>>>>>>>>> isn't deployed completely and It's destroyed after timeout.
> >>>>>>>>>>>> The rest of SSVMs (Console Proxy VM, Storage VM and
> Guest
> >> Network
> >>>> VM)
> >>>>>>>>>> are
> >>>>>>>>>>>> deployed correctly. I can access to the instance console,
> >> put into
> >>>>>>>> guest
> >>>>>>>>>>>> network a instance, connect to it, etc ...
> >>>>>>>>>>>> Could you help me to resolve this issue? I don't know
> >> which is the
> >>>>>>>> thing
> >>>>>>>>>>>> that I'm doing wrong ...
> >>>>>>>>>>>> This is the context:
> >>>>>>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)Num. of
> >> Management
> >>>>>>>>>> Server:
> >>>>>>>>>>>> 1 (under CentOS 6.4) [physical server]. The MS has this
> network
> >>>>>>>>>>>> configuration:IP: 10.10.10.110/24GW: 10.10.10.254DNS
> server:
> >>>>>>>>>>>> 10.10.10.116/24Hypervisor: VMWARE 4.1:2 ESXi hosts:IPs:
> >>>> 10.10.1.101 &
> >>>>>>>>>>>> .102/24GW: 10.10.1.254vCenter: 10.10.1.100Standard Virtual
> >>>> Switches.
> >>>>>>>>>>>> Virtual Network Architecture:VmWare Virtual Switch CS
> Physical
> >>>>>>>>>>>> Network Network Subnet Gateway VLAN
> >>>>>>>>>>>> TAG CS Traffic Type Start IP Range End IP RangevSwitch0
> >>>>>>>>>>>> PhysNet-mgmt-svm 10.10.1.0
> >>>>>>>>>>>> 255.255.255.0 10.10.1.254 NONE CS Management 10.10.1.120
> >>>>>>>>>>>> 10.10.1.240vSwitch1
> >>>>>>>>>>>> PhysNet-storage 10.10.2.0 255.255.255.0 10.10.2.254
> >>>>>>>>>>>> NONE Storage 10.10.2.120
> >>>>>>>>>>>> 10.10.2.240vSwitch2 PhysNet-guest-1
> >>>>>>>>>>>> 10.10.3.0 255.255.255.0 10.10.3.254 NONE
> >>>>>>>>>>>> Guest 10.10.3.1 10.10.3.254vSwitch3
> >>>>>>>>>>>> PhysNet-public 10.10.4.0
> >>>>>>>>>>>> 255.255.255.0 10.10.4.254 NONE Public
> >>>>>>>>>>>> 10.10.4.1 10.10.4.240
> >>>>>>>>>>>> I log in to ssvm consoles and I can see the following:vRouter
> >>>> (VPC)
> >>>>>>>>>> System
> >>>>>>>>>>>> VM - doesn't have a specific route to MS:root@r-53-VM:~#
> netstat
> >>>>>>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
> >>>>>>>>>>>> Flags MSS Window irtt Iface10.10.1.0 0.0.0.0 255.255.255.0
> >>>>>>>>>>>> U 0 0 0 eth3root@r-53-VM:~#
> >>>>>>>>>>>> CS management server:[root@cs-1 ~]# netstat -nrKernel IP
> routing
> >>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS Window
> >>>>>>>>>>>> irtt Iface10.10.10.0 0.0.0.0 255.255.255.0 U 0 0
> >>>>>>>>>>>> 0 eth0169.254.0.0 0.0.0.0 255.255.0.0 U 0 0
> >>>>>>>>>>>> 0 eth00.0.0.0 10.10.10.254 0.0.0.0 UG 0
> >>>>>>>>>>>> 0 0 eth0[root@cs-1 ~]#
> >>>>>>>>>>>> Console Proxy System VM:root@v-50-VM:~# netstat -
> nrKernel IP
> >>>> routing
> >>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS Window
> >>>>>>>>>>>> irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
> >>>>>>>>>>>> 0 eth110.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
> >>>>>>>>>>>> 0 eth110.10.4.0 0.0.0.0 255.255.255.0 U 0
> >>>>>>>>>>>> 0 0 eth210.10.1.0 0.0.0.0 255.255.255.0 U
> >>>>>>>>>>>> 0 0 0 eth110.10.10.0 10.10.1.254 255.255.255.0 UG
> >>>>>>>>>>>> 0 0 0 eth10.0.0.0 10.10.4.254 0.0.0.0 UG
> >>>>>>>>>>>> 0 0 0 eth2root@v-50-VM:~#
> >>>>>>>>>>>> vRouter (no VPC- Guest Network) System VM:root@r-49-
> VM:~#
> >> netstat
> >>>>>>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
> >>>>>>>>>>>> Flags MSS Window irtt Iface10.10.4.0 0.0.0.0 255.255.255.0
> >>>>>>>>>>>> U 0 0 0 eth210.10.3.0 0.0.0.0
> >>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth010.10.1.0 0.0.0.0
> >>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0 10.10.1.254
> >>>>>>>>>>>> 255.255.255.0 UG 0 0 0 eth10.0.0.0
> >>>>>>>>>>>> 10.10.4.254 0.0.0.0 UG 0 0 0 eth2root@r-49-VM
> >>>>>>>>>>>> :~#
> >>>>>>>>>>>> Secondary Storage System VMroot@s-28-VM:~# netstat -
> nrKernel IP
> >>>>>>>> routing
> >>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS
> >>>>>>>>>>>> Window irtt Iface10.10.10.116 10.10.1.254 255.255.255.255
> UGH
> >>>>>>>>>>>> 0 0 0 eth110.10.10.110 10.10.1.254
> >>>>>>>>>>>> 255.255.255.255 UGH 0 0 0 eth110.10.4.0
> >>>>>>>>>>>> 0.0.0.0 255.255.255.0 U 0 0
> >>>>>>>>>>>> 0 eth210.10.2.0 0.0.0.0 255.255.255.0 U
> >>>>>>>>>>>> 0 0 0 eth310.10.1.0 0.0.0.0
> >>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0
> >>>>>>>>>>>> 10.10.1.254 255.255.255.0 UG 0 0 0
> >>>>>>>>>>>> eth10.0.0.0 10.10.4.254 0.0.0.0 UG
> >>>>>>>>>>>> 0 0 0 eth2root@s-28-VM:~# management-server.log
> >>>>>>>>>>>> (filtered by r-53-VM):
> >>>>>>>>>>>> [root@cs-1 ~]# g>> GNU/Linux 5.0 (32-bit)","bootArgs":"
> vpccidr=
> >>>>>>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
> >>>> template=domP
> >>>>>>>>>> name=r-53-VM
> >>>>>>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
> >>>>>>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
> >>>> disable_rp_filter=true
> >>>>>>>>>> extra_pubnics=2
> >>>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>
> >>>>
> >>
> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitC
> puUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E
> 1000"},"uuid":"c71fdb8a-7392-4491-8fa7-
> dc1074149871","disks":[{"id":54,"name":"ROOT-
> 53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path"
> :"ROOT-53-
> 54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesyste
> m","storagePoolUuid":"961a0972-5d85-3a20-a3ab-
> 98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-
> 1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-
> ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.
> 10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Contr
> ol","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}},{"che
> ck.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":
> 100,"name":"r-53-
> VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.
> 1.238","
> >>>>>>>>>>>> router.name
> >>>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>
> >>>>
> >> ":"r-53-
> VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbp
> s":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-
> 1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"10.1
> 0.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","
> broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurity
> GroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-
> VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountId
> ":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":fals
> e,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetm
> ask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":20
> 0,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"rout
> er.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"10.1
> 0.1.238","
> >>>>>>>>>>>> router.name
> >>>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>
> >>>>
> >> ":"r-53-
> VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountId
> ":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":fals
> e,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetm
> ask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":20
> 0,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessDeta
> ils":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","
> >>>>>>>>>>>> router.name":"r-53-VM"},"wait":0}},{}] }2013-08-25
> 11:34:48,001
> >>>> DEBUG
> >>>>>>>>>>>> [agent.transport.Request] (Job-Executor-13:job-11) Seq
> >>>> 1-1308430869:
> >>>>>>>>>>>> Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1,
> Flags:
> >>>>>>>> 100111,
> >>>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>
> >>>>
> >> [{"StartCommand":{"vm":{"id":53,"name":"r-53-
> VM","bootloader":"HVM","type":"DomainRouter">>
> >>>>>>>>>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
> >>>>>>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
> >>>> template=domP
> >>>>>>>>>> name=r-53-VM
> >>>>>>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
> >>>>>>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
> >>>> disable_rp_filter=true
> >>>>>>>>>> extra_pubnics=2
> >>>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>
> >>>>
> >>
> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitC
> puUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E
> 1000"},"uuid":"c71fdb8a-7392-4491-8fa7-
> dc1074149871","disks":[{"id":54,"name":"ROOT-
> 53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path"
> :"ROOT-53-
> 54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesyste
> m","storagePoolUuid":"961a0972-5d85-3a20-a3ab-
> 98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":>>
> >>>>>>>>>> GNU/Linux 5.0 (32-bit)",
> >>>>>>>>
> >>>>
RE: VPC virtual router fails to start up - no route to CS
Management Server.
Posted by "Musayev, Ilya" <im...@webmd.net>.
What stops you from adding a route as test on RVM?
> -----Original Message-----
> From: COCHE Sébastien [mailto:SCOCHE@sigma.fr]
> Sent: Friday, September 06, 2013 12:49 PM
> To: users@cloudstack.apache.org
> Cc: dev@cloudstack.apache.org
> Subject: RE: VPC virtual router fails to start up - no route to CS Management
> Server.
>
> Hi Enrique,
>
> I had the same issue on 4.0, 4.0.1 and 4.1 CloudStack's releases.
> I followed the documentation for complex deployment (CloudStack Manager
> and hypervisor (ESX) on a different networks) After some research it seems
> that the VPC's vRouter do not have a route to communicate with CloudStack
> server. On a VPC vRouter, the default route is set on the public network.
> I already post on this issue, and I did not have any feedback (my question
> could be not clear).
> I hope you will be luckiest.
>
> Best regards
>
> -----Message d'origine-----
> De : Enrique Ladrón de Guevara Hernández
> [mailto:enriquelgh@hotmail.com] Envoyé : mercredi 4 septembre 2013 00:23
> À : users@cloudstack.apache.org Cc : dev@cloudstack.apache.org Objet : RE:
> VPC virtual router fails to start up - no route to CS Management Server.
>
> Hi,
>
> I don't know why but don't achive to insert the tar file ...
>
> You can download it in this link: http://we.tl/kHJtO3BK3f
>
> Regards.
>
>
> ----------------------------------------
> > From: enriquelgh@hotmail.com
> > To: users@cloudstack.apache.org
> > CC: dev@cloudstack.apache.org
> > Subject: RE: VPC virtual router fails to start up - no route to CS
> Management Server.
> > Date: Wed, 4 Sep 2013 00:15:10 +0200
> >
> > Hi,
> >
> > Logs and screenshots attached in a tar file.
> >
> > In my case, the type of the first interface is "Control", as you can see in the
> screenshots.
> >
> > @developers, if you need more info let me know.
> >
> > Thanks to everyone,
> > Regards.
> >
> >
> >>> Date: Tue, 3 Sep 2013 08:05:10 +0100
> >>> Subject: Re: VPC virtual router fails to start up - no route to CS
> >> Management Server.
> >>> From: msweet.dev@gmail.com
> >>> To: users@cloudstack.apache.org
> >>> CC: dev@cloudstack.apache.org
> >>>
> >>> Hi,
> >>>
> >>> I couldn't find any screenshots in the string of messages.
> >>> Looking at the logs it almost seems as like the VPC is stopping
> >>> unexpectedly.
> >>>
> >>> Looking at my VPC, the first interface is a Link Local for Control
> >>> type traffic, which is running on KVM.
> >>> I will CC this into the dev mailinglist in search for a developer
> >>> who knows more about VMWare and VPCs.
> >>>
> >>> In the meantime, please could you attach (in a tar), the screenshots
> >>> of the VPC interfaces from the cloudstack interfaces.
> >>>
> >>> Thanks,
> >>> Marty
> >>>
> >>>
> >>>
> >>>
> >>> On Mon, Sep 2, 2013 at 6:28 PM, Enrique Ladrón de Guevara Hernández
> >>> < enriquelgh@hotmail.com> wrote:
> >>>
> >>>> Hi Marty,
> >>>>
> >>>> Sorry, could you look at the logs and screenshots?? Do you need
> >>>> more info to debug the issue??
> >>>>
> >>>> Do you know if there is a bug related to this scenario??
> >>>>
> >>>> I try to find any information on Internet and check my config but I
> >>>> don't know how to continue go ahead ...
> >>>>
> >>>> Do you recommend re-installing CS software with other version or
> >>>> the same version ....??
> >>>>
> >>>> Thanks in advanced for your help.
> >>>> Regards.
> >>>>
> >>>>
> >>>> ----------------------------------------
> >>>>> From: enriquelgh@hotmail.com
> >>>>> To: users@cloudstack.apache.org
> >>>>> Subject: RE: VPC virtual router fails to start up - no route to CS
> >>>> Management Server.
> >>>>> Date: Wed, 28 Aug 2013 20:16:26 +0200
> >>>>>
> >>>>> Now better!
> >>>>>
> >>>>> Regards.
> >>>>>
> >>>>> ----------------------------------------
> >>>>>> From: enriquelgh@hotmail.com
> >>>>>> To: users@cloudstack.apache.org
> >>>>>> Subject: RE: VPC virtual router fails to start up - no route to
> >>>>>> CS
> >>>> Management Server.
> >>>>>> Date: Wed, 28 Aug 2013 20:09:39 +0200
> >>>>>>
> >>>>>> Hi Marty,
> >>>>>>
> >>>>>> I have used a new test to capture screenshots and logs:
> >>>>>>
> >>>>>> VPC Name: VPC-Test
> >>>>>> Job: job-69
> >>>>>> vrsm: r-59-VM
> >>>>>>
> >>>>>> you can find files attached.
> >>>>>>
> >>>>>> Thanks,
> >>>>>> Regards.
> >>>>>>
> >>>>>> -
> >>>>>> ----------------------------------------
> >>>>>>> Date: Wed, 28 Aug 2013 10:16:23 +0100
> >>>>>>> Subject: Re: VPC virtual router fails to start up - no route to
> >>>>>>> CS
> >>>> Management Server.
> >>>>>>> From: msweet.dev@gmail.com
> >>>>>>> To: users@cloudstack.apache.org
> >>>>>>>
> >>>>>>> Hi,
> >>>>>>>
> >>>>>>> Could you let me know the IP addresses listed in the cloudstack
> >>>> interface
> >>>>>>> under Infrastructure> Virtual Routers> VPC
> >>>>>>>
> >>>>>>> Marty
> >>>>>>>
> >>>>>>>
> >>>>>>> On Tue, Aug 27, 2013 at 11:11 PM, Enrique Ladrón de Guevara
> >> Hernández <
> >>>>>>> enriquelgh@hotmail.com> wrote:
> >>>>>>>
> >>>>>>>> Hi Marty,
> >>>>>>>>
> >>>>>>>> Yes, I have still got this issue ... :S I'm very lost ...
> >>>>>>>>
> >>>>>>>> Guest Networks are working fine, but in VPC nop ...
> >>>>>>>>
> >>>>>>>> If you need more info, please let me know.
> >>>>>>>>
> >>>>>>>> Thanks a lot for your time,
> >>>>>>>> Regards.
> >>>>>>>>
> >>>>>>>>
> >>>>>>>> ----------------------------------------
> >>>>>>>>> Date: Tue, 27 Aug 2013 22:54:11 +0100
> >>>>>>>>> Subject: Re: VPC virtual router fails to start up - no route
> >>>>>>>>> to CS
> >>>>>>>> Management Server.
> >>>>>>>>> From: msweet.dev@gmail.com
> >>>>>>>>> To: users@cloudstack.apache.org
> >>>>>>>>>
> >>>>>>>>> Hi Enrique,
> >>>>>>>>>
> >>>>>>>>> Sorry I haven't got back to you, is this still an issue?
> >>>>>>>>> If so, I will take a look at it and get back to you in the morning.
> >>>>>>>>>
> >>>>>>>>> Thanks,
> >>>>>>>>> Marty
> >>>>>>>>>
> >>>>>>>>> On Monday, August 26, 2013, Enrique Ladrón de Guevara
> >>>>>>>>> Hernández
> >>>> wrote:
> >>>>>>>>>
> >>>>>>>>>> Hi Marty,
> >>>>>>>>>>
> >>>>>>>>>> My apologies for the format. I hope this time the email
> >> format will
> >>>> be
> >>>>>>>>>> better. You can find the logs attached.
> >>>>>>>>>>
> >>>>>>>>>> In this log you can see several VPC deployment tests. One of
> >>>>>>>>>> them
> >>>> is:
> >>>>>>>>>> - VPC name: VPC-Prueba-1
> >>>>>>>>>> - job: job-11
> >>>>>>>>>> - ssvm: r-53-VM.
> >>>>>>>>>>
> >>>>>>>>>> I use GUI to create VPC. The system VM (virutal router) is
> >>>>>>>>>> created
> >>>> and I
> >>>>>>>>>> can log in by console (VNC or VMWARE console), but after 40
> >>>>>>>>>> min
> >>>> (aprox)
> >>>>>>>>>> this SSVM are destroyed because the MS is not able to
> >> connect with.
> >>>>>>>>>>
> >>>>>>>>>> I think the System VM needs default gateway route or static
> >>>>>>>>>> route
> >>>> to MS
> >>>>>>>>>> server like the rest of SystemVMs (Console, Sec. Storage or
> >>>>>>>>>> Guest
> >>>> Net.).
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)
> >>>>>>>>>>
> >>>>>>>>>> Num. of Management Server: 1 (under CentOS 6.4) [physical
> server].
> >>>>>>>>>>
> >>>>>>>>>> The MS has this network configuration: IP: 10.10.10.110/24 GW:
> >>>>>>>>>> 10.10.10.254
> >>>>>>>>>>
> >>>>>>>>>> DNS server:10.10.10.116/24
> >>>>>>>>>>
> >>>>>>>>>> Hypervisor: VMWARE 4.1 (with Standard Virtual Switches), 2
> >>>>>>>>>> ESXi
> >>>> hosts:
> >>>>>>>>>> IPs: 10.10.1.101 & .102/24 GW: 10.10.1.254
> >>>>>>>>>>
> >>>>>>>>>> vCenter: 10.10.1.100/24.
> >>>>>>>>>>
> >>>>>>>>>> Virtual Network Architecture:
> >>>>>>>>>>
> >>>>>>>>>> CS Traffic Type:CS Management VmWare Virtual
> Switch:vSwitch0
> >>>>>>>>>> CS Physical Network:PhysNet-mgmt-svm
> >>>>>>>>>> Network:10.10.1.0
> >>>>>>>>>> Subnet:/24
> >>>>>>>>>> Gateway:10.10.1.254
> >>>>>>>>>> VLAN TAG: NONE
> >>>>>>>>>> Start IP Range:10.10.1.120
> >>>>>>>>>> End IP Range: 10.10.1.240
> >>>>>>>>>>
> >>>>>>>>>> CS Traffic Type: Storage
> >>>>>>>>>> VmWare Virtual Switch:vSwitch1 CS Physical
> >>>>>>>>>> Network:PhysNet-storage
> >>>>>>>>>> Network:10.10.2.0
> >>>>>>>>>> Subnet:/24
> >>>>>>>>>> Gateway:10.10.2.254
> >>>>>>>>>> VLAN TAG: NONE
> >>>>>>>>>> Start IP Range:10.10.2.120
> >>>>>>>>>> End IP Range: 10.10.2.240
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> CS Traffic Type:Guest
> >>>>>>>>>> VmWare Virtual Switch:vSwitch2 CS Physical
> >>>>>>>>>> Network:PhysNet-guest-1
> >>>>>>>>>> Network:10.10.3.0
> >>>>>>>>>> Subnet:/24
> >>>>>>>>>> Gateway:10.10.3.254
> >>>>>>>>>> VLAN TAG: NONE
> >>>>>>>>>> Start IP Range:10.10.3.1
> >>>>>>>>>> End IP Range: 10.10.3.254
> >>>>>>>>>>
> >>>>>>>>>> CS Traffic Type:Public
> >>>>>>>>>> VmWare Virtual Switch:vSwitch3 CS Physical
> >>>>>>>>>> Network:PhysNet-public
> >>>>>>>>>> Network:10.10.4.0
> >>>>>>>>>> Subnet:/24
> >>>>>>>>>> Gateway:10.10.4.254
> >>>>>>>>>> VLAN TAG: NONE
> >>>>>>>>>> Start IP Range:10.10.4.1
> >>>>>>>>>> End IP Range: 10.10.4.240
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> vRouter (VPC) System VM - doesn't have a specific route to
> MS:
> >>>>>>>>>>
> >>>>>>>>>> root@r-53-VM:~# netstat -nr
> >>>>>>>>>> Kernel IP routing table
> >>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
> >>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> >>>>>>>>>> eth3
> >>>>>>>>>> root@r-53-VM:~#
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> CS management server:
> >>>>>>>>>>
> >>>>>>>>>> [root@cs-1 ~]# netstat -nr
> >>>>>>>>>> Kernel IP routing table
> >>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
> >>>>>>>>>> 10.10.10.0 0.0.0.0 255.255.255.0 U 0 0 0
> >>>>>>>>>> eth0
> >>>>>>>>>> 169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0
> >>>>>>>>>> eth0
> >>>>>>>>>> 0.0.0.0 10.10.10.254 0.0.0.0 UG 0 0 0
> >>>>>>>>>> eth0
> >>>>>>>>>> [root@cs-1 ~]#
> >>>>>>>>>>
> >>>>>>>>>> Console Proxy System VM:
> >>>>>>>>>>
> >>>>>>>>>> root@v-50-VM:~# netstat -nr
> >>>>>>>>>> Kernel IP routing table
> >>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
> >>>>>>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0 0
> >>>>>>>>>> eth1
> >>>>>>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0 0
> >>>>>>>>>> eth1
> >>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
> >>>>>>>>>> eth2
> >>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> >>>>>>>>>> eth1
> >>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
> >>>>>>>>>> eth1
> >>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
> >>>>>>>>>> eth2
> >>>>>>>>>> root@v-50-VM:~#
> >>>>>>>>>>
> >>>>>>>>>> vRouter (no VPC- Guest Network) System VM:
> >>>>>>>>>>
> >>>>>>>>>> root@r-49-VM:~# netstat -nr
> >>>>>>>>>> Kernel IP routing table
> >>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
> >>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
> >>>>>>>>>> eth2
> >>>>>>>>>> 10.10.3.0 0.0.0.0 255.255.255.0 U 0 0 0
> >>>>>>>>>> eth0
> >>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> >>>>>>>>>> eth1
> >>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
> >>>>>>>>>> eth1
> >>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
> >>>>>>>>>> eth2
> >>>>>>>>>> root@r-49-VM:~#
> >>>>>>>>>>
> >>>>>>>>>> Secondary Storage System VM:
> >>>>>>>>>>
> >>>>>>>>>> root@s-28-VM:~# netstat -nr
> >>>>>>>>>> Kernel IP routing table
> >>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
> >>>>>>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
> >>>>>>>>>> 0 eth1
> >>>>>>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
> >>>>>>>>>> 0 eth1
> >>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0
> >>>>>>>>>> 0 0 eth2
> >>>>>>>>>> 10.10.2.0 0.0.0.0 255.255.255.0 U 0
> >>>>>>>>>> 0 0 eth3
> >>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0
> >>>>>>>>>> 0 0 eth1
> >>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0
> >>>>>>>>>> 0 eth1
> >>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG
> >>>>>>>>>> 0 0 0 eth2
> >>>>>>>>>> root@s-28-VM:~#
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> Thanks,
> >>>>>>>>>> Regards.
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>
> >>>>
> >> ------------------------------------------------------------------------------------------
> ---
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>
> >>>>
> >> ------------------------------------------------------------------------------------------
> ---
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>> Date: Mon, 26 Aug 2013 15:19:06 +0100
> >>>>>>>>>>> Subject: Re: VPC virtual router fails to start up - no
> >> route to CS
> >>>>>>>>>> Management Server.
> >>>>>>>>>>> From: msweet.dev@gmail.com <javascript:;>
> >>>>>>>>>>> To: users@cloudstack.apache.org <javascript:;>
> >>>>>>>>>>>
> >>>>>>>>>>> Hi,
> >>>>>>>>>>>
> >>>>>>>>>>> I don't think this has got a response because of the poor
> >>>> formatting of
> >>>>>>>>>> the
> >>>>>>>>>>> log. Please could you attach the log in a separate file and
> >> I will
> >>>>>>>> take a
> >>>>>>>>>>> look?
> >>>>>>>>>>> Am I correct in thinking that it is creating the system VM, and
> >>>> then
> >>>>>>>>>>> destroying it?
> >>>>>>>>>>>
> >>>>>>>>>>> Thanks,
> >>>>>>>>>>> Marty
> >>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>> On Sun, Aug 25, 2013 at 11:46 PM, Enrique Ladrón de Guevara
> >>>> Hernández <
> >>>>>>>>>>> enriquelgh@hotmail.com> wrote:
> >>>>>>>>>>>
> >>>>>>>>>>>> Hi,
> >>>>>>>>>>>> I'm carrying out my End of Career Project related to
> CloudStack
> >>>>>>>>>>>> deployment. I got issues when I try to deploy a VPC, the VPC
> >>>> virtual
> >>>>>>>>>> router
> >>>>>>>>>>>> isn't deployed completely and It's destroyed after timeout.
> >>>>>>>>>>>> The rest of SSVMs (Console Proxy VM, Storage VM and
> Guest
> >> Network
> >>>> VM)
> >>>>>>>>>> are
> >>>>>>>>>>>> deployed correctly. I can access to the instance console,
> >> put into
> >>>>>>>> guest
> >>>>>>>>>>>> network a instance, connect to it, etc ...
> >>>>>>>>>>>> Could you help me to resolve this issue? I don't know
> >> which is the
> >>>>>>>> thing
> >>>>>>>>>>>> that I'm doing wrong ...
> >>>>>>>>>>>> This is the context:
> >>>>>>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)Num. of
> >> Management
> >>>>>>>>>> Server:
> >>>>>>>>>>>> 1 (under CentOS 6.4) [physical server]. The MS has this
> network
> >>>>>>>>>>>> configuration:IP: 10.10.10.110/24GW: 10.10.10.254DNS
> server:
> >>>>>>>>>>>> 10.10.10.116/24Hypervisor: VMWARE 4.1:2 ESXi hosts:IPs:
> >>>> 10.10.1.101 &
> >>>>>>>>>>>> .102/24GW: 10.10.1.254vCenter: 10.10.1.100Standard Virtual
> >>>> Switches.
> >>>>>>>>>>>> Virtual Network Architecture:VmWare Virtual Switch CS
> Physical
> >>>>>>>>>>>> Network Network Subnet Gateway VLAN
> >>>>>>>>>>>> TAG CS Traffic Type Start IP Range End IP RangevSwitch0
> >>>>>>>>>>>> PhysNet-mgmt-svm 10.10.1.0
> >>>>>>>>>>>> 255.255.255.0 10.10.1.254 NONE CS Management 10.10.1.120
> >>>>>>>>>>>> 10.10.1.240vSwitch1
> >>>>>>>>>>>> PhysNet-storage 10.10.2.0 255.255.255.0 10.10.2.254
> >>>>>>>>>>>> NONE Storage 10.10.2.120
> >>>>>>>>>>>> 10.10.2.240vSwitch2 PhysNet-guest-1
> >>>>>>>>>>>> 10.10.3.0 255.255.255.0 10.10.3.254 NONE
> >>>>>>>>>>>> Guest 10.10.3.1 10.10.3.254vSwitch3
> >>>>>>>>>>>> PhysNet-public 10.10.4.0
> >>>>>>>>>>>> 255.255.255.0 10.10.4.254 NONE Public
> >>>>>>>>>>>> 10.10.4.1 10.10.4.240
> >>>>>>>>>>>> I log in to ssvm consoles and I can see the following:vRouter
> >>>> (VPC)
> >>>>>>>>>> System
> >>>>>>>>>>>> VM - doesn't have a specific route to MS:root@r-53-VM:~#
> netstat
> >>>>>>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
> >>>>>>>>>>>> Flags MSS Window irtt Iface10.10.1.0 0.0.0.0 255.255.255.0
> >>>>>>>>>>>> U 0 0 0 eth3root@r-53-VM:~#
> >>>>>>>>>>>> CS management server:[root@cs-1 ~]# netstat -nrKernel IP
> routing
> >>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS Window
> >>>>>>>>>>>> irtt Iface10.10.10.0 0.0.0.0 255.255.255.0 U 0 0
> >>>>>>>>>>>> 0 eth0169.254.0.0 0.0.0.0 255.255.0.0 U 0 0
> >>>>>>>>>>>> 0 eth00.0.0.0 10.10.10.254 0.0.0.0 UG 0
> >>>>>>>>>>>> 0 0 eth0[root@cs-1 ~]#
> >>>>>>>>>>>> Console Proxy System VM:root@v-50-VM:~# netstat -
> nrKernel IP
> >>>> routing
> >>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS Window
> >>>>>>>>>>>> irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
> >>>>>>>>>>>> 0 eth110.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
> >>>>>>>>>>>> 0 eth110.10.4.0 0.0.0.0 255.255.255.0 U 0
> >>>>>>>>>>>> 0 0 eth210.10.1.0 0.0.0.0 255.255.255.0 U
> >>>>>>>>>>>> 0 0 0 eth110.10.10.0 10.10.1.254 255.255.255.0 UG
> >>>>>>>>>>>> 0 0 0 eth10.0.0.0 10.10.4.254 0.0.0.0 UG
> >>>>>>>>>>>> 0 0 0 eth2root@v-50-VM:~#
> >>>>>>>>>>>> vRouter (no VPC- Guest Network) System VM:root@r-49-
> VM:~#
> >> netstat
> >>>>>>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
> >>>>>>>>>>>> Flags MSS Window irtt Iface10.10.4.0 0.0.0.0 255.255.255.0
> >>>>>>>>>>>> U 0 0 0 eth210.10.3.0 0.0.0.0
> >>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth010.10.1.0 0.0.0.0
> >>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0 10.10.1.254
> >>>>>>>>>>>> 255.255.255.0 UG 0 0 0 eth10.0.0.0
> >>>>>>>>>>>> 10.10.4.254 0.0.0.0 UG 0 0 0 eth2root@r-49-VM
> >>>>>>>>>>>> :~#
> >>>>>>>>>>>> Secondary Storage System VMroot@s-28-VM:~# netstat -
> nrKernel IP
> >>>>>>>> routing
> >>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS
> >>>>>>>>>>>> Window irtt Iface10.10.10.116 10.10.1.254 255.255.255.255
> UGH
> >>>>>>>>>>>> 0 0 0 eth110.10.10.110 10.10.1.254
> >>>>>>>>>>>> 255.255.255.255 UGH 0 0 0 eth110.10.4.0
> >>>>>>>>>>>> 0.0.0.0 255.255.255.0 U 0 0
> >>>>>>>>>>>> 0 eth210.10.2.0 0.0.0.0 255.255.255.0 U
> >>>>>>>>>>>> 0 0 0 eth310.10.1.0 0.0.0.0
> >>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0
> >>>>>>>>>>>> 10.10.1.254 255.255.255.0 UG 0 0 0
> >>>>>>>>>>>> eth10.0.0.0 10.10.4.254 0.0.0.0 UG
> >>>>>>>>>>>> 0 0 0 eth2root@s-28-VM:~# management-server.log
> >>>>>>>>>>>> (filtered by r-53-VM):
> >>>>>>>>>>>> [root@cs-1 ~]# g>> GNU/Linux 5.0 (32-bit)","bootArgs":"
> vpccidr=
> >>>>>>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
> >>>> template=domP
> >>>>>>>>>> name=r-53-VM
> >>>>>>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
> >>>>>>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
> >>>> disable_rp_filter=true
> >>>>>>>>>> extra_pubnics=2
> >>>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>
> >>>>
> >>
> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitC
> puUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E
> 1000"},"uuid":"c71fdb8a-7392-4491-8fa7-
> dc1074149871","disks":[{"id":54,"name":"ROOT-
> 53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path"
> :"ROOT-53-
> 54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesyste
> m","storagePoolUuid":"961a0972-5d85-3a20-a3ab-
> 98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-
> 1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-
> ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.
> 10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Contr
> ol","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}},{"che
> ck.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":
> 100,"name":"r-53-
> VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.
> 1.238","
> >>>>>>>>>>>> router.name
> >>>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>
> >>>>
> >> ":"r-53-
> VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbp
> s":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-
> 1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"10.1
> 0.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","
> broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurity
> GroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-
> VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountId
> ":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":fals
> e,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetm
> ask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":20
> 0,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"rout
> er.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"10.1
> 0.1.238","
> >>>>>>>>>>>> router.name
> >>>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>
> >>>>
> >> ":"r-53-
> VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountId
> ":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":fals
> e,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetm
> ask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":20
> 0,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessDeta
> ils":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","
> >>>>>>>>>>>> router.name":"r-53-VM"},"wait":0}},{}] }2013-08-25
> 11:34:48,001
> >>>> DEBUG
> >>>>>>>>>>>> [agent.transport.Request] (Job-Executor-13:job-11) Seq
> >>>> 1-1308430869:
> >>>>>>>>>>>> Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1,
> Flags:
> >>>>>>>> 100111,
> >>>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>
> >>>>
> >> [{"StartCommand":{"vm":{"id":53,"name":"r-53-
> VM","bootloader":"HVM","type":"DomainRouter">>
> >>>>>>>>>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
> >>>>>>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
> >>>> template=domP
> >>>>>>>>>> name=r-53-VM
> >>>>>>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
> >>>>>>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
> >>>> disable_rp_filter=true
> >>>>>>>>>> extra_pubnics=2
> >>>>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>
> >>>>
> >>
> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitC
> puUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E
> 1000"},"uuid":"c71fdb8a-7392-4491-8fa7-
> dc1074149871","disks":[{"id":54,"name":"ROOT-
> 53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path"
> :"ROOT-53-
> 54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesyste
> m","storagePoolUuid":"961a0972-5d85-3a20-a3ab-
> 98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":>>
> >>>>>>>>>> GNU/Linux 5.0 (32-bit)",
> >>>>>>>>
> >>>>
RE: VPC virtual router fails to start up - no route to CS Management Server.
Posted by COCHE Sébastien <SC...@sigma.fr>.
Hi Enrique,
I had the same issue on 4.0, 4.0.1 and 4.1 CloudStack's releases.
I followed the documentation for complex deployment (CloudStack Manager and hypervisor (ESX) on a different networks)
After some research it seems that the VPC's vRouter do not have a route to communicate with CloudStack server. On a VPC vRouter, the default route is set on the public network.
I already post on this issue, and I did not have any feedback (my question could be not clear).
I hope you will be luckiest.
Best regards
-----Message d'origine-----
De : Enrique Ladrón de Guevara Hernández [mailto:enriquelgh@hotmail.com]
Envoyé : mercredi 4 septembre 2013 00:23
À : users@cloudstack.apache.org
Cc : dev@cloudstack.apache.org
Objet : RE: VPC virtual router fails to start up - no route to CS Management Server.
Hi,
I don't know why but don't achive to insert the tar file ...
You can download it in this link: http://we.tl/kHJtO3BK3f
Regards.
----------------------------------------
> From: enriquelgh@hotmail.com
> To: users@cloudstack.apache.org
> CC: dev@cloudstack.apache.org
> Subject: RE: VPC virtual router fails to start up - no route to CS Management Server.
> Date: Wed, 4 Sep 2013 00:15:10 +0200
>
> Hi,
>
> Logs and screenshots attached in a tar file.
>
> In my case, the type of the first interface is "Control", as you can see in the screenshots.
>
> @developers, if you need more info let me know.
>
> Thanks to everyone,
> Regards.
>
>
>>> Date: Tue, 3 Sep 2013 08:05:10 +0100
>>> Subject: Re: VPC virtual router fails to start up - no route to CS
>> Management Server.
>>> From: msweet.dev@gmail.com
>>> To: users@cloudstack.apache.org
>>> CC: dev@cloudstack.apache.org
>>>
>>> Hi,
>>>
>>> I couldn't find any screenshots in the string of messages.
>>> Looking at the logs it almost seems as like the VPC is stopping
>>> unexpectedly.
>>>
>>> Looking at my VPC, the first interface is a Link Local for Control
>>> type traffic, which is running on KVM.
>>> I will CC this into the dev mailinglist in search for a developer
>>> who knows more about VMWare and VPCs.
>>>
>>> In the meantime, please could you attach (in a tar), the screenshots
>>> of the VPC interfaces from the cloudstack interfaces.
>>>
>>> Thanks,
>>> Marty
>>>
>>>
>>>
>>>
>>> On Mon, Sep 2, 2013 at 6:28 PM, Enrique Ladrón de Guevara Hernández
>>> < enriquelgh@hotmail.com> wrote:
>>>
>>>> Hi Marty,
>>>>
>>>> Sorry, could you look at the logs and screenshots?? Do you need
>>>> more info to debug the issue??
>>>>
>>>> Do you know if there is a bug related to this scenario??
>>>>
>>>> I try to find any information on Internet and check my config but I
>>>> don't know how to continue go ahead ...
>>>>
>>>> Do you recommend re-installing CS software with other version or
>>>> the same version ....??
>>>>
>>>> Thanks in advanced for your help.
>>>> Regards.
>>>>
>>>>
>>>> ----------------------------------------
>>>>> From: enriquelgh@hotmail.com
>>>>> To: users@cloudstack.apache.org
>>>>> Subject: RE: VPC virtual router fails to start up - no route to CS
>>>> Management Server.
>>>>> Date: Wed, 28 Aug 2013 20:16:26 +0200
>>>>>
>>>>> Now better!
>>>>>
>>>>> Regards.
>>>>>
>>>>> ----------------------------------------
>>>>>> From: enriquelgh@hotmail.com
>>>>>> To: users@cloudstack.apache.org
>>>>>> Subject: RE: VPC virtual router fails to start up - no route to
>>>>>> CS
>>>> Management Server.
>>>>>> Date: Wed, 28 Aug 2013 20:09:39 +0200
>>>>>>
>>>>>> Hi Marty,
>>>>>>
>>>>>> I have used a new test to capture screenshots and logs:
>>>>>>
>>>>>> VPC Name: VPC-Test
>>>>>> Job: job-69
>>>>>> vrsm: r-59-VM
>>>>>>
>>>>>> you can find files attached.
>>>>>>
>>>>>> Thanks,
>>>>>> Regards.
>>>>>>
>>>>>> -
>>>>>> ----------------------------------------
>>>>>>> Date: Wed, 28 Aug 2013 10:16:23 +0100
>>>>>>> Subject: Re: VPC virtual router fails to start up - no route to
>>>>>>> CS
>>>> Management Server.
>>>>>>> From: msweet.dev@gmail.com
>>>>>>> To: users@cloudstack.apache.org
>>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> Could you let me know the IP addresses listed in the cloudstack
>>>> interface
>>>>>>> under Infrastructure> Virtual Routers> VPC
>>>>>>>
>>>>>>> Marty
>>>>>>>
>>>>>>>
>>>>>>> On Tue, Aug 27, 2013 at 11:11 PM, Enrique Ladrón de Guevara
>> Hernández <
>>>>>>> enriquelgh@hotmail.com> wrote:
>>>>>>>
>>>>>>>> Hi Marty,
>>>>>>>>
>>>>>>>> Yes, I have still got this issue ... :S I'm very lost ...
>>>>>>>>
>>>>>>>> Guest Networks are working fine, but in VPC nop ...
>>>>>>>>
>>>>>>>> If you need more info, please let me know.
>>>>>>>>
>>>>>>>> Thanks a lot for your time,
>>>>>>>> Regards.
>>>>>>>>
>>>>>>>>
>>>>>>>> ----------------------------------------
>>>>>>>>> Date: Tue, 27 Aug 2013 22:54:11 +0100
>>>>>>>>> Subject: Re: VPC virtual router fails to start up - no route
>>>>>>>>> to CS
>>>>>>>> Management Server.
>>>>>>>>> From: msweet.dev@gmail.com
>>>>>>>>> To: users@cloudstack.apache.org
>>>>>>>>>
>>>>>>>>> Hi Enrique,
>>>>>>>>>
>>>>>>>>> Sorry I haven't got back to you, is this still an issue?
>>>>>>>>> If so, I will take a look at it and get back to you in the morning.
>>>>>>>>>
>>>>>>>>> Thanks,
>>>>>>>>> Marty
>>>>>>>>>
>>>>>>>>> On Monday, August 26, 2013, Enrique Ladrón de Guevara
>>>>>>>>> Hernández
>>>> wrote:
>>>>>>>>>
>>>>>>>>>> Hi Marty,
>>>>>>>>>>
>>>>>>>>>> My apologies for the format. I hope this time the email
>> format will
>>>> be
>>>>>>>>>> better. You can find the logs attached.
>>>>>>>>>>
>>>>>>>>>> In this log you can see several VPC deployment tests. One of
>>>>>>>>>> them
>>>> is:
>>>>>>>>>> - VPC name: VPC-Prueba-1
>>>>>>>>>> - job: job-11
>>>>>>>>>> - ssvm: r-53-VM.
>>>>>>>>>>
>>>>>>>>>> I use GUI to create VPC. The system VM (virutal router) is
>>>>>>>>>> created
>>>> and I
>>>>>>>>>> can log in by console (VNC or VMWARE console), but after 40
>>>>>>>>>> min
>>>> (aprox)
>>>>>>>>>> this SSVM are destroyed because the MS is not able to
>> connect with.
>>>>>>>>>>
>>>>>>>>>> I think the System VM needs default gateway route or static
>>>>>>>>>> route
>>>> to MS
>>>>>>>>>> server like the rest of SystemVMs (Console, Sec. Storage or
>>>>>>>>>> Guest
>>>> Net.).
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)
>>>>>>>>>>
>>>>>>>>>> Num. of Management Server: 1 (under CentOS 6.4) [physical server].
>>>>>>>>>>
>>>>>>>>>> The MS has this network configuration: IP: 10.10.10.110/24 GW:
>>>>>>>>>> 10.10.10.254
>>>>>>>>>>
>>>>>>>>>> DNS server:10.10.10.116/24
>>>>>>>>>>
>>>>>>>>>> Hypervisor: VMWARE 4.1 (with Standard Virtual Switches), 2
>>>>>>>>>> ESXi
>>>> hosts:
>>>>>>>>>> IPs: 10.10.1.101 & .102/24 GW: 10.10.1.254
>>>>>>>>>>
>>>>>>>>>> vCenter: 10.10.1.100/24.
>>>>>>>>>>
>>>>>>>>>> Virtual Network Architecture:
>>>>>>>>>>
>>>>>>>>>> CS Traffic Type:CS Management VmWare Virtual Switch:vSwitch0
>>>>>>>>>> CS Physical Network:PhysNet-mgmt-svm
>>>>>>>>>> Network:10.10.1.0
>>>>>>>>>> Subnet:/24
>>>>>>>>>> Gateway:10.10.1.254
>>>>>>>>>> VLAN TAG: NONE
>>>>>>>>>> Start IP Range:10.10.1.120
>>>>>>>>>> End IP Range: 10.10.1.240
>>>>>>>>>>
>>>>>>>>>> CS Traffic Type: Storage
>>>>>>>>>> VmWare Virtual Switch:vSwitch1 CS Physical
>>>>>>>>>> Network:PhysNet-storage
>>>>>>>>>> Network:10.10.2.0
>>>>>>>>>> Subnet:/24
>>>>>>>>>> Gateway:10.10.2.254
>>>>>>>>>> VLAN TAG: NONE
>>>>>>>>>> Start IP Range:10.10.2.120
>>>>>>>>>> End IP Range: 10.10.2.240
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> CS Traffic Type:Guest
>>>>>>>>>> VmWare Virtual Switch:vSwitch2 CS Physical
>>>>>>>>>> Network:PhysNet-guest-1
>>>>>>>>>> Network:10.10.3.0
>>>>>>>>>> Subnet:/24
>>>>>>>>>> Gateway:10.10.3.254
>>>>>>>>>> VLAN TAG: NONE
>>>>>>>>>> Start IP Range:10.10.3.1
>>>>>>>>>> End IP Range: 10.10.3.254
>>>>>>>>>>
>>>>>>>>>> CS Traffic Type:Public
>>>>>>>>>> VmWare Virtual Switch:vSwitch3 CS Physical
>>>>>>>>>> Network:PhysNet-public
>>>>>>>>>> Network:10.10.4.0
>>>>>>>>>> Subnet:/24
>>>>>>>>>> Gateway:10.10.4.254
>>>>>>>>>> VLAN TAG: NONE
>>>>>>>>>> Start IP Range:10.10.4.1
>>>>>>>>>> End IP Range: 10.10.4.240
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> vRouter (VPC) System VM - doesn't have a specific route to MS:
>>>>>>>>>>
>>>>>>>>>> root@r-53-VM:~# netstat -nr
>>>>>>>>>> Kernel IP routing table
>>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
>>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>>> eth3
>>>>>>>>>> root@r-53-VM:~#
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> CS management server:
>>>>>>>>>>
>>>>>>>>>> [root@cs-1 ~]# netstat -nr
>>>>>>>>>> Kernel IP routing table
>>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>>>>>>>> Iface
>>>>>>>>>> 10.10.10.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>>> eth0
>>>>>>>>>> 169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0
>>>>>>>>>> eth0
>>>>>>>>>> 0.0.0.0 10.10.10.254 0.0.0.0 UG 0 0 0
>>>>>>>>>> eth0
>>>>>>>>>> [root@cs-1 ~]#
>>>>>>>>>>
>>>>>>>>>> Console Proxy System VM:
>>>>>>>>>>
>>>>>>>>>> root@v-50-VM:~# netstat -nr
>>>>>>>>>> Kernel IP routing table
>>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>>>>>>>> Iface
>>>>>>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0 0
>>>>>>>>>> eth1
>>>>>>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0 0
>>>>>>>>>> eth1
>>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>>> eth2
>>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>>> eth1
>>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
>>>>>>>>>> eth1
>>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
>>>>>>>>>> eth2
>>>>>>>>>> root@v-50-VM:~#
>>>>>>>>>>
>>>>>>>>>> vRouter (no VPC- Guest Network) System VM:
>>>>>>>>>>
>>>>>>>>>> root@r-49-VM:~# netstat -nr
>>>>>>>>>> Kernel IP routing table
>>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>>>>>>>> Iface
>>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>>> eth2
>>>>>>>>>> 10.10.3.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>>> eth0
>>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>>> eth1
>>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
>>>>>>>>>> eth1
>>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
>>>>>>>>>> eth2
>>>>>>>>>> root@r-49-VM:~#
>>>>>>>>>>
>>>>>>>>>> Secondary Storage System VM:
>>>>>>>>>>
>>>>>>>>>> root@s-28-VM:~# netstat -nr
>>>>>>>>>> Kernel IP routing table
>>>>>>>>>> Destination Gateway Genmask Flags MSS
>>>>>>>>>> Window irtt Iface
>>>>>>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>>>>>> 0 eth1
>>>>>>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>>>>>> 0 eth1
>>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0
>>>>>>>>>> 0 0 eth2
>>>>>>>>>> 10.10.2.0 0.0.0.0 255.255.255.0 U 0
>>>>>>>>>> 0 0 eth3
>>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0
>>>>>>>>>> 0 0 eth1
>>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0
>>>>>>>>>> 0 eth1
>>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG
>>>>>>>>>> 0 0 0 eth2
>>>>>>>>>> root@s-28-VM:~#
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Thanks,
>>>>>>>>>> Regards.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>
>> ---------------------------------------------------------------------------------------------
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>
>> ---------------------------------------------------------------------------------------------
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>> Date: Mon, 26 Aug 2013 15:19:06 +0100
>>>>>>>>>>> Subject: Re: VPC virtual router fails to start up - no
>> route to CS
>>>>>>>>>> Management Server.
>>>>>>>>>>> From: msweet.dev@gmail.com <javascript:;>
>>>>>>>>>>> To: users@cloudstack.apache.org <javascript:;>
>>>>>>>>>>>
>>>>>>>>>>> Hi,
>>>>>>>>>>>
>>>>>>>>>>> I don't think this has got a response because of the poor
>>>> formatting of
>>>>>>>>>> the
>>>>>>>>>>> log. Please could you attach the log in a separate file and
>> I will
>>>>>>>> take a
>>>>>>>>>>> look?
>>>>>>>>>>> Am I correct in thinking that it is creating the system VM, and
>>>> then
>>>>>>>>>>> destroying it?
>>>>>>>>>>>
>>>>>>>>>>> Thanks,
>>>>>>>>>>> Marty
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> On Sun, Aug 25, 2013 at 11:46 PM, Enrique Ladrón de Guevara
>>>> Hernández <
>>>>>>>>>>> enriquelgh@hotmail.com> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Hi,
>>>>>>>>>>>> I'm carrying out my End of Career Project related to CloudStack
>>>>>>>>>>>> deployment. I got issues when I try to deploy a VPC, the VPC
>>>> virtual
>>>>>>>>>> router
>>>>>>>>>>>> isn't deployed completely and It's destroyed after timeout.
>>>>>>>>>>>> The rest of SSVMs (Console Proxy VM, Storage VM and Guest
>> Network
>>>> VM)
>>>>>>>>>> are
>>>>>>>>>>>> deployed correctly. I can access to the instance console,
>> put into
>>>>>>>> guest
>>>>>>>>>>>> network a instance, connect to it, etc ...
>>>>>>>>>>>> Could you help me to resolve this issue? I don't know
>> which is the
>>>>>>>> thing
>>>>>>>>>>>> that I'm doing wrong ...
>>>>>>>>>>>> This is the context:
>>>>>>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)Num. of
>> Management
>>>>>>>>>> Server:
>>>>>>>>>>>> 1 (under CentOS 6.4) [physical server]. The MS has this network
>>>>>>>>>>>> configuration:IP: 10.10.10.110/24GW: 10.10.10.254DNS server:
>>>>>>>>>>>> 10.10.10.116/24Hypervisor: VMWARE 4.1:2 ESXi hosts:IPs:
>>>> 10.10.1.101 &
>>>>>>>>>>>> .102/24GW: 10.10.1.254vCenter: 10.10.1.100Standard Virtual
>>>> Switches.
>>>>>>>>>>>> Virtual Network Architecture:VmWare Virtual Switch CS Physical
>>>>>>>>>>>> Network Network Subnet Gateway VLAN
>>>>>>>>>>>> TAG CS Traffic Type Start IP Range End IP RangevSwitch0
>>>>>>>>>>>> PhysNet-mgmt-svm 10.10.1.0
>>>>>>>>>>>> 255.255.255.0 10.10.1.254 NONE CS Management 10.10.1.120
>>>>>>>>>>>> 10.10.1.240vSwitch1
>>>>>>>>>>>> PhysNet-storage 10.10.2.0 255.255.255.0 10.10.2.254
>>>>>>>>>>>> NONE Storage 10.10.2.120
>>>>>>>>>>>> 10.10.2.240vSwitch2 PhysNet-guest-1
>>>>>>>>>>>> 10.10.3.0 255.255.255.0 10.10.3.254 NONE
>>>>>>>>>>>> Guest 10.10.3.1 10.10.3.254vSwitch3
>>>>>>>>>>>> PhysNet-public 10.10.4.0
>>>>>>>>>>>> 255.255.255.0 10.10.4.254 NONE Public
>>>>>>>>>>>> 10.10.4.1 10.10.4.240
>>>>>>>>>>>> I log in to ssvm consoles and I can see the following:vRouter
>>>> (VPC)
>>>>>>>>>> System
>>>>>>>>>>>> VM - doesn't have a specific route to MS:root@r-53-VM:~# netstat
>>>>>>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
>>>>>>>>>>>> Flags MSS Window irtt Iface10.10.1.0 0.0.0.0 255.255.255.0
>>>>>>>>>>>> U 0 0 0 eth3root@r-53-VM:~#
>>>>>>>>>>>> CS management server:[root@cs-1 ~]# netstat -nrKernel IP routing
>>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS Window
>>>>>>>>>>>> irtt Iface10.10.10.0 0.0.0.0 255.255.255.0 U 0 0
>>>>>>>>>>>> 0 eth0169.254.0.0 0.0.0.0 255.255.0.0 U 0 0
>>>>>>>>>>>> 0 eth00.0.0.0 10.10.10.254 0.0.0.0 UG 0
>>>>>>>>>>>> 0 0 eth0[root@cs-1 ~]#
>>>>>>>>>>>> Console Proxy System VM:root@v-50-VM:~# netstat -nrKernel IP
>>>> routing
>>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS Window
>>>>>>>>>>>> irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>>>>>>>> 0 eth110.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>>>>>>>> 0 eth110.10.4.0 0.0.0.0 255.255.255.0 U 0
>>>>>>>>>>>> 0 0 eth210.10.1.0 0.0.0.0 255.255.255.0 U
>>>>>>>>>>>> 0 0 0 eth110.10.10.0 10.10.1.254 255.255.255.0 UG
>>>>>>>>>>>> 0 0 0 eth10.0.0.0 10.10.4.254 0.0.0.0 UG
>>>>>>>>>>>> 0 0 0 eth2root@v-50-VM:~#
>>>>>>>>>>>> vRouter (no VPC- Guest Network) System VM:root@r-49-VM:~#
>> netstat
>>>>>>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
>>>>>>>>>>>> Flags MSS Window irtt Iface10.10.4.0 0.0.0.0 255.255.255.0
>>>>>>>>>>>> U 0 0 0 eth210.10.3.0 0.0.0.0
>>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth010.10.1.0 0.0.0.0
>>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0 10.10.1.254
>>>>>>>>>>>> 255.255.255.0 UG 0 0 0 eth10.0.0.0
>>>>>>>>>>>> 10.10.4.254 0.0.0.0 UG 0 0 0 eth2root@r-49-VM
>>>>>>>>>>>> :~#
>>>>>>>>>>>> Secondary Storage System VMroot@s-28-VM:~# netstat -nrKernel IP
>>>>>>>> routing
>>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS
>>>>>>>>>>>> Window irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH
>>>>>>>>>>>> 0 0 0 eth110.10.10.110 10.10.1.254
>>>>>>>>>>>> 255.255.255.255 UGH 0 0 0 eth110.10.4.0
>>>>>>>>>>>> 0.0.0.0 255.255.255.0 U 0 0
>>>>>>>>>>>> 0 eth210.10.2.0 0.0.0.0 255.255.255.0 U
>>>>>>>>>>>> 0 0 0 eth310.10.1.0 0.0.0.0
>>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0
>>>>>>>>>>>> 10.10.1.254 255.255.255.0 UG 0 0 0
>>>>>>>>>>>> eth10.0.0.0 10.10.4.254 0.0.0.0 UG
>>>>>>>>>>>> 0 0 0 eth2root@s-28-VM:~# management-server.log
>>>>>>>>>>>> (filtered by r-53-VM):
>>>>>>>>>>>> [root@cs-1 ~]# g>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
>>>>>>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
>>>> template=domP
>>>>>>>>>> name=r-53-VM
>>>>>>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
>>>>>>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
>>>> disable_rp_filter=true
>>>>>>>>>> extra_pubnics=2
>>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>
>> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}},{"check.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":100,"name":"r-53-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.1.238","
>>>>>>>>>>>> router.name
>>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>
>> ":"r-53-VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbps":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"10.10.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"router.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"10.10.1.238","
>>>>>>>>>>>> router.name
>>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>
>> ":"r-53-VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessDetails":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","
>>>>>>>>>>>> router.name":"r-53-VM"},"wait":0}},{}] }2013-08-25 11:34:48,001
>>>> DEBUG
>>>>>>>>>>>> [agent.transport.Request] (Job-Executor-13:job-11) Seq
>>>> 1-1308430869:
>>>>>>>>>>>> Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags:
>>>>>>>> 100111,
>>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>
>> [{"StartCommand":{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter">>
>>>>>>>>>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
>>>>>>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
>>>> template=domP
>>>>>>>>>> name=r-53-VM
>>>>>>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
>>>>>>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
>>>> disable_rp_filter=true
>>>>>>>>>> extra_pubnics=2
>>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>
>> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":>>
>>>>>>>>>> GNU/Linux 5.0 (32-bit)",
>>>>>>>>
>>>>
RE: VPC virtual router fails to start up - no route to CS Management Server.
Posted by COCHE Sébastien <SC...@sigma.fr>.
Hi Enrique,
I had the same issue on 4.0, 4.0.1 and 4.1 CloudStack's releases.
I followed the documentation for complex deployment (CloudStack Manager and hypervisor (ESX) on a different networks)
After some research it seems that the VPC's vRouter do not have a route to communicate with CloudStack server. On a VPC vRouter, the default route is set on the public network.
I already post on this issue, and I did not have any feedback (my question could be not clear).
I hope you will be luckiest.
Best regards
-----Message d'origine-----
De : Enrique Ladrón de Guevara Hernández [mailto:enriquelgh@hotmail.com]
Envoyé : mercredi 4 septembre 2013 00:23
À : users@cloudstack.apache.org
Cc : dev@cloudstack.apache.org
Objet : RE: VPC virtual router fails to start up - no route to CS Management Server.
Hi,
I don't know why but don't achive to insert the tar file ...
You can download it in this link: http://we.tl/kHJtO3BK3f
Regards.
----------------------------------------
> From: enriquelgh@hotmail.com
> To: users@cloudstack.apache.org
> CC: dev@cloudstack.apache.org
> Subject: RE: VPC virtual router fails to start up - no route to CS Management Server.
> Date: Wed, 4 Sep 2013 00:15:10 +0200
>
> Hi,
>
> Logs and screenshots attached in a tar file.
>
> In my case, the type of the first interface is "Control", as you can see in the screenshots.
>
> @developers, if you need more info let me know.
>
> Thanks to everyone,
> Regards.
>
>
>>> Date: Tue, 3 Sep 2013 08:05:10 +0100
>>> Subject: Re: VPC virtual router fails to start up - no route to CS
>> Management Server.
>>> From: msweet.dev@gmail.com
>>> To: users@cloudstack.apache.org
>>> CC: dev@cloudstack.apache.org
>>>
>>> Hi,
>>>
>>> I couldn't find any screenshots in the string of messages.
>>> Looking at the logs it almost seems as like the VPC is stopping
>>> unexpectedly.
>>>
>>> Looking at my VPC, the first interface is a Link Local for Control
>>> type traffic, which is running on KVM.
>>> I will CC this into the dev mailinglist in search for a developer
>>> who knows more about VMWare and VPCs.
>>>
>>> In the meantime, please could you attach (in a tar), the screenshots
>>> of the VPC interfaces from the cloudstack interfaces.
>>>
>>> Thanks,
>>> Marty
>>>
>>>
>>>
>>>
>>> On Mon, Sep 2, 2013 at 6:28 PM, Enrique Ladrón de Guevara Hernández
>>> < enriquelgh@hotmail.com> wrote:
>>>
>>>> Hi Marty,
>>>>
>>>> Sorry, could you look at the logs and screenshots?? Do you need
>>>> more info to debug the issue??
>>>>
>>>> Do you know if there is a bug related to this scenario??
>>>>
>>>> I try to find any information on Internet and check my config but I
>>>> don't know how to continue go ahead ...
>>>>
>>>> Do you recommend re-installing CS software with other version or
>>>> the same version ....??
>>>>
>>>> Thanks in advanced for your help.
>>>> Regards.
>>>>
>>>>
>>>> ----------------------------------------
>>>>> From: enriquelgh@hotmail.com
>>>>> To: users@cloudstack.apache.org
>>>>> Subject: RE: VPC virtual router fails to start up - no route to CS
>>>> Management Server.
>>>>> Date: Wed, 28 Aug 2013 20:16:26 +0200
>>>>>
>>>>> Now better!
>>>>>
>>>>> Regards.
>>>>>
>>>>> ----------------------------------------
>>>>>> From: enriquelgh@hotmail.com
>>>>>> To: users@cloudstack.apache.org
>>>>>> Subject: RE: VPC virtual router fails to start up - no route to
>>>>>> CS
>>>> Management Server.
>>>>>> Date: Wed, 28 Aug 2013 20:09:39 +0200
>>>>>>
>>>>>> Hi Marty,
>>>>>>
>>>>>> I have used a new test to capture screenshots and logs:
>>>>>>
>>>>>> VPC Name: VPC-Test
>>>>>> Job: job-69
>>>>>> vrsm: r-59-VM
>>>>>>
>>>>>> you can find files attached.
>>>>>>
>>>>>> Thanks,
>>>>>> Regards.
>>>>>>
>>>>>> -
>>>>>> ----------------------------------------
>>>>>>> Date: Wed, 28 Aug 2013 10:16:23 +0100
>>>>>>> Subject: Re: VPC virtual router fails to start up - no route to
>>>>>>> CS
>>>> Management Server.
>>>>>>> From: msweet.dev@gmail.com
>>>>>>> To: users@cloudstack.apache.org
>>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> Could you let me know the IP addresses listed in the cloudstack
>>>> interface
>>>>>>> under Infrastructure> Virtual Routers> VPC
>>>>>>>
>>>>>>> Marty
>>>>>>>
>>>>>>>
>>>>>>> On Tue, Aug 27, 2013 at 11:11 PM, Enrique Ladrón de Guevara
>> Hernández <
>>>>>>> enriquelgh@hotmail.com> wrote:
>>>>>>>
>>>>>>>> Hi Marty,
>>>>>>>>
>>>>>>>> Yes, I have still got this issue ... :S I'm very lost ...
>>>>>>>>
>>>>>>>> Guest Networks are working fine, but in VPC nop ...
>>>>>>>>
>>>>>>>> If you need more info, please let me know.
>>>>>>>>
>>>>>>>> Thanks a lot for your time,
>>>>>>>> Regards.
>>>>>>>>
>>>>>>>>
>>>>>>>> ----------------------------------------
>>>>>>>>> Date: Tue, 27 Aug 2013 22:54:11 +0100
>>>>>>>>> Subject: Re: VPC virtual router fails to start up - no route
>>>>>>>>> to CS
>>>>>>>> Management Server.
>>>>>>>>> From: msweet.dev@gmail.com
>>>>>>>>> To: users@cloudstack.apache.org
>>>>>>>>>
>>>>>>>>> Hi Enrique,
>>>>>>>>>
>>>>>>>>> Sorry I haven't got back to you, is this still an issue?
>>>>>>>>> If so, I will take a look at it and get back to you in the morning.
>>>>>>>>>
>>>>>>>>> Thanks,
>>>>>>>>> Marty
>>>>>>>>>
>>>>>>>>> On Monday, August 26, 2013, Enrique Ladrón de Guevara
>>>>>>>>> Hernández
>>>> wrote:
>>>>>>>>>
>>>>>>>>>> Hi Marty,
>>>>>>>>>>
>>>>>>>>>> My apologies for the format. I hope this time the email
>> format will
>>>> be
>>>>>>>>>> better. You can find the logs attached.
>>>>>>>>>>
>>>>>>>>>> In this log you can see several VPC deployment tests. One of
>>>>>>>>>> them
>>>> is:
>>>>>>>>>> - VPC name: VPC-Prueba-1
>>>>>>>>>> - job: job-11
>>>>>>>>>> - ssvm: r-53-VM.
>>>>>>>>>>
>>>>>>>>>> I use GUI to create VPC. The system VM (virutal router) is
>>>>>>>>>> created
>>>> and I
>>>>>>>>>> can log in by console (VNC or VMWARE console), but after 40
>>>>>>>>>> min
>>>> (aprox)
>>>>>>>>>> this SSVM are destroyed because the MS is not able to
>> connect with.
>>>>>>>>>>
>>>>>>>>>> I think the System VM needs default gateway route or static
>>>>>>>>>> route
>>>> to MS
>>>>>>>>>> server like the rest of SystemVMs (Console, Sec. Storage or
>>>>>>>>>> Guest
>>>> Net.).
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)
>>>>>>>>>>
>>>>>>>>>> Num. of Management Server: 1 (under CentOS 6.4) [physical server].
>>>>>>>>>>
>>>>>>>>>> The MS has this network configuration: IP: 10.10.10.110/24 GW:
>>>>>>>>>> 10.10.10.254
>>>>>>>>>>
>>>>>>>>>> DNS server:10.10.10.116/24
>>>>>>>>>>
>>>>>>>>>> Hypervisor: VMWARE 4.1 (with Standard Virtual Switches), 2
>>>>>>>>>> ESXi
>>>> hosts:
>>>>>>>>>> IPs: 10.10.1.101 & .102/24 GW: 10.10.1.254
>>>>>>>>>>
>>>>>>>>>> vCenter: 10.10.1.100/24.
>>>>>>>>>>
>>>>>>>>>> Virtual Network Architecture:
>>>>>>>>>>
>>>>>>>>>> CS Traffic Type:CS Management VmWare Virtual Switch:vSwitch0
>>>>>>>>>> CS Physical Network:PhysNet-mgmt-svm
>>>>>>>>>> Network:10.10.1.0
>>>>>>>>>> Subnet:/24
>>>>>>>>>> Gateway:10.10.1.254
>>>>>>>>>> VLAN TAG: NONE
>>>>>>>>>> Start IP Range:10.10.1.120
>>>>>>>>>> End IP Range: 10.10.1.240
>>>>>>>>>>
>>>>>>>>>> CS Traffic Type: Storage
>>>>>>>>>> VmWare Virtual Switch:vSwitch1 CS Physical
>>>>>>>>>> Network:PhysNet-storage
>>>>>>>>>> Network:10.10.2.0
>>>>>>>>>> Subnet:/24
>>>>>>>>>> Gateway:10.10.2.254
>>>>>>>>>> VLAN TAG: NONE
>>>>>>>>>> Start IP Range:10.10.2.120
>>>>>>>>>> End IP Range: 10.10.2.240
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> CS Traffic Type:Guest
>>>>>>>>>> VmWare Virtual Switch:vSwitch2 CS Physical
>>>>>>>>>> Network:PhysNet-guest-1
>>>>>>>>>> Network:10.10.3.0
>>>>>>>>>> Subnet:/24
>>>>>>>>>> Gateway:10.10.3.254
>>>>>>>>>> VLAN TAG: NONE
>>>>>>>>>> Start IP Range:10.10.3.1
>>>>>>>>>> End IP Range: 10.10.3.254
>>>>>>>>>>
>>>>>>>>>> CS Traffic Type:Public
>>>>>>>>>> VmWare Virtual Switch:vSwitch3 CS Physical
>>>>>>>>>> Network:PhysNet-public
>>>>>>>>>> Network:10.10.4.0
>>>>>>>>>> Subnet:/24
>>>>>>>>>> Gateway:10.10.4.254
>>>>>>>>>> VLAN TAG: NONE
>>>>>>>>>> Start IP Range:10.10.4.1
>>>>>>>>>> End IP Range: 10.10.4.240
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> vRouter (VPC) System VM - doesn't have a specific route to MS:
>>>>>>>>>>
>>>>>>>>>> root@r-53-VM:~# netstat -nr
>>>>>>>>>> Kernel IP routing table
>>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt Iface
>>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>>> eth3
>>>>>>>>>> root@r-53-VM:~#
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> CS management server:
>>>>>>>>>>
>>>>>>>>>> [root@cs-1 ~]# netstat -nr
>>>>>>>>>> Kernel IP routing table
>>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>>>>>>>> Iface
>>>>>>>>>> 10.10.10.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>>> eth0
>>>>>>>>>> 169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0
>>>>>>>>>> eth0
>>>>>>>>>> 0.0.0.0 10.10.10.254 0.0.0.0 UG 0 0 0
>>>>>>>>>> eth0
>>>>>>>>>> [root@cs-1 ~]#
>>>>>>>>>>
>>>>>>>>>> Console Proxy System VM:
>>>>>>>>>>
>>>>>>>>>> root@v-50-VM:~# netstat -nr
>>>>>>>>>> Kernel IP routing table
>>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>>>>>>>> Iface
>>>>>>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0 0
>>>>>>>>>> eth1
>>>>>>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0 0
>>>>>>>>>> eth1
>>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>>> eth2
>>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>>> eth1
>>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
>>>>>>>>>> eth1
>>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
>>>>>>>>>> eth2
>>>>>>>>>> root@v-50-VM:~#
>>>>>>>>>>
>>>>>>>>>> vRouter (no VPC- Guest Network) System VM:
>>>>>>>>>>
>>>>>>>>>> root@r-49-VM:~# netstat -nr
>>>>>>>>>> Kernel IP routing table
>>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>>>>>>>> Iface
>>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>>> eth2
>>>>>>>>>> 10.10.3.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>>> eth0
>>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>>> eth1
>>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
>>>>>>>>>> eth1
>>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
>>>>>>>>>> eth2
>>>>>>>>>> root@r-49-VM:~#
>>>>>>>>>>
>>>>>>>>>> Secondary Storage System VM:
>>>>>>>>>>
>>>>>>>>>> root@s-28-VM:~# netstat -nr
>>>>>>>>>> Kernel IP routing table
>>>>>>>>>> Destination Gateway Genmask Flags MSS
>>>>>>>>>> Window irtt Iface
>>>>>>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>>>>>> 0 eth1
>>>>>>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>>>>>> 0 eth1
>>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0
>>>>>>>>>> 0 0 eth2
>>>>>>>>>> 10.10.2.0 0.0.0.0 255.255.255.0 U 0
>>>>>>>>>> 0 0 eth3
>>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0
>>>>>>>>>> 0 0 eth1
>>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0
>>>>>>>>>> 0 eth1
>>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG
>>>>>>>>>> 0 0 0 eth2
>>>>>>>>>> root@s-28-VM:~#
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Thanks,
>>>>>>>>>> Regards.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>
>> ---------------------------------------------------------------------------------------------
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>
>> ---------------------------------------------------------------------------------------------
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>> Date: Mon, 26 Aug 2013 15:19:06 +0100
>>>>>>>>>>> Subject: Re: VPC virtual router fails to start up - no
>> route to CS
>>>>>>>>>> Management Server.
>>>>>>>>>>> From: msweet.dev@gmail.com <javascript:;>
>>>>>>>>>>> To: users@cloudstack.apache.org <javascript:;>
>>>>>>>>>>>
>>>>>>>>>>> Hi,
>>>>>>>>>>>
>>>>>>>>>>> I don't think this has got a response because of the poor
>>>> formatting of
>>>>>>>>>> the
>>>>>>>>>>> log. Please could you attach the log in a separate file and
>> I will
>>>>>>>> take a
>>>>>>>>>>> look?
>>>>>>>>>>> Am I correct in thinking that it is creating the system VM, and
>>>> then
>>>>>>>>>>> destroying it?
>>>>>>>>>>>
>>>>>>>>>>> Thanks,
>>>>>>>>>>> Marty
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> On Sun, Aug 25, 2013 at 11:46 PM, Enrique Ladrón de Guevara
>>>> Hernández <
>>>>>>>>>>> enriquelgh@hotmail.com> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Hi,
>>>>>>>>>>>> I'm carrying out my End of Career Project related to CloudStack
>>>>>>>>>>>> deployment. I got issues when I try to deploy a VPC, the VPC
>>>> virtual
>>>>>>>>>> router
>>>>>>>>>>>> isn't deployed completely and It's destroyed after timeout.
>>>>>>>>>>>> The rest of SSVMs (Console Proxy VM, Storage VM and Guest
>> Network
>>>> VM)
>>>>>>>>>> are
>>>>>>>>>>>> deployed correctly. I can access to the instance console,
>> put into
>>>>>>>> guest
>>>>>>>>>>>> network a instance, connect to it, etc ...
>>>>>>>>>>>> Could you help me to resolve this issue? I don't know
>> which is the
>>>>>>>> thing
>>>>>>>>>>>> that I'm doing wrong ...
>>>>>>>>>>>> This is the context:
>>>>>>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)Num. of
>> Management
>>>>>>>>>> Server:
>>>>>>>>>>>> 1 (under CentOS 6.4) [physical server]. The MS has this network
>>>>>>>>>>>> configuration:IP: 10.10.10.110/24GW: 10.10.10.254DNS server:
>>>>>>>>>>>> 10.10.10.116/24Hypervisor: VMWARE 4.1:2 ESXi hosts:IPs:
>>>> 10.10.1.101 &
>>>>>>>>>>>> .102/24GW: 10.10.1.254vCenter: 10.10.1.100Standard Virtual
>>>> Switches.
>>>>>>>>>>>> Virtual Network Architecture:VmWare Virtual Switch CS Physical
>>>>>>>>>>>> Network Network Subnet Gateway VLAN
>>>>>>>>>>>> TAG CS Traffic Type Start IP Range End IP RangevSwitch0
>>>>>>>>>>>> PhysNet-mgmt-svm 10.10.1.0
>>>>>>>>>>>> 255.255.255.0 10.10.1.254 NONE CS Management 10.10.1.120
>>>>>>>>>>>> 10.10.1.240vSwitch1
>>>>>>>>>>>> PhysNet-storage 10.10.2.0 255.255.255.0 10.10.2.254
>>>>>>>>>>>> NONE Storage 10.10.2.120
>>>>>>>>>>>> 10.10.2.240vSwitch2 PhysNet-guest-1
>>>>>>>>>>>> 10.10.3.0 255.255.255.0 10.10.3.254 NONE
>>>>>>>>>>>> Guest 10.10.3.1 10.10.3.254vSwitch3
>>>>>>>>>>>> PhysNet-public 10.10.4.0
>>>>>>>>>>>> 255.255.255.0 10.10.4.254 NONE Public
>>>>>>>>>>>> 10.10.4.1 10.10.4.240
>>>>>>>>>>>> I log in to ssvm consoles and I can see the following:vRouter
>>>> (VPC)
>>>>>>>>>> System
>>>>>>>>>>>> VM - doesn't have a specific route to MS:root@r-53-VM:~# netstat
>>>>>>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
>>>>>>>>>>>> Flags MSS Window irtt Iface10.10.1.0 0.0.0.0 255.255.255.0
>>>>>>>>>>>> U 0 0 0 eth3root@r-53-VM:~#
>>>>>>>>>>>> CS management server:[root@cs-1 ~]# netstat -nrKernel IP routing
>>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS Window
>>>>>>>>>>>> irtt Iface10.10.10.0 0.0.0.0 255.255.255.0 U 0 0
>>>>>>>>>>>> 0 eth0169.254.0.0 0.0.0.0 255.255.0.0 U 0 0
>>>>>>>>>>>> 0 eth00.0.0.0 10.10.10.254 0.0.0.0 UG 0
>>>>>>>>>>>> 0 0 eth0[root@cs-1 ~]#
>>>>>>>>>>>> Console Proxy System VM:root@v-50-VM:~# netstat -nrKernel IP
>>>> routing
>>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS Window
>>>>>>>>>>>> irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>>>>>>>> 0 eth110.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>>>>>>>> 0 eth110.10.4.0 0.0.0.0 255.255.255.0 U 0
>>>>>>>>>>>> 0 0 eth210.10.1.0 0.0.0.0 255.255.255.0 U
>>>>>>>>>>>> 0 0 0 eth110.10.10.0 10.10.1.254 255.255.255.0 UG
>>>>>>>>>>>> 0 0 0 eth10.0.0.0 10.10.4.254 0.0.0.0 UG
>>>>>>>>>>>> 0 0 0 eth2root@v-50-VM:~#
>>>>>>>>>>>> vRouter (no VPC- Guest Network) System VM:root@r-49-VM:~#
>> netstat
>>>>>>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
>>>>>>>>>>>> Flags MSS Window irtt Iface10.10.4.0 0.0.0.0 255.255.255.0
>>>>>>>>>>>> U 0 0 0 eth210.10.3.0 0.0.0.0
>>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth010.10.1.0 0.0.0.0
>>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0 10.10.1.254
>>>>>>>>>>>> 255.255.255.0 UG 0 0 0 eth10.0.0.0
>>>>>>>>>>>> 10.10.4.254 0.0.0.0 UG 0 0 0 eth2root@r-49-VM
>>>>>>>>>>>> :~#
>>>>>>>>>>>> Secondary Storage System VMroot@s-28-VM:~# netstat -nrKernel IP
>>>>>>>> routing
>>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS
>>>>>>>>>>>> Window irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH
>>>>>>>>>>>> 0 0 0 eth110.10.10.110 10.10.1.254
>>>>>>>>>>>> 255.255.255.255 UGH 0 0 0 eth110.10.4.0
>>>>>>>>>>>> 0.0.0.0 255.255.255.0 U 0 0
>>>>>>>>>>>> 0 eth210.10.2.0 0.0.0.0 255.255.255.0 U
>>>>>>>>>>>> 0 0 0 eth310.10.1.0 0.0.0.0
>>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0
>>>>>>>>>>>> 10.10.1.254 255.255.255.0 UG 0 0 0
>>>>>>>>>>>> eth10.0.0.0 10.10.4.254 0.0.0.0 UG
>>>>>>>>>>>> 0 0 0 eth2root@s-28-VM:~# management-server.log
>>>>>>>>>>>> (filtered by r-53-VM):
>>>>>>>>>>>> [root@cs-1 ~]# g>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
>>>>>>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
>>>> template=domP
>>>>>>>>>> name=r-53-VM
>>>>>>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
>>>>>>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
>>>> disable_rp_filter=true
>>>>>>>>>> extra_pubnics=2
>>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>
>> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}},{"check.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":100,"name":"r-53-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.1.238","
>>>>>>>>>>>> router.name
>>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>
>> ":"r-53-VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbps":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"10.10.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"router.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"10.10.1.238","
>>>>>>>>>>>> router.name
>>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>
>> ":"r-53-VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessDetails":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","
>>>>>>>>>>>> router.name":"r-53-VM"},"wait":0}},{}] }2013-08-25 11:34:48,001
>>>> DEBUG
>>>>>>>>>>>> [agent.transport.Request] (Job-Executor-13:job-11) Seq
>>>> 1-1308430869:
>>>>>>>>>>>> Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags:
>>>>>>>> 100111,
>>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>
>> [{"StartCommand":{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter">>
>>>>>>>>>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
>>>>>>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
>>>> template=domP
>>>>>>>>>> name=r-53-VM
>>>>>>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
>>>>>>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
>>>> disable_rp_filter=true
>>>>>>>>>> extra_pubnics=2
>>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>
>> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":>>
>>>>>>>>>> GNU/Linux 5.0 (32-bit)",
>>>>>>>>
>>>>
RE: VPC virtual router fails to start up - no route to CS
Management Server.
Posted by Enrique Ladrón de Guevara Hernández <en...@hotmail.com>.
Hi,
I don't know why but don't achive to insert the tar file ...
You can download it in this link: http://we.tl/kHJtO3BK3f
Regards.
----------------------------------------
> From: enriquelgh@hotmail.com
> To: users@cloudstack.apache.org
> CC: dev@cloudstack.apache.org
> Subject: RE: VPC virtual router fails to start up - no route to CS Management Server.
> Date: Wed, 4 Sep 2013 00:15:10 +0200
>
> Hi,
>
> Logs and screenshots attached in a tar file.
>
> In my case, the type of the first interface is "Control", as you can see in the screenshots.
>
> @developers, if you need more info let me know.
>
> Thanks to everyone,
> Regards.
>
>
>>> Date: Tue, 3 Sep 2013 08:05:10 +0100
>>> Subject: Re: VPC virtual router fails to start up - no route to CS
>> Management Server.
>>> From: msweet.dev@gmail.com
>>> To: users@cloudstack.apache.org
>>> CC: dev@cloudstack.apache.org
>>>
>>> Hi,
>>>
>>> I couldn't find any screenshots in the string of messages.
>>> Looking at the logs it almost seems as like the VPC is stopping
>>> unexpectedly.
>>>
>>> Looking at my VPC, the first interface is a Link Local for Control type
>>> traffic, which is running on KVM.
>>> I will CC this into the dev mailinglist in search for a developer who knows
>>> more about VMWare and VPCs.
>>>
>>> In the meantime, please could you attach (in a tar), the screenshots of the
>>> VPC interfaces from the cloudstack interfaces.
>>>
>>> Thanks,
>>> Marty
>>>
>>>
>>>
>>>
>>> On Mon, Sep 2, 2013 at 6:28 PM, Enrique Ladrón de Guevara Hernández <
>>> enriquelgh@hotmail.com> wrote:
>>>
>>>> Hi Marty,
>>>>
>>>> Sorry, could you look at the logs and screenshots?? Do you need more info
>>>> to debug the issue??
>>>>
>>>> Do you know if there is a bug related to this scenario??
>>>>
>>>> I try to find any information on Internet and check my config but I don't
>>>> know how to continue go ahead ...
>>>>
>>>> Do you recommend re-installing CS software with other version or the same
>>>> version ....??
>>>>
>>>> Thanks in advanced for your help.
>>>> Regards.
>>>>
>>>>
>>>> ----------------------------------------
>>>>> From: enriquelgh@hotmail.com
>>>>> To: users@cloudstack.apache.org
>>>>> Subject: RE: VPC virtual router fails to start up - no route to CS
>>>> Management Server.
>>>>> Date: Wed, 28 Aug 2013 20:16:26 +0200
>>>>>
>>>>> Now better!
>>>>>
>>>>> Regards.
>>>>>
>>>>> ----------------------------------------
>>>>>> From: enriquelgh@hotmail.com
>>>>>> To: users@cloudstack.apache.org
>>>>>> Subject: RE: VPC virtual router fails to start up - no route to CS
>>>> Management Server.
>>>>>> Date: Wed, 28 Aug 2013 20:09:39 +0200
>>>>>>
>>>>>> Hi Marty,
>>>>>>
>>>>>> I have used a new test to capture screenshots and logs:
>>>>>>
>>>>>> VPC Name: VPC-Test
>>>>>> Job: job-69
>>>>>> vrsm: r-59-VM
>>>>>>
>>>>>> you can find files attached.
>>>>>>
>>>>>> Thanks,
>>>>>> Regards.
>>>>>>
>>>>>> -
>>>>>> ----------------------------------------
>>>>>>> Date: Wed, 28 Aug 2013 10:16:23 +0100
>>>>>>> Subject: Re: VPC virtual router fails to start up - no route to CS
>>>> Management Server.
>>>>>>> From: msweet.dev@gmail.com
>>>>>>> To: users@cloudstack.apache.org
>>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> Could you let me know the IP addresses listed in the cloudstack
>>>> interface
>>>>>>> under Infrastructure> Virtual Routers> VPC
>>>>>>>
>>>>>>> Marty
>>>>>>>
>>>>>>>
>>>>>>> On Tue, Aug 27, 2013 at 11:11 PM, Enrique Ladrón de Guevara
>> Hernández <
>>>>>>> enriquelgh@hotmail.com> wrote:
>>>>>>>
>>>>>>>> Hi Marty,
>>>>>>>>
>>>>>>>> Yes, I have still got this issue ... :S I'm very lost ...
>>>>>>>>
>>>>>>>> Guest Networks are working fine, but in VPC nop ...
>>>>>>>>
>>>>>>>> If you need more info, please let me know.
>>>>>>>>
>>>>>>>> Thanks a lot for your time,
>>>>>>>> Regards.
>>>>>>>>
>>>>>>>>
>>>>>>>> ----------------------------------------
>>>>>>>>> Date: Tue, 27 Aug 2013 22:54:11 +0100
>>>>>>>>> Subject: Re: VPC virtual router fails to start up - no route to CS
>>>>>>>> Management Server.
>>>>>>>>> From: msweet.dev@gmail.com
>>>>>>>>> To: users@cloudstack.apache.org
>>>>>>>>>
>>>>>>>>> Hi Enrique,
>>>>>>>>>
>>>>>>>>> Sorry I haven't got back to you, is this still an issue?
>>>>>>>>> If so, I will take a look at it and get back to you in the morning.
>>>>>>>>>
>>>>>>>>> Thanks,
>>>>>>>>> Marty
>>>>>>>>>
>>>>>>>>> On Monday, August 26, 2013, Enrique Ladrón de Guevara Hernández
>>>> wrote:
>>>>>>>>>
>>>>>>>>>> Hi Marty,
>>>>>>>>>>
>>>>>>>>>> My apologies for the format. I hope this time the email
>> format will
>>>> be
>>>>>>>>>> better. You can find the logs attached.
>>>>>>>>>>
>>>>>>>>>> In this log you can see several VPC deployment tests. One of them
>>>> is:
>>>>>>>>>> - VPC name: VPC-Prueba-1
>>>>>>>>>> - job: job-11
>>>>>>>>>> - ssvm: r-53-VM.
>>>>>>>>>>
>>>>>>>>>> I use GUI to create VPC. The system VM (virutal router) is created
>>>> and I
>>>>>>>>>> can log in by console (VNC or VMWARE console), but after 40 min
>>>> (aprox)
>>>>>>>>>> this SSVM are destroyed because the MS is not able to
>> connect with.
>>>>>>>>>>
>>>>>>>>>> I think the System VM needs default gateway route or static route
>>>> to MS
>>>>>>>>>> server like the rest of SystemVMs (Console, Sec. Storage or Guest
>>>> Net.).
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)
>>>>>>>>>>
>>>>>>>>>> Num. of Management Server: 1 (under CentOS 6.4) [physical server].
>>>>>>>>>>
>>>>>>>>>> The MS has this network configuration: IP: 10.10.10.110/24 GW:
>>>>>>>>>> 10.10.10.254
>>>>>>>>>>
>>>>>>>>>> DNS server:10.10.10.116/24
>>>>>>>>>>
>>>>>>>>>> Hypervisor: VMWARE 4.1 (with Standard Virtual Switches), 2 ESXi
>>>> hosts:
>>>>>>>>>> IPs: 10.10.1.101 & .102/24 GW: 10.10.1.254
>>>>>>>>>>
>>>>>>>>>> vCenter: 10.10.1.100/24.
>>>>>>>>>>
>>>>>>>>>> Virtual Network Architecture:
>>>>>>>>>>
>>>>>>>>>> CS Traffic Type:CS Management
>>>>>>>>>> VmWare Virtual Switch:vSwitch0
>>>>>>>>>> CS Physical Network:PhysNet-mgmt-svm
>>>>>>>>>> Network:10.10.1.0
>>>>>>>>>> Subnet:/24
>>>>>>>>>> Gateway:10.10.1.254
>>>>>>>>>> VLAN TAG: NONE
>>>>>>>>>> Start IP Range:10.10.1.120
>>>>>>>>>> End IP Range: 10.10.1.240
>>>>>>>>>>
>>>>>>>>>> CS Traffic Type: Storage
>>>>>>>>>> VmWare Virtual Switch:vSwitch1
>>>>>>>>>> CS Physical Network:PhysNet-storage
>>>>>>>>>> Network:10.10.2.0
>>>>>>>>>> Subnet:/24
>>>>>>>>>> Gateway:10.10.2.254
>>>>>>>>>> VLAN TAG: NONE
>>>>>>>>>> Start IP Range:10.10.2.120
>>>>>>>>>> End IP Range: 10.10.2.240
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> CS Traffic Type:Guest
>>>>>>>>>> VmWare Virtual Switch:vSwitch2
>>>>>>>>>> CS Physical Network:PhysNet-guest-1
>>>>>>>>>> Network:10.10.3.0
>>>>>>>>>> Subnet:/24
>>>>>>>>>> Gateway:10.10.3.254
>>>>>>>>>> VLAN TAG: NONE
>>>>>>>>>> Start IP Range:10.10.3.1
>>>>>>>>>> End IP Range: 10.10.3.254
>>>>>>>>>>
>>>>>>>>>> CS Traffic Type:Public
>>>>>>>>>> VmWare Virtual Switch:vSwitch3
>>>>>>>>>> CS Physical Network:PhysNet-public
>>>>>>>>>> Network:10.10.4.0
>>>>>>>>>> Subnet:/24
>>>>>>>>>> Gateway:10.10.4.254
>>>>>>>>>> VLAN TAG: NONE
>>>>>>>>>> Start IP Range:10.10.4.1
>>>>>>>>>> End IP Range: 10.10.4.240
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> vRouter (VPC) System VM - doesn't have a specific route to MS:
>>>>>>>>>>
>>>>>>>>>> root@r-53-VM:~# netstat -nr
>>>>>>>>>> Kernel IP routing table
>>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>>>>>>>> Iface
>>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>>> eth3
>>>>>>>>>> root@r-53-VM:~#
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> CS management server:
>>>>>>>>>>
>>>>>>>>>> [root@cs-1 ~]# netstat -nr
>>>>>>>>>> Kernel IP routing table
>>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>>>>>>>> Iface
>>>>>>>>>> 10.10.10.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>>> eth0
>>>>>>>>>> 169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0
>>>>>>>>>> eth0
>>>>>>>>>> 0.0.0.0 10.10.10.254 0.0.0.0 UG 0 0 0
>>>>>>>>>> eth0
>>>>>>>>>> [root@cs-1 ~]#
>>>>>>>>>>
>>>>>>>>>> Console Proxy System VM:
>>>>>>>>>>
>>>>>>>>>> root@v-50-VM:~# netstat -nr
>>>>>>>>>> Kernel IP routing table
>>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>>>>>>>> Iface
>>>>>>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0 0
>>>>>>>>>> eth1
>>>>>>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0 0
>>>>>>>>>> eth1
>>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>>> eth2
>>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>>> eth1
>>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
>>>>>>>>>> eth1
>>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
>>>>>>>>>> eth2
>>>>>>>>>> root@v-50-VM:~#
>>>>>>>>>>
>>>>>>>>>> vRouter (no VPC- Guest Network) System VM:
>>>>>>>>>>
>>>>>>>>>> root@r-49-VM:~# netstat -nr
>>>>>>>>>> Kernel IP routing table
>>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>>>>>>>> Iface
>>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>>> eth2
>>>>>>>>>> 10.10.3.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>>> eth0
>>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>>> eth1
>>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
>>>>>>>>>> eth1
>>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
>>>>>>>>>> eth2
>>>>>>>>>> root@r-49-VM:~#
>>>>>>>>>>
>>>>>>>>>> Secondary Storage System VM:
>>>>>>>>>>
>>>>>>>>>> root@s-28-VM:~# netstat -nr
>>>>>>>>>> Kernel IP routing table
>>>>>>>>>> Destination Gateway Genmask Flags MSS
>>>>>>>>>> Window irtt Iface
>>>>>>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>>>>>> 0 eth1
>>>>>>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>>>>>> 0 eth1
>>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0
>>>>>>>>>> 0 0 eth2
>>>>>>>>>> 10.10.2.0 0.0.0.0 255.255.255.0 U 0
>>>>>>>>>> 0 0 eth3
>>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0
>>>>>>>>>> 0 0 eth1
>>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0
>>>>>>>>>> 0 eth1
>>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG
>>>>>>>>>> 0 0 0 eth2
>>>>>>>>>> root@s-28-VM:~#
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Thanks,
>>>>>>>>>> Regards.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>
>> ---------------------------------------------------------------------------------------------
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>
>> ---------------------------------------------------------------------------------------------
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>> Date: Mon, 26 Aug 2013 15:19:06 +0100
>>>>>>>>>>> Subject: Re: VPC virtual router fails to start up - no
>> route to CS
>>>>>>>>>> Management Server.
>>>>>>>>>>> From: msweet.dev@gmail.com <javascript:;>
>>>>>>>>>>> To: users@cloudstack.apache.org <javascript:;>
>>>>>>>>>>>
>>>>>>>>>>> Hi,
>>>>>>>>>>>
>>>>>>>>>>> I don't think this has got a response because of the poor
>>>> formatting of
>>>>>>>>>> the
>>>>>>>>>>> log. Please could you attach the log in a separate file and
>> I will
>>>>>>>> take a
>>>>>>>>>>> look?
>>>>>>>>>>> Am I correct in thinking that it is creating the system VM, and
>>>> then
>>>>>>>>>>> destroying it?
>>>>>>>>>>>
>>>>>>>>>>> Thanks,
>>>>>>>>>>> Marty
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> On Sun, Aug 25, 2013 at 11:46 PM, Enrique Ladrón de Guevara
>>>> Hernández <
>>>>>>>>>>> enriquelgh@hotmail.com> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Hi,
>>>>>>>>>>>> I'm carrying out my End of Career Project related to CloudStack
>>>>>>>>>>>> deployment. I got issues when I try to deploy a VPC, the VPC
>>>> virtual
>>>>>>>>>> router
>>>>>>>>>>>> isn't deployed completely and It's destroyed after timeout.
>>>>>>>>>>>> The rest of SSVMs (Console Proxy VM, Storage VM and Guest
>> Network
>>>> VM)
>>>>>>>>>> are
>>>>>>>>>>>> deployed correctly. I can access to the instance console,
>> put into
>>>>>>>> guest
>>>>>>>>>>>> network a instance, connect to it, etc ...
>>>>>>>>>>>> Could you help me to resolve this issue? I don't know
>> which is the
>>>>>>>> thing
>>>>>>>>>>>> that I'm doing wrong ...
>>>>>>>>>>>> This is the context:
>>>>>>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)Num. of
>> Management
>>>>>>>>>> Server:
>>>>>>>>>>>> 1 (under CentOS 6.4) [physical server]. The MS has this network
>>>>>>>>>>>> configuration:IP: 10.10.10.110/24GW: 10.10.10.254DNS server:
>>>>>>>>>>>> 10.10.10.116/24Hypervisor: VMWARE 4.1:2 ESXi hosts:IPs:
>>>> 10.10.1.101 &
>>>>>>>>>>>> .102/24GW: 10.10.1.254vCenter: 10.10.1.100Standard Virtual
>>>> Switches.
>>>>>>>>>>>> Virtual Network Architecture:VmWare Virtual Switch CS Physical
>>>>>>>>>>>> Network Network Subnet Gateway VLAN
>>>>>>>>>>>> TAG CS Traffic Type Start IP Range End IP RangevSwitch0
>>>>>>>>>>>> PhysNet-mgmt-svm 10.10.1.0
>>>>>>>>>>>> 255.255.255.0 10.10.1.254 NONE CS Management 10.10.1.120
>>>>>>>>>>>> 10.10.1.240vSwitch1
>>>>>>>>>>>> PhysNet-storage 10.10.2.0 255.255.255.0 10.10.2.254
>>>>>>>>>>>> NONE Storage 10.10.2.120
>>>>>>>>>>>> 10.10.2.240vSwitch2 PhysNet-guest-1
>>>>>>>>>>>> 10.10.3.0 255.255.255.0 10.10.3.254 NONE
>>>>>>>>>>>> Guest 10.10.3.1 10.10.3.254vSwitch3
>>>>>>>>>>>> PhysNet-public 10.10.4.0
>>>>>>>>>>>> 255.255.255.0 10.10.4.254 NONE Public
>>>>>>>>>>>> 10.10.4.1 10.10.4.240
>>>>>>>>>>>> I log in to ssvm consoles and I can see the following:vRouter
>>>> (VPC)
>>>>>>>>>> System
>>>>>>>>>>>> VM - doesn't have a specific route to MS:root@r-53-VM:~# netstat
>>>>>>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
>>>>>>>>>>>> Flags MSS Window irtt Iface10.10.1.0 0.0.0.0 255.255.255.0
>>>>>>>>>>>> U 0 0 0 eth3root@r-53-VM:~#
>>>>>>>>>>>> CS management server:[root@cs-1 ~]# netstat -nrKernel IP routing
>>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS Window
>>>>>>>>>>>> irtt Iface10.10.10.0 0.0.0.0 255.255.255.0 U 0 0
>>>>>>>>>>>> 0 eth0169.254.0.0 0.0.0.0 255.255.0.0 U 0 0
>>>>>>>>>>>> 0 eth00.0.0.0 10.10.10.254 0.0.0.0 UG 0
>>>>>>>>>>>> 0 0 eth0[root@cs-1 ~]#
>>>>>>>>>>>> Console Proxy System VM:root@v-50-VM:~# netstat -nrKernel IP
>>>> routing
>>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS Window
>>>>>>>>>>>> irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>>>>>>>> 0 eth110.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>>>>>>>> 0 eth110.10.4.0 0.0.0.0 255.255.255.0 U 0
>>>>>>>>>>>> 0 0 eth210.10.1.0 0.0.0.0 255.255.255.0 U
>>>>>>>>>>>> 0 0 0 eth110.10.10.0 10.10.1.254 255.255.255.0 UG
>>>>>>>>>>>> 0 0 0 eth10.0.0.0 10.10.4.254 0.0.0.0 UG
>>>>>>>>>>>> 0 0 0 eth2root@v-50-VM:~#
>>>>>>>>>>>> vRouter (no VPC- Guest Network) System VM:root@r-49-VM:~#
>> netstat
>>>>>>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
>>>>>>>>>>>> Flags MSS Window irtt Iface10.10.4.0 0.0.0.0 255.255.255.0
>>>>>>>>>>>> U 0 0 0 eth210.10.3.0 0.0.0.0
>>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth010.10.1.0 0.0.0.0
>>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0 10.10.1.254
>>>>>>>>>>>> 255.255.255.0 UG 0 0 0 eth10.0.0.0
>>>>>>>>>>>> 10.10.4.254 0.0.0.0 UG 0 0 0 eth2root@r-49-VM
>>>>>>>>>>>> :~#
>>>>>>>>>>>> Secondary Storage System VMroot@s-28-VM:~# netstat -nrKernel IP
>>>>>>>> routing
>>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS
>>>>>>>>>>>> Window irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH
>>>>>>>>>>>> 0 0 0 eth110.10.10.110 10.10.1.254
>>>>>>>>>>>> 255.255.255.255 UGH 0 0 0 eth110.10.4.0
>>>>>>>>>>>> 0.0.0.0 255.255.255.0 U 0 0
>>>>>>>>>>>> 0 eth210.10.2.0 0.0.0.0 255.255.255.0 U
>>>>>>>>>>>> 0 0 0 eth310.10.1.0 0.0.0.0
>>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0
>>>>>>>>>>>> 10.10.1.254 255.255.255.0 UG 0 0 0
>>>>>>>>>>>> eth10.0.0.0 10.10.4.254 0.0.0.0 UG
>>>>>>>>>>>> 0 0 0 eth2root@s-28-VM:~# management-server.log
>>>>>>>>>>>> (filtered by r-53-VM):
>>>>>>>>>>>> [root@cs-1 ~]# g>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
>>>>>>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
>>>> template=domP
>>>>>>>>>> name=r-53-VM
>>>>>>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
>>>>>>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
>>>> disable_rp_filter=true
>>>>>>>>>> extra_pubnics=2
>>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>
>> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}},{"check.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":100,"name":"r-53-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.1.238","
>>>>>>>>>>>> router.name
>>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>
>> ":"r-53-VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbps":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"10.10.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"router.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"10.10.1.238","
>>>>>>>>>>>> router.name
>>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>
>> ":"r-53-VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessDetails":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","
>>>>>>>>>>>> router.name":"r-53-VM"},"wait":0}},{}] }2013-08-25 11:34:48,001
>>>> DEBUG
>>>>>>>>>>>> [agent.transport.Request] (Job-Executor-13:job-11) Seq
>>>> 1-1308430869:
>>>>>>>>>>>> Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags:
>>>>>>>> 100111,
>>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>
>> [{"StartCommand":{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter">>
>>>>>>>>>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
>>>>>>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
>>>> template=domP
>>>>>>>>>> name=r-53-VM
>>>>>>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
>>>>>>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
>>>> disable_rp_filter=true
>>>>>>>>>> extra_pubnics=2
>>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>
>> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":>>
>>>>>>>>>> GNU/Linux 5.0 (32-bit)",
>>>>>>>>
>>>>
RE: VPC virtual router fails to start up - no route to CS
Management Server.
Posted by Enrique Ladrón de Guevara Hernández <en...@hotmail.com>.
Hi,
I don't know why but don't achive to insert the tar file ...
You can download it in this link: http://we.tl/kHJtO3BK3f
Regards.
----------------------------------------
> From: enriquelgh@hotmail.com
> To: users@cloudstack.apache.org
> CC: dev@cloudstack.apache.org
> Subject: RE: VPC virtual router fails to start up - no route to CS Management Server.
> Date: Wed, 4 Sep 2013 00:15:10 +0200
>
> Hi,
>
> Logs and screenshots attached in a tar file.
>
> In my case, the type of the first interface is "Control", as you can see in the screenshots.
>
> @developers, if you need more info let me know.
>
> Thanks to everyone,
> Regards.
>
>
>>> Date: Tue, 3 Sep 2013 08:05:10 +0100
>>> Subject: Re: VPC virtual router fails to start up - no route to CS
>> Management Server.
>>> From: msweet.dev@gmail.com
>>> To: users@cloudstack.apache.org
>>> CC: dev@cloudstack.apache.org
>>>
>>> Hi,
>>>
>>> I couldn't find any screenshots in the string of messages.
>>> Looking at the logs it almost seems as like the VPC is stopping
>>> unexpectedly.
>>>
>>> Looking at my VPC, the first interface is a Link Local for Control type
>>> traffic, which is running on KVM.
>>> I will CC this into the dev mailinglist in search for a developer who knows
>>> more about VMWare and VPCs.
>>>
>>> In the meantime, please could you attach (in a tar), the screenshots of the
>>> VPC interfaces from the cloudstack interfaces.
>>>
>>> Thanks,
>>> Marty
>>>
>>>
>>>
>>>
>>> On Mon, Sep 2, 2013 at 6:28 PM, Enrique Ladrón de Guevara Hernández <
>>> enriquelgh@hotmail.com> wrote:
>>>
>>>> Hi Marty,
>>>>
>>>> Sorry, could you look at the logs and screenshots?? Do you need more info
>>>> to debug the issue??
>>>>
>>>> Do you know if there is a bug related to this scenario??
>>>>
>>>> I try to find any information on Internet and check my config but I don't
>>>> know how to continue go ahead ...
>>>>
>>>> Do you recommend re-installing CS software with other version or the same
>>>> version ....??
>>>>
>>>> Thanks in advanced for your help.
>>>> Regards.
>>>>
>>>>
>>>> ----------------------------------------
>>>>> From: enriquelgh@hotmail.com
>>>>> To: users@cloudstack.apache.org
>>>>> Subject: RE: VPC virtual router fails to start up - no route to CS
>>>> Management Server.
>>>>> Date: Wed, 28 Aug 2013 20:16:26 +0200
>>>>>
>>>>> Now better!
>>>>>
>>>>> Regards.
>>>>>
>>>>> ----------------------------------------
>>>>>> From: enriquelgh@hotmail.com
>>>>>> To: users@cloudstack.apache.org
>>>>>> Subject: RE: VPC virtual router fails to start up - no route to CS
>>>> Management Server.
>>>>>> Date: Wed, 28 Aug 2013 20:09:39 +0200
>>>>>>
>>>>>> Hi Marty,
>>>>>>
>>>>>> I have used a new test to capture screenshots and logs:
>>>>>>
>>>>>> VPC Name: VPC-Test
>>>>>> Job: job-69
>>>>>> vrsm: r-59-VM
>>>>>>
>>>>>> you can find files attached.
>>>>>>
>>>>>> Thanks,
>>>>>> Regards.
>>>>>>
>>>>>> -
>>>>>> ----------------------------------------
>>>>>>> Date: Wed, 28 Aug 2013 10:16:23 +0100
>>>>>>> Subject: Re: VPC virtual router fails to start up - no route to CS
>>>> Management Server.
>>>>>>> From: msweet.dev@gmail.com
>>>>>>> To: users@cloudstack.apache.org
>>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> Could you let me know the IP addresses listed in the cloudstack
>>>> interface
>>>>>>> under Infrastructure> Virtual Routers> VPC
>>>>>>>
>>>>>>> Marty
>>>>>>>
>>>>>>>
>>>>>>> On Tue, Aug 27, 2013 at 11:11 PM, Enrique Ladrón de Guevara
>> Hernández <
>>>>>>> enriquelgh@hotmail.com> wrote:
>>>>>>>
>>>>>>>> Hi Marty,
>>>>>>>>
>>>>>>>> Yes, I have still got this issue ... :S I'm very lost ...
>>>>>>>>
>>>>>>>> Guest Networks are working fine, but in VPC nop ...
>>>>>>>>
>>>>>>>> If you need more info, please let me know.
>>>>>>>>
>>>>>>>> Thanks a lot for your time,
>>>>>>>> Regards.
>>>>>>>>
>>>>>>>>
>>>>>>>> ----------------------------------------
>>>>>>>>> Date: Tue, 27 Aug 2013 22:54:11 +0100
>>>>>>>>> Subject: Re: VPC virtual router fails to start up - no route to CS
>>>>>>>> Management Server.
>>>>>>>>> From: msweet.dev@gmail.com
>>>>>>>>> To: users@cloudstack.apache.org
>>>>>>>>>
>>>>>>>>> Hi Enrique,
>>>>>>>>>
>>>>>>>>> Sorry I haven't got back to you, is this still an issue?
>>>>>>>>> If so, I will take a look at it and get back to you in the morning.
>>>>>>>>>
>>>>>>>>> Thanks,
>>>>>>>>> Marty
>>>>>>>>>
>>>>>>>>> On Monday, August 26, 2013, Enrique Ladrón de Guevara Hernández
>>>> wrote:
>>>>>>>>>
>>>>>>>>>> Hi Marty,
>>>>>>>>>>
>>>>>>>>>> My apologies for the format. I hope this time the email
>> format will
>>>> be
>>>>>>>>>> better. You can find the logs attached.
>>>>>>>>>>
>>>>>>>>>> In this log you can see several VPC deployment tests. One of them
>>>> is:
>>>>>>>>>> - VPC name: VPC-Prueba-1
>>>>>>>>>> - job: job-11
>>>>>>>>>> - ssvm: r-53-VM.
>>>>>>>>>>
>>>>>>>>>> I use GUI to create VPC. The system VM (virutal router) is created
>>>> and I
>>>>>>>>>> can log in by console (VNC or VMWARE console), but after 40 min
>>>> (aprox)
>>>>>>>>>> this SSVM are destroyed because the MS is not able to
>> connect with.
>>>>>>>>>>
>>>>>>>>>> I think the System VM needs default gateway route or static route
>>>> to MS
>>>>>>>>>> server like the rest of SystemVMs (Console, Sec. Storage or Guest
>>>> Net.).
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)
>>>>>>>>>>
>>>>>>>>>> Num. of Management Server: 1 (under CentOS 6.4) [physical server].
>>>>>>>>>>
>>>>>>>>>> The MS has this network configuration: IP: 10.10.10.110/24 GW:
>>>>>>>>>> 10.10.10.254
>>>>>>>>>>
>>>>>>>>>> DNS server:10.10.10.116/24
>>>>>>>>>>
>>>>>>>>>> Hypervisor: VMWARE 4.1 (with Standard Virtual Switches), 2 ESXi
>>>> hosts:
>>>>>>>>>> IPs: 10.10.1.101 & .102/24 GW: 10.10.1.254
>>>>>>>>>>
>>>>>>>>>> vCenter: 10.10.1.100/24.
>>>>>>>>>>
>>>>>>>>>> Virtual Network Architecture:
>>>>>>>>>>
>>>>>>>>>> CS Traffic Type:CS Management
>>>>>>>>>> VmWare Virtual Switch:vSwitch0
>>>>>>>>>> CS Physical Network:PhysNet-mgmt-svm
>>>>>>>>>> Network:10.10.1.0
>>>>>>>>>> Subnet:/24
>>>>>>>>>> Gateway:10.10.1.254
>>>>>>>>>> VLAN TAG: NONE
>>>>>>>>>> Start IP Range:10.10.1.120
>>>>>>>>>> End IP Range: 10.10.1.240
>>>>>>>>>>
>>>>>>>>>> CS Traffic Type: Storage
>>>>>>>>>> VmWare Virtual Switch:vSwitch1
>>>>>>>>>> CS Physical Network:PhysNet-storage
>>>>>>>>>> Network:10.10.2.0
>>>>>>>>>> Subnet:/24
>>>>>>>>>> Gateway:10.10.2.254
>>>>>>>>>> VLAN TAG: NONE
>>>>>>>>>> Start IP Range:10.10.2.120
>>>>>>>>>> End IP Range: 10.10.2.240
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> CS Traffic Type:Guest
>>>>>>>>>> VmWare Virtual Switch:vSwitch2
>>>>>>>>>> CS Physical Network:PhysNet-guest-1
>>>>>>>>>> Network:10.10.3.0
>>>>>>>>>> Subnet:/24
>>>>>>>>>> Gateway:10.10.3.254
>>>>>>>>>> VLAN TAG: NONE
>>>>>>>>>> Start IP Range:10.10.3.1
>>>>>>>>>> End IP Range: 10.10.3.254
>>>>>>>>>>
>>>>>>>>>> CS Traffic Type:Public
>>>>>>>>>> VmWare Virtual Switch:vSwitch3
>>>>>>>>>> CS Physical Network:PhysNet-public
>>>>>>>>>> Network:10.10.4.0
>>>>>>>>>> Subnet:/24
>>>>>>>>>> Gateway:10.10.4.254
>>>>>>>>>> VLAN TAG: NONE
>>>>>>>>>> Start IP Range:10.10.4.1
>>>>>>>>>> End IP Range: 10.10.4.240
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> vRouter (VPC) System VM - doesn't have a specific route to MS:
>>>>>>>>>>
>>>>>>>>>> root@r-53-VM:~# netstat -nr
>>>>>>>>>> Kernel IP routing table
>>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>>>>>>>> Iface
>>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>>> eth3
>>>>>>>>>> root@r-53-VM:~#
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> CS management server:
>>>>>>>>>>
>>>>>>>>>> [root@cs-1 ~]# netstat -nr
>>>>>>>>>> Kernel IP routing table
>>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>>>>>>>> Iface
>>>>>>>>>> 10.10.10.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>>> eth0
>>>>>>>>>> 169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0
>>>>>>>>>> eth0
>>>>>>>>>> 0.0.0.0 10.10.10.254 0.0.0.0 UG 0 0 0
>>>>>>>>>> eth0
>>>>>>>>>> [root@cs-1 ~]#
>>>>>>>>>>
>>>>>>>>>> Console Proxy System VM:
>>>>>>>>>>
>>>>>>>>>> root@v-50-VM:~# netstat -nr
>>>>>>>>>> Kernel IP routing table
>>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>>>>>>>> Iface
>>>>>>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0 0
>>>>>>>>>> eth1
>>>>>>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0 0
>>>>>>>>>> eth1
>>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>>> eth2
>>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>>> eth1
>>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
>>>>>>>>>> eth1
>>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
>>>>>>>>>> eth2
>>>>>>>>>> root@v-50-VM:~#
>>>>>>>>>>
>>>>>>>>>> vRouter (no VPC- Guest Network) System VM:
>>>>>>>>>>
>>>>>>>>>> root@r-49-VM:~# netstat -nr
>>>>>>>>>> Kernel IP routing table
>>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>>>>>>>> Iface
>>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>>> eth2
>>>>>>>>>> 10.10.3.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>>> eth0
>>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>>> eth1
>>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
>>>>>>>>>> eth1
>>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
>>>>>>>>>> eth2
>>>>>>>>>> root@r-49-VM:~#
>>>>>>>>>>
>>>>>>>>>> Secondary Storage System VM:
>>>>>>>>>>
>>>>>>>>>> root@s-28-VM:~# netstat -nr
>>>>>>>>>> Kernel IP routing table
>>>>>>>>>> Destination Gateway Genmask Flags MSS
>>>>>>>>>> Window irtt Iface
>>>>>>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>>>>>> 0 eth1
>>>>>>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>>>>>> 0 eth1
>>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0
>>>>>>>>>> 0 0 eth2
>>>>>>>>>> 10.10.2.0 0.0.0.0 255.255.255.0 U 0
>>>>>>>>>> 0 0 eth3
>>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0
>>>>>>>>>> 0 0 eth1
>>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0
>>>>>>>>>> 0 eth1
>>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG
>>>>>>>>>> 0 0 0 eth2
>>>>>>>>>> root@s-28-VM:~#
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Thanks,
>>>>>>>>>> Regards.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>
>> ---------------------------------------------------------------------------------------------
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>
>> ---------------------------------------------------------------------------------------------
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>> Date: Mon, 26 Aug 2013 15:19:06 +0100
>>>>>>>>>>> Subject: Re: VPC virtual router fails to start up - no
>> route to CS
>>>>>>>>>> Management Server.
>>>>>>>>>>> From: msweet.dev@gmail.com <javascript:;>
>>>>>>>>>>> To: users@cloudstack.apache.org <javascript:;>
>>>>>>>>>>>
>>>>>>>>>>> Hi,
>>>>>>>>>>>
>>>>>>>>>>> I don't think this has got a response because of the poor
>>>> formatting of
>>>>>>>>>> the
>>>>>>>>>>> log. Please could you attach the log in a separate file and
>> I will
>>>>>>>> take a
>>>>>>>>>>> look?
>>>>>>>>>>> Am I correct in thinking that it is creating the system VM, and
>>>> then
>>>>>>>>>>> destroying it?
>>>>>>>>>>>
>>>>>>>>>>> Thanks,
>>>>>>>>>>> Marty
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> On Sun, Aug 25, 2013 at 11:46 PM, Enrique Ladrón de Guevara
>>>> Hernández <
>>>>>>>>>>> enriquelgh@hotmail.com> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Hi,
>>>>>>>>>>>> I'm carrying out my End of Career Project related to CloudStack
>>>>>>>>>>>> deployment. I got issues when I try to deploy a VPC, the VPC
>>>> virtual
>>>>>>>>>> router
>>>>>>>>>>>> isn't deployed completely and It's destroyed after timeout.
>>>>>>>>>>>> The rest of SSVMs (Console Proxy VM, Storage VM and Guest
>> Network
>>>> VM)
>>>>>>>>>> are
>>>>>>>>>>>> deployed correctly. I can access to the instance console,
>> put into
>>>>>>>> guest
>>>>>>>>>>>> network a instance, connect to it, etc ...
>>>>>>>>>>>> Could you help me to resolve this issue? I don't know
>> which is the
>>>>>>>> thing
>>>>>>>>>>>> that I'm doing wrong ...
>>>>>>>>>>>> This is the context:
>>>>>>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)Num. of
>> Management
>>>>>>>>>> Server:
>>>>>>>>>>>> 1 (under CentOS 6.4) [physical server]. The MS has this network
>>>>>>>>>>>> configuration:IP: 10.10.10.110/24GW: 10.10.10.254DNS server:
>>>>>>>>>>>> 10.10.10.116/24Hypervisor: VMWARE 4.1:2 ESXi hosts:IPs:
>>>> 10.10.1.101 &
>>>>>>>>>>>> .102/24GW: 10.10.1.254vCenter: 10.10.1.100Standard Virtual
>>>> Switches.
>>>>>>>>>>>> Virtual Network Architecture:VmWare Virtual Switch CS Physical
>>>>>>>>>>>> Network Network Subnet Gateway VLAN
>>>>>>>>>>>> TAG CS Traffic Type Start IP Range End IP RangevSwitch0
>>>>>>>>>>>> PhysNet-mgmt-svm 10.10.1.0
>>>>>>>>>>>> 255.255.255.0 10.10.1.254 NONE CS Management 10.10.1.120
>>>>>>>>>>>> 10.10.1.240vSwitch1
>>>>>>>>>>>> PhysNet-storage 10.10.2.0 255.255.255.0 10.10.2.254
>>>>>>>>>>>> NONE Storage 10.10.2.120
>>>>>>>>>>>> 10.10.2.240vSwitch2 PhysNet-guest-1
>>>>>>>>>>>> 10.10.3.0 255.255.255.0 10.10.3.254 NONE
>>>>>>>>>>>> Guest 10.10.3.1 10.10.3.254vSwitch3
>>>>>>>>>>>> PhysNet-public 10.10.4.0
>>>>>>>>>>>> 255.255.255.0 10.10.4.254 NONE Public
>>>>>>>>>>>> 10.10.4.1 10.10.4.240
>>>>>>>>>>>> I log in to ssvm consoles and I can see the following:vRouter
>>>> (VPC)
>>>>>>>>>> System
>>>>>>>>>>>> VM - doesn't have a specific route to MS:root@r-53-VM:~# netstat
>>>>>>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
>>>>>>>>>>>> Flags MSS Window irtt Iface10.10.1.0 0.0.0.0 255.255.255.0
>>>>>>>>>>>> U 0 0 0 eth3root@r-53-VM:~#
>>>>>>>>>>>> CS management server:[root@cs-1 ~]# netstat -nrKernel IP routing
>>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS Window
>>>>>>>>>>>> irtt Iface10.10.10.0 0.0.0.0 255.255.255.0 U 0 0
>>>>>>>>>>>> 0 eth0169.254.0.0 0.0.0.0 255.255.0.0 U 0 0
>>>>>>>>>>>> 0 eth00.0.0.0 10.10.10.254 0.0.0.0 UG 0
>>>>>>>>>>>> 0 0 eth0[root@cs-1 ~]#
>>>>>>>>>>>> Console Proxy System VM:root@v-50-VM:~# netstat -nrKernel IP
>>>> routing
>>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS Window
>>>>>>>>>>>> irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>>>>>>>> 0 eth110.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>>>>>>>> 0 eth110.10.4.0 0.0.0.0 255.255.255.0 U 0
>>>>>>>>>>>> 0 0 eth210.10.1.0 0.0.0.0 255.255.255.0 U
>>>>>>>>>>>> 0 0 0 eth110.10.10.0 10.10.1.254 255.255.255.0 UG
>>>>>>>>>>>> 0 0 0 eth10.0.0.0 10.10.4.254 0.0.0.0 UG
>>>>>>>>>>>> 0 0 0 eth2root@v-50-VM:~#
>>>>>>>>>>>> vRouter (no VPC- Guest Network) System VM:root@r-49-VM:~#
>> netstat
>>>>>>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
>>>>>>>>>>>> Flags MSS Window irtt Iface10.10.4.0 0.0.0.0 255.255.255.0
>>>>>>>>>>>> U 0 0 0 eth210.10.3.0 0.0.0.0
>>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth010.10.1.0 0.0.0.0
>>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0 10.10.1.254
>>>>>>>>>>>> 255.255.255.0 UG 0 0 0 eth10.0.0.0
>>>>>>>>>>>> 10.10.4.254 0.0.0.0 UG 0 0 0 eth2root@r-49-VM
>>>>>>>>>>>> :~#
>>>>>>>>>>>> Secondary Storage System VMroot@s-28-VM:~# netstat -nrKernel IP
>>>>>>>> routing
>>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS
>>>>>>>>>>>> Window irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH
>>>>>>>>>>>> 0 0 0 eth110.10.10.110 10.10.1.254
>>>>>>>>>>>> 255.255.255.255 UGH 0 0 0 eth110.10.4.0
>>>>>>>>>>>> 0.0.0.0 255.255.255.0 U 0 0
>>>>>>>>>>>> 0 eth210.10.2.0 0.0.0.0 255.255.255.0 U
>>>>>>>>>>>> 0 0 0 eth310.10.1.0 0.0.0.0
>>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0
>>>>>>>>>>>> 10.10.1.254 255.255.255.0 UG 0 0 0
>>>>>>>>>>>> eth10.0.0.0 10.10.4.254 0.0.0.0 UG
>>>>>>>>>>>> 0 0 0 eth2root@s-28-VM:~# management-server.log
>>>>>>>>>>>> (filtered by r-53-VM):
>>>>>>>>>>>> [root@cs-1 ~]# g>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
>>>>>>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
>>>> template=domP
>>>>>>>>>> name=r-53-VM
>>>>>>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
>>>>>>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
>>>> disable_rp_filter=true
>>>>>>>>>> extra_pubnics=2
>>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>
>> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}},{"check.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":100,"name":"r-53-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.1.238","
>>>>>>>>>>>> router.name
>>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>
>> ":"r-53-VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbps":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"10.10.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"router.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"10.10.1.238","
>>>>>>>>>>>> router.name
>>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>
>> ":"r-53-VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessDetails":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","
>>>>>>>>>>>> router.name":"r-53-VM"},"wait":0}},{}] }2013-08-25 11:34:48,001
>>>> DEBUG
>>>>>>>>>>>> [agent.transport.Request] (Job-Executor-13:job-11) Seq
>>>> 1-1308430869:
>>>>>>>>>>>> Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags:
>>>>>>>> 100111,
>>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>
>> [{"StartCommand":{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter">>
>>>>>>>>>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
>>>>>>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
>>>> template=domP
>>>>>>>>>> name=r-53-VM
>>>>>>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
>>>>>>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
>>>> disable_rp_filter=true
>>>>>>>>>> extra_pubnics=2
>>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>
>>>>
>> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":>>
>>>>>>>>>> GNU/Linux 5.0 (32-bit)",
>>>>>>>>
>>>>
RE: VPC virtual router fails to start up - no route to CS
Management Server.
Posted by Enrique Ladrón de Guevara Hernández <en...@hotmail.com>.
Hi,
Logs and screenshots attached in a tar file.
In my case, the type of the first interface is "Control", as you can see in the screenshots.
@developers, if you need more info let me know.
Thanks to everyone,
Regards.
>> Date: Tue, 3 Sep 2013 08:05:10 +0100
>> Subject: Re: VPC virtual router fails to start up - no route to CS
> Management Server.
>> From: msweet.dev@gmail.com
>> To: users@cloudstack.apache.org
>> CC: dev@cloudstack.apache.org
>>
>> Hi,
>>
>> I couldn't find any screenshots in the string of messages.
>> Looking at the logs it almost seems as like the VPC is stopping
>> unexpectedly.
>>
>> Looking at my VPC, the first interface is a Link Local for Control type
>> traffic, which is running on KVM.
>> I will CC this into the dev mailinglist in search for a developer who knows
>> more about VMWare and VPCs.
>>
>> In the meantime, please could you attach (in a tar), the screenshots of the
>> VPC interfaces from the cloudstack interfaces.
>>
>> Thanks,
>> Marty
>>
>>
>>
>>
>> On Mon, Sep 2, 2013 at 6:28 PM, Enrique Ladrón de Guevara Hernández <
>> enriquelgh@hotmail.com> wrote:
>>
>>> Hi Marty,
>>>
>>> Sorry, could you look at the logs and screenshots?? Do you need more info
>>> to debug the issue??
>>>
>>> Do you know if there is a bug related to this scenario??
>>>
>>> I try to find any information on Internet and check my config but I don't
>>> know how to continue go ahead ...
>>>
>>> Do you recommend re-installing CS software with other version or the same
>>> version ....??
>>>
>>> Thanks in advanced for your help.
>>> Regards.
>>>
>>>
>>> ----------------------------------------
>>>> From: enriquelgh@hotmail.com
>>>> To: users@cloudstack.apache.org
>>>> Subject: RE: VPC virtual router fails to start up - no route to CS
>>> Management Server.
>>>> Date: Wed, 28 Aug 2013 20:16:26 +0200
>>>>
>>>> Now better!
>>>>
>>>> Regards.
>>>>
>>>> ----------------------------------------
>>>>> From: enriquelgh@hotmail.com
>>>>> To: users@cloudstack.apache.org
>>>>> Subject: RE: VPC virtual router fails to start up - no route to CS
>>> Management Server.
>>>>> Date: Wed, 28 Aug 2013 20:09:39 +0200
>>>>>
>>>>> Hi Marty,
>>>>>
>>>>> I have used a new test to capture screenshots and logs:
>>>>>
>>>>> VPC Name: VPC-Test
>>>>> Job: job-69
>>>>> vrsm: r-59-VM
>>>>>
>>>>> you can find files attached.
>>>>>
>>>>> Thanks,
>>>>> Regards.
>>>>>
>>>>> -
>>>>> ----------------------------------------
>>>>>> Date: Wed, 28 Aug 2013 10:16:23 +0100
>>>>>> Subject: Re: VPC virtual router fails to start up - no route to CS
>>> Management Server.
>>>>>> From: msweet.dev@gmail.com
>>>>>> To: users@cloudstack.apache.org
>>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> Could you let me know the IP addresses listed in the cloudstack
>>> interface
>>>>>> under Infrastructure> Virtual Routers> VPC
>>>>>>
>>>>>> Marty
>>>>>>
>>>>>>
>>>>>> On Tue, Aug 27, 2013 at 11:11 PM, Enrique Ladrón de Guevara
> Hernández <
>>>>>> enriquelgh@hotmail.com> wrote:
>>>>>>
>>>>>>> Hi Marty,
>>>>>>>
>>>>>>> Yes, I have still got this issue ... :S I'm very lost ...
>>>>>>>
>>>>>>> Guest Networks are working fine, but in VPC nop ...
>>>>>>>
>>>>>>> If you need more info, please let me know.
>>>>>>>
>>>>>>> Thanks a lot for your time,
>>>>>>> Regards.
>>>>>>>
>>>>>>>
>>>>>>> ----------------------------------------
>>>>>>>> Date: Tue, 27 Aug 2013 22:54:11 +0100
>>>>>>>> Subject: Re: VPC virtual router fails to start up - no route to CS
>>>>>>> Management Server.
>>>>>>>> From: msweet.dev@gmail.com
>>>>>>>> To: users@cloudstack.apache.org
>>>>>>>>
>>>>>>>> Hi Enrique,
>>>>>>>>
>>>>>>>> Sorry I haven't got back to you, is this still an issue?
>>>>>>>> If so, I will take a look at it and get back to you in the morning.
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Marty
>>>>>>>>
>>>>>>>> On Monday, August 26, 2013, Enrique Ladrón de Guevara Hernández
>>> wrote:
>>>>>>>>
>>>>>>>>> Hi Marty,
>>>>>>>>>
>>>>>>>>> My apologies for the format. I hope this time the email
> format will
>>> be
>>>>>>>>> better. You can find the logs attached.
>>>>>>>>>
>>>>>>>>> In this log you can see several VPC deployment tests. One of them
>>> is:
>>>>>>>>> - VPC name: VPC-Prueba-1
>>>>>>>>> - job: job-11
>>>>>>>>> - ssvm: r-53-VM.
>>>>>>>>>
>>>>>>>>> I use GUI to create VPC. The system VM (virutal router) is created
>>> and I
>>>>>>>>> can log in by console (VNC or VMWARE console), but after 40 min
>>> (aprox)
>>>>>>>>> this SSVM are destroyed because the MS is not able to
> connect with.
>>>>>>>>>
>>>>>>>>> I think the System VM needs default gateway route or static route
>>> to MS
>>>>>>>>> server like the rest of SystemVMs (Console, Sec. Storage or Guest
>>> Net.).
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)
>>>>>>>>>
>>>>>>>>> Num. of Management Server: 1 (under CentOS 6.4) [physical server].
>>>>>>>>>
>>>>>>>>> The MS has this network configuration: IP: 10.10.10.110/24 GW:
>>>>>>>>> 10.10.10.254
>>>>>>>>>
>>>>>>>>> DNS server:10.10.10.116/24
>>>>>>>>>
>>>>>>>>> Hypervisor: VMWARE 4.1 (with Standard Virtual Switches), 2 ESXi
>>> hosts:
>>>>>>>>> IPs: 10.10.1.101 & .102/24 GW: 10.10.1.254
>>>>>>>>>
>>>>>>>>> vCenter: 10.10.1.100/24.
>>>>>>>>>
>>>>>>>>> Virtual Network Architecture:
>>>>>>>>>
>>>>>>>>> CS Traffic Type:CS Management
>>>>>>>>> VmWare Virtual Switch:vSwitch0
>>>>>>>>> CS Physical Network:PhysNet-mgmt-svm
>>>>>>>>> Network:10.10.1.0
>>>>>>>>> Subnet:/24
>>>>>>>>> Gateway:10.10.1.254
>>>>>>>>> VLAN TAG: NONE
>>>>>>>>> Start IP Range:10.10.1.120
>>>>>>>>> End IP Range: 10.10.1.240
>>>>>>>>>
>>>>>>>>> CS Traffic Type: Storage
>>>>>>>>> VmWare Virtual Switch:vSwitch1
>>>>>>>>> CS Physical Network:PhysNet-storage
>>>>>>>>> Network:10.10.2.0
>>>>>>>>> Subnet:/24
>>>>>>>>> Gateway:10.10.2.254
>>>>>>>>> VLAN TAG: NONE
>>>>>>>>> Start IP Range:10.10.2.120
>>>>>>>>> End IP Range: 10.10.2.240
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> CS Traffic Type:Guest
>>>>>>>>> VmWare Virtual Switch:vSwitch2
>>>>>>>>> CS Physical Network:PhysNet-guest-1
>>>>>>>>> Network:10.10.3.0
>>>>>>>>> Subnet:/24
>>>>>>>>> Gateway:10.10.3.254
>>>>>>>>> VLAN TAG: NONE
>>>>>>>>> Start IP Range:10.10.3.1
>>>>>>>>> End IP Range: 10.10.3.254
>>>>>>>>>
>>>>>>>>> CS Traffic Type:Public
>>>>>>>>> VmWare Virtual Switch:vSwitch3
>>>>>>>>> CS Physical Network:PhysNet-public
>>>>>>>>> Network:10.10.4.0
>>>>>>>>> Subnet:/24
>>>>>>>>> Gateway:10.10.4.254
>>>>>>>>> VLAN TAG: NONE
>>>>>>>>> Start IP Range:10.10.4.1
>>>>>>>>> End IP Range: 10.10.4.240
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> vRouter (VPC) System VM - doesn't have a specific route to MS:
>>>>>>>>>
>>>>>>>>> root@r-53-VM:~# netstat -nr
>>>>>>>>> Kernel IP routing table
>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>>>>>>> Iface
>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>> eth3
>>>>>>>>> root@r-53-VM:~#
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> CS management server:
>>>>>>>>>
>>>>>>>>> [root@cs-1 ~]# netstat -nr
>>>>>>>>> Kernel IP routing table
>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>>>>>>> Iface
>>>>>>>>> 10.10.10.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>> eth0
>>>>>>>>> 169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0
>>>>>>>>> eth0
>>>>>>>>> 0.0.0.0 10.10.10.254 0.0.0.0 UG 0 0 0
>>>>>>>>> eth0
>>>>>>>>> [root@cs-1 ~]#
>>>>>>>>>
>>>>>>>>> Console Proxy System VM:
>>>>>>>>>
>>>>>>>>> root@v-50-VM:~# netstat -nr
>>>>>>>>> Kernel IP routing table
>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>>>>>>> Iface
>>>>>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0 0
>>>>>>>>> eth1
>>>>>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0 0
>>>>>>>>> eth1
>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>> eth2
>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>> eth1
>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
>>>>>>>>> eth1
>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
>>>>>>>>> eth2
>>>>>>>>> root@v-50-VM:~#
>>>>>>>>>
>>>>>>>>> vRouter (no VPC- Guest Network) System VM:
>>>>>>>>>
>>>>>>>>> root@r-49-VM:~# netstat -nr
>>>>>>>>> Kernel IP routing table
>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>>>>>>> Iface
>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>> eth2
>>>>>>>>> 10.10.3.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>> eth0
>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>> eth1
>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
>>>>>>>>> eth1
>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
>>>>>>>>> eth2
>>>>>>>>> root@r-49-VM:~#
>>>>>>>>>
>>>>>>>>> Secondary Storage System VM:
>>>>>>>>>
>>>>>>>>> root@s-28-VM:~# netstat -nr
>>>>>>>>> Kernel IP routing table
>>>>>>>>> Destination Gateway Genmask Flags MSS
>>>>>>>>> Window irtt Iface
>>>>>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>>>>> 0 eth1
>>>>>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>>>>> 0 eth1
>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0
>>>>>>>>> 0 0 eth2
>>>>>>>>> 10.10.2.0 0.0.0.0 255.255.255.0 U 0
>>>>>>>>> 0 0 eth3
>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0
>>>>>>>>> 0 0 eth1
>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0
>>>>>>>>> 0 eth1
>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG
>>>>>>>>> 0 0 0 eth2
>>>>>>>>> root@s-28-VM:~#
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Thanks,
>>>>>>>>> Regards.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>
>>>
> ---------------------------------------------------------------------------------------------
>>>>>>>>>
>>>>>>>>>
>>>>>>>
>>>
> ---------------------------------------------------------------------------------------------
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>> Date: Mon, 26 Aug 2013 15:19:06 +0100
>>>>>>>>>> Subject: Re: VPC virtual router fails to start up - no
> route to CS
>>>>>>>>> Management Server.
>>>>>>>>>> From: msweet.dev@gmail.com <javascript:;>
>>>>>>>>>> To: users@cloudstack.apache.org <javascript:;>
>>>>>>>>>>
>>>>>>>>>> Hi,
>>>>>>>>>>
>>>>>>>>>> I don't think this has got a response because of the poor
>>> formatting of
>>>>>>>>> the
>>>>>>>>>> log. Please could you attach the log in a separate file and
> I will
>>>>>>> take a
>>>>>>>>>> look?
>>>>>>>>>> Am I correct in thinking that it is creating the system VM, and
>>> then
>>>>>>>>>> destroying it?
>>>>>>>>>>
>>>>>>>>>> Thanks,
>>>>>>>>>> Marty
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> On Sun, Aug 25, 2013 at 11:46 PM, Enrique Ladrón de Guevara
>>> Hernández <
>>>>>>>>>> enriquelgh@hotmail.com> wrote:
>>>>>>>>>>
>>>>>>>>>>> Hi,
>>>>>>>>>>> I'm carrying out my End of Career Project related to CloudStack
>>>>>>>>>>> deployment. I got issues when I try to deploy a VPC, the VPC
>>> virtual
>>>>>>>>> router
>>>>>>>>>>> isn't deployed completely and It's destroyed after timeout.
>>>>>>>>>>> The rest of SSVMs (Console Proxy VM, Storage VM and Guest
> Network
>>> VM)
>>>>>>>>> are
>>>>>>>>>>> deployed correctly. I can access to the instance console,
> put into
>>>>>>> guest
>>>>>>>>>>> network a instance, connect to it, etc ...
>>>>>>>>>>> Could you help me to resolve this issue? I don't know
> which is the
>>>>>>> thing
>>>>>>>>>>> that I'm doing wrong ...
>>>>>>>>>>> This is the context:
>>>>>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)Num. of
> Management
>>>>>>>>> Server:
>>>>>>>>>>> 1 (under CentOS 6.4) [physical server]. The MS has this network
>>>>>>>>>>> configuration:IP: 10.10.10.110/24GW: 10.10.10.254DNS server:
>>>>>>>>>>> 10.10.10.116/24Hypervisor: VMWARE 4.1:2 ESXi hosts:IPs:
>>> 10.10.1.101 &
>>>>>>>>>>> .102/24GW: 10.10.1.254vCenter: 10.10.1.100Standard Virtual
>>> Switches.
>>>>>>>>>>> Virtual Network Architecture:VmWare Virtual Switch CS Physical
>>>>>>>>>>> Network Network Subnet Gateway VLAN
>>>>>>>>>>> TAG CS Traffic Type Start IP Range End IP RangevSwitch0
>>>>>>>>>>> PhysNet-mgmt-svm 10.10.1.0
>>>>>>>>>>> 255.255.255.0 10.10.1.254 NONE CS Management 10.10.1.120
>>>>>>>>>>> 10.10.1.240vSwitch1
>>>>>>>>>>> PhysNet-storage 10.10.2.0 255.255.255.0 10.10.2.254
>>>>>>>>>>> NONE Storage 10.10.2.120
>>>>>>>>>>> 10.10.2.240vSwitch2 PhysNet-guest-1
>>>>>>>>>>> 10.10.3.0 255.255.255.0 10.10.3.254 NONE
>>>>>>>>>>> Guest 10.10.3.1 10.10.3.254vSwitch3
>>>>>>>>>>> PhysNet-public 10.10.4.0
>>>>>>>>>>> 255.255.255.0 10.10.4.254 NONE Public
>>>>>>>>>>> 10.10.4.1 10.10.4.240
>>>>>>>>>>> I log in to ssvm consoles and I can see the following:vRouter
>>> (VPC)
>>>>>>>>> System
>>>>>>>>>>> VM - doesn't have a specific route to MS:root@r-53-VM:~# netstat
>>>>>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
>>>>>>>>>>> Flags MSS Window irtt Iface10.10.1.0 0.0.0.0 255.255.255.0
>>>>>>>>>>> U 0 0 0 eth3root@r-53-VM:~#
>>>>>>>>>>> CS management server:[root@cs-1 ~]# netstat -nrKernel IP routing
>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS Window
>>>>>>>>>>> irtt Iface10.10.10.0 0.0.0.0 255.255.255.0 U 0 0
>>>>>>>>>>> 0 eth0169.254.0.0 0.0.0.0 255.255.0.0 U 0 0
>>>>>>>>>>> 0 eth00.0.0.0 10.10.10.254 0.0.0.0 UG 0
>>>>>>>>>>> 0 0 eth0[root@cs-1 ~]#
>>>>>>>>>>> Console Proxy System VM:root@v-50-VM:~# netstat -nrKernel IP
>>> routing
>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS Window
>>>>>>>>>>> irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>>>>>>> 0 eth110.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>>>>>>> 0 eth110.10.4.0 0.0.0.0 255.255.255.0 U 0
>>>>>>>>>>> 0 0 eth210.10.1.0 0.0.0.0 255.255.255.0 U
>>>>>>>>>>> 0 0 0 eth110.10.10.0 10.10.1.254 255.255.255.0 UG
>>>>>>>>>>> 0 0 0 eth10.0.0.0 10.10.4.254 0.0.0.0 UG
>>>>>>>>>>> 0 0 0 eth2root@v-50-VM:~#
>>>>>>>>>>> vRouter (no VPC- Guest Network) System VM:root@r-49-VM:~#
> netstat
>>>>>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
>>>>>>>>>>> Flags MSS Window irtt Iface10.10.4.0 0.0.0.0 255.255.255.0
>>>>>>>>>>> U 0 0 0 eth210.10.3.0 0.0.0.0
>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth010.10.1.0 0.0.0.0
>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0 10.10.1.254
>>>>>>>>>>> 255.255.255.0 UG 0 0 0 eth10.0.0.0
>>>>>>>>>>> 10.10.4.254 0.0.0.0 UG 0 0 0 eth2root@r-49-VM
>>>>>>>>>>> :~#
>>>>>>>>>>> Secondary Storage System VMroot@s-28-VM:~# netstat -nrKernel IP
>>>>>>> routing
>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS
>>>>>>>>>>> Window irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH
>>>>>>>>>>> 0 0 0 eth110.10.10.110 10.10.1.254
>>>>>>>>>>> 255.255.255.255 UGH 0 0 0 eth110.10.4.0
>>>>>>>>>>> 0.0.0.0 255.255.255.0 U 0 0
>>>>>>>>>>> 0 eth210.10.2.0 0.0.0.0 255.255.255.0 U
>>>>>>>>>>> 0 0 0 eth310.10.1.0 0.0.0.0
>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0
>>>>>>>>>>> 10.10.1.254 255.255.255.0 UG 0 0 0
>>>>>>>>>>> eth10.0.0.0 10.10.4.254 0.0.0.0 UG
>>>>>>>>>>> 0 0 0 eth2root@s-28-VM:~# management-server.log
>>>>>>>>>>> (filtered by r-53-VM):
>>>>>>>>>>> [root@cs-1 ~]# g>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
>>>>>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
>>> template=domP
>>>>>>>>> name=r-53-VM
>>>>>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
>>>>>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
>>> disable_rp_filter=true
>>>>>>>>> extra_pubnics=2
>>>>>>>>>>>
>>>>>>>>>
>>>>>>>
>>>
> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}},{"check.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":100,"name":"r-53-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.1.238","
>>>>>>>>>>> router.name
>>>>>>>>>>>
>>>>>>>>>
>>>>>>>
>>>
> ":"r-53-VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbps":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"10.10.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"router.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"10.10.1.238","
>>>>>>>>>>> router.name
>>>>>>>>>>>
>>>>>>>>>
>>>>>>>
>>>
> ":"r-53-VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessDetails":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","
>>>>>>>>>>> router.name":"r-53-VM"},"wait":0}},{}] }2013-08-25 11:34:48,001
>>> DEBUG
>>>>>>>>>>> [agent.transport.Request] (Job-Executor-13:job-11) Seq
>>> 1-1308430869:
>>>>>>>>>>> Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags:
>>>>>>> 100111,
>>>>>>>>>>>
>>>>>>>>>
>>>>>>>
>>>
> [{"StartCommand":{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter">>
>>>>>>>>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
>>>>>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
>>> template=domP
>>>>>>>>> name=r-53-VM
>>>>>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
>>>>>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
>>> disable_rp_filter=true
>>>>>>>>> extra_pubnics=2
>>>>>>>>>>>
>>>>>>>>>
>>>>>>>
>>>
> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":>>
>>>>>>>>> GNU/Linux 5.0 (32-bit)",
>>>>>>>
>>>
RE: VPC virtual router fails to start up - no route to CS
Management Server.
Posted by Enrique Ladrón de Guevara Hernández <en...@hotmail.com>.
Hi,
Logs and screenshots attached in a tar file.
In my case, the type of the first interface is "Control", as you can see in the screenshots.
@developers, if you need more info let me know.
Thanks to everyone,
Regards.
>> Date: Tue, 3 Sep 2013 08:05:10 +0100
>> Subject: Re: VPC virtual router fails to start up - no route to CS
> Management Server.
>> From: msweet.dev@gmail.com
>> To: users@cloudstack.apache.org
>> CC: dev@cloudstack.apache.org
>>
>> Hi,
>>
>> I couldn't find any screenshots in the string of messages.
>> Looking at the logs it almost seems as like the VPC is stopping
>> unexpectedly.
>>
>> Looking at my VPC, the first interface is a Link Local for Control type
>> traffic, which is running on KVM.
>> I will CC this into the dev mailinglist in search for a developer who knows
>> more about VMWare and VPCs.
>>
>> In the meantime, please could you attach (in a tar), the screenshots of the
>> VPC interfaces from the cloudstack interfaces.
>>
>> Thanks,
>> Marty
>>
>>
>>
>>
>> On Mon, Sep 2, 2013 at 6:28 PM, Enrique Ladrón de Guevara Hernández <
>> enriquelgh@hotmail.com> wrote:
>>
>>> Hi Marty,
>>>
>>> Sorry, could you look at the logs and screenshots?? Do you need more info
>>> to debug the issue??
>>>
>>> Do you know if there is a bug related to this scenario??
>>>
>>> I try to find any information on Internet and check my config but I don't
>>> know how to continue go ahead ...
>>>
>>> Do you recommend re-installing CS software with other version or the same
>>> version ....??
>>>
>>> Thanks in advanced for your help.
>>> Regards.
>>>
>>>
>>> ----------------------------------------
>>>> From: enriquelgh@hotmail.com
>>>> To: users@cloudstack.apache.org
>>>> Subject: RE: VPC virtual router fails to start up - no route to CS
>>> Management Server.
>>>> Date: Wed, 28 Aug 2013 20:16:26 +0200
>>>>
>>>> Now better!
>>>>
>>>> Regards.
>>>>
>>>> ----------------------------------------
>>>>> From: enriquelgh@hotmail.com
>>>>> To: users@cloudstack.apache.org
>>>>> Subject: RE: VPC virtual router fails to start up - no route to CS
>>> Management Server.
>>>>> Date: Wed, 28 Aug 2013 20:09:39 +0200
>>>>>
>>>>> Hi Marty,
>>>>>
>>>>> I have used a new test to capture screenshots and logs:
>>>>>
>>>>> VPC Name: VPC-Test
>>>>> Job: job-69
>>>>> vrsm: r-59-VM
>>>>>
>>>>> you can find files attached.
>>>>>
>>>>> Thanks,
>>>>> Regards.
>>>>>
>>>>> -
>>>>> ----------------------------------------
>>>>>> Date: Wed, 28 Aug 2013 10:16:23 +0100
>>>>>> Subject: Re: VPC virtual router fails to start up - no route to CS
>>> Management Server.
>>>>>> From: msweet.dev@gmail.com
>>>>>> To: users@cloudstack.apache.org
>>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> Could you let me know the IP addresses listed in the cloudstack
>>> interface
>>>>>> under Infrastructure> Virtual Routers> VPC
>>>>>>
>>>>>> Marty
>>>>>>
>>>>>>
>>>>>> On Tue, Aug 27, 2013 at 11:11 PM, Enrique Ladrón de Guevara
> Hernández <
>>>>>> enriquelgh@hotmail.com> wrote:
>>>>>>
>>>>>>> Hi Marty,
>>>>>>>
>>>>>>> Yes, I have still got this issue ... :S I'm very lost ...
>>>>>>>
>>>>>>> Guest Networks are working fine, but in VPC nop ...
>>>>>>>
>>>>>>> If you need more info, please let me know.
>>>>>>>
>>>>>>> Thanks a lot for your time,
>>>>>>> Regards.
>>>>>>>
>>>>>>>
>>>>>>> ----------------------------------------
>>>>>>>> Date: Tue, 27 Aug 2013 22:54:11 +0100
>>>>>>>> Subject: Re: VPC virtual router fails to start up - no route to CS
>>>>>>> Management Server.
>>>>>>>> From: msweet.dev@gmail.com
>>>>>>>> To: users@cloudstack.apache.org
>>>>>>>>
>>>>>>>> Hi Enrique,
>>>>>>>>
>>>>>>>> Sorry I haven't got back to you, is this still an issue?
>>>>>>>> If so, I will take a look at it and get back to you in the morning.
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Marty
>>>>>>>>
>>>>>>>> On Monday, August 26, 2013, Enrique Ladrón de Guevara Hernández
>>> wrote:
>>>>>>>>
>>>>>>>>> Hi Marty,
>>>>>>>>>
>>>>>>>>> My apologies for the format. I hope this time the email
> format will
>>> be
>>>>>>>>> better. You can find the logs attached.
>>>>>>>>>
>>>>>>>>> In this log you can see several VPC deployment tests. One of them
>>> is:
>>>>>>>>> - VPC name: VPC-Prueba-1
>>>>>>>>> - job: job-11
>>>>>>>>> - ssvm: r-53-VM.
>>>>>>>>>
>>>>>>>>> I use GUI to create VPC. The system VM (virutal router) is created
>>> and I
>>>>>>>>> can log in by console (VNC or VMWARE console), but after 40 min
>>> (aprox)
>>>>>>>>> this SSVM are destroyed because the MS is not able to
> connect with.
>>>>>>>>>
>>>>>>>>> I think the System VM needs default gateway route or static route
>>> to MS
>>>>>>>>> server like the rest of SystemVMs (Console, Sec. Storage or Guest
>>> Net.).
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)
>>>>>>>>>
>>>>>>>>> Num. of Management Server: 1 (under CentOS 6.4) [physical server].
>>>>>>>>>
>>>>>>>>> The MS has this network configuration: IP: 10.10.10.110/24 GW:
>>>>>>>>> 10.10.10.254
>>>>>>>>>
>>>>>>>>> DNS server:10.10.10.116/24
>>>>>>>>>
>>>>>>>>> Hypervisor: VMWARE 4.1 (with Standard Virtual Switches), 2 ESXi
>>> hosts:
>>>>>>>>> IPs: 10.10.1.101 & .102/24 GW: 10.10.1.254
>>>>>>>>>
>>>>>>>>> vCenter: 10.10.1.100/24.
>>>>>>>>>
>>>>>>>>> Virtual Network Architecture:
>>>>>>>>>
>>>>>>>>> CS Traffic Type:CS Management
>>>>>>>>> VmWare Virtual Switch:vSwitch0
>>>>>>>>> CS Physical Network:PhysNet-mgmt-svm
>>>>>>>>> Network:10.10.1.0
>>>>>>>>> Subnet:/24
>>>>>>>>> Gateway:10.10.1.254
>>>>>>>>> VLAN TAG: NONE
>>>>>>>>> Start IP Range:10.10.1.120
>>>>>>>>> End IP Range: 10.10.1.240
>>>>>>>>>
>>>>>>>>> CS Traffic Type: Storage
>>>>>>>>> VmWare Virtual Switch:vSwitch1
>>>>>>>>> CS Physical Network:PhysNet-storage
>>>>>>>>> Network:10.10.2.0
>>>>>>>>> Subnet:/24
>>>>>>>>> Gateway:10.10.2.254
>>>>>>>>> VLAN TAG: NONE
>>>>>>>>> Start IP Range:10.10.2.120
>>>>>>>>> End IP Range: 10.10.2.240
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> CS Traffic Type:Guest
>>>>>>>>> VmWare Virtual Switch:vSwitch2
>>>>>>>>> CS Physical Network:PhysNet-guest-1
>>>>>>>>> Network:10.10.3.0
>>>>>>>>> Subnet:/24
>>>>>>>>> Gateway:10.10.3.254
>>>>>>>>> VLAN TAG: NONE
>>>>>>>>> Start IP Range:10.10.3.1
>>>>>>>>> End IP Range: 10.10.3.254
>>>>>>>>>
>>>>>>>>> CS Traffic Type:Public
>>>>>>>>> VmWare Virtual Switch:vSwitch3
>>>>>>>>> CS Physical Network:PhysNet-public
>>>>>>>>> Network:10.10.4.0
>>>>>>>>> Subnet:/24
>>>>>>>>> Gateway:10.10.4.254
>>>>>>>>> VLAN TAG: NONE
>>>>>>>>> Start IP Range:10.10.4.1
>>>>>>>>> End IP Range: 10.10.4.240
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> vRouter (VPC) System VM - doesn't have a specific route to MS:
>>>>>>>>>
>>>>>>>>> root@r-53-VM:~# netstat -nr
>>>>>>>>> Kernel IP routing table
>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>>>>>>> Iface
>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>> eth3
>>>>>>>>> root@r-53-VM:~#
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> CS management server:
>>>>>>>>>
>>>>>>>>> [root@cs-1 ~]# netstat -nr
>>>>>>>>> Kernel IP routing table
>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>>>>>>> Iface
>>>>>>>>> 10.10.10.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>> eth0
>>>>>>>>> 169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0
>>>>>>>>> eth0
>>>>>>>>> 0.0.0.0 10.10.10.254 0.0.0.0 UG 0 0 0
>>>>>>>>> eth0
>>>>>>>>> [root@cs-1 ~]#
>>>>>>>>>
>>>>>>>>> Console Proxy System VM:
>>>>>>>>>
>>>>>>>>> root@v-50-VM:~# netstat -nr
>>>>>>>>> Kernel IP routing table
>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>>>>>>> Iface
>>>>>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0 0
>>>>>>>>> eth1
>>>>>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0 0
>>>>>>>>> eth1
>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>> eth2
>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>> eth1
>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
>>>>>>>>> eth1
>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
>>>>>>>>> eth2
>>>>>>>>> root@v-50-VM:~#
>>>>>>>>>
>>>>>>>>> vRouter (no VPC- Guest Network) System VM:
>>>>>>>>>
>>>>>>>>> root@r-49-VM:~# netstat -nr
>>>>>>>>> Kernel IP routing table
>>>>>>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>>>>>>> Iface
>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>> eth2
>>>>>>>>> 10.10.3.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>> eth0
>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>>>>> eth1
>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
>>>>>>>>> eth1
>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
>>>>>>>>> eth2
>>>>>>>>> root@r-49-VM:~#
>>>>>>>>>
>>>>>>>>> Secondary Storage System VM:
>>>>>>>>>
>>>>>>>>> root@s-28-VM:~# netstat -nr
>>>>>>>>> Kernel IP routing table
>>>>>>>>> Destination Gateway Genmask Flags MSS
>>>>>>>>> Window irtt Iface
>>>>>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>>>>> 0 eth1
>>>>>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>>>>> 0 eth1
>>>>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0
>>>>>>>>> 0 0 eth2
>>>>>>>>> 10.10.2.0 0.0.0.0 255.255.255.0 U 0
>>>>>>>>> 0 0 eth3
>>>>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0
>>>>>>>>> 0 0 eth1
>>>>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0
>>>>>>>>> 0 eth1
>>>>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG
>>>>>>>>> 0 0 0 eth2
>>>>>>>>> root@s-28-VM:~#
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Thanks,
>>>>>>>>> Regards.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>
>>>
> ---------------------------------------------------------------------------------------------
>>>>>>>>>
>>>>>>>>>
>>>>>>>
>>>
> ---------------------------------------------------------------------------------------------
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>> Date: Mon, 26 Aug 2013 15:19:06 +0100
>>>>>>>>>> Subject: Re: VPC virtual router fails to start up - no
> route to CS
>>>>>>>>> Management Server.
>>>>>>>>>> From: msweet.dev@gmail.com <javascript:;>
>>>>>>>>>> To: users@cloudstack.apache.org <javascript:;>
>>>>>>>>>>
>>>>>>>>>> Hi,
>>>>>>>>>>
>>>>>>>>>> I don't think this has got a response because of the poor
>>> formatting of
>>>>>>>>> the
>>>>>>>>>> log. Please could you attach the log in a separate file and
> I will
>>>>>>> take a
>>>>>>>>>> look?
>>>>>>>>>> Am I correct in thinking that it is creating the system VM, and
>>> then
>>>>>>>>>> destroying it?
>>>>>>>>>>
>>>>>>>>>> Thanks,
>>>>>>>>>> Marty
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> On Sun, Aug 25, 2013 at 11:46 PM, Enrique Ladrón de Guevara
>>> Hernández <
>>>>>>>>>> enriquelgh@hotmail.com> wrote:
>>>>>>>>>>
>>>>>>>>>>> Hi,
>>>>>>>>>>> I'm carrying out my End of Career Project related to CloudStack
>>>>>>>>>>> deployment. I got issues when I try to deploy a VPC, the VPC
>>> virtual
>>>>>>>>> router
>>>>>>>>>>> isn't deployed completely and It's destroyed after timeout.
>>>>>>>>>>> The rest of SSVMs (Console Proxy VM, Storage VM and Guest
> Network
>>> VM)
>>>>>>>>> are
>>>>>>>>>>> deployed correctly. I can access to the instance console,
> put into
>>>>>>> guest
>>>>>>>>>>> network a instance, connect to it, etc ...
>>>>>>>>>>> Could you help me to resolve this issue? I don't know
> which is the
>>>>>>> thing
>>>>>>>>>>> that I'm doing wrong ...
>>>>>>>>>>> This is the context:
>>>>>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)Num. of
> Management
>>>>>>>>> Server:
>>>>>>>>>>> 1 (under CentOS 6.4) [physical server]. The MS has this network
>>>>>>>>>>> configuration:IP: 10.10.10.110/24GW: 10.10.10.254DNS server:
>>>>>>>>>>> 10.10.10.116/24Hypervisor: VMWARE 4.1:2 ESXi hosts:IPs:
>>> 10.10.1.101 &
>>>>>>>>>>> .102/24GW: 10.10.1.254vCenter: 10.10.1.100Standard Virtual
>>> Switches.
>>>>>>>>>>> Virtual Network Architecture:VmWare Virtual Switch CS Physical
>>>>>>>>>>> Network Network Subnet Gateway VLAN
>>>>>>>>>>> TAG CS Traffic Type Start IP Range End IP RangevSwitch0
>>>>>>>>>>> PhysNet-mgmt-svm 10.10.1.0
>>>>>>>>>>> 255.255.255.0 10.10.1.254 NONE CS Management 10.10.1.120
>>>>>>>>>>> 10.10.1.240vSwitch1
>>>>>>>>>>> PhysNet-storage 10.10.2.0 255.255.255.0 10.10.2.254
>>>>>>>>>>> NONE Storage 10.10.2.120
>>>>>>>>>>> 10.10.2.240vSwitch2 PhysNet-guest-1
>>>>>>>>>>> 10.10.3.0 255.255.255.0 10.10.3.254 NONE
>>>>>>>>>>> Guest 10.10.3.1 10.10.3.254vSwitch3
>>>>>>>>>>> PhysNet-public 10.10.4.0
>>>>>>>>>>> 255.255.255.0 10.10.4.254 NONE Public
>>>>>>>>>>> 10.10.4.1 10.10.4.240
>>>>>>>>>>> I log in to ssvm consoles and I can see the following:vRouter
>>> (VPC)
>>>>>>>>> System
>>>>>>>>>>> VM - doesn't have a specific route to MS:root@r-53-VM:~# netstat
>>>>>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
>>>>>>>>>>> Flags MSS Window irtt Iface10.10.1.0 0.0.0.0 255.255.255.0
>>>>>>>>>>> U 0 0 0 eth3root@r-53-VM:~#
>>>>>>>>>>> CS management server:[root@cs-1 ~]# netstat -nrKernel IP routing
>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS Window
>>>>>>>>>>> irtt Iface10.10.10.0 0.0.0.0 255.255.255.0 U 0 0
>>>>>>>>>>> 0 eth0169.254.0.0 0.0.0.0 255.255.0.0 U 0 0
>>>>>>>>>>> 0 eth00.0.0.0 10.10.10.254 0.0.0.0 UG 0
>>>>>>>>>>> 0 0 eth0[root@cs-1 ~]#
>>>>>>>>>>> Console Proxy System VM:root@v-50-VM:~# netstat -nrKernel IP
>>> routing
>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS Window
>>>>>>>>>>> irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>>>>>>> 0 eth110.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>>>>>>> 0 eth110.10.4.0 0.0.0.0 255.255.255.0 U 0
>>>>>>>>>>> 0 0 eth210.10.1.0 0.0.0.0 255.255.255.0 U
>>>>>>>>>>> 0 0 0 eth110.10.10.0 10.10.1.254 255.255.255.0 UG
>>>>>>>>>>> 0 0 0 eth10.0.0.0 10.10.4.254 0.0.0.0 UG
>>>>>>>>>>> 0 0 0 eth2root@v-50-VM:~#
>>>>>>>>>>> vRouter (no VPC- Guest Network) System VM:root@r-49-VM:~#
> netstat
>>>>>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
>>>>>>>>>>> Flags MSS Window irtt Iface10.10.4.0 0.0.0.0 255.255.255.0
>>>>>>>>>>> U 0 0 0 eth210.10.3.0 0.0.0.0
>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth010.10.1.0 0.0.0.0
>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0 10.10.1.254
>>>>>>>>>>> 255.255.255.0 UG 0 0 0 eth10.0.0.0
>>>>>>>>>>> 10.10.4.254 0.0.0.0 UG 0 0 0 eth2root@r-49-VM
>>>>>>>>>>> :~#
>>>>>>>>>>> Secondary Storage System VMroot@s-28-VM:~# netstat -nrKernel IP
>>>>>>> routing
>>>>>>>>>>> tableDestination Gateway Genmask Flags MSS
>>>>>>>>>>> Window irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH
>>>>>>>>>>> 0 0 0 eth110.10.10.110 10.10.1.254
>>>>>>>>>>> 255.255.255.255 UGH 0 0 0 eth110.10.4.0
>>>>>>>>>>> 0.0.0.0 255.255.255.0 U 0 0
>>>>>>>>>>> 0 eth210.10.2.0 0.0.0.0 255.255.255.0 U
>>>>>>>>>>> 0 0 0 eth310.10.1.0 0.0.0.0
>>>>>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0
>>>>>>>>>>> 10.10.1.254 255.255.255.0 UG 0 0 0
>>>>>>>>>>> eth10.0.0.0 10.10.4.254 0.0.0.0 UG
>>>>>>>>>>> 0 0 0 eth2root@s-28-VM:~# management-server.log
>>>>>>>>>>> (filtered by r-53-VM):
>>>>>>>>>>> [root@cs-1 ~]# g>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
>>>>>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
>>> template=domP
>>>>>>>>> name=r-53-VM
>>>>>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
>>>>>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
>>> disable_rp_filter=true
>>>>>>>>> extra_pubnics=2
>>>>>>>>>>>
>>>>>>>>>
>>>>>>>
>>>
> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}},{"check.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":100,"name":"r-53-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.1.238","
>>>>>>>>>>> router.name
>>>>>>>>>>>
>>>>>>>>>
>>>>>>>
>>>
> ":"r-53-VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbps":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"10.10.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"router.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"10.10.1.238","
>>>>>>>>>>> router.name
>>>>>>>>>>>
>>>>>>>>>
>>>>>>>
>>>
> ":"r-53-VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessDetails":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","
>>>>>>>>>>> router.name":"r-53-VM"},"wait":0}},{}] }2013-08-25 11:34:48,001
>>> DEBUG
>>>>>>>>>>> [agent.transport.Request] (Job-Executor-13:job-11) Seq
>>> 1-1308430869:
>>>>>>>>>>> Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags:
>>>>>>> 100111,
>>>>>>>>>>>
>>>>>>>>>
>>>>>>>
>>>
> [{"StartCommand":{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter">>
>>>>>>>>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
>>>>>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
>>> template=domP
>>>>>>>>> name=r-53-VM
>>>>>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
>>>>>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
>>> disable_rp_filter=true
>>>>>>>>> extra_pubnics=2
>>>>>>>>>>>
>>>>>>>>>
>>>>>>>
>>>
> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":>>
>>>>>>>>> GNU/Linux 5.0 (32-bit)",
>>>>>>>
>>>
RE: VPC virtual router fails to start up - no route to CS
Management Server.
Posted by Enrique Ladrón de Guevara Hernández <en...@hotmail.com>.
Hi,
Logs and screenshots attached in a tar file.
In my case, the type of the first interface is "Control", as you can see in the screenshots.
@developers, if you need more info let me know.
Thanks to everyone,Regards.
> Date: Tue, 3 Sep 2013 08:05:10 +0100> Subject: Re: VPC virtual router fails to start up - no route to CS Management Server.
> From: msweet.dev@gmail.com
> To: users@cloudstack.apache.org
> CC: dev@cloudstack.apache.org
>
> Hi,
>
> I couldn't find any screenshots in the string of messages.
> Looking at the logs it almost seems as like the VPC is stopping
> unexpectedly.
>
> Looking at my VPC, the first interface is a Link Local for Control type
> traffic, which is running on KVM.
> I will CC this into the dev mailinglist in search for a developer who knows
> more about VMWare and VPCs.
>
> In the meantime, please could you attach (in a tar), the screenshots of the
> VPC interfaces from the cloudstack interfaces.
>
> Thanks,
> Marty
>
>
>
>
> On Mon, Sep 2, 2013 at 6:28 PM, Enrique Ladrón de Guevara Hernández <
> enriquelgh@hotmail.com> wrote:
>
> > Hi Marty,
> >
> > Sorry, could you look at the logs and screenshots?? Do you need more info
> > to debug the issue??
> >
> > Do you know if there is a bug related to this scenario??
> >
> > I try to find any information on Internet and check my config but I don't
> > know how to continue go ahead ...
> >
> > Do you recommend re-installing CS software with other version or the same
> > version ....??
> >
> > Thanks in advanced for your help.
> > Regards.
> >
> >
> > ----------------------------------------
> > > From: enriquelgh@hotmail.com
> > > To: users@cloudstack.apache.org
> > > Subject: RE: VPC virtual router fails to start up - no route to CS
> > Management Server.
> > > Date: Wed, 28 Aug 2013 20:16:26 +0200
> > >
> > > Now better!
> > >
> > > Regards.
> > >
> > > ----------------------------------------
> > >> From: enriquelgh@hotmail.com
> > >> To: users@cloudstack.apache.org
> > >> Subject: RE: VPC virtual router fails to start up - no route to CS
> > Management Server.
> > >> Date: Wed, 28 Aug 2013 20:09:39 +0200
> > >>
> > >> Hi Marty,
> > >>
> > >> I have used a new test to capture screenshots and logs:
> > >>
> > >> VPC Name: VPC-Test
> > >> Job: job-69
> > >> vrsm: r-59-VM
> > >>
> > >> you can find files attached.
> > >>
> > >> Thanks,
> > >> Regards.
> > >>
> > >> -
> > >> ----------------------------------------
> > >>> Date: Wed, 28 Aug 2013 10:16:23 +0100
> > >>> Subject: Re: VPC virtual router fails to start up - no route to CS
> > Management Server.
> > >>> From: msweet.dev@gmail.com
> > >>> To: users@cloudstack.apache.org
> > >>>
> > >>> Hi,
> > >>>
> > >>> Could you let me know the IP addresses listed in the cloudstack
> > interface
> > >>> under Infrastructure> Virtual Routers> VPC
> > >>>
> > >>> Marty
> > >>>
> > >>>
> > >>> On Tue, Aug 27, 2013 at 11:11 PM, Enrique Ladrón de Guevara Hernández <
> > >>> enriquelgh@hotmail.com> wrote:
> > >>>
> > >>>> Hi Marty,
> > >>>>
> > >>>> Yes, I have still got this issue ... :S I'm very lost ...
> > >>>>
> > >>>> Guest Networks are working fine, but in VPC nop ...
> > >>>>
> > >>>> If you need more info, please let me know.
> > >>>>
> > >>>> Thanks a lot for your time,
> > >>>> Regards.
> > >>>>
> > >>>>
> > >>>> ----------------------------------------
> > >>>>> Date: Tue, 27 Aug 2013 22:54:11 +0100
> > >>>>> Subject: Re: VPC virtual router fails to start up - no route to CS
> > >>>> Management Server.
> > >>>>> From: msweet.dev@gmail.com
> > >>>>> To: users@cloudstack.apache.org
> > >>>>>
> > >>>>> Hi Enrique,
> > >>>>>
> > >>>>> Sorry I haven't got back to you, is this still an issue?
> > >>>>> If so, I will take a look at it and get back to you in the morning.
> > >>>>>
> > >>>>> Thanks,
> > >>>>> Marty
> > >>>>>
> > >>>>> On Monday, August 26, 2013, Enrique Ladrón de Guevara Hernández
> > wrote:
> > >>>>>
> > >>>>>> Hi Marty,
> > >>>>>>
> > >>>>>> My apologies for the format. I hope this time the email format will
> > be
> > >>>>>> better. You can find the logs attached.
> > >>>>>>
> > >>>>>> In this log you can see several VPC deployment tests. One of them
> > is:
> > >>>>>> - VPC name: VPC-Prueba-1
> > >>>>>> - job: job-11
> > >>>>>> - ssvm: r-53-VM.
> > >>>>>>
> > >>>>>> I use GUI to create VPC. The system VM (virutal router) is created
> > and I
> > >>>>>> can log in by console (VNC or VMWARE console), but after 40 min
> > (aprox)
> > >>>>>> this SSVM are destroyed because the MS is not able to connect with.
> > >>>>>>
> > >>>>>> I think the System VM needs default gateway route or static route
> > to MS
> > >>>>>> server like the rest of SystemVMs (Console, Sec. Storage or Guest
> > Net.).
> > >>>>>>
> > >>>>>>
> > >>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)
> > >>>>>>
> > >>>>>> Num. of Management Server: 1 (under CentOS 6.4) [physical server].
> > >>>>>>
> > >>>>>> The MS has this network configuration: IP: 10.10.10.110/24 GW:
> > >>>>>> 10.10.10.254
> > >>>>>>
> > >>>>>> DNS server:10.10.10.116/24
> > >>>>>>
> > >>>>>> Hypervisor: VMWARE 4.1 (with Standard Virtual Switches), 2 ESXi
> > hosts:
> > >>>>>> IPs: 10.10.1.101 & .102/24 GW: 10.10.1.254
> > >>>>>>
> > >>>>>> vCenter: 10.10.1.100/24.
> > >>>>>>
> > >>>>>> Virtual Network Architecture:
> > >>>>>>
> > >>>>>> CS Traffic Type:CS Management
> > >>>>>> VmWare Virtual Switch:vSwitch0
> > >>>>>> CS Physical Network:PhysNet-mgmt-svm
> > >>>>>> Network:10.10.1.0
> > >>>>>> Subnet:/24
> > >>>>>> Gateway:10.10.1.254
> > >>>>>> VLAN TAG: NONE
> > >>>>>> Start IP Range:10.10.1.120
> > >>>>>> End IP Range: 10.10.1.240
> > >>>>>>
> > >>>>>> CS Traffic Type: Storage
> > >>>>>> VmWare Virtual Switch:vSwitch1
> > >>>>>> CS Physical Network:PhysNet-storage
> > >>>>>> Network:10.10.2.0
> > >>>>>> Subnet:/24
> > >>>>>> Gateway:10.10.2.254
> > >>>>>> VLAN TAG: NONE
> > >>>>>> Start IP Range:10.10.2.120
> > >>>>>> End IP Range: 10.10.2.240
> > >>>>>>
> > >>>>>>
> > >>>>>> CS Traffic Type:Guest
> > >>>>>> VmWare Virtual Switch:vSwitch2
> > >>>>>> CS Physical Network:PhysNet-guest-1
> > >>>>>> Network:10.10.3.0
> > >>>>>> Subnet:/24
> > >>>>>> Gateway:10.10.3.254
> > >>>>>> VLAN TAG: NONE
> > >>>>>> Start IP Range:10.10.3.1
> > >>>>>> End IP Range: 10.10.3.254
> > >>>>>>
> > >>>>>> CS Traffic Type:Public
> > >>>>>> VmWare Virtual Switch:vSwitch3
> > >>>>>> CS Physical Network:PhysNet-public
> > >>>>>> Network:10.10.4.0
> > >>>>>> Subnet:/24
> > >>>>>> Gateway:10.10.4.254
> > >>>>>> VLAN TAG: NONE
> > >>>>>> Start IP Range:10.10.4.1
> > >>>>>> End IP Range: 10.10.4.240
> > >>>>>>
> > >>>>>>
> > >>>>>> vRouter (VPC) System VM - doesn't have a specific route to MS:
> > >>>>>>
> > >>>>>> root@r-53-VM:~# netstat -nr
> > >>>>>> Kernel IP routing table
> > >>>>>> Destination Gateway Genmask Flags MSS Window irtt
> > >>>>>> Iface
> > >>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>> eth3
> > >>>>>> root@r-53-VM:~#
> > >>>>>>
> > >>>>>>
> > >>>>>> CS management server:
> > >>>>>>
> > >>>>>> [root@cs-1 ~]# netstat -nr
> > >>>>>> Kernel IP routing table
> > >>>>>> Destination Gateway Genmask Flags MSS Window irtt
> > >>>>>> Iface
> > >>>>>> 10.10.10.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>> eth0
> > >>>>>> 169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0
> > >>>>>> eth0
> > >>>>>> 0.0.0.0 10.10.10.254 0.0.0.0 UG 0 0 0
> > >>>>>> eth0
> > >>>>>> [root@cs-1 ~]#
> > >>>>>>
> > >>>>>> Console Proxy System VM:
> > >>>>>>
> > >>>>>> root@v-50-VM:~# netstat -nr
> > >>>>>> Kernel IP routing table
> > >>>>>> Destination Gateway Genmask Flags MSS Window irtt
> > >>>>>> Iface
> > >>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0 0
> > >>>>>> eth1
> > >>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0 0
> > >>>>>> eth1
> > >>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>> eth2
> > >>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>> eth1
> > >>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
> > >>>>>> eth1
> > >>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
> > >>>>>> eth2
> > >>>>>> root@v-50-VM:~#
> > >>>>>>
> > >>>>>> vRouter (no VPC- Guest Network) System VM:
> > >>>>>>
> > >>>>>> root@r-49-VM:~# netstat -nr
> > >>>>>> Kernel IP routing table
> > >>>>>> Destination Gateway Genmask Flags MSS Window irtt
> > >>>>>> Iface
> > >>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>> eth2
> > >>>>>> 10.10.3.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>> eth0
> > >>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>> eth1
> > >>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
> > >>>>>> eth1
> > >>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
> > >>>>>> eth2
> > >>>>>> root@r-49-VM:~#
> > >>>>>>
> > >>>>>> Secondary Storage System VM:
> > >>>>>>
> > >>>>>> root@s-28-VM:~# netstat -nr
> > >>>>>> Kernel IP routing table
> > >>>>>> Destination Gateway Genmask Flags MSS
> > >>>>>> Window irtt Iface
> > >>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
> > >>>>>> 0 eth1
> > >>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
> > >>>>>> 0 eth1
> > >>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0
> > >>>>>> 0 0 eth2
> > >>>>>> 10.10.2.0 0.0.0.0 255.255.255.0 U 0
> > >>>>>> 0 0 eth3
> > >>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0
> > >>>>>> 0 0 eth1
> > >>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0
> > >>>>>> 0 eth1
> > >>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG
> > >>>>>> 0 0 0 eth2
> > >>>>>> root@s-28-VM:~#
> > >>>>>>
> > >>>>>>
> > >>>>>> Thanks,
> > >>>>>> Regards.
> > >>>>>>
> > >>>>>>
> > >>>>>>
> > >>>>
> > ---------------------------------------------------------------------------------------------
> > >>>>>>
> > >>>>>>
> > >>>>
> > ---------------------------------------------------------------------------------------------
> > >>>>>>
> > >>>>>>
> > >>>>>>> Date: Mon, 26 Aug 2013 15:19:06 +0100
> > >>>>>>> Subject: Re: VPC virtual router fails to start up - no route to CS
> > >>>>>> Management Server.
> > >>>>>>> From: msweet.dev@gmail.com <javascript:;>
> > >>>>>>> To: users@cloudstack.apache.org <javascript:;>
> > >>>>>>>
> > >>>>>>> Hi,
> > >>>>>>>
> > >>>>>>> I don't think this has got a response because of the poor
> > formatting of
> > >>>>>> the
> > >>>>>>> log. Please could you attach the log in a separate file and I will
> > >>>> take a
> > >>>>>>> look?
> > >>>>>>> Am I correct in thinking that it is creating the system VM, and
> > then
> > >>>>>>> destroying it?
> > >>>>>>>
> > >>>>>>> Thanks,
> > >>>>>>> Marty
> > >>>>>>>
> > >>>>>>>
> > >>>>>>> On Sun, Aug 25, 2013 at 11:46 PM, Enrique Ladrón de Guevara
> > Hernández <
> > >>>>>>> enriquelgh@hotmail.com> wrote:
> > >>>>>>>
> > >>>>>>>> Hi,
> > >>>>>>>> I'm carrying out my End of Career Project related to CloudStack
> > >>>>>>>> deployment. I got issues when I try to deploy a VPC, the VPC
> > virtual
> > >>>>>> router
> > >>>>>>>> isn't deployed completely and It's destroyed after timeout.
> > >>>>>>>> The rest of SSVMs (Console Proxy VM, Storage VM and Guest Network
> > VM)
> > >>>>>> are
> > >>>>>>>> deployed correctly. I can access to the instance console, put into
> > >>>> guest
> > >>>>>>>> network a instance, connect to it, etc ...
> > >>>>>>>> Could you help me to resolve this issue? I don't know which is the
> > >>>> thing
> > >>>>>>>> that I'm doing wrong ...
> > >>>>>>>> This is the context:
> > >>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)Num. of Management
> > >>>>>> Server:
> > >>>>>>>> 1 (under CentOS 6.4) [physical server]. The MS has this network
> > >>>>>>>> configuration:IP: 10.10.10.110/24GW: 10.10.10.254DNS server:
> > >>>>>>>> 10.10.10.116/24Hypervisor: VMWARE 4.1:2 ESXi hosts:IPs:
> > 10.10.1.101 &
> > >>>>>>>> .102/24GW: 10.10.1.254vCenter: 10.10.1.100Standard Virtual
> > Switches.
> > >>>>>>>> Virtual Network Architecture:VmWare Virtual Switch CS Physical
> > >>>>>>>> Network Network Subnet Gateway VLAN
> > >>>>>>>> TAG CS Traffic Type Start IP Range End IP RangevSwitch0
> > >>>>>>>> PhysNet-mgmt-svm 10.10.1.0
> > >>>>>>>> 255.255.255.0 10.10.1.254 NONE CS Management 10.10.1.120
> > >>>>>>>> 10.10.1.240vSwitch1
> > >>>>>>>> PhysNet-storage 10.10.2.0 255.255.255.0 10.10.2.254
> > >>>>>>>> NONE Storage 10.10.2.120
> > >>>>>>>> 10.10.2.240vSwitch2 PhysNet-guest-1
> > >>>>>>>> 10.10.3.0 255.255.255.0 10.10.3.254 NONE
> > >>>>>>>> Guest 10.10.3.1 10.10.3.254vSwitch3
> > >>>>>>>> PhysNet-public 10.10.4.0
> > >>>>>>>> 255.255.255.0 10.10.4.254 NONE Public
> > >>>>>>>> 10.10.4.1 10.10.4.240
> > >>>>>>>> I log in to ssvm consoles and I can see the following:vRouter
> > (VPC)
> > >>>>>> System
> > >>>>>>>> VM - doesn't have a specific route to MS:root@r-53-VM:~# netstat
> > >>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
> > >>>>>>>> Flags MSS Window irtt Iface10.10.1.0 0.0.0.0 255.255.255.0
> > >>>>>>>> U 0 0 0 eth3root@r-53-VM:~#
> > >>>>>>>> CS management server:[root@cs-1 ~]# netstat -nrKernel IP routing
> > >>>>>>>> tableDestination Gateway Genmask Flags MSS Window
> > >>>>>>>> irtt Iface10.10.10.0 0.0.0.0 255.255.255.0 U 0 0
> > >>>>>>>> 0 eth0169.254.0.0 0.0.0.0 255.255.0.0 U 0 0
> > >>>>>>>> 0 eth00.0.0.0 10.10.10.254 0.0.0.0 UG 0
> > >>>>>>>> 0 0 eth0[root@cs-1 ~]#
> > >>>>>>>> Console Proxy System VM:root@v-50-VM:~# netstat -nrKernel IP
> > routing
> > >>>>>>>> tableDestination Gateway Genmask Flags MSS Window
> > >>>>>>>> irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
> > >>>>>>>> 0 eth110.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
> > >>>>>>>> 0 eth110.10.4.0 0.0.0.0 255.255.255.0 U 0
> > >>>>>>>> 0 0 eth210.10.1.0 0.0.0.0 255.255.255.0 U
> > >>>>>>>> 0 0 0 eth110.10.10.0 10.10.1.254 255.255.255.0 UG
> > >>>>>>>> 0 0 0 eth10.0.0.0 10.10.4.254 0.0.0.0 UG
> > >>>>>>>> 0 0 0 eth2root@v-50-VM:~#
> > >>>>>>>> vRouter (no VPC- Guest Network) System VM:root@r-49-VM:~# netstat
> > >>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
> > >>>>>>>> Flags MSS Window irtt Iface10.10.4.0 0.0.0.0 255.255.255.0
> > >>>>>>>> U 0 0 0 eth210.10.3.0 0.0.0.0
> > >>>>>>>> 255.255.255.0 U 0 0 0 eth010.10.1.0 0.0.0.0
> > >>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0 10.10.1.254
> > >>>>>>>> 255.255.255.0 UG 0 0 0 eth10.0.0.0
> > >>>>>>>> 10.10.4.254 0.0.0.0 UG 0 0 0 eth2root@r-49-VM
> > >>>>>>>> :~#
> > >>>>>>>> Secondary Storage System VMroot@s-28-VM:~# netstat -nrKernel IP
> > >>>> routing
> > >>>>>>>> tableDestination Gateway Genmask Flags MSS
> > >>>>>>>> Window irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH
> > >>>>>>>> 0 0 0 eth110.10.10.110 10.10.1.254
> > >>>>>>>> 255.255.255.255 UGH 0 0 0 eth110.10.4.0
> > >>>>>>>> 0.0.0.0 255.255.255.0 U 0 0
> > >>>>>>>> 0 eth210.10.2.0 0.0.0.0 255.255.255.0 U
> > >>>>>>>> 0 0 0 eth310.10.1.0 0.0.0.0
> > >>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0
> > >>>>>>>> 10.10.1.254 255.255.255.0 UG 0 0 0
> > >>>>>>>> eth10.0.0.0 10.10.4.254 0.0.0.0 UG
> > >>>>>>>> 0 0 0 eth2root@s-28-VM:~# management-server.log
> > >>>>>>>> (filtered by r-53-VM):
> > >>>>>>>> [root@cs-1 ~]# g>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
> > >>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
> > template=domP
> > >>>>>> name=r-53-VM
> > >>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
> > >>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
> > disable_rp_filter=true
> > >>>>>> extra_pubnics=2
> > >>>>>>>>
> > >>>>>>
> > >>>>
> > nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}},{"check.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":100,"name":"r-53-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.1.238","
> > >>>>>>>> router.name
> > >>>>>>>>
> > >>>>>>
> > >>>>
> > ":"r-53-VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbps":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"10.10.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"router.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"10.10.1.238","
> > >>>>>>>> router.name
> > >>>>>>>>
> > >>>>>>
> > >>>>
> > ":"r-53-VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessDetails":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","
> > >>>>>>>> router.name":"r-53-VM"},"wait":0}},{}] }2013-08-25 11:34:48,001
> > DEBUG
> > >>>>>>>> [agent.transport.Request] (Job-Executor-13:job-11) Seq
> > 1-1308430869:
> > >>>>>>>> Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags:
> > >>>> 100111,
> > >>>>>>>>
> > >>>>>>
> > >>>>
> > [{"StartCommand":{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter">>
> > >>>>>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
> > >>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
> > template=domP
> > >>>>>> name=r-53-VM
> > >>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
> > >>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
> > disable_rp_filter=true
> > >>>>>> extra_pubnics=2
> > >>>>>>>>
> > >>>>>>
> > >>>>
> > nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":>>
> > >>>>>> GNU/Linux 5.0 (32-bit)",
> > >>>>
> >
RE: VPC virtual router fails to start up - no route to CS
Management Server.
Posted by Enrique Ladrón de Guevara Hernández <en...@hotmail.com>.
Hi,
Logs and screenshots attached in a tar file.
In my case, the type of the first interface is "Control", as you can see in the screenshots.
@developers, if you need more info let me know.
Thanks to everyone,Regards.
> Date: Tue, 3 Sep 2013 08:05:10 +0100> Subject: Re: VPC virtual router fails to start up - no route to CS Management Server.
> From: msweet.dev@gmail.com
> To: users@cloudstack.apache.org
> CC: dev@cloudstack.apache.org
>
> Hi,
>
> I couldn't find any screenshots in the string of messages.
> Looking at the logs it almost seems as like the VPC is stopping
> unexpectedly.
>
> Looking at my VPC, the first interface is a Link Local for Control type
> traffic, which is running on KVM.
> I will CC this into the dev mailinglist in search for a developer who knows
> more about VMWare and VPCs.
>
> In the meantime, please could you attach (in a tar), the screenshots of the
> VPC interfaces from the cloudstack interfaces.
>
> Thanks,
> Marty
>
>
>
>
> On Mon, Sep 2, 2013 at 6:28 PM, Enrique Ladrón de Guevara Hernández <
> enriquelgh@hotmail.com> wrote:
>
> > Hi Marty,
> >
> > Sorry, could you look at the logs and screenshots?? Do you need more info
> > to debug the issue??
> >
> > Do you know if there is a bug related to this scenario??
> >
> > I try to find any information on Internet and check my config but I don't
> > know how to continue go ahead ...
> >
> > Do you recommend re-installing CS software with other version or the same
> > version ....??
> >
> > Thanks in advanced for your help.
> > Regards.
> >
> >
> > ----------------------------------------
> > > From: enriquelgh@hotmail.com
> > > To: users@cloudstack.apache.org
> > > Subject: RE: VPC virtual router fails to start up - no route to CS
> > Management Server.
> > > Date: Wed, 28 Aug 2013 20:16:26 +0200
> > >
> > > Now better!
> > >
> > > Regards.
> > >
> > > ----------------------------------------
> > >> From: enriquelgh@hotmail.com
> > >> To: users@cloudstack.apache.org
> > >> Subject: RE: VPC virtual router fails to start up - no route to CS
> > Management Server.
> > >> Date: Wed, 28 Aug 2013 20:09:39 +0200
> > >>
> > >> Hi Marty,
> > >>
> > >> I have used a new test to capture screenshots and logs:
> > >>
> > >> VPC Name: VPC-Test
> > >> Job: job-69
> > >> vrsm: r-59-VM
> > >>
> > >> you can find files attached.
> > >>
> > >> Thanks,
> > >> Regards.
> > >>
> > >> -
> > >> ----------------------------------------
> > >>> Date: Wed, 28 Aug 2013 10:16:23 +0100
> > >>> Subject: Re: VPC virtual router fails to start up - no route to CS
> > Management Server.
> > >>> From: msweet.dev@gmail.com
> > >>> To: users@cloudstack.apache.org
> > >>>
> > >>> Hi,
> > >>>
> > >>> Could you let me know the IP addresses listed in the cloudstack
> > interface
> > >>> under Infrastructure> Virtual Routers> VPC
> > >>>
> > >>> Marty
> > >>>
> > >>>
> > >>> On Tue, Aug 27, 2013 at 11:11 PM, Enrique Ladrón de Guevara Hernández <
> > >>> enriquelgh@hotmail.com> wrote:
> > >>>
> > >>>> Hi Marty,
> > >>>>
> > >>>> Yes, I have still got this issue ... :S I'm very lost ...
> > >>>>
> > >>>> Guest Networks are working fine, but in VPC nop ...
> > >>>>
> > >>>> If you need more info, please let me know.
> > >>>>
> > >>>> Thanks a lot for your time,
> > >>>> Regards.
> > >>>>
> > >>>>
> > >>>> ----------------------------------------
> > >>>>> Date: Tue, 27 Aug 2013 22:54:11 +0100
> > >>>>> Subject: Re: VPC virtual router fails to start up - no route to CS
> > >>>> Management Server.
> > >>>>> From: msweet.dev@gmail.com
> > >>>>> To: users@cloudstack.apache.org
> > >>>>>
> > >>>>> Hi Enrique,
> > >>>>>
> > >>>>> Sorry I haven't got back to you, is this still an issue?
> > >>>>> If so, I will take a look at it and get back to you in the morning.
> > >>>>>
> > >>>>> Thanks,
> > >>>>> Marty
> > >>>>>
> > >>>>> On Monday, August 26, 2013, Enrique Ladrón de Guevara Hernández
> > wrote:
> > >>>>>
> > >>>>>> Hi Marty,
> > >>>>>>
> > >>>>>> My apologies for the format. I hope this time the email format will
> > be
> > >>>>>> better. You can find the logs attached.
> > >>>>>>
> > >>>>>> In this log you can see several VPC deployment tests. One of them
> > is:
> > >>>>>> - VPC name: VPC-Prueba-1
> > >>>>>> - job: job-11
> > >>>>>> - ssvm: r-53-VM.
> > >>>>>>
> > >>>>>> I use GUI to create VPC. The system VM (virutal router) is created
> > and I
> > >>>>>> can log in by console (VNC or VMWARE console), but after 40 min
> > (aprox)
> > >>>>>> this SSVM are destroyed because the MS is not able to connect with.
> > >>>>>>
> > >>>>>> I think the System VM needs default gateway route or static route
> > to MS
> > >>>>>> server like the rest of SystemVMs (Console, Sec. Storage or Guest
> > Net.).
> > >>>>>>
> > >>>>>>
> > >>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)
> > >>>>>>
> > >>>>>> Num. of Management Server: 1 (under CentOS 6.4) [physical server].
> > >>>>>>
> > >>>>>> The MS has this network configuration: IP: 10.10.10.110/24 GW:
> > >>>>>> 10.10.10.254
> > >>>>>>
> > >>>>>> DNS server:10.10.10.116/24
> > >>>>>>
> > >>>>>> Hypervisor: VMWARE 4.1 (with Standard Virtual Switches), 2 ESXi
> > hosts:
> > >>>>>> IPs: 10.10.1.101 & .102/24 GW: 10.10.1.254
> > >>>>>>
> > >>>>>> vCenter: 10.10.1.100/24.
> > >>>>>>
> > >>>>>> Virtual Network Architecture:
> > >>>>>>
> > >>>>>> CS Traffic Type:CS Management
> > >>>>>> VmWare Virtual Switch:vSwitch0
> > >>>>>> CS Physical Network:PhysNet-mgmt-svm
> > >>>>>> Network:10.10.1.0
> > >>>>>> Subnet:/24
> > >>>>>> Gateway:10.10.1.254
> > >>>>>> VLAN TAG: NONE
> > >>>>>> Start IP Range:10.10.1.120
> > >>>>>> End IP Range: 10.10.1.240
> > >>>>>>
> > >>>>>> CS Traffic Type: Storage
> > >>>>>> VmWare Virtual Switch:vSwitch1
> > >>>>>> CS Physical Network:PhysNet-storage
> > >>>>>> Network:10.10.2.0
> > >>>>>> Subnet:/24
> > >>>>>> Gateway:10.10.2.254
> > >>>>>> VLAN TAG: NONE
> > >>>>>> Start IP Range:10.10.2.120
> > >>>>>> End IP Range: 10.10.2.240
> > >>>>>>
> > >>>>>>
> > >>>>>> CS Traffic Type:Guest
> > >>>>>> VmWare Virtual Switch:vSwitch2
> > >>>>>> CS Physical Network:PhysNet-guest-1
> > >>>>>> Network:10.10.3.0
> > >>>>>> Subnet:/24
> > >>>>>> Gateway:10.10.3.254
> > >>>>>> VLAN TAG: NONE
> > >>>>>> Start IP Range:10.10.3.1
> > >>>>>> End IP Range: 10.10.3.254
> > >>>>>>
> > >>>>>> CS Traffic Type:Public
> > >>>>>> VmWare Virtual Switch:vSwitch3
> > >>>>>> CS Physical Network:PhysNet-public
> > >>>>>> Network:10.10.4.0
> > >>>>>> Subnet:/24
> > >>>>>> Gateway:10.10.4.254
> > >>>>>> VLAN TAG: NONE
> > >>>>>> Start IP Range:10.10.4.1
> > >>>>>> End IP Range: 10.10.4.240
> > >>>>>>
> > >>>>>>
> > >>>>>> vRouter (VPC) System VM - doesn't have a specific route to MS:
> > >>>>>>
> > >>>>>> root@r-53-VM:~# netstat -nr
> > >>>>>> Kernel IP routing table
> > >>>>>> Destination Gateway Genmask Flags MSS Window irtt
> > >>>>>> Iface
> > >>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>> eth3
> > >>>>>> root@r-53-VM:~#
> > >>>>>>
> > >>>>>>
> > >>>>>> CS management server:
> > >>>>>>
> > >>>>>> [root@cs-1 ~]# netstat -nr
> > >>>>>> Kernel IP routing table
> > >>>>>> Destination Gateway Genmask Flags MSS Window irtt
> > >>>>>> Iface
> > >>>>>> 10.10.10.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>> eth0
> > >>>>>> 169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0
> > >>>>>> eth0
> > >>>>>> 0.0.0.0 10.10.10.254 0.0.0.0 UG 0 0 0
> > >>>>>> eth0
> > >>>>>> [root@cs-1 ~]#
> > >>>>>>
> > >>>>>> Console Proxy System VM:
> > >>>>>>
> > >>>>>> root@v-50-VM:~# netstat -nr
> > >>>>>> Kernel IP routing table
> > >>>>>> Destination Gateway Genmask Flags MSS Window irtt
> > >>>>>> Iface
> > >>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0 0
> > >>>>>> eth1
> > >>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0 0
> > >>>>>> eth1
> > >>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>> eth2
> > >>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>> eth1
> > >>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
> > >>>>>> eth1
> > >>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
> > >>>>>> eth2
> > >>>>>> root@v-50-VM:~#
> > >>>>>>
> > >>>>>> vRouter (no VPC- Guest Network) System VM:
> > >>>>>>
> > >>>>>> root@r-49-VM:~# netstat -nr
> > >>>>>> Kernel IP routing table
> > >>>>>> Destination Gateway Genmask Flags MSS Window irtt
> > >>>>>> Iface
> > >>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>> eth2
> > >>>>>> 10.10.3.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>> eth0
> > >>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>> eth1
> > >>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
> > >>>>>> eth1
> > >>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
> > >>>>>> eth2
> > >>>>>> root@r-49-VM:~#
> > >>>>>>
> > >>>>>> Secondary Storage System VM:
> > >>>>>>
> > >>>>>> root@s-28-VM:~# netstat -nr
> > >>>>>> Kernel IP routing table
> > >>>>>> Destination Gateway Genmask Flags MSS
> > >>>>>> Window irtt Iface
> > >>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
> > >>>>>> 0 eth1
> > >>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
> > >>>>>> 0 eth1
> > >>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0
> > >>>>>> 0 0 eth2
> > >>>>>> 10.10.2.0 0.0.0.0 255.255.255.0 U 0
> > >>>>>> 0 0 eth3
> > >>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0
> > >>>>>> 0 0 eth1
> > >>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0
> > >>>>>> 0 eth1
> > >>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG
> > >>>>>> 0 0 0 eth2
> > >>>>>> root@s-28-VM:~#
> > >>>>>>
> > >>>>>>
> > >>>>>> Thanks,
> > >>>>>> Regards.
> > >>>>>>
> > >>>>>>
> > >>>>>>
> > >>>>
> > ---------------------------------------------------------------------------------------------
> > >>>>>>
> > >>>>>>
> > >>>>
> > ---------------------------------------------------------------------------------------------
> > >>>>>>
> > >>>>>>
> > >>>>>>> Date: Mon, 26 Aug 2013 15:19:06 +0100
> > >>>>>>> Subject: Re: VPC virtual router fails to start up - no route to CS
> > >>>>>> Management Server.
> > >>>>>>> From: msweet.dev@gmail.com <javascript:;>
> > >>>>>>> To: users@cloudstack.apache.org <javascript:;>
> > >>>>>>>
> > >>>>>>> Hi,
> > >>>>>>>
> > >>>>>>> I don't think this has got a response because of the poor
> > formatting of
> > >>>>>> the
> > >>>>>>> log. Please could you attach the log in a separate file and I will
> > >>>> take a
> > >>>>>>> look?
> > >>>>>>> Am I correct in thinking that it is creating the system VM, and
> > then
> > >>>>>>> destroying it?
> > >>>>>>>
> > >>>>>>> Thanks,
> > >>>>>>> Marty
> > >>>>>>>
> > >>>>>>>
> > >>>>>>> On Sun, Aug 25, 2013 at 11:46 PM, Enrique Ladrón de Guevara
> > Hernández <
> > >>>>>>> enriquelgh@hotmail.com> wrote:
> > >>>>>>>
> > >>>>>>>> Hi,
> > >>>>>>>> I'm carrying out my End of Career Project related to CloudStack
> > >>>>>>>> deployment. I got issues when I try to deploy a VPC, the VPC
> > virtual
> > >>>>>> router
> > >>>>>>>> isn't deployed completely and It's destroyed after timeout.
> > >>>>>>>> The rest of SSVMs (Console Proxy VM, Storage VM and Guest Network
> > VM)
> > >>>>>> are
> > >>>>>>>> deployed correctly. I can access to the instance console, put into
> > >>>> guest
> > >>>>>>>> network a instance, connect to it, etc ...
> > >>>>>>>> Could you help me to resolve this issue? I don't know which is the
> > >>>> thing
> > >>>>>>>> that I'm doing wrong ...
> > >>>>>>>> This is the context:
> > >>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)Num. of Management
> > >>>>>> Server:
> > >>>>>>>> 1 (under CentOS 6.4) [physical server]. The MS has this network
> > >>>>>>>> configuration:IP: 10.10.10.110/24GW: 10.10.10.254DNS server:
> > >>>>>>>> 10.10.10.116/24Hypervisor: VMWARE 4.1:2 ESXi hosts:IPs:
> > 10.10.1.101 &
> > >>>>>>>> .102/24GW: 10.10.1.254vCenter: 10.10.1.100Standard Virtual
> > Switches.
> > >>>>>>>> Virtual Network Architecture:VmWare Virtual Switch CS Physical
> > >>>>>>>> Network Network Subnet Gateway VLAN
> > >>>>>>>> TAG CS Traffic Type Start IP Range End IP RangevSwitch0
> > >>>>>>>> PhysNet-mgmt-svm 10.10.1.0
> > >>>>>>>> 255.255.255.0 10.10.1.254 NONE CS Management 10.10.1.120
> > >>>>>>>> 10.10.1.240vSwitch1
> > >>>>>>>> PhysNet-storage 10.10.2.0 255.255.255.0 10.10.2.254
> > >>>>>>>> NONE Storage 10.10.2.120
> > >>>>>>>> 10.10.2.240vSwitch2 PhysNet-guest-1
> > >>>>>>>> 10.10.3.0 255.255.255.0 10.10.3.254 NONE
> > >>>>>>>> Guest 10.10.3.1 10.10.3.254vSwitch3
> > >>>>>>>> PhysNet-public 10.10.4.0
> > >>>>>>>> 255.255.255.0 10.10.4.254 NONE Public
> > >>>>>>>> 10.10.4.1 10.10.4.240
> > >>>>>>>> I log in to ssvm consoles and I can see the following:vRouter
> > (VPC)
> > >>>>>> System
> > >>>>>>>> VM - doesn't have a specific route to MS:root@r-53-VM:~# netstat
> > >>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
> > >>>>>>>> Flags MSS Window irtt Iface10.10.1.0 0.0.0.0 255.255.255.0
> > >>>>>>>> U 0 0 0 eth3root@r-53-VM:~#
> > >>>>>>>> CS management server:[root@cs-1 ~]# netstat -nrKernel IP routing
> > >>>>>>>> tableDestination Gateway Genmask Flags MSS Window
> > >>>>>>>> irtt Iface10.10.10.0 0.0.0.0 255.255.255.0 U 0 0
> > >>>>>>>> 0 eth0169.254.0.0 0.0.0.0 255.255.0.0 U 0 0
> > >>>>>>>> 0 eth00.0.0.0 10.10.10.254 0.0.0.0 UG 0
> > >>>>>>>> 0 0 eth0[root@cs-1 ~]#
> > >>>>>>>> Console Proxy System VM:root@v-50-VM:~# netstat -nrKernel IP
> > routing
> > >>>>>>>> tableDestination Gateway Genmask Flags MSS Window
> > >>>>>>>> irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
> > >>>>>>>> 0 eth110.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
> > >>>>>>>> 0 eth110.10.4.0 0.0.0.0 255.255.255.0 U 0
> > >>>>>>>> 0 0 eth210.10.1.0 0.0.0.0 255.255.255.0 U
> > >>>>>>>> 0 0 0 eth110.10.10.0 10.10.1.254 255.255.255.0 UG
> > >>>>>>>> 0 0 0 eth10.0.0.0 10.10.4.254 0.0.0.0 UG
> > >>>>>>>> 0 0 0 eth2root@v-50-VM:~#
> > >>>>>>>> vRouter (no VPC- Guest Network) System VM:root@r-49-VM:~# netstat
> > >>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
> > >>>>>>>> Flags MSS Window irtt Iface10.10.4.0 0.0.0.0 255.255.255.0
> > >>>>>>>> U 0 0 0 eth210.10.3.0 0.0.0.0
> > >>>>>>>> 255.255.255.0 U 0 0 0 eth010.10.1.0 0.0.0.0
> > >>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0 10.10.1.254
> > >>>>>>>> 255.255.255.0 UG 0 0 0 eth10.0.0.0
> > >>>>>>>> 10.10.4.254 0.0.0.0 UG 0 0 0 eth2root@r-49-VM
> > >>>>>>>> :~#
> > >>>>>>>> Secondary Storage System VMroot@s-28-VM:~# netstat -nrKernel IP
> > >>>> routing
> > >>>>>>>> tableDestination Gateway Genmask Flags MSS
> > >>>>>>>> Window irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH
> > >>>>>>>> 0 0 0 eth110.10.10.110 10.10.1.254
> > >>>>>>>> 255.255.255.255 UGH 0 0 0 eth110.10.4.0
> > >>>>>>>> 0.0.0.0 255.255.255.0 U 0 0
> > >>>>>>>> 0 eth210.10.2.0 0.0.0.0 255.255.255.0 U
> > >>>>>>>> 0 0 0 eth310.10.1.0 0.0.0.0
> > >>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0
> > >>>>>>>> 10.10.1.254 255.255.255.0 UG 0 0 0
> > >>>>>>>> eth10.0.0.0 10.10.4.254 0.0.0.0 UG
> > >>>>>>>> 0 0 0 eth2root@s-28-VM:~# management-server.log
> > >>>>>>>> (filtered by r-53-VM):
> > >>>>>>>> [root@cs-1 ~]# g>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
> > >>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
> > template=domP
> > >>>>>> name=r-53-VM
> > >>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
> > >>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
> > disable_rp_filter=true
> > >>>>>> extra_pubnics=2
> > >>>>>>>>
> > >>>>>>
> > >>>>
> > nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}},{"check.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":100,"name":"r-53-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.1.238","
> > >>>>>>>> router.name
> > >>>>>>>>
> > >>>>>>
> > >>>>
> > ":"r-53-VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbps":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"10.10.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"router.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"10.10.1.238","
> > >>>>>>>> router.name
> > >>>>>>>>
> > >>>>>>
> > >>>>
> > ":"r-53-VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessDetails":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","
> > >>>>>>>> router.name":"r-53-VM"},"wait":0}},{}] }2013-08-25 11:34:48,001
> > DEBUG
> > >>>>>>>> [agent.transport.Request] (Job-Executor-13:job-11) Seq
> > 1-1308430869:
> > >>>>>>>> Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags:
> > >>>> 100111,
> > >>>>>>>>
> > >>>>>>
> > >>>>
> > [{"StartCommand":{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter">>
> > >>>>>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
> > >>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
> > template=domP
> > >>>>>> name=r-53-VM
> > >>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
> > >>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
> > disable_rp_filter=true
> > >>>>>> extra_pubnics=2
> > >>>>>>>>
> > >>>>>>
> > >>>>
> > nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":>>
> > >>>>>> GNU/Linux 5.0 (32-bit)",
> > >>>>
> >
RE: VPC virtual router fails to start up - no route to CS
Management Server.
Posted by Enrique Ladrón de Guevara Hernández <en...@hotmail.com>.
Hi,
Logs and screenshots attached in a tar file.
In my case, the type of the first interface is "Control", as you can see in the screenshots.
@developers, if you need more info let me know.
Thanks to everyone,Regards.
> Date: Tue, 3 Sep 2013 08:05:10 +0100> Subject: Re: VPC virtual router fails to start up - no route to CS Management Server.
> From: msweet.dev@gmail.com
> To: users@cloudstack.apache.org
> CC: dev@cloudstack.apache.org
>
> Hi,
>
> I couldn't find any screenshots in the string of messages.
> Looking at the logs it almost seems as like the VPC is stopping
> unexpectedly.
>
> Looking at my VPC, the first interface is a Link Local for Control type
> traffic, which is running on KVM.
> I will CC this into the dev mailinglist in search for a developer who knows
> more about VMWare and VPCs.
>
> In the meantime, please could you attach (in a tar), the screenshots of the
> VPC interfaces from the cloudstack interfaces.
>
> Thanks,
> Marty
>
>
>
>
> On Mon, Sep 2, 2013 at 6:28 PM, Enrique Ladrón de Guevara Hernández <
> enriquelgh@hotmail.com> wrote:
>
> > Hi Marty,
> >
> > Sorry, could you look at the logs and screenshots?? Do you need more info
> > to debug the issue??
> >
> > Do you know if there is a bug related to this scenario??
> >
> > I try to find any information on Internet and check my config but I don't
> > know how to continue go ahead ...
> >
> > Do you recommend re-installing CS software with other version or the same
> > version ....??
> >
> > Thanks in advanced for your help.
> > Regards.
> >
> >
> > ----------------------------------------
> > > From: enriquelgh@hotmail.com
> > > To: users@cloudstack.apache.org
> > > Subject: RE: VPC virtual router fails to start up - no route to CS
> > Management Server.
> > > Date: Wed, 28 Aug 2013 20:16:26 +0200
> > >
> > > Now better!
> > >
> > > Regards.
> > >
> > > ----------------------------------------
> > >> From: enriquelgh@hotmail.com
> > >> To: users@cloudstack.apache.org
> > >> Subject: RE: VPC virtual router fails to start up - no route to CS
> > Management Server.
> > >> Date: Wed, 28 Aug 2013 20:09:39 +0200
> > >>
> > >> Hi Marty,
> > >>
> > >> I have used a new test to capture screenshots and logs:
> > >>
> > >> VPC Name: VPC-Test
> > >> Job: job-69
> > >> vrsm: r-59-VM
> > >>
> > >> you can find files attached.
> > >>
> > >> Thanks,
> > >> Regards.
> > >>
> > >> -
> > >> ----------------------------------------
> > >>> Date: Wed, 28 Aug 2013 10:16:23 +0100
> > >>> Subject: Re: VPC virtual router fails to start up - no route to CS
> > Management Server.
> > >>> From: msweet.dev@gmail.com
> > >>> To: users@cloudstack.apache.org
> > >>>
> > >>> Hi,
> > >>>
> > >>> Could you let me know the IP addresses listed in the cloudstack
> > interface
> > >>> under Infrastructure> Virtual Routers> VPC
> > >>>
> > >>> Marty
> > >>>
> > >>>
> > >>> On Tue, Aug 27, 2013 at 11:11 PM, Enrique Ladrón de Guevara Hernández <
> > >>> enriquelgh@hotmail.com> wrote:
> > >>>
> > >>>> Hi Marty,
> > >>>>
> > >>>> Yes, I have still got this issue ... :S I'm very lost ...
> > >>>>
> > >>>> Guest Networks are working fine, but in VPC nop ...
> > >>>>
> > >>>> If you need more info, please let me know.
> > >>>>
> > >>>> Thanks a lot for your time,
> > >>>> Regards.
> > >>>>
> > >>>>
> > >>>> ----------------------------------------
> > >>>>> Date: Tue, 27 Aug 2013 22:54:11 +0100
> > >>>>> Subject: Re: VPC virtual router fails to start up - no route to CS
> > >>>> Management Server.
> > >>>>> From: msweet.dev@gmail.com
> > >>>>> To: users@cloudstack.apache.org
> > >>>>>
> > >>>>> Hi Enrique,
> > >>>>>
> > >>>>> Sorry I haven't got back to you, is this still an issue?
> > >>>>> If so, I will take a look at it and get back to you in the morning.
> > >>>>>
> > >>>>> Thanks,
> > >>>>> Marty
> > >>>>>
> > >>>>> On Monday, August 26, 2013, Enrique Ladrón de Guevara Hernández
> > wrote:
> > >>>>>
> > >>>>>> Hi Marty,
> > >>>>>>
> > >>>>>> My apologies for the format. I hope this time the email format will
> > be
> > >>>>>> better. You can find the logs attached.
> > >>>>>>
> > >>>>>> In this log you can see several VPC deployment tests. One of them
> > is:
> > >>>>>> - VPC name: VPC-Prueba-1
> > >>>>>> - job: job-11
> > >>>>>> - ssvm: r-53-VM.
> > >>>>>>
> > >>>>>> I use GUI to create VPC. The system VM (virutal router) is created
> > and I
> > >>>>>> can log in by console (VNC or VMWARE console), but after 40 min
> > (aprox)
> > >>>>>> this SSVM are destroyed because the MS is not able to connect with.
> > >>>>>>
> > >>>>>> I think the System VM needs default gateway route or static route
> > to MS
> > >>>>>> server like the rest of SystemVMs (Console, Sec. Storage or Guest
> > Net.).
> > >>>>>>
> > >>>>>>
> > >>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)
> > >>>>>>
> > >>>>>> Num. of Management Server: 1 (under CentOS 6.4) [physical server].
> > >>>>>>
> > >>>>>> The MS has this network configuration: IP: 10.10.10.110/24 GW:
> > >>>>>> 10.10.10.254
> > >>>>>>
> > >>>>>> DNS server:10.10.10.116/24
> > >>>>>>
> > >>>>>> Hypervisor: VMWARE 4.1 (with Standard Virtual Switches), 2 ESXi
> > hosts:
> > >>>>>> IPs: 10.10.1.101 & .102/24 GW: 10.10.1.254
> > >>>>>>
> > >>>>>> vCenter: 10.10.1.100/24.
> > >>>>>>
> > >>>>>> Virtual Network Architecture:
> > >>>>>>
> > >>>>>> CS Traffic Type:CS Management
> > >>>>>> VmWare Virtual Switch:vSwitch0
> > >>>>>> CS Physical Network:PhysNet-mgmt-svm
> > >>>>>> Network:10.10.1.0
> > >>>>>> Subnet:/24
> > >>>>>> Gateway:10.10.1.254
> > >>>>>> VLAN TAG: NONE
> > >>>>>> Start IP Range:10.10.1.120
> > >>>>>> End IP Range: 10.10.1.240
> > >>>>>>
> > >>>>>> CS Traffic Type: Storage
> > >>>>>> VmWare Virtual Switch:vSwitch1
> > >>>>>> CS Physical Network:PhysNet-storage
> > >>>>>> Network:10.10.2.0
> > >>>>>> Subnet:/24
> > >>>>>> Gateway:10.10.2.254
> > >>>>>> VLAN TAG: NONE
> > >>>>>> Start IP Range:10.10.2.120
> > >>>>>> End IP Range: 10.10.2.240
> > >>>>>>
> > >>>>>>
> > >>>>>> CS Traffic Type:Guest
> > >>>>>> VmWare Virtual Switch:vSwitch2
> > >>>>>> CS Physical Network:PhysNet-guest-1
> > >>>>>> Network:10.10.3.0
> > >>>>>> Subnet:/24
> > >>>>>> Gateway:10.10.3.254
> > >>>>>> VLAN TAG: NONE
> > >>>>>> Start IP Range:10.10.3.1
> > >>>>>> End IP Range: 10.10.3.254
> > >>>>>>
> > >>>>>> CS Traffic Type:Public
> > >>>>>> VmWare Virtual Switch:vSwitch3
> > >>>>>> CS Physical Network:PhysNet-public
> > >>>>>> Network:10.10.4.0
> > >>>>>> Subnet:/24
> > >>>>>> Gateway:10.10.4.254
> > >>>>>> VLAN TAG: NONE
> > >>>>>> Start IP Range:10.10.4.1
> > >>>>>> End IP Range: 10.10.4.240
> > >>>>>>
> > >>>>>>
> > >>>>>> vRouter (VPC) System VM - doesn't have a specific route to MS:
> > >>>>>>
> > >>>>>> root@r-53-VM:~# netstat -nr
> > >>>>>> Kernel IP routing table
> > >>>>>> Destination Gateway Genmask Flags MSS Window irtt
> > >>>>>> Iface
> > >>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>> eth3
> > >>>>>> root@r-53-VM:~#
> > >>>>>>
> > >>>>>>
> > >>>>>> CS management server:
> > >>>>>>
> > >>>>>> [root@cs-1 ~]# netstat -nr
> > >>>>>> Kernel IP routing table
> > >>>>>> Destination Gateway Genmask Flags MSS Window irtt
> > >>>>>> Iface
> > >>>>>> 10.10.10.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>> eth0
> > >>>>>> 169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0
> > >>>>>> eth0
> > >>>>>> 0.0.0.0 10.10.10.254 0.0.0.0 UG 0 0 0
> > >>>>>> eth0
> > >>>>>> [root@cs-1 ~]#
> > >>>>>>
> > >>>>>> Console Proxy System VM:
> > >>>>>>
> > >>>>>> root@v-50-VM:~# netstat -nr
> > >>>>>> Kernel IP routing table
> > >>>>>> Destination Gateway Genmask Flags MSS Window irtt
> > >>>>>> Iface
> > >>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0 0
> > >>>>>> eth1
> > >>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0 0
> > >>>>>> eth1
> > >>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>> eth2
> > >>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>> eth1
> > >>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
> > >>>>>> eth1
> > >>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
> > >>>>>> eth2
> > >>>>>> root@v-50-VM:~#
> > >>>>>>
> > >>>>>> vRouter (no VPC- Guest Network) System VM:
> > >>>>>>
> > >>>>>> root@r-49-VM:~# netstat -nr
> > >>>>>> Kernel IP routing table
> > >>>>>> Destination Gateway Genmask Flags MSS Window irtt
> > >>>>>> Iface
> > >>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>> eth2
> > >>>>>> 10.10.3.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>> eth0
> > >>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>> eth1
> > >>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
> > >>>>>> eth1
> > >>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
> > >>>>>> eth2
> > >>>>>> root@r-49-VM:~#
> > >>>>>>
> > >>>>>> Secondary Storage System VM:
> > >>>>>>
> > >>>>>> root@s-28-VM:~# netstat -nr
> > >>>>>> Kernel IP routing table
> > >>>>>> Destination Gateway Genmask Flags MSS
> > >>>>>> Window irtt Iface
> > >>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
> > >>>>>> 0 eth1
> > >>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
> > >>>>>> 0 eth1
> > >>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0
> > >>>>>> 0 0 eth2
> > >>>>>> 10.10.2.0 0.0.0.0 255.255.255.0 U 0
> > >>>>>> 0 0 eth3
> > >>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0
> > >>>>>> 0 0 eth1
> > >>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0
> > >>>>>> 0 eth1
> > >>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG
> > >>>>>> 0 0 0 eth2
> > >>>>>> root@s-28-VM:~#
> > >>>>>>
> > >>>>>>
> > >>>>>> Thanks,
> > >>>>>> Regards.
> > >>>>>>
> > >>>>>>
> > >>>>>>
> > >>>>
> > ---------------------------------------------------------------------------------------------
> > >>>>>>
> > >>>>>>
> > >>>>
> > ---------------------------------------------------------------------------------------------
> > >>>>>>
> > >>>>>>
> > >>>>>>> Date: Mon, 26 Aug 2013 15:19:06 +0100
> > >>>>>>> Subject: Re: VPC virtual router fails to start up - no route to CS
> > >>>>>> Management Server.
> > >>>>>>> From: msweet.dev@gmail.com <javascript:;>
> > >>>>>>> To: users@cloudstack.apache.org <javascript:;>
> > >>>>>>>
> > >>>>>>> Hi,
> > >>>>>>>
> > >>>>>>> I don't think this has got a response because of the poor
> > formatting of
> > >>>>>> the
> > >>>>>>> log. Please could you attach the log in a separate file and I will
> > >>>> take a
> > >>>>>>> look?
> > >>>>>>> Am I correct in thinking that it is creating the system VM, and
> > then
> > >>>>>>> destroying it?
> > >>>>>>>
> > >>>>>>> Thanks,
> > >>>>>>> Marty
> > >>>>>>>
> > >>>>>>>
> > >>>>>>> On Sun, Aug 25, 2013 at 11:46 PM, Enrique Ladrón de Guevara
> > Hernández <
> > >>>>>>> enriquelgh@hotmail.com> wrote:
> > >>>>>>>
> > >>>>>>>> Hi,
> > >>>>>>>> I'm carrying out my End of Career Project related to CloudStack
> > >>>>>>>> deployment. I got issues when I try to deploy a VPC, the VPC
> > virtual
> > >>>>>> router
> > >>>>>>>> isn't deployed completely and It's destroyed after timeout.
> > >>>>>>>> The rest of SSVMs (Console Proxy VM, Storage VM and Guest Network
> > VM)
> > >>>>>> are
> > >>>>>>>> deployed correctly. I can access to the instance console, put into
> > >>>> guest
> > >>>>>>>> network a instance, connect to it, etc ...
> > >>>>>>>> Could you help me to resolve this issue? I don't know which is the
> > >>>> thing
> > >>>>>>>> that I'm doing wrong ...
> > >>>>>>>> This is the context:
> > >>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)Num. of Management
> > >>>>>> Server:
> > >>>>>>>> 1 (under CentOS 6.4) [physical server]. The MS has this network
> > >>>>>>>> configuration:IP: 10.10.10.110/24GW: 10.10.10.254DNS server:
> > >>>>>>>> 10.10.10.116/24Hypervisor: VMWARE 4.1:2 ESXi hosts:IPs:
> > 10.10.1.101 &
> > >>>>>>>> .102/24GW: 10.10.1.254vCenter: 10.10.1.100Standard Virtual
> > Switches.
> > >>>>>>>> Virtual Network Architecture:VmWare Virtual Switch CS Physical
> > >>>>>>>> Network Network Subnet Gateway VLAN
> > >>>>>>>> TAG CS Traffic Type Start IP Range End IP RangevSwitch0
> > >>>>>>>> PhysNet-mgmt-svm 10.10.1.0
> > >>>>>>>> 255.255.255.0 10.10.1.254 NONE CS Management 10.10.1.120
> > >>>>>>>> 10.10.1.240vSwitch1
> > >>>>>>>> PhysNet-storage 10.10.2.0 255.255.255.0 10.10.2.254
> > >>>>>>>> NONE Storage 10.10.2.120
> > >>>>>>>> 10.10.2.240vSwitch2 PhysNet-guest-1
> > >>>>>>>> 10.10.3.0 255.255.255.0 10.10.3.254 NONE
> > >>>>>>>> Guest 10.10.3.1 10.10.3.254vSwitch3
> > >>>>>>>> PhysNet-public 10.10.4.0
> > >>>>>>>> 255.255.255.0 10.10.4.254 NONE Public
> > >>>>>>>> 10.10.4.1 10.10.4.240
> > >>>>>>>> I log in to ssvm consoles and I can see the following:vRouter
> > (VPC)
> > >>>>>> System
> > >>>>>>>> VM - doesn't have a specific route to MS:root@r-53-VM:~# netstat
> > >>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
> > >>>>>>>> Flags MSS Window irtt Iface10.10.1.0 0.0.0.0 255.255.255.0
> > >>>>>>>> U 0 0 0 eth3root@r-53-VM:~#
> > >>>>>>>> CS management server:[root@cs-1 ~]# netstat -nrKernel IP routing
> > >>>>>>>> tableDestination Gateway Genmask Flags MSS Window
> > >>>>>>>> irtt Iface10.10.10.0 0.0.0.0 255.255.255.0 U 0 0
> > >>>>>>>> 0 eth0169.254.0.0 0.0.0.0 255.255.0.0 U 0 0
> > >>>>>>>> 0 eth00.0.0.0 10.10.10.254 0.0.0.0 UG 0
> > >>>>>>>> 0 0 eth0[root@cs-1 ~]#
> > >>>>>>>> Console Proxy System VM:root@v-50-VM:~# netstat -nrKernel IP
> > routing
> > >>>>>>>> tableDestination Gateway Genmask Flags MSS Window
> > >>>>>>>> irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
> > >>>>>>>> 0 eth110.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
> > >>>>>>>> 0 eth110.10.4.0 0.0.0.0 255.255.255.0 U 0
> > >>>>>>>> 0 0 eth210.10.1.0 0.0.0.0 255.255.255.0 U
> > >>>>>>>> 0 0 0 eth110.10.10.0 10.10.1.254 255.255.255.0 UG
> > >>>>>>>> 0 0 0 eth10.0.0.0 10.10.4.254 0.0.0.0 UG
> > >>>>>>>> 0 0 0 eth2root@v-50-VM:~#
> > >>>>>>>> vRouter (no VPC- Guest Network) System VM:root@r-49-VM:~# netstat
> > >>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
> > >>>>>>>> Flags MSS Window irtt Iface10.10.4.0 0.0.0.0 255.255.255.0
> > >>>>>>>> U 0 0 0 eth210.10.3.0 0.0.0.0
> > >>>>>>>> 255.255.255.0 U 0 0 0 eth010.10.1.0 0.0.0.0
> > >>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0 10.10.1.254
> > >>>>>>>> 255.255.255.0 UG 0 0 0 eth10.0.0.0
> > >>>>>>>> 10.10.4.254 0.0.0.0 UG 0 0 0 eth2root@r-49-VM
> > >>>>>>>> :~#
> > >>>>>>>> Secondary Storage System VMroot@s-28-VM:~# netstat -nrKernel IP
> > >>>> routing
> > >>>>>>>> tableDestination Gateway Genmask Flags MSS
> > >>>>>>>> Window irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH
> > >>>>>>>> 0 0 0 eth110.10.10.110 10.10.1.254
> > >>>>>>>> 255.255.255.255 UGH 0 0 0 eth110.10.4.0
> > >>>>>>>> 0.0.0.0 255.255.255.0 U 0 0
> > >>>>>>>> 0 eth210.10.2.0 0.0.0.0 255.255.255.0 U
> > >>>>>>>> 0 0 0 eth310.10.1.0 0.0.0.0
> > >>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0
> > >>>>>>>> 10.10.1.254 255.255.255.0 UG 0 0 0
> > >>>>>>>> eth10.0.0.0 10.10.4.254 0.0.0.0 UG
> > >>>>>>>> 0 0 0 eth2root@s-28-VM:~# management-server.log
> > >>>>>>>> (filtered by r-53-VM):
> > >>>>>>>> [root@cs-1 ~]# g>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
> > >>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
> > template=domP
> > >>>>>> name=r-53-VM
> > >>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
> > >>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
> > disable_rp_filter=true
> > >>>>>> extra_pubnics=2
> > >>>>>>>>
> > >>>>>>
> > >>>>
> > nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}},{"check.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":100,"name":"r-53-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.1.238","
> > >>>>>>>> router.name
> > >>>>>>>>
> > >>>>>>
> > >>>>
> > ":"r-53-VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbps":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"10.10.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"router.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"10.10.1.238","
> > >>>>>>>> router.name
> > >>>>>>>>
> > >>>>>>
> > >>>>
> > ":"r-53-VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessDetails":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","
> > >>>>>>>> router.name":"r-53-VM"},"wait":0}},{}] }2013-08-25 11:34:48,001
> > DEBUG
> > >>>>>>>> [agent.transport.Request] (Job-Executor-13:job-11) Seq
> > 1-1308430869:
> > >>>>>>>> Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags:
> > >>>> 100111,
> > >>>>>>>>
> > >>>>>>
> > >>>>
> > [{"StartCommand":{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter">>
> > >>>>>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
> > >>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
> > template=domP
> > >>>>>> name=r-53-VM
> > >>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
> > >>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
> > disable_rp_filter=true
> > >>>>>> extra_pubnics=2
> > >>>>>>>>
> > >>>>>>
> > >>>>
> > nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":>>
> > >>>>>> GNU/Linux 5.0 (32-bit)",
> > >>>>
> >
RE: VPC virtual router fails to start up - no route to CS
Management Server.
Posted by Enrique Ladrón de Guevara Hernández <en...@hotmail.com>.
Hi,
Logs and screenshots attached in a tar file.
In my case, the type of the first interface is "Control", as you can see in the screenshots.
@developers, if you need more info let me know.
Thanks to everyone,Regards.
> Date: Tue, 3 Sep 2013 08:05:10 +0100> Subject: Re: VPC virtual router fails to start up - no route to CS Management Server.
> From: msweet.dev@gmail.com
> To: users@cloudstack.apache.org
> CC: dev@cloudstack.apache.org
>
> Hi,
>
> I couldn't find any screenshots in the string of messages.
> Looking at the logs it almost seems as like the VPC is stopping
> unexpectedly.
>
> Looking at my VPC, the first interface is a Link Local for Control type
> traffic, which is running on KVM.
> I will CC this into the dev mailinglist in search for a developer who knows
> more about VMWare and VPCs.
>
> In the meantime, please could you attach (in a tar), the screenshots of the
> VPC interfaces from the cloudstack interfaces.
>
> Thanks,
> Marty
>
>
>
>
> On Mon, Sep 2, 2013 at 6:28 PM, Enrique Ladrón de Guevara Hernández <
> enriquelgh@hotmail.com> wrote:
>
> > Hi Marty,
> >
> > Sorry, could you look at the logs and screenshots?? Do you need more info
> > to debug the issue??
> >
> > Do you know if there is a bug related to this scenario??
> >
> > I try to find any information on Internet and check my config but I don't
> > know how to continue go ahead ...
> >
> > Do you recommend re-installing CS software with other version or the same
> > version ....??
> >
> > Thanks in advanced for your help.
> > Regards.
> >
> >
> > ----------------------------------------
> > > From: enriquelgh@hotmail.com
> > > To: users@cloudstack.apache.org
> > > Subject: RE: VPC virtual router fails to start up - no route to CS
> > Management Server.
> > > Date: Wed, 28 Aug 2013 20:16:26 +0200
> > >
> > > Now better!
> > >
> > > Regards.
> > >
> > > ----------------------------------------
> > >> From: enriquelgh@hotmail.com
> > >> To: users@cloudstack.apache.org
> > >> Subject: RE: VPC virtual router fails to start up - no route to CS
> > Management Server.
> > >> Date: Wed, 28 Aug 2013 20:09:39 +0200
> > >>
> > >> Hi Marty,
> > >>
> > >> I have used a new test to capture screenshots and logs:
> > >>
> > >> VPC Name: VPC-Test
> > >> Job: job-69
> > >> vrsm: r-59-VM
> > >>
> > >> you can find files attached.
> > >>
> > >> Thanks,
> > >> Regards.
> > >>
> > >> -
> > >> ----------------------------------------
> > >>> Date: Wed, 28 Aug 2013 10:16:23 +0100
> > >>> Subject: Re: VPC virtual router fails to start up - no route to CS
> > Management Server.
> > >>> From: msweet.dev@gmail.com
> > >>> To: users@cloudstack.apache.org
> > >>>
> > >>> Hi,
> > >>>
> > >>> Could you let me know the IP addresses listed in the cloudstack
> > interface
> > >>> under Infrastructure> Virtual Routers> VPC
> > >>>
> > >>> Marty
> > >>>
> > >>>
> > >>> On Tue, Aug 27, 2013 at 11:11 PM, Enrique Ladrón de Guevara Hernández <
> > >>> enriquelgh@hotmail.com> wrote:
> > >>>
> > >>>> Hi Marty,
> > >>>>
> > >>>> Yes, I have still got this issue ... :S I'm very lost ...
> > >>>>
> > >>>> Guest Networks are working fine, but in VPC nop ...
> > >>>>
> > >>>> If you need more info, please let me know.
> > >>>>
> > >>>> Thanks a lot for your time,
> > >>>> Regards.
> > >>>>
> > >>>>
> > >>>> ----------------------------------------
> > >>>>> Date: Tue, 27 Aug 2013 22:54:11 +0100
> > >>>>> Subject: Re: VPC virtual router fails to start up - no route to CS
> > >>>> Management Server.
> > >>>>> From: msweet.dev@gmail.com
> > >>>>> To: users@cloudstack.apache.org
> > >>>>>
> > >>>>> Hi Enrique,
> > >>>>>
> > >>>>> Sorry I haven't got back to you, is this still an issue?
> > >>>>> If so, I will take a look at it and get back to you in the morning.
> > >>>>>
> > >>>>> Thanks,
> > >>>>> Marty
> > >>>>>
> > >>>>> On Monday, August 26, 2013, Enrique Ladrón de Guevara Hernández
> > wrote:
> > >>>>>
> > >>>>>> Hi Marty,
> > >>>>>>
> > >>>>>> My apologies for the format. I hope this time the email format will
> > be
> > >>>>>> better. You can find the logs attached.
> > >>>>>>
> > >>>>>> In this log you can see several VPC deployment tests. One of them
> > is:
> > >>>>>> - VPC name: VPC-Prueba-1
> > >>>>>> - job: job-11
> > >>>>>> - ssvm: r-53-VM.
> > >>>>>>
> > >>>>>> I use GUI to create VPC. The system VM (virutal router) is created
> > and I
> > >>>>>> can log in by console (VNC or VMWARE console), but after 40 min
> > (aprox)
> > >>>>>> this SSVM are destroyed because the MS is not able to connect with.
> > >>>>>>
> > >>>>>> I think the System VM needs default gateway route or static route
> > to MS
> > >>>>>> server like the rest of SystemVMs (Console, Sec. Storage or Guest
> > Net.).
> > >>>>>>
> > >>>>>>
> > >>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)
> > >>>>>>
> > >>>>>> Num. of Management Server: 1 (under CentOS 6.4) [physical server].
> > >>>>>>
> > >>>>>> The MS has this network configuration: IP: 10.10.10.110/24 GW:
> > >>>>>> 10.10.10.254
> > >>>>>>
> > >>>>>> DNS server:10.10.10.116/24
> > >>>>>>
> > >>>>>> Hypervisor: VMWARE 4.1 (with Standard Virtual Switches), 2 ESXi
> > hosts:
> > >>>>>> IPs: 10.10.1.101 & .102/24 GW: 10.10.1.254
> > >>>>>>
> > >>>>>> vCenter: 10.10.1.100/24.
> > >>>>>>
> > >>>>>> Virtual Network Architecture:
> > >>>>>>
> > >>>>>> CS Traffic Type:CS Management
> > >>>>>> VmWare Virtual Switch:vSwitch0
> > >>>>>> CS Physical Network:PhysNet-mgmt-svm
> > >>>>>> Network:10.10.1.0
> > >>>>>> Subnet:/24
> > >>>>>> Gateway:10.10.1.254
> > >>>>>> VLAN TAG: NONE
> > >>>>>> Start IP Range:10.10.1.120
> > >>>>>> End IP Range: 10.10.1.240
> > >>>>>>
> > >>>>>> CS Traffic Type: Storage
> > >>>>>> VmWare Virtual Switch:vSwitch1
> > >>>>>> CS Physical Network:PhysNet-storage
> > >>>>>> Network:10.10.2.0
> > >>>>>> Subnet:/24
> > >>>>>> Gateway:10.10.2.254
> > >>>>>> VLAN TAG: NONE
> > >>>>>> Start IP Range:10.10.2.120
> > >>>>>> End IP Range: 10.10.2.240
> > >>>>>>
> > >>>>>>
> > >>>>>> CS Traffic Type:Guest
> > >>>>>> VmWare Virtual Switch:vSwitch2
> > >>>>>> CS Physical Network:PhysNet-guest-1
> > >>>>>> Network:10.10.3.0
> > >>>>>> Subnet:/24
> > >>>>>> Gateway:10.10.3.254
> > >>>>>> VLAN TAG: NONE
> > >>>>>> Start IP Range:10.10.3.1
> > >>>>>> End IP Range: 10.10.3.254
> > >>>>>>
> > >>>>>> CS Traffic Type:Public
> > >>>>>> VmWare Virtual Switch:vSwitch3
> > >>>>>> CS Physical Network:PhysNet-public
> > >>>>>> Network:10.10.4.0
> > >>>>>> Subnet:/24
> > >>>>>> Gateway:10.10.4.254
> > >>>>>> VLAN TAG: NONE
> > >>>>>> Start IP Range:10.10.4.1
> > >>>>>> End IP Range: 10.10.4.240
> > >>>>>>
> > >>>>>>
> > >>>>>> vRouter (VPC) System VM - doesn't have a specific route to MS:
> > >>>>>>
> > >>>>>> root@r-53-VM:~# netstat -nr
> > >>>>>> Kernel IP routing table
> > >>>>>> Destination Gateway Genmask Flags MSS Window irtt
> > >>>>>> Iface
> > >>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>> eth3
> > >>>>>> root@r-53-VM:~#
> > >>>>>>
> > >>>>>>
> > >>>>>> CS management server:
> > >>>>>>
> > >>>>>> [root@cs-1 ~]# netstat -nr
> > >>>>>> Kernel IP routing table
> > >>>>>> Destination Gateway Genmask Flags MSS Window irtt
> > >>>>>> Iface
> > >>>>>> 10.10.10.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>> eth0
> > >>>>>> 169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0
> > >>>>>> eth0
> > >>>>>> 0.0.0.0 10.10.10.254 0.0.0.0 UG 0 0 0
> > >>>>>> eth0
> > >>>>>> [root@cs-1 ~]#
> > >>>>>>
> > >>>>>> Console Proxy System VM:
> > >>>>>>
> > >>>>>> root@v-50-VM:~# netstat -nr
> > >>>>>> Kernel IP routing table
> > >>>>>> Destination Gateway Genmask Flags MSS Window irtt
> > >>>>>> Iface
> > >>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0 0
> > >>>>>> eth1
> > >>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0 0
> > >>>>>> eth1
> > >>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>> eth2
> > >>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>> eth1
> > >>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
> > >>>>>> eth1
> > >>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
> > >>>>>> eth2
> > >>>>>> root@v-50-VM:~#
> > >>>>>>
> > >>>>>> vRouter (no VPC- Guest Network) System VM:
> > >>>>>>
> > >>>>>> root@r-49-VM:~# netstat -nr
> > >>>>>> Kernel IP routing table
> > >>>>>> Destination Gateway Genmask Flags MSS Window irtt
> > >>>>>> Iface
> > >>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>> eth2
> > >>>>>> 10.10.3.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>> eth0
> > >>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> > >>>>>> eth1
> > >>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
> > >>>>>> eth1
> > >>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
> > >>>>>> eth2
> > >>>>>> root@r-49-VM:~#
> > >>>>>>
> > >>>>>> Secondary Storage System VM:
> > >>>>>>
> > >>>>>> root@s-28-VM:~# netstat -nr
> > >>>>>> Kernel IP routing table
> > >>>>>> Destination Gateway Genmask Flags MSS
> > >>>>>> Window irtt Iface
> > >>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
> > >>>>>> 0 eth1
> > >>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
> > >>>>>> 0 eth1
> > >>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0
> > >>>>>> 0 0 eth2
> > >>>>>> 10.10.2.0 0.0.0.0 255.255.255.0 U 0
> > >>>>>> 0 0 eth3
> > >>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0
> > >>>>>> 0 0 eth1
> > >>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0
> > >>>>>> 0 eth1
> > >>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG
> > >>>>>> 0 0 0 eth2
> > >>>>>> root@s-28-VM:~#
> > >>>>>>
> > >>>>>>
> > >>>>>> Thanks,
> > >>>>>> Regards.
> > >>>>>>
> > >>>>>>
> > >>>>>>
> > >>>>
> > ---------------------------------------------------------------------------------------------
> > >>>>>>
> > >>>>>>
> > >>>>
> > ---------------------------------------------------------------------------------------------
> > >>>>>>
> > >>>>>>
> > >>>>>>> Date: Mon, 26 Aug 2013 15:19:06 +0100
> > >>>>>>> Subject: Re: VPC virtual router fails to start up - no route to CS
> > >>>>>> Management Server.
> > >>>>>>> From: msweet.dev@gmail.com <javascript:;>
> > >>>>>>> To: users@cloudstack.apache.org <javascript:;>
> > >>>>>>>
> > >>>>>>> Hi,
> > >>>>>>>
> > >>>>>>> I don't think this has got a response because of the poor
> > formatting of
> > >>>>>> the
> > >>>>>>> log. Please could you attach the log in a separate file and I will
> > >>>> take a
> > >>>>>>> look?
> > >>>>>>> Am I correct in thinking that it is creating the system VM, and
> > then
> > >>>>>>> destroying it?
> > >>>>>>>
> > >>>>>>> Thanks,
> > >>>>>>> Marty
> > >>>>>>>
> > >>>>>>>
> > >>>>>>> On Sun, Aug 25, 2013 at 11:46 PM, Enrique Ladrón de Guevara
> > Hernández <
> > >>>>>>> enriquelgh@hotmail.com> wrote:
> > >>>>>>>
> > >>>>>>>> Hi,
> > >>>>>>>> I'm carrying out my End of Career Project related to CloudStack
> > >>>>>>>> deployment. I got issues when I try to deploy a VPC, the VPC
> > virtual
> > >>>>>> router
> > >>>>>>>> isn't deployed completely and It's destroyed after timeout.
> > >>>>>>>> The rest of SSVMs (Console Proxy VM, Storage VM and Guest Network
> > VM)
> > >>>>>> are
> > >>>>>>>> deployed correctly. I can access to the instance console, put into
> > >>>> guest
> > >>>>>>>> network a instance, connect to it, etc ...
> > >>>>>>>> Could you help me to resolve this issue? I don't know which is the
> > >>>> thing
> > >>>>>>>> that I'm doing wrong ...
> > >>>>>>>> This is the context:
> > >>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)Num. of Management
> > >>>>>> Server:
> > >>>>>>>> 1 (under CentOS 6.4) [physical server]. The MS has this network
> > >>>>>>>> configuration:IP: 10.10.10.110/24GW: 10.10.10.254DNS server:
> > >>>>>>>> 10.10.10.116/24Hypervisor: VMWARE 4.1:2 ESXi hosts:IPs:
> > 10.10.1.101 &
> > >>>>>>>> .102/24GW: 10.10.1.254vCenter: 10.10.1.100Standard Virtual
> > Switches.
> > >>>>>>>> Virtual Network Architecture:VmWare Virtual Switch CS Physical
> > >>>>>>>> Network Network Subnet Gateway VLAN
> > >>>>>>>> TAG CS Traffic Type Start IP Range End IP RangevSwitch0
> > >>>>>>>> PhysNet-mgmt-svm 10.10.1.0
> > >>>>>>>> 255.255.255.0 10.10.1.254 NONE CS Management 10.10.1.120
> > >>>>>>>> 10.10.1.240vSwitch1
> > >>>>>>>> PhysNet-storage 10.10.2.0 255.255.255.0 10.10.2.254
> > >>>>>>>> NONE Storage 10.10.2.120
> > >>>>>>>> 10.10.2.240vSwitch2 PhysNet-guest-1
> > >>>>>>>> 10.10.3.0 255.255.255.0 10.10.3.254 NONE
> > >>>>>>>> Guest 10.10.3.1 10.10.3.254vSwitch3
> > >>>>>>>> PhysNet-public 10.10.4.0
> > >>>>>>>> 255.255.255.0 10.10.4.254 NONE Public
> > >>>>>>>> 10.10.4.1 10.10.4.240
> > >>>>>>>> I log in to ssvm consoles and I can see the following:vRouter
> > (VPC)
> > >>>>>> System
> > >>>>>>>> VM - doesn't have a specific route to MS:root@r-53-VM:~# netstat
> > >>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
> > >>>>>>>> Flags MSS Window irtt Iface10.10.1.0 0.0.0.0 255.255.255.0
> > >>>>>>>> U 0 0 0 eth3root@r-53-VM:~#
> > >>>>>>>> CS management server:[root@cs-1 ~]# netstat -nrKernel IP routing
> > >>>>>>>> tableDestination Gateway Genmask Flags MSS Window
> > >>>>>>>> irtt Iface10.10.10.0 0.0.0.0 255.255.255.0 U 0 0
> > >>>>>>>> 0 eth0169.254.0.0 0.0.0.0 255.255.0.0 U 0 0
> > >>>>>>>> 0 eth00.0.0.0 10.10.10.254 0.0.0.0 UG 0
> > >>>>>>>> 0 0 eth0[root@cs-1 ~]#
> > >>>>>>>> Console Proxy System VM:root@v-50-VM:~# netstat -nrKernel IP
> > routing
> > >>>>>>>> tableDestination Gateway Genmask Flags MSS Window
> > >>>>>>>> irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
> > >>>>>>>> 0 eth110.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
> > >>>>>>>> 0 eth110.10.4.0 0.0.0.0 255.255.255.0 U 0
> > >>>>>>>> 0 0 eth210.10.1.0 0.0.0.0 255.255.255.0 U
> > >>>>>>>> 0 0 0 eth110.10.10.0 10.10.1.254 255.255.255.0 UG
> > >>>>>>>> 0 0 0 eth10.0.0.0 10.10.4.254 0.0.0.0 UG
> > >>>>>>>> 0 0 0 eth2root@v-50-VM:~#
> > >>>>>>>> vRouter (no VPC- Guest Network) System VM:root@r-49-VM:~# netstat
> > >>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
> > >>>>>>>> Flags MSS Window irtt Iface10.10.4.0 0.0.0.0 255.255.255.0
> > >>>>>>>> U 0 0 0 eth210.10.3.0 0.0.0.0
> > >>>>>>>> 255.255.255.0 U 0 0 0 eth010.10.1.0 0.0.0.0
> > >>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0 10.10.1.254
> > >>>>>>>> 255.255.255.0 UG 0 0 0 eth10.0.0.0
> > >>>>>>>> 10.10.4.254 0.0.0.0 UG 0 0 0 eth2root@r-49-VM
> > >>>>>>>> :~#
> > >>>>>>>> Secondary Storage System VMroot@s-28-VM:~# netstat -nrKernel IP
> > >>>> routing
> > >>>>>>>> tableDestination Gateway Genmask Flags MSS
> > >>>>>>>> Window irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH
> > >>>>>>>> 0 0 0 eth110.10.10.110 10.10.1.254
> > >>>>>>>> 255.255.255.255 UGH 0 0 0 eth110.10.4.0
> > >>>>>>>> 0.0.0.0 255.255.255.0 U 0 0
> > >>>>>>>> 0 eth210.10.2.0 0.0.0.0 255.255.255.0 U
> > >>>>>>>> 0 0 0 eth310.10.1.0 0.0.0.0
> > >>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0
> > >>>>>>>> 10.10.1.254 255.255.255.0 UG 0 0 0
> > >>>>>>>> eth10.0.0.0 10.10.4.254 0.0.0.0 UG
> > >>>>>>>> 0 0 0 eth2root@s-28-VM:~# management-server.log
> > >>>>>>>> (filtered by r-53-VM):
> > >>>>>>>> [root@cs-1 ~]# g>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
> > >>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
> > template=domP
> > >>>>>> name=r-53-VM
> > >>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
> > >>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
> > disable_rp_filter=true
> > >>>>>> extra_pubnics=2
> > >>>>>>>>
> > >>>>>>
> > >>>>
> > nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}},{"check.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":100,"name":"r-53-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.1.238","
> > >>>>>>>> router.name
> > >>>>>>>>
> > >>>>>>
> > >>>>
> > ":"r-53-VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbps":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"10.10.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"router.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"10.10.1.238","
> > >>>>>>>> router.name
> > >>>>>>>>
> > >>>>>>
> > >>>>
> > ":"r-53-VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessDetails":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","
> > >>>>>>>> router.name":"r-53-VM"},"wait":0}},{}] }2013-08-25 11:34:48,001
> > DEBUG
> > >>>>>>>> [agent.transport.Request] (Job-Executor-13:job-11) Seq
> > 1-1308430869:
> > >>>>>>>> Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags:
> > >>>> 100111,
> > >>>>>>>>
> > >>>>>>
> > >>>>
> > [{"StartCommand":{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter">>
> > >>>>>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
> > >>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
> > template=domP
> > >>>>>> name=r-53-VM
> > >>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
> > >>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
> > disable_rp_filter=true
> > >>>>>> extra_pubnics=2
> > >>>>>>>>
> > >>>>>>
> > >>>>
> > nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":>>
> > >>>>>> GNU/Linux 5.0 (32-bit)",
> > >>>>
> >
Re: VPC virtual router fails to start up - no route to CS Management Server.
Posted by Marty Sweet <ms...@gmail.com>.
Hi,
I couldn't find any screenshots in the string of messages.
Looking at the logs it almost seems as like the VPC is stopping
unexpectedly.
Looking at my VPC, the first interface is a Link Local for Control type
traffic, which is running on KVM.
I will CC this into the dev mailinglist in search for a developer who knows
more about VMWare and VPCs.
In the meantime, please could you attach (in a tar), the screenshots of the
VPC interfaces from the cloudstack interfaces.
Thanks,
Marty
On Mon, Sep 2, 2013 at 6:28 PM, Enrique Ladrón de Guevara Hernández <
enriquelgh@hotmail.com> wrote:
> Hi Marty,
>
> Sorry, could you look at the logs and screenshots?? Do you need more info
> to debug the issue??
>
> Do you know if there is a bug related to this scenario??
>
> I try to find any information on Internet and check my config but I don't
> know how to continue go ahead ...
>
> Do you recommend re-installing CS software with other version or the same
> version ....??
>
> Thanks in advanced for your help.
> Regards.
>
>
> ----------------------------------------
> > From: enriquelgh@hotmail.com
> > To: users@cloudstack.apache.org
> > Subject: RE: VPC virtual router fails to start up - no route to CS
> Management Server.
> > Date: Wed, 28 Aug 2013 20:16:26 +0200
> >
> > Now better!
> >
> > Regards.
> >
> > ----------------------------------------
> >> From: enriquelgh@hotmail.com
> >> To: users@cloudstack.apache.org
> >> Subject: RE: VPC virtual router fails to start up - no route to CS
> Management Server.
> >> Date: Wed, 28 Aug 2013 20:09:39 +0200
> >>
> >> Hi Marty,
> >>
> >> I have used a new test to capture screenshots and logs:
> >>
> >> VPC Name: VPC-Test
> >> Job: job-69
> >> vrsm: r-59-VM
> >>
> >> you can find files attached.
> >>
> >> Thanks,
> >> Regards.
> >>
> >> -
> >> ----------------------------------------
> >>> Date: Wed, 28 Aug 2013 10:16:23 +0100
> >>> Subject: Re: VPC virtual router fails to start up - no route to CS
> Management Server.
> >>> From: msweet.dev@gmail.com
> >>> To: users@cloudstack.apache.org
> >>>
> >>> Hi,
> >>>
> >>> Could you let me know the IP addresses listed in the cloudstack
> interface
> >>> under Infrastructure> Virtual Routers> VPC
> >>>
> >>> Marty
> >>>
> >>>
> >>> On Tue, Aug 27, 2013 at 11:11 PM, Enrique Ladrón de Guevara Hernández <
> >>> enriquelgh@hotmail.com> wrote:
> >>>
> >>>> Hi Marty,
> >>>>
> >>>> Yes, I have still got this issue ... :S I'm very lost ...
> >>>>
> >>>> Guest Networks are working fine, but in VPC nop ...
> >>>>
> >>>> If you need more info, please let me know.
> >>>>
> >>>> Thanks a lot for your time,
> >>>> Regards.
> >>>>
> >>>>
> >>>> ----------------------------------------
> >>>>> Date: Tue, 27 Aug 2013 22:54:11 +0100
> >>>>> Subject: Re: VPC virtual router fails to start up - no route to CS
> >>>> Management Server.
> >>>>> From: msweet.dev@gmail.com
> >>>>> To: users@cloudstack.apache.org
> >>>>>
> >>>>> Hi Enrique,
> >>>>>
> >>>>> Sorry I haven't got back to you, is this still an issue?
> >>>>> If so, I will take a look at it and get back to you in the morning.
> >>>>>
> >>>>> Thanks,
> >>>>> Marty
> >>>>>
> >>>>> On Monday, August 26, 2013, Enrique Ladrón de Guevara Hernández
> wrote:
> >>>>>
> >>>>>> Hi Marty,
> >>>>>>
> >>>>>> My apologies for the format. I hope this time the email format will
> be
> >>>>>> better. You can find the logs attached.
> >>>>>>
> >>>>>> In this log you can see several VPC deployment tests. One of them
> is:
> >>>>>> - VPC name: VPC-Prueba-1
> >>>>>> - job: job-11
> >>>>>> - ssvm: r-53-VM.
> >>>>>>
> >>>>>> I use GUI to create VPC. The system VM (virutal router) is created
> and I
> >>>>>> can log in by console (VNC or VMWARE console), but after 40 min
> (aprox)
> >>>>>> this SSVM are destroyed because the MS is not able to connect with.
> >>>>>>
> >>>>>> I think the System VM needs default gateway route or static route
> to MS
> >>>>>> server like the rest of SystemVMs (Console, Sec. Storage or Guest
> Net.).
> >>>>>>
> >>>>>>
> >>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)
> >>>>>>
> >>>>>> Num. of Management Server: 1 (under CentOS 6.4) [physical server].
> >>>>>>
> >>>>>> The MS has this network configuration: IP: 10.10.10.110/24 GW:
> >>>>>> 10.10.10.254
> >>>>>>
> >>>>>> DNS server:10.10.10.116/24
> >>>>>>
> >>>>>> Hypervisor: VMWARE 4.1 (with Standard Virtual Switches), 2 ESXi
> hosts:
> >>>>>> IPs: 10.10.1.101 & .102/24 GW: 10.10.1.254
> >>>>>>
> >>>>>> vCenter: 10.10.1.100/24.
> >>>>>>
> >>>>>> Virtual Network Architecture:
> >>>>>>
> >>>>>> CS Traffic Type:CS Management
> >>>>>> VmWare Virtual Switch:vSwitch0
> >>>>>> CS Physical Network:PhysNet-mgmt-svm
> >>>>>> Network:10.10.1.0
> >>>>>> Subnet:/24
> >>>>>> Gateway:10.10.1.254
> >>>>>> VLAN TAG: NONE
> >>>>>> Start IP Range:10.10.1.120
> >>>>>> End IP Range: 10.10.1.240
> >>>>>>
> >>>>>> CS Traffic Type: Storage
> >>>>>> VmWare Virtual Switch:vSwitch1
> >>>>>> CS Physical Network:PhysNet-storage
> >>>>>> Network:10.10.2.0
> >>>>>> Subnet:/24
> >>>>>> Gateway:10.10.2.254
> >>>>>> VLAN TAG: NONE
> >>>>>> Start IP Range:10.10.2.120
> >>>>>> End IP Range: 10.10.2.240
> >>>>>>
> >>>>>>
> >>>>>> CS Traffic Type:Guest
> >>>>>> VmWare Virtual Switch:vSwitch2
> >>>>>> CS Physical Network:PhysNet-guest-1
> >>>>>> Network:10.10.3.0
> >>>>>> Subnet:/24
> >>>>>> Gateway:10.10.3.254
> >>>>>> VLAN TAG: NONE
> >>>>>> Start IP Range:10.10.3.1
> >>>>>> End IP Range: 10.10.3.254
> >>>>>>
> >>>>>> CS Traffic Type:Public
> >>>>>> VmWare Virtual Switch:vSwitch3
> >>>>>> CS Physical Network:PhysNet-public
> >>>>>> Network:10.10.4.0
> >>>>>> Subnet:/24
> >>>>>> Gateway:10.10.4.254
> >>>>>> VLAN TAG: NONE
> >>>>>> Start IP Range:10.10.4.1
> >>>>>> End IP Range: 10.10.4.240
> >>>>>>
> >>>>>>
> >>>>>> vRouter (VPC) System VM - doesn't have a specific route to MS:
> >>>>>>
> >>>>>> root@r-53-VM:~# netstat -nr
> >>>>>> Kernel IP routing table
> >>>>>> Destination Gateway Genmask Flags MSS Window irtt
> >>>>>> Iface
> >>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> >>>>>> eth3
> >>>>>> root@r-53-VM:~#
> >>>>>>
> >>>>>>
> >>>>>> CS management server:
> >>>>>>
> >>>>>> [root@cs-1 ~]# netstat -nr
> >>>>>> Kernel IP routing table
> >>>>>> Destination Gateway Genmask Flags MSS Window irtt
> >>>>>> Iface
> >>>>>> 10.10.10.0 0.0.0.0 255.255.255.0 U 0 0 0
> >>>>>> eth0
> >>>>>> 169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0
> >>>>>> eth0
> >>>>>> 0.0.0.0 10.10.10.254 0.0.0.0 UG 0 0 0
> >>>>>> eth0
> >>>>>> [root@cs-1 ~]#
> >>>>>>
> >>>>>> Console Proxy System VM:
> >>>>>>
> >>>>>> root@v-50-VM:~# netstat -nr
> >>>>>> Kernel IP routing table
> >>>>>> Destination Gateway Genmask Flags MSS Window irtt
> >>>>>> Iface
> >>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0 0
> >>>>>> eth1
> >>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0 0
> >>>>>> eth1
> >>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
> >>>>>> eth2
> >>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> >>>>>> eth1
> >>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
> >>>>>> eth1
> >>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
> >>>>>> eth2
> >>>>>> root@v-50-VM:~#
> >>>>>>
> >>>>>> vRouter (no VPC- Guest Network) System VM:
> >>>>>>
> >>>>>> root@r-49-VM:~# netstat -nr
> >>>>>> Kernel IP routing table
> >>>>>> Destination Gateway Genmask Flags MSS Window irtt
> >>>>>> Iface
> >>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
> >>>>>> eth2
> >>>>>> 10.10.3.0 0.0.0.0 255.255.255.0 U 0 0 0
> >>>>>> eth0
> >>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> >>>>>> eth1
> >>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
> >>>>>> eth1
> >>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
> >>>>>> eth2
> >>>>>> root@r-49-VM:~#
> >>>>>>
> >>>>>> Secondary Storage System VM:
> >>>>>>
> >>>>>> root@s-28-VM:~# netstat -nr
> >>>>>> Kernel IP routing table
> >>>>>> Destination Gateway Genmask Flags MSS
> >>>>>> Window irtt Iface
> >>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
> >>>>>> 0 eth1
> >>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
> >>>>>> 0 eth1
> >>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0
> >>>>>> 0 0 eth2
> >>>>>> 10.10.2.0 0.0.0.0 255.255.255.0 U 0
> >>>>>> 0 0 eth3
> >>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0
> >>>>>> 0 0 eth1
> >>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0
> >>>>>> 0 eth1
> >>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG
> >>>>>> 0 0 0 eth2
> >>>>>> root@s-28-VM:~#
> >>>>>>
> >>>>>>
> >>>>>> Thanks,
> >>>>>> Regards.
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>
> ---------------------------------------------------------------------------------------------
> >>>>>>
> >>>>>>
> >>>>
> ---------------------------------------------------------------------------------------------
> >>>>>>
> >>>>>>
> >>>>>>> Date: Mon, 26 Aug 2013 15:19:06 +0100
> >>>>>>> Subject: Re: VPC virtual router fails to start up - no route to CS
> >>>>>> Management Server.
> >>>>>>> From: msweet.dev@gmail.com <javascript:;>
> >>>>>>> To: users@cloudstack.apache.org <javascript:;>
> >>>>>>>
> >>>>>>> Hi,
> >>>>>>>
> >>>>>>> I don't think this has got a response because of the poor
> formatting of
> >>>>>> the
> >>>>>>> log. Please could you attach the log in a separate file and I will
> >>>> take a
> >>>>>>> look?
> >>>>>>> Am I correct in thinking that it is creating the system VM, and
> then
> >>>>>>> destroying it?
> >>>>>>>
> >>>>>>> Thanks,
> >>>>>>> Marty
> >>>>>>>
> >>>>>>>
> >>>>>>> On Sun, Aug 25, 2013 at 11:46 PM, Enrique Ladrón de Guevara
> Hernández <
> >>>>>>> enriquelgh@hotmail.com> wrote:
> >>>>>>>
> >>>>>>>> Hi,
> >>>>>>>> I'm carrying out my End of Career Project related to CloudStack
> >>>>>>>> deployment. I got issues when I try to deploy a VPC, the VPC
> virtual
> >>>>>> router
> >>>>>>>> isn't deployed completely and It's destroyed after timeout.
> >>>>>>>> The rest of SSVMs (Console Proxy VM, Storage VM and Guest Network
> VM)
> >>>>>> are
> >>>>>>>> deployed correctly. I can access to the instance console, put into
> >>>> guest
> >>>>>>>> network a instance, connect to it, etc ...
> >>>>>>>> Could you help me to resolve this issue? I don't know which is the
> >>>> thing
> >>>>>>>> that I'm doing wrong ...
> >>>>>>>> This is the context:
> >>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)Num. of Management
> >>>>>> Server:
> >>>>>>>> 1 (under CentOS 6.4) [physical server]. The MS has this network
> >>>>>>>> configuration:IP: 10.10.10.110/24GW: 10.10.10.254DNS server:
> >>>>>>>> 10.10.10.116/24Hypervisor: VMWARE 4.1:2 ESXi hosts:IPs:
> 10.10.1.101 &
> >>>>>>>> .102/24GW: 10.10.1.254vCenter: 10.10.1.100Standard Virtual
> Switches.
> >>>>>>>> Virtual Network Architecture:VmWare Virtual Switch CS Physical
> >>>>>>>> Network Network Subnet Gateway VLAN
> >>>>>>>> TAG CS Traffic Type Start IP Range End IP RangevSwitch0
> >>>>>>>> PhysNet-mgmt-svm 10.10.1.0
> >>>>>>>> 255.255.255.0 10.10.1.254 NONE CS Management 10.10.1.120
> >>>>>>>> 10.10.1.240vSwitch1
> >>>>>>>> PhysNet-storage 10.10.2.0 255.255.255.0 10.10.2.254
> >>>>>>>> NONE Storage 10.10.2.120
> >>>>>>>> 10.10.2.240vSwitch2 PhysNet-guest-1
> >>>>>>>> 10.10.3.0 255.255.255.0 10.10.3.254 NONE
> >>>>>>>> Guest 10.10.3.1 10.10.3.254vSwitch3
> >>>>>>>> PhysNet-public 10.10.4.0
> >>>>>>>> 255.255.255.0 10.10.4.254 NONE Public
> >>>>>>>> 10.10.4.1 10.10.4.240
> >>>>>>>> I log in to ssvm consoles and I can see the following:vRouter
> (VPC)
> >>>>>> System
> >>>>>>>> VM - doesn't have a specific route to MS:root@r-53-VM:~# netstat
> >>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
> >>>>>>>> Flags MSS Window irtt Iface10.10.1.0 0.0.0.0 255.255.255.0
> >>>>>>>> U 0 0 0 eth3root@r-53-VM:~#
> >>>>>>>> CS management server:[root@cs-1 ~]# netstat -nrKernel IP routing
> >>>>>>>> tableDestination Gateway Genmask Flags MSS Window
> >>>>>>>> irtt Iface10.10.10.0 0.0.0.0 255.255.255.0 U 0 0
> >>>>>>>> 0 eth0169.254.0.0 0.0.0.0 255.255.0.0 U 0 0
> >>>>>>>> 0 eth00.0.0.0 10.10.10.254 0.0.0.0 UG 0
> >>>>>>>> 0 0 eth0[root@cs-1 ~]#
> >>>>>>>> Console Proxy System VM:root@v-50-VM:~# netstat -nrKernel IP
> routing
> >>>>>>>> tableDestination Gateway Genmask Flags MSS Window
> >>>>>>>> irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
> >>>>>>>> 0 eth110.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
> >>>>>>>> 0 eth110.10.4.0 0.0.0.0 255.255.255.0 U 0
> >>>>>>>> 0 0 eth210.10.1.0 0.0.0.0 255.255.255.0 U
> >>>>>>>> 0 0 0 eth110.10.10.0 10.10.1.254 255.255.255.0 UG
> >>>>>>>> 0 0 0 eth10.0.0.0 10.10.4.254 0.0.0.0 UG
> >>>>>>>> 0 0 0 eth2root@v-50-VM:~#
> >>>>>>>> vRouter (no VPC- Guest Network) System VM:root@r-49-VM:~# netstat
> >>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
> >>>>>>>> Flags MSS Window irtt Iface10.10.4.0 0.0.0.0 255.255.255.0
> >>>>>>>> U 0 0 0 eth210.10.3.0 0.0.0.0
> >>>>>>>> 255.255.255.0 U 0 0 0 eth010.10.1.0 0.0.0.0
> >>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0 10.10.1.254
> >>>>>>>> 255.255.255.0 UG 0 0 0 eth10.0.0.0
> >>>>>>>> 10.10.4.254 0.0.0.0 UG 0 0 0 eth2root@r-49-VM
> >>>>>>>> :~#
> >>>>>>>> Secondary Storage System VMroot@s-28-VM:~# netstat -nrKernel IP
> >>>> routing
> >>>>>>>> tableDestination Gateway Genmask Flags MSS
> >>>>>>>> Window irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH
> >>>>>>>> 0 0 0 eth110.10.10.110 10.10.1.254
> >>>>>>>> 255.255.255.255 UGH 0 0 0 eth110.10.4.0
> >>>>>>>> 0.0.0.0 255.255.255.0 U 0 0
> >>>>>>>> 0 eth210.10.2.0 0.0.0.0 255.255.255.0 U
> >>>>>>>> 0 0 0 eth310.10.1.0 0.0.0.0
> >>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0
> >>>>>>>> 10.10.1.254 255.255.255.0 UG 0 0 0
> >>>>>>>> eth10.0.0.0 10.10.4.254 0.0.0.0 UG
> >>>>>>>> 0 0 0 eth2root@s-28-VM:~# management-server.log
> >>>>>>>> (filtered by r-53-VM):
> >>>>>>>> [root@cs-1 ~]# g>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
> >>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
> template=domP
> >>>>>> name=r-53-VM
> >>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
> >>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
> disable_rp_filter=true
> >>>>>> extra_pubnics=2
> >>>>>>>>
> >>>>>>
> >>>>
> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}},{"check.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":100,"name":"r-53-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.1.238","
> >>>>>>>> router.name
> >>>>>>>>
> >>>>>>
> >>>>
> ":"r-53-VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbps":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"10.10.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"router.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"10.10.1.238","
> >>>>>>>> router.name
> >>>>>>>>
> >>>>>>
> >>>>
> ":"r-53-VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessDetails":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","
> >>>>>>>> router.name":"r-53-VM"},"wait":0}},{}] }2013-08-25 11:34:48,001
> DEBUG
> >>>>>>>> [agent.transport.Request] (Job-Executor-13:job-11) Seq
> 1-1308430869:
> >>>>>>>> Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags:
> >>>> 100111,
> >>>>>>>>
> >>>>>>
> >>>>
> [{"StartCommand":{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter">>
> >>>>>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
> >>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
> template=domP
> >>>>>> name=r-53-VM
> >>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
> >>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
> disable_rp_filter=true
> >>>>>> extra_pubnics=2
> >>>>>>>>
> >>>>>>
> >>>>
> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":>>
> >>>>>> GNU/Linux 5.0 (32-bit)",
> >>>>
>
Re: VPC virtual router fails to start up - no route to CS Management Server.
Posted by Marty Sweet <ms...@gmail.com>.
Hi,
I couldn't find any screenshots in the string of messages.
Looking at the logs it almost seems as like the VPC is stopping
unexpectedly.
Looking at my VPC, the first interface is a Link Local for Control type
traffic, which is running on KVM.
I will CC this into the dev mailinglist in search for a developer who knows
more about VMWare and VPCs.
In the meantime, please could you attach (in a tar), the screenshots of the
VPC interfaces from the cloudstack interfaces.
Thanks,
Marty
On Mon, Sep 2, 2013 at 6:28 PM, Enrique Ladrón de Guevara Hernández <
enriquelgh@hotmail.com> wrote:
> Hi Marty,
>
> Sorry, could you look at the logs and screenshots?? Do you need more info
> to debug the issue??
>
> Do you know if there is a bug related to this scenario??
>
> I try to find any information on Internet and check my config but I don't
> know how to continue go ahead ...
>
> Do you recommend re-installing CS software with other version or the same
> version ....??
>
> Thanks in advanced for your help.
> Regards.
>
>
> ----------------------------------------
> > From: enriquelgh@hotmail.com
> > To: users@cloudstack.apache.org
> > Subject: RE: VPC virtual router fails to start up - no route to CS
> Management Server.
> > Date: Wed, 28 Aug 2013 20:16:26 +0200
> >
> > Now better!
> >
> > Regards.
> >
> > ----------------------------------------
> >> From: enriquelgh@hotmail.com
> >> To: users@cloudstack.apache.org
> >> Subject: RE: VPC virtual router fails to start up - no route to CS
> Management Server.
> >> Date: Wed, 28 Aug 2013 20:09:39 +0200
> >>
> >> Hi Marty,
> >>
> >> I have used a new test to capture screenshots and logs:
> >>
> >> VPC Name: VPC-Test
> >> Job: job-69
> >> vrsm: r-59-VM
> >>
> >> you can find files attached.
> >>
> >> Thanks,
> >> Regards.
> >>
> >> -
> >> ----------------------------------------
> >>> Date: Wed, 28 Aug 2013 10:16:23 +0100
> >>> Subject: Re: VPC virtual router fails to start up - no route to CS
> Management Server.
> >>> From: msweet.dev@gmail.com
> >>> To: users@cloudstack.apache.org
> >>>
> >>> Hi,
> >>>
> >>> Could you let me know the IP addresses listed in the cloudstack
> interface
> >>> under Infrastructure> Virtual Routers> VPC
> >>>
> >>> Marty
> >>>
> >>>
> >>> On Tue, Aug 27, 2013 at 11:11 PM, Enrique Ladrón de Guevara Hernández <
> >>> enriquelgh@hotmail.com> wrote:
> >>>
> >>>> Hi Marty,
> >>>>
> >>>> Yes, I have still got this issue ... :S I'm very lost ...
> >>>>
> >>>> Guest Networks are working fine, but in VPC nop ...
> >>>>
> >>>> If you need more info, please let me know.
> >>>>
> >>>> Thanks a lot for your time,
> >>>> Regards.
> >>>>
> >>>>
> >>>> ----------------------------------------
> >>>>> Date: Tue, 27 Aug 2013 22:54:11 +0100
> >>>>> Subject: Re: VPC virtual router fails to start up - no route to CS
> >>>> Management Server.
> >>>>> From: msweet.dev@gmail.com
> >>>>> To: users@cloudstack.apache.org
> >>>>>
> >>>>> Hi Enrique,
> >>>>>
> >>>>> Sorry I haven't got back to you, is this still an issue?
> >>>>> If so, I will take a look at it and get back to you in the morning.
> >>>>>
> >>>>> Thanks,
> >>>>> Marty
> >>>>>
> >>>>> On Monday, August 26, 2013, Enrique Ladrón de Guevara Hernández
> wrote:
> >>>>>
> >>>>>> Hi Marty,
> >>>>>>
> >>>>>> My apologies for the format. I hope this time the email format will
> be
> >>>>>> better. You can find the logs attached.
> >>>>>>
> >>>>>> In this log you can see several VPC deployment tests. One of them
> is:
> >>>>>> - VPC name: VPC-Prueba-1
> >>>>>> - job: job-11
> >>>>>> - ssvm: r-53-VM.
> >>>>>>
> >>>>>> I use GUI to create VPC. The system VM (virutal router) is created
> and I
> >>>>>> can log in by console (VNC or VMWARE console), but after 40 min
> (aprox)
> >>>>>> this SSVM are destroyed because the MS is not able to connect with.
> >>>>>>
> >>>>>> I think the System VM needs default gateway route or static route
> to MS
> >>>>>> server like the rest of SystemVMs (Console, Sec. Storage or Guest
> Net.).
> >>>>>>
> >>>>>>
> >>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)
> >>>>>>
> >>>>>> Num. of Management Server: 1 (under CentOS 6.4) [physical server].
> >>>>>>
> >>>>>> The MS has this network configuration: IP: 10.10.10.110/24 GW:
> >>>>>> 10.10.10.254
> >>>>>>
> >>>>>> DNS server:10.10.10.116/24
> >>>>>>
> >>>>>> Hypervisor: VMWARE 4.1 (with Standard Virtual Switches), 2 ESXi
> hosts:
> >>>>>> IPs: 10.10.1.101 & .102/24 GW: 10.10.1.254
> >>>>>>
> >>>>>> vCenter: 10.10.1.100/24.
> >>>>>>
> >>>>>> Virtual Network Architecture:
> >>>>>>
> >>>>>> CS Traffic Type:CS Management
> >>>>>> VmWare Virtual Switch:vSwitch0
> >>>>>> CS Physical Network:PhysNet-mgmt-svm
> >>>>>> Network:10.10.1.0
> >>>>>> Subnet:/24
> >>>>>> Gateway:10.10.1.254
> >>>>>> VLAN TAG: NONE
> >>>>>> Start IP Range:10.10.1.120
> >>>>>> End IP Range: 10.10.1.240
> >>>>>>
> >>>>>> CS Traffic Type: Storage
> >>>>>> VmWare Virtual Switch:vSwitch1
> >>>>>> CS Physical Network:PhysNet-storage
> >>>>>> Network:10.10.2.0
> >>>>>> Subnet:/24
> >>>>>> Gateway:10.10.2.254
> >>>>>> VLAN TAG: NONE
> >>>>>> Start IP Range:10.10.2.120
> >>>>>> End IP Range: 10.10.2.240
> >>>>>>
> >>>>>>
> >>>>>> CS Traffic Type:Guest
> >>>>>> VmWare Virtual Switch:vSwitch2
> >>>>>> CS Physical Network:PhysNet-guest-1
> >>>>>> Network:10.10.3.0
> >>>>>> Subnet:/24
> >>>>>> Gateway:10.10.3.254
> >>>>>> VLAN TAG: NONE
> >>>>>> Start IP Range:10.10.3.1
> >>>>>> End IP Range: 10.10.3.254
> >>>>>>
> >>>>>> CS Traffic Type:Public
> >>>>>> VmWare Virtual Switch:vSwitch3
> >>>>>> CS Physical Network:PhysNet-public
> >>>>>> Network:10.10.4.0
> >>>>>> Subnet:/24
> >>>>>> Gateway:10.10.4.254
> >>>>>> VLAN TAG: NONE
> >>>>>> Start IP Range:10.10.4.1
> >>>>>> End IP Range: 10.10.4.240
> >>>>>>
> >>>>>>
> >>>>>> vRouter (VPC) System VM - doesn't have a specific route to MS:
> >>>>>>
> >>>>>> root@r-53-VM:~# netstat -nr
> >>>>>> Kernel IP routing table
> >>>>>> Destination Gateway Genmask Flags MSS Window irtt
> >>>>>> Iface
> >>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> >>>>>> eth3
> >>>>>> root@r-53-VM:~#
> >>>>>>
> >>>>>>
> >>>>>> CS management server:
> >>>>>>
> >>>>>> [root@cs-1 ~]# netstat -nr
> >>>>>> Kernel IP routing table
> >>>>>> Destination Gateway Genmask Flags MSS Window irtt
> >>>>>> Iface
> >>>>>> 10.10.10.0 0.0.0.0 255.255.255.0 U 0 0 0
> >>>>>> eth0
> >>>>>> 169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0
> >>>>>> eth0
> >>>>>> 0.0.0.0 10.10.10.254 0.0.0.0 UG 0 0 0
> >>>>>> eth0
> >>>>>> [root@cs-1 ~]#
> >>>>>>
> >>>>>> Console Proxy System VM:
> >>>>>>
> >>>>>> root@v-50-VM:~# netstat -nr
> >>>>>> Kernel IP routing table
> >>>>>> Destination Gateway Genmask Flags MSS Window irtt
> >>>>>> Iface
> >>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0 0
> >>>>>> eth1
> >>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0 0
> >>>>>> eth1
> >>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
> >>>>>> eth2
> >>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> >>>>>> eth1
> >>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
> >>>>>> eth1
> >>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
> >>>>>> eth2
> >>>>>> root@v-50-VM:~#
> >>>>>>
> >>>>>> vRouter (no VPC- Guest Network) System VM:
> >>>>>>
> >>>>>> root@r-49-VM:~# netstat -nr
> >>>>>> Kernel IP routing table
> >>>>>> Destination Gateway Genmask Flags MSS Window irtt
> >>>>>> Iface
> >>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
> >>>>>> eth2
> >>>>>> 10.10.3.0 0.0.0.0 255.255.255.0 U 0 0 0
> >>>>>> eth0
> >>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> >>>>>> eth1
> >>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
> >>>>>> eth1
> >>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
> >>>>>> eth2
> >>>>>> root@r-49-VM:~#
> >>>>>>
> >>>>>> Secondary Storage System VM:
> >>>>>>
> >>>>>> root@s-28-VM:~# netstat -nr
> >>>>>> Kernel IP routing table
> >>>>>> Destination Gateway Genmask Flags MSS
> >>>>>> Window irtt Iface
> >>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
> >>>>>> 0 eth1
> >>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
> >>>>>> 0 eth1
> >>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0
> >>>>>> 0 0 eth2
> >>>>>> 10.10.2.0 0.0.0.0 255.255.255.0 U 0
> >>>>>> 0 0 eth3
> >>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0
> >>>>>> 0 0 eth1
> >>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0
> >>>>>> 0 eth1
> >>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG
> >>>>>> 0 0 0 eth2
> >>>>>> root@s-28-VM:~#
> >>>>>>
> >>>>>>
> >>>>>> Thanks,
> >>>>>> Regards.
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>
> ---------------------------------------------------------------------------------------------
> >>>>>>
> >>>>>>
> >>>>
> ---------------------------------------------------------------------------------------------
> >>>>>>
> >>>>>>
> >>>>>>> Date: Mon, 26 Aug 2013 15:19:06 +0100
> >>>>>>> Subject: Re: VPC virtual router fails to start up - no route to CS
> >>>>>> Management Server.
> >>>>>>> From: msweet.dev@gmail.com <javascript:;>
> >>>>>>> To: users@cloudstack.apache.org <javascript:;>
> >>>>>>>
> >>>>>>> Hi,
> >>>>>>>
> >>>>>>> I don't think this has got a response because of the poor
> formatting of
> >>>>>> the
> >>>>>>> log. Please could you attach the log in a separate file and I will
> >>>> take a
> >>>>>>> look?
> >>>>>>> Am I correct in thinking that it is creating the system VM, and
> then
> >>>>>>> destroying it?
> >>>>>>>
> >>>>>>> Thanks,
> >>>>>>> Marty
> >>>>>>>
> >>>>>>>
> >>>>>>> On Sun, Aug 25, 2013 at 11:46 PM, Enrique Ladrón de Guevara
> Hernández <
> >>>>>>> enriquelgh@hotmail.com> wrote:
> >>>>>>>
> >>>>>>>> Hi,
> >>>>>>>> I'm carrying out my End of Career Project related to CloudStack
> >>>>>>>> deployment. I got issues when I try to deploy a VPC, the VPC
> virtual
> >>>>>> router
> >>>>>>>> isn't deployed completely and It's destroyed after timeout.
> >>>>>>>> The rest of SSVMs (Console Proxy VM, Storage VM and Guest Network
> VM)
> >>>>>> are
> >>>>>>>> deployed correctly. I can access to the instance console, put into
> >>>> guest
> >>>>>>>> network a instance, connect to it, etc ...
> >>>>>>>> Could you help me to resolve this issue? I don't know which is the
> >>>> thing
> >>>>>>>> that I'm doing wrong ...
> >>>>>>>> This is the context:
> >>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)Num. of Management
> >>>>>> Server:
> >>>>>>>> 1 (under CentOS 6.4) [physical server]. The MS has this network
> >>>>>>>> configuration:IP: 10.10.10.110/24GW: 10.10.10.254DNS server:
> >>>>>>>> 10.10.10.116/24Hypervisor: VMWARE 4.1:2 ESXi hosts:IPs:
> 10.10.1.101 &
> >>>>>>>> .102/24GW: 10.10.1.254vCenter: 10.10.1.100Standard Virtual
> Switches.
> >>>>>>>> Virtual Network Architecture:VmWare Virtual Switch CS Physical
> >>>>>>>> Network Network Subnet Gateway VLAN
> >>>>>>>> TAG CS Traffic Type Start IP Range End IP RangevSwitch0
> >>>>>>>> PhysNet-mgmt-svm 10.10.1.0
> >>>>>>>> 255.255.255.0 10.10.1.254 NONE CS Management 10.10.1.120
> >>>>>>>> 10.10.1.240vSwitch1
> >>>>>>>> PhysNet-storage 10.10.2.0 255.255.255.0 10.10.2.254
> >>>>>>>> NONE Storage 10.10.2.120
> >>>>>>>> 10.10.2.240vSwitch2 PhysNet-guest-1
> >>>>>>>> 10.10.3.0 255.255.255.0 10.10.3.254 NONE
> >>>>>>>> Guest 10.10.3.1 10.10.3.254vSwitch3
> >>>>>>>> PhysNet-public 10.10.4.0
> >>>>>>>> 255.255.255.0 10.10.4.254 NONE Public
> >>>>>>>> 10.10.4.1 10.10.4.240
> >>>>>>>> I log in to ssvm consoles and I can see the following:vRouter
> (VPC)
> >>>>>> System
> >>>>>>>> VM - doesn't have a specific route to MS:root@r-53-VM:~# netstat
> >>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
> >>>>>>>> Flags MSS Window irtt Iface10.10.1.0 0.0.0.0 255.255.255.0
> >>>>>>>> U 0 0 0 eth3root@r-53-VM:~#
> >>>>>>>> CS management server:[root@cs-1 ~]# netstat -nrKernel IP routing
> >>>>>>>> tableDestination Gateway Genmask Flags MSS Window
> >>>>>>>> irtt Iface10.10.10.0 0.0.0.0 255.255.255.0 U 0 0
> >>>>>>>> 0 eth0169.254.0.0 0.0.0.0 255.255.0.0 U 0 0
> >>>>>>>> 0 eth00.0.0.0 10.10.10.254 0.0.0.0 UG 0
> >>>>>>>> 0 0 eth0[root@cs-1 ~]#
> >>>>>>>> Console Proxy System VM:root@v-50-VM:~# netstat -nrKernel IP
> routing
> >>>>>>>> tableDestination Gateway Genmask Flags MSS Window
> >>>>>>>> irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
> >>>>>>>> 0 eth110.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
> >>>>>>>> 0 eth110.10.4.0 0.0.0.0 255.255.255.0 U 0
> >>>>>>>> 0 0 eth210.10.1.0 0.0.0.0 255.255.255.0 U
> >>>>>>>> 0 0 0 eth110.10.10.0 10.10.1.254 255.255.255.0 UG
> >>>>>>>> 0 0 0 eth10.0.0.0 10.10.4.254 0.0.0.0 UG
> >>>>>>>> 0 0 0 eth2root@v-50-VM:~#
> >>>>>>>> vRouter (no VPC- Guest Network) System VM:root@r-49-VM:~# netstat
> >>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
> >>>>>>>> Flags MSS Window irtt Iface10.10.4.0 0.0.0.0 255.255.255.0
> >>>>>>>> U 0 0 0 eth210.10.3.0 0.0.0.0
> >>>>>>>> 255.255.255.0 U 0 0 0 eth010.10.1.0 0.0.0.0
> >>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0 10.10.1.254
> >>>>>>>> 255.255.255.0 UG 0 0 0 eth10.0.0.0
> >>>>>>>> 10.10.4.254 0.0.0.0 UG 0 0 0 eth2root@r-49-VM
> >>>>>>>> :~#
> >>>>>>>> Secondary Storage System VMroot@s-28-VM:~# netstat -nrKernel IP
> >>>> routing
> >>>>>>>> tableDestination Gateway Genmask Flags MSS
> >>>>>>>> Window irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH
> >>>>>>>> 0 0 0 eth110.10.10.110 10.10.1.254
> >>>>>>>> 255.255.255.255 UGH 0 0 0 eth110.10.4.0
> >>>>>>>> 0.0.0.0 255.255.255.0 U 0 0
> >>>>>>>> 0 eth210.10.2.0 0.0.0.0 255.255.255.0 U
> >>>>>>>> 0 0 0 eth310.10.1.0 0.0.0.0
> >>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0
> >>>>>>>> 10.10.1.254 255.255.255.0 UG 0 0 0
> >>>>>>>> eth10.0.0.0 10.10.4.254 0.0.0.0 UG
> >>>>>>>> 0 0 0 eth2root@s-28-VM:~# management-server.log
> >>>>>>>> (filtered by r-53-VM):
> >>>>>>>> [root@cs-1 ~]# g>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
> >>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
> template=domP
> >>>>>> name=r-53-VM
> >>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
> >>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
> disable_rp_filter=true
> >>>>>> extra_pubnics=2
> >>>>>>>>
> >>>>>>
> >>>>
> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}},{"check.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":100,"name":"r-53-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.1.238","
> >>>>>>>> router.name
> >>>>>>>>
> >>>>>>
> >>>>
> ":"r-53-VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbps":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"10.10.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"router.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"10.10.1.238","
> >>>>>>>> router.name
> >>>>>>>>
> >>>>>>
> >>>>
> ":"r-53-VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessDetails":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","
> >>>>>>>> router.name":"r-53-VM"},"wait":0}},{}] }2013-08-25 11:34:48,001
> DEBUG
> >>>>>>>> [agent.transport.Request] (Job-Executor-13:job-11) Seq
> 1-1308430869:
> >>>>>>>> Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags:
> >>>> 100111,
> >>>>>>>>
> >>>>>>
> >>>>
> [{"StartCommand":{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter">>
> >>>>>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
> >>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116
> template=domP
> >>>>>> name=r-53-VM
> >>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
> >>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter
> disable_rp_filter=true
> >>>>>> extra_pubnics=2
> >>>>>>>>
> >>>>>>
> >>>>
> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":>>
> >>>>>> GNU/Linux 5.0 (32-bit)",
> >>>>
>
RE: VPC virtual router fails to start up - no route to CS
Management Server.
Posted by Enrique Ladrón de Guevara Hernández <en...@hotmail.com>.
Hi Marty,
Sorry, could you look at the logs and screenshots?? Do you need more info to debug the issue??
Do you know if there is a bug related to this scenario??
I try to find any information on Internet and check my config but I don't know how to continue go ahead ...
Do you recommend re-installing CS software with other version or the same version ....??
Thanks in advanced for your help.
Regards.
----------------------------------------
> From: enriquelgh@hotmail.com
> To: users@cloudstack.apache.org
> Subject: RE: VPC virtual router fails to start up - no route to CS Management Server.
> Date: Wed, 28 Aug 2013 20:16:26 +0200
>
> Now better!
>
> Regards.
>
> ----------------------------------------
>> From: enriquelgh@hotmail.com
>> To: users@cloudstack.apache.org
>> Subject: RE: VPC virtual router fails to start up - no route to CS Management Server.
>> Date: Wed, 28 Aug 2013 20:09:39 +0200
>>
>> Hi Marty,
>>
>> I have used a new test to capture screenshots and logs:
>>
>> VPC Name: VPC-Test
>> Job: job-69
>> vrsm: r-59-VM
>>
>> you can find files attached.
>>
>> Thanks,
>> Regards.
>>
>> -
>> ----------------------------------------
>>> Date: Wed, 28 Aug 2013 10:16:23 +0100
>>> Subject: Re: VPC virtual router fails to start up - no route to CS Management Server.
>>> From: msweet.dev@gmail.com
>>> To: users@cloudstack.apache.org
>>>
>>> Hi,
>>>
>>> Could you let me know the IP addresses listed in the cloudstack interface
>>> under Infrastructure> Virtual Routers> VPC
>>>
>>> Marty
>>>
>>>
>>> On Tue, Aug 27, 2013 at 11:11 PM, Enrique Ladrón de Guevara Hernández <
>>> enriquelgh@hotmail.com> wrote:
>>>
>>>> Hi Marty,
>>>>
>>>> Yes, I have still got this issue ... :S I'm very lost ...
>>>>
>>>> Guest Networks are working fine, but in VPC nop ...
>>>>
>>>> If you need more info, please let me know.
>>>>
>>>> Thanks a lot for your time,
>>>> Regards.
>>>>
>>>>
>>>> ----------------------------------------
>>>>> Date: Tue, 27 Aug 2013 22:54:11 +0100
>>>>> Subject: Re: VPC virtual router fails to start up - no route to CS
>>>> Management Server.
>>>>> From: msweet.dev@gmail.com
>>>>> To: users@cloudstack.apache.org
>>>>>
>>>>> Hi Enrique,
>>>>>
>>>>> Sorry I haven't got back to you, is this still an issue?
>>>>> If so, I will take a look at it and get back to you in the morning.
>>>>>
>>>>> Thanks,
>>>>> Marty
>>>>>
>>>>> On Monday, August 26, 2013, Enrique Ladrón de Guevara Hernández wrote:
>>>>>
>>>>>> Hi Marty,
>>>>>>
>>>>>> My apologies for the format. I hope this time the email format will be
>>>>>> better. You can find the logs attached.
>>>>>>
>>>>>> In this log you can see several VPC deployment tests. One of them is:
>>>>>> - VPC name: VPC-Prueba-1
>>>>>> - job: job-11
>>>>>> - ssvm: r-53-VM.
>>>>>>
>>>>>> I use GUI to create VPC. The system VM (virutal router) is created and I
>>>>>> can log in by console (VNC or VMWARE console), but after 40 min (aprox)
>>>>>> this SSVM are destroyed because the MS is not able to connect with.
>>>>>>
>>>>>> I think the System VM needs default gateway route or static route to MS
>>>>>> server like the rest of SystemVMs (Console, Sec. Storage or Guest Net.).
>>>>>>
>>>>>>
>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)
>>>>>>
>>>>>> Num. of Management Server: 1 (under CentOS 6.4) [physical server].
>>>>>>
>>>>>> The MS has this network configuration: IP: 10.10.10.110/24 GW:
>>>>>> 10.10.10.254
>>>>>>
>>>>>> DNS server:10.10.10.116/24
>>>>>>
>>>>>> Hypervisor: VMWARE 4.1 (with Standard Virtual Switches), 2 ESXi hosts:
>>>>>> IPs: 10.10.1.101 & .102/24 GW: 10.10.1.254
>>>>>>
>>>>>> vCenter: 10.10.1.100/24.
>>>>>>
>>>>>> Virtual Network Architecture:
>>>>>>
>>>>>> CS Traffic Type:CS Management
>>>>>> VmWare Virtual Switch:vSwitch0
>>>>>> CS Physical Network:PhysNet-mgmt-svm
>>>>>> Network:10.10.1.0
>>>>>> Subnet:/24
>>>>>> Gateway:10.10.1.254
>>>>>> VLAN TAG: NONE
>>>>>> Start IP Range:10.10.1.120
>>>>>> End IP Range: 10.10.1.240
>>>>>>
>>>>>> CS Traffic Type: Storage
>>>>>> VmWare Virtual Switch:vSwitch1
>>>>>> CS Physical Network:PhysNet-storage
>>>>>> Network:10.10.2.0
>>>>>> Subnet:/24
>>>>>> Gateway:10.10.2.254
>>>>>> VLAN TAG: NONE
>>>>>> Start IP Range:10.10.2.120
>>>>>> End IP Range: 10.10.2.240
>>>>>>
>>>>>>
>>>>>> CS Traffic Type:Guest
>>>>>> VmWare Virtual Switch:vSwitch2
>>>>>> CS Physical Network:PhysNet-guest-1
>>>>>> Network:10.10.3.0
>>>>>> Subnet:/24
>>>>>> Gateway:10.10.3.254
>>>>>> VLAN TAG: NONE
>>>>>> Start IP Range:10.10.3.1
>>>>>> End IP Range: 10.10.3.254
>>>>>>
>>>>>> CS Traffic Type:Public
>>>>>> VmWare Virtual Switch:vSwitch3
>>>>>> CS Physical Network:PhysNet-public
>>>>>> Network:10.10.4.0
>>>>>> Subnet:/24
>>>>>> Gateway:10.10.4.254
>>>>>> VLAN TAG: NONE
>>>>>> Start IP Range:10.10.4.1
>>>>>> End IP Range: 10.10.4.240
>>>>>>
>>>>>>
>>>>>> vRouter (VPC) System VM - doesn't have a specific route to MS:
>>>>>>
>>>>>> root@r-53-VM:~# netstat -nr
>>>>>> Kernel IP routing table
>>>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>>>> Iface
>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>> eth3
>>>>>> root@r-53-VM:~#
>>>>>>
>>>>>>
>>>>>> CS management server:
>>>>>>
>>>>>> [root@cs-1 ~]# netstat -nr
>>>>>> Kernel IP routing table
>>>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>>>> Iface
>>>>>> 10.10.10.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>> eth0
>>>>>> 169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0
>>>>>> eth0
>>>>>> 0.0.0.0 10.10.10.254 0.0.0.0 UG 0 0 0
>>>>>> eth0
>>>>>> [root@cs-1 ~]#
>>>>>>
>>>>>> Console Proxy System VM:
>>>>>>
>>>>>> root@v-50-VM:~# netstat -nr
>>>>>> Kernel IP routing table
>>>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>>>> Iface
>>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0 0
>>>>>> eth1
>>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0 0
>>>>>> eth1
>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>> eth2
>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>> eth1
>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
>>>>>> eth1
>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
>>>>>> eth2
>>>>>> root@v-50-VM:~#
>>>>>>
>>>>>> vRouter (no VPC- Guest Network) System VM:
>>>>>>
>>>>>> root@r-49-VM:~# netstat -nr
>>>>>> Kernel IP routing table
>>>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>>>> Iface
>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>> eth2
>>>>>> 10.10.3.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>> eth0
>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>>> eth1
>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
>>>>>> eth1
>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
>>>>>> eth2
>>>>>> root@r-49-VM:~#
>>>>>>
>>>>>> Secondary Storage System VM:
>>>>>>
>>>>>> root@s-28-VM:~# netstat -nr
>>>>>> Kernel IP routing table
>>>>>> Destination Gateway Genmask Flags MSS
>>>>>> Window irtt Iface
>>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>> 0 eth1
>>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>> 0 eth1
>>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0
>>>>>> 0 0 eth2
>>>>>> 10.10.2.0 0.0.0.0 255.255.255.0 U 0
>>>>>> 0 0 eth3
>>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0
>>>>>> 0 0 eth1
>>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0
>>>>>> 0 eth1
>>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG
>>>>>> 0 0 0 eth2
>>>>>> root@s-28-VM:~#
>>>>>>
>>>>>>
>>>>>> Thanks,
>>>>>> Regards.
>>>>>>
>>>>>>
>>>>>>
>>>> ---------------------------------------------------------------------------------------------
>>>>>>
>>>>>>
>>>> ---------------------------------------------------------------------------------------------
>>>>>>
>>>>>>
>>>>>>> Date: Mon, 26 Aug 2013 15:19:06 +0100
>>>>>>> Subject: Re: VPC virtual router fails to start up - no route to CS
>>>>>> Management Server.
>>>>>>> From: msweet.dev@gmail.com <javascript:;>
>>>>>>> To: users@cloudstack.apache.org <javascript:;>
>>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> I don't think this has got a response because of the poor formatting of
>>>>>> the
>>>>>>> log. Please could you attach the log in a separate file and I will
>>>> take a
>>>>>>> look?
>>>>>>> Am I correct in thinking that it is creating the system VM, and then
>>>>>>> destroying it?
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Marty
>>>>>>>
>>>>>>>
>>>>>>> On Sun, Aug 25, 2013 at 11:46 PM, Enrique Ladrón de Guevara Hernández <
>>>>>>> enriquelgh@hotmail.com> wrote:
>>>>>>>
>>>>>>>> Hi,
>>>>>>>> I'm carrying out my End of Career Project related to CloudStack
>>>>>>>> deployment. I got issues when I try to deploy a VPC, the VPC virtual
>>>>>> router
>>>>>>>> isn't deployed completely and It's destroyed after timeout.
>>>>>>>> The rest of SSVMs (Console Proxy VM, Storage VM and Guest Network VM)
>>>>>> are
>>>>>>>> deployed correctly. I can access to the instance console, put into
>>>> guest
>>>>>>>> network a instance, connect to it, etc ...
>>>>>>>> Could you help me to resolve this issue? I don't know which is the
>>>> thing
>>>>>>>> that I'm doing wrong ...
>>>>>>>> This is the context:
>>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)Num. of Management
>>>>>> Server:
>>>>>>>> 1 (under CentOS 6.4) [physical server]. The MS has this network
>>>>>>>> configuration:IP: 10.10.10.110/24GW: 10.10.10.254DNS server:
>>>>>>>> 10.10.10.116/24Hypervisor: VMWARE 4.1:2 ESXi hosts:IPs: 10.10.1.101 &
>>>>>>>> .102/24GW: 10.10.1.254vCenter: 10.10.1.100Standard Virtual Switches.
>>>>>>>> Virtual Network Architecture:VmWare Virtual Switch CS Physical
>>>>>>>> Network Network Subnet Gateway VLAN
>>>>>>>> TAG CS Traffic Type Start IP Range End IP RangevSwitch0
>>>>>>>> PhysNet-mgmt-svm 10.10.1.0
>>>>>>>> 255.255.255.0 10.10.1.254 NONE CS Management 10.10.1.120
>>>>>>>> 10.10.1.240vSwitch1
>>>>>>>> PhysNet-storage 10.10.2.0 255.255.255.0 10.10.2.254
>>>>>>>> NONE Storage 10.10.2.120
>>>>>>>> 10.10.2.240vSwitch2 PhysNet-guest-1
>>>>>>>> 10.10.3.0 255.255.255.0 10.10.3.254 NONE
>>>>>>>> Guest 10.10.3.1 10.10.3.254vSwitch3
>>>>>>>> PhysNet-public 10.10.4.0
>>>>>>>> 255.255.255.0 10.10.4.254 NONE Public
>>>>>>>> 10.10.4.1 10.10.4.240
>>>>>>>> I log in to ssvm consoles and I can see the following:vRouter (VPC)
>>>>>> System
>>>>>>>> VM - doesn't have a specific route to MS:root@r-53-VM:~# netstat
>>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
>>>>>>>> Flags MSS Window irtt Iface10.10.1.0 0.0.0.0 255.255.255.0
>>>>>>>> U 0 0 0 eth3root@r-53-VM:~#
>>>>>>>> CS management server:[root@cs-1 ~]# netstat -nrKernel IP routing
>>>>>>>> tableDestination Gateway Genmask Flags MSS Window
>>>>>>>> irtt Iface10.10.10.0 0.0.0.0 255.255.255.0 U 0 0
>>>>>>>> 0 eth0169.254.0.0 0.0.0.0 255.255.0.0 U 0 0
>>>>>>>> 0 eth00.0.0.0 10.10.10.254 0.0.0.0 UG 0
>>>>>>>> 0 0 eth0[root@cs-1 ~]#
>>>>>>>> Console Proxy System VM:root@v-50-VM:~# netstat -nrKernel IP routing
>>>>>>>> tableDestination Gateway Genmask Flags MSS Window
>>>>>>>> irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>>>> 0 eth110.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>>>> 0 eth110.10.4.0 0.0.0.0 255.255.255.0 U 0
>>>>>>>> 0 0 eth210.10.1.0 0.0.0.0 255.255.255.0 U
>>>>>>>> 0 0 0 eth110.10.10.0 10.10.1.254 255.255.255.0 UG
>>>>>>>> 0 0 0 eth10.0.0.0 10.10.4.254 0.0.0.0 UG
>>>>>>>> 0 0 0 eth2root@v-50-VM:~#
>>>>>>>> vRouter (no VPC- Guest Network) System VM:root@r-49-VM:~# netstat
>>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
>>>>>>>> Flags MSS Window irtt Iface10.10.4.0 0.0.0.0 255.255.255.0
>>>>>>>> U 0 0 0 eth210.10.3.0 0.0.0.0
>>>>>>>> 255.255.255.0 U 0 0 0 eth010.10.1.0 0.0.0.0
>>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0 10.10.1.254
>>>>>>>> 255.255.255.0 UG 0 0 0 eth10.0.0.0
>>>>>>>> 10.10.4.254 0.0.0.0 UG 0 0 0 eth2root@r-49-VM
>>>>>>>> :~#
>>>>>>>> Secondary Storage System VMroot@s-28-VM:~# netstat -nrKernel IP
>>>> routing
>>>>>>>> tableDestination Gateway Genmask Flags MSS
>>>>>>>> Window irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH
>>>>>>>> 0 0 0 eth110.10.10.110 10.10.1.254
>>>>>>>> 255.255.255.255 UGH 0 0 0 eth110.10.4.0
>>>>>>>> 0.0.0.0 255.255.255.0 U 0 0
>>>>>>>> 0 eth210.10.2.0 0.0.0.0 255.255.255.0 U
>>>>>>>> 0 0 0 eth310.10.1.0 0.0.0.0
>>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0
>>>>>>>> 10.10.1.254 255.255.255.0 UG 0 0 0
>>>>>>>> eth10.0.0.0 10.10.4.254 0.0.0.0 UG
>>>>>>>> 0 0 0 eth2root@s-28-VM:~# management-server.log
>>>>>>>> (filtered by r-53-VM):
>>>>>>>> [root@cs-1 ~]# g>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
>>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116 template=domP
>>>>>> name=r-53-VM
>>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
>>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true
>>>>>> extra_pubnics=2
>>>>>>>>
>>>>>>
>>>> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}},{"check.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":100,"name":"r-53-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.1.238","
>>>>>>>> router.name
>>>>>>>>
>>>>>>
>>>> ":"r-53-VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbps":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"10.10.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"router.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"10.10.1.238","
>>>>>>>> router.name
>>>>>>>>
>>>>>>
>>>> ":"r-53-VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessDetails":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","
>>>>>>>> router.name":"r-53-VM"},"wait":0}},{}] }2013-08-25 11:34:48,001 DEBUG
>>>>>>>> [agent.transport.Request] (Job-Executor-13:job-11) Seq 1-1308430869:
>>>>>>>> Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags:
>>>> 100111,
>>>>>>>>
>>>>>>
>>>> [{"StartCommand":{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter">>
>>>>>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
>>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116 template=domP
>>>>>> name=r-53-VM
>>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
>>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true
>>>>>> extra_pubnics=2
>>>>>>>>
>>>>>>
>>>> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":>>
>>>>>> GNU/Linux 5.0 (32-bit)",
>>>>
RE: VPC virtual router fails to start up - no route to CS
Management Server.
Posted by Enrique Ladrón de Guevara Hernández <en...@hotmail.com>.
Now better!
Regards.
----------------------------------------
> From: enriquelgh@hotmail.com
> To: users@cloudstack.apache.org
> Subject: RE: VPC virtual router fails to start up - no route to CS Management Server.
> Date: Wed, 28 Aug 2013 20:09:39 +0200
>
> Hi Marty,
>
> I have used a new test to capture screenshots and logs:
>
> VPC Name: VPC-Test
> Job: job-69
> vrsm: r-59-VM
>
> you can find files attached.
>
> Thanks,
> Regards.
>
> -
> ----------------------------------------
>> Date: Wed, 28 Aug 2013 10:16:23 +0100
>> Subject: Re: VPC virtual router fails to start up - no route to CS Management Server.
>> From: msweet.dev@gmail.com
>> To: users@cloudstack.apache.org
>>
>> Hi,
>>
>> Could you let me know the IP addresses listed in the cloudstack interface
>> under Infrastructure> Virtual Routers> VPC
>>
>> Marty
>>
>>
>> On Tue, Aug 27, 2013 at 11:11 PM, Enrique Ladrón de Guevara Hernández <
>> enriquelgh@hotmail.com> wrote:
>>
>>> Hi Marty,
>>>
>>> Yes, I have still got this issue ... :S I'm very lost ...
>>>
>>> Guest Networks are working fine, but in VPC nop ...
>>>
>>> If you need more info, please let me know.
>>>
>>> Thanks a lot for your time,
>>> Regards.
>>>
>>>
>>> ----------------------------------------
>>>> Date: Tue, 27 Aug 2013 22:54:11 +0100
>>>> Subject: Re: VPC virtual router fails to start up - no route to CS
>>> Management Server.
>>>> From: msweet.dev@gmail.com
>>>> To: users@cloudstack.apache.org
>>>>
>>>> Hi Enrique,
>>>>
>>>> Sorry I haven't got back to you, is this still an issue?
>>>> If so, I will take a look at it and get back to you in the morning.
>>>>
>>>> Thanks,
>>>> Marty
>>>>
>>>> On Monday, August 26, 2013, Enrique Ladrón de Guevara Hernández wrote:
>>>>
>>>>> Hi Marty,
>>>>>
>>>>> My apologies for the format. I hope this time the email format will be
>>>>> better. You can find the logs attached.
>>>>>
>>>>> In this log you can see several VPC deployment tests. One of them is:
>>>>> - VPC name: VPC-Prueba-1
>>>>> - job: job-11
>>>>> - ssvm: r-53-VM.
>>>>>
>>>>> I use GUI to create VPC. The system VM (virutal router) is created and I
>>>>> can log in by console (VNC or VMWARE console), but after 40 min (aprox)
>>>>> this SSVM are destroyed because the MS is not able to connect with.
>>>>>
>>>>> I think the System VM needs default gateway route or static route to MS
>>>>> server like the rest of SystemVMs (Console, Sec. Storage or Guest Net.).
>>>>>
>>>>>
>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)
>>>>>
>>>>> Num. of Management Server: 1 (under CentOS 6.4) [physical server].
>>>>>
>>>>> The MS has this network configuration: IP: 10.10.10.110/24 GW:
>>>>> 10.10.10.254
>>>>>
>>>>> DNS server:10.10.10.116/24
>>>>>
>>>>> Hypervisor: VMWARE 4.1 (with Standard Virtual Switches), 2 ESXi hosts:
>>>>> IPs: 10.10.1.101 & .102/24 GW: 10.10.1.254
>>>>>
>>>>> vCenter: 10.10.1.100/24.
>>>>>
>>>>> Virtual Network Architecture:
>>>>>
>>>>> CS Traffic Type:CS Management
>>>>> VmWare Virtual Switch:vSwitch0
>>>>> CS Physical Network:PhysNet-mgmt-svm
>>>>> Network:10.10.1.0
>>>>> Subnet:/24
>>>>> Gateway:10.10.1.254
>>>>> VLAN TAG: NONE
>>>>> Start IP Range:10.10.1.120
>>>>> End IP Range: 10.10.1.240
>>>>>
>>>>> CS Traffic Type: Storage
>>>>> VmWare Virtual Switch:vSwitch1
>>>>> CS Physical Network:PhysNet-storage
>>>>> Network:10.10.2.0
>>>>> Subnet:/24
>>>>> Gateway:10.10.2.254
>>>>> VLAN TAG: NONE
>>>>> Start IP Range:10.10.2.120
>>>>> End IP Range: 10.10.2.240
>>>>>
>>>>>
>>>>> CS Traffic Type:Guest
>>>>> VmWare Virtual Switch:vSwitch2
>>>>> CS Physical Network:PhysNet-guest-1
>>>>> Network:10.10.3.0
>>>>> Subnet:/24
>>>>> Gateway:10.10.3.254
>>>>> VLAN TAG: NONE
>>>>> Start IP Range:10.10.3.1
>>>>> End IP Range: 10.10.3.254
>>>>>
>>>>> CS Traffic Type:Public
>>>>> VmWare Virtual Switch:vSwitch3
>>>>> CS Physical Network:PhysNet-public
>>>>> Network:10.10.4.0
>>>>> Subnet:/24
>>>>> Gateway:10.10.4.254
>>>>> VLAN TAG: NONE
>>>>> Start IP Range:10.10.4.1
>>>>> End IP Range: 10.10.4.240
>>>>>
>>>>>
>>>>> vRouter (VPC) System VM - doesn't have a specific route to MS:
>>>>>
>>>>> root@r-53-VM:~# netstat -nr
>>>>> Kernel IP routing table
>>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>>> Iface
>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>> eth3
>>>>> root@r-53-VM:~#
>>>>>
>>>>>
>>>>> CS management server:
>>>>>
>>>>> [root@cs-1 ~]# netstat -nr
>>>>> Kernel IP routing table
>>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>>> Iface
>>>>> 10.10.10.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>> eth0
>>>>> 169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0
>>>>> eth0
>>>>> 0.0.0.0 10.10.10.254 0.0.0.0 UG 0 0 0
>>>>> eth0
>>>>> [root@cs-1 ~]#
>>>>>
>>>>> Console Proxy System VM:
>>>>>
>>>>> root@v-50-VM:~# netstat -nr
>>>>> Kernel IP routing table
>>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>>> Iface
>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0 0
>>>>> eth1
>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0 0
>>>>> eth1
>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>> eth2
>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>> eth1
>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
>>>>> eth1
>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
>>>>> eth2
>>>>> root@v-50-VM:~#
>>>>>
>>>>> vRouter (no VPC- Guest Network) System VM:
>>>>>
>>>>> root@r-49-VM:~# netstat -nr
>>>>> Kernel IP routing table
>>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>>> Iface
>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>> eth2
>>>>> 10.10.3.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>> eth0
>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>>> eth1
>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
>>>>> eth1
>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
>>>>> eth2
>>>>> root@r-49-VM:~#
>>>>>
>>>>> Secondary Storage System VM:
>>>>>
>>>>> root@s-28-VM:~# netstat -nr
>>>>> Kernel IP routing table
>>>>> Destination Gateway Genmask Flags MSS
>>>>> Window irtt Iface
>>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
>>>>> 0 eth1
>>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
>>>>> 0 eth1
>>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0
>>>>> 0 0 eth2
>>>>> 10.10.2.0 0.0.0.0 255.255.255.0 U 0
>>>>> 0 0 eth3
>>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0
>>>>> 0 0 eth1
>>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0
>>>>> 0 eth1
>>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG
>>>>> 0 0 0 eth2
>>>>> root@s-28-VM:~#
>>>>>
>>>>>
>>>>> Thanks,
>>>>> Regards.
>>>>>
>>>>>
>>>>>
>>> ---------------------------------------------------------------------------------------------
>>>>>
>>>>>
>>> ---------------------------------------------------------------------------------------------
>>>>>
>>>>>
>>>>>> Date: Mon, 26 Aug 2013 15:19:06 +0100
>>>>>> Subject: Re: VPC virtual router fails to start up - no route to CS
>>>>> Management Server.
>>>>>> From: msweet.dev@gmail.com <javascript:;>
>>>>>> To: users@cloudstack.apache.org <javascript:;>
>>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> I don't think this has got a response because of the poor formatting of
>>>>> the
>>>>>> log. Please could you attach the log in a separate file and I will
>>> take a
>>>>>> look?
>>>>>> Am I correct in thinking that it is creating the system VM, and then
>>>>>> destroying it?
>>>>>>
>>>>>> Thanks,
>>>>>> Marty
>>>>>>
>>>>>>
>>>>>> On Sun, Aug 25, 2013 at 11:46 PM, Enrique Ladrón de Guevara Hernández <
>>>>>> enriquelgh@hotmail.com> wrote:
>>>>>>
>>>>>>> Hi,
>>>>>>> I'm carrying out my End of Career Project related to CloudStack
>>>>>>> deployment. I got issues when I try to deploy a VPC, the VPC virtual
>>>>> router
>>>>>>> isn't deployed completely and It's destroyed after timeout.
>>>>>>> The rest of SSVMs (Console Proxy VM, Storage VM and Guest Network VM)
>>>>> are
>>>>>>> deployed correctly. I can access to the instance console, put into
>>> guest
>>>>>>> network a instance, connect to it, etc ...
>>>>>>> Could you help me to resolve this issue? I don't know which is the
>>> thing
>>>>>>> that I'm doing wrong ...
>>>>>>> This is the context:
>>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)Num. of Management
>>>>> Server:
>>>>>>> 1 (under CentOS 6.4) [physical server]. The MS has this network
>>>>>>> configuration:IP: 10.10.10.110/24GW: 10.10.10.254DNS server:
>>>>>>> 10.10.10.116/24Hypervisor: VMWARE 4.1:2 ESXi hosts:IPs: 10.10.1.101 &
>>>>>>> .102/24GW: 10.10.1.254vCenter: 10.10.1.100Standard Virtual Switches.
>>>>>>> Virtual Network Architecture:VmWare Virtual Switch CS Physical
>>>>>>> Network Network Subnet Gateway VLAN
>>>>>>> TAG CS Traffic Type Start IP Range End IP RangevSwitch0
>>>>>>> PhysNet-mgmt-svm 10.10.1.0
>>>>>>> 255.255.255.0 10.10.1.254 NONE CS Management 10.10.1.120
>>>>>>> 10.10.1.240vSwitch1
>>>>>>> PhysNet-storage 10.10.2.0 255.255.255.0 10.10.2.254
>>>>>>> NONE Storage 10.10.2.120
>>>>>>> 10.10.2.240vSwitch2 PhysNet-guest-1
>>>>>>> 10.10.3.0 255.255.255.0 10.10.3.254 NONE
>>>>>>> Guest 10.10.3.1 10.10.3.254vSwitch3
>>>>>>> PhysNet-public 10.10.4.0
>>>>>>> 255.255.255.0 10.10.4.254 NONE Public
>>>>>>> 10.10.4.1 10.10.4.240
>>>>>>> I log in to ssvm consoles and I can see the following:vRouter (VPC)
>>>>> System
>>>>>>> VM - doesn't have a specific route to MS:root@r-53-VM:~# netstat
>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
>>>>>>> Flags MSS Window irtt Iface10.10.1.0 0.0.0.0 255.255.255.0
>>>>>>> U 0 0 0 eth3root@r-53-VM:~#
>>>>>>> CS management server:[root@cs-1 ~]# netstat -nrKernel IP routing
>>>>>>> tableDestination Gateway Genmask Flags MSS Window
>>>>>>> irtt Iface10.10.10.0 0.0.0.0 255.255.255.0 U 0 0
>>>>>>> 0 eth0169.254.0.0 0.0.0.0 255.255.0.0 U 0 0
>>>>>>> 0 eth00.0.0.0 10.10.10.254 0.0.0.0 UG 0
>>>>>>> 0 0 eth0[root@cs-1 ~]#
>>>>>>> Console Proxy System VM:root@v-50-VM:~# netstat -nrKernel IP routing
>>>>>>> tableDestination Gateway Genmask Flags MSS Window
>>>>>>> irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>>> 0 eth110.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>>> 0 eth110.10.4.0 0.0.0.0 255.255.255.0 U 0
>>>>>>> 0 0 eth210.10.1.0 0.0.0.0 255.255.255.0 U
>>>>>>> 0 0 0 eth110.10.10.0 10.10.1.254 255.255.255.0 UG
>>>>>>> 0 0 0 eth10.0.0.0 10.10.4.254 0.0.0.0 UG
>>>>>>> 0 0 0 eth2root@v-50-VM:~#
>>>>>>> vRouter (no VPC- Guest Network) System VM:root@r-49-VM:~# netstat
>>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
>>>>>>> Flags MSS Window irtt Iface10.10.4.0 0.0.0.0 255.255.255.0
>>>>>>> U 0 0 0 eth210.10.3.0 0.0.0.0
>>>>>>> 255.255.255.0 U 0 0 0 eth010.10.1.0 0.0.0.0
>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0 10.10.1.254
>>>>>>> 255.255.255.0 UG 0 0 0 eth10.0.0.0
>>>>>>> 10.10.4.254 0.0.0.0 UG 0 0 0 eth2root@r-49-VM
>>>>>>> :~#
>>>>>>> Secondary Storage System VMroot@s-28-VM:~# netstat -nrKernel IP
>>> routing
>>>>>>> tableDestination Gateway Genmask Flags MSS
>>>>>>> Window irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH
>>>>>>> 0 0 0 eth110.10.10.110 10.10.1.254
>>>>>>> 255.255.255.255 UGH 0 0 0 eth110.10.4.0
>>>>>>> 0.0.0.0 255.255.255.0 U 0 0
>>>>>>> 0 eth210.10.2.0 0.0.0.0 255.255.255.0 U
>>>>>>> 0 0 0 eth310.10.1.0 0.0.0.0
>>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0
>>>>>>> 10.10.1.254 255.255.255.0 UG 0 0 0
>>>>>>> eth10.0.0.0 10.10.4.254 0.0.0.0 UG
>>>>>>> 0 0 0 eth2root@s-28-VM:~# management-server.log
>>>>>>> (filtered by r-53-VM):
>>>>>>> [root@cs-1 ~]# g>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116 template=domP
>>>>> name=r-53-VM
>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true
>>>>> extra_pubnics=2
>>>>>>>
>>>>>
>>> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}},{"check.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":100,"name":"r-53-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.1.238","
>>>>>>> router.name
>>>>>>>
>>>>>
>>> ":"r-53-VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbps":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"10.10.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"router.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"10.10.1.238","
>>>>>>> router.name
>>>>>>>
>>>>>
>>> ":"r-53-VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessDetails":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","
>>>>>>> router.name":"r-53-VM"},"wait":0}},{}] }2013-08-25 11:34:48,001 DEBUG
>>>>>>> [agent.transport.Request] (Job-Executor-13:job-11) Seq 1-1308430869:
>>>>>>> Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags:
>>> 100111,
>>>>>>>
>>>>>
>>> [{"StartCommand":{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter">>
>>>>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
>>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116 template=domP
>>>>> name=r-53-VM
>>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
>>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true
>>>>> extra_pubnics=2
>>>>>>>
>>>>>
>>> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":>>
>>>>> GNU/Linux 5.0 (32-bit)",
>>>
RE: VPC virtual router fails to start up - no route to CS
Management Server.
Posted by Enrique Ladrón de Guevara Hernández <en...@hotmail.com>.
Hi Marty,
I have used a new test to capture screenshots and logs:
VPC Name: VPC-Test
Job: job-69
vrsm: r-59-VM
you can find files attached.
Thanks,
Regards.
-
----------------------------------------
> Date: Wed, 28 Aug 2013 10:16:23 +0100
> Subject: Re: VPC virtual router fails to start up - no route to CS Management Server.
> From: msweet.dev@gmail.com
> To: users@cloudstack.apache.org
>
> Hi,
>
> Could you let me know the IP addresses listed in the cloudstack interface
> under Infrastructure> Virtual Routers> VPC
>
> Marty
>
>
> On Tue, Aug 27, 2013 at 11:11 PM, Enrique Ladrón de Guevara Hernández <
> enriquelgh@hotmail.com> wrote:
>
>> Hi Marty,
>>
>> Yes, I have still got this issue ... :S I'm very lost ...
>>
>> Guest Networks are working fine, but in VPC nop ...
>>
>> If you need more info, please let me know.
>>
>> Thanks a lot for your time,
>> Regards.
>>
>>
>> ----------------------------------------
>>> Date: Tue, 27 Aug 2013 22:54:11 +0100
>>> Subject: Re: VPC virtual router fails to start up - no route to CS
>> Management Server.
>>> From: msweet.dev@gmail.com
>>> To: users@cloudstack.apache.org
>>>
>>> Hi Enrique,
>>>
>>> Sorry I haven't got back to you, is this still an issue?
>>> If so, I will take a look at it and get back to you in the morning.
>>>
>>> Thanks,
>>> Marty
>>>
>>> On Monday, August 26, 2013, Enrique Ladrón de Guevara Hernández wrote:
>>>
>>>> Hi Marty,
>>>>
>>>> My apologies for the format. I hope this time the email format will be
>>>> better. You can find the logs attached.
>>>>
>>>> In this log you can see several VPC deployment tests. One of them is:
>>>> - VPC name: VPC-Prueba-1
>>>> - job: job-11
>>>> - ssvm: r-53-VM.
>>>>
>>>> I use GUI to create VPC. The system VM (virutal router) is created and I
>>>> can log in by console (VNC or VMWARE console), but after 40 min (aprox)
>>>> this SSVM are destroyed because the MS is not able to connect with.
>>>>
>>>> I think the System VM needs default gateway route or static route to MS
>>>> server like the rest of SystemVMs (Console, Sec. Storage or Guest Net.).
>>>>
>>>>
>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)
>>>>
>>>> Num. of Management Server: 1 (under CentOS 6.4) [physical server].
>>>>
>>>> The MS has this network configuration: IP: 10.10.10.110/24 GW:
>>>> 10.10.10.254
>>>>
>>>> DNS server:10.10.10.116/24
>>>>
>>>> Hypervisor: VMWARE 4.1 (with Standard Virtual Switches), 2 ESXi hosts:
>>>> IPs: 10.10.1.101 & .102/24 GW: 10.10.1.254
>>>>
>>>> vCenter: 10.10.1.100/24.
>>>>
>>>> Virtual Network Architecture:
>>>>
>>>> CS Traffic Type:CS Management
>>>> VmWare Virtual Switch:vSwitch0
>>>> CS Physical Network:PhysNet-mgmt-svm
>>>> Network:10.10.1.0
>>>> Subnet:/24
>>>> Gateway:10.10.1.254
>>>> VLAN TAG: NONE
>>>> Start IP Range:10.10.1.120
>>>> End IP Range: 10.10.1.240
>>>>
>>>> CS Traffic Type: Storage
>>>> VmWare Virtual Switch:vSwitch1
>>>> CS Physical Network:PhysNet-storage
>>>> Network:10.10.2.0
>>>> Subnet:/24
>>>> Gateway:10.10.2.254
>>>> VLAN TAG: NONE
>>>> Start IP Range:10.10.2.120
>>>> End IP Range: 10.10.2.240
>>>>
>>>>
>>>> CS Traffic Type:Guest
>>>> VmWare Virtual Switch:vSwitch2
>>>> CS Physical Network:PhysNet-guest-1
>>>> Network:10.10.3.0
>>>> Subnet:/24
>>>> Gateway:10.10.3.254
>>>> VLAN TAG: NONE
>>>> Start IP Range:10.10.3.1
>>>> End IP Range: 10.10.3.254
>>>>
>>>> CS Traffic Type:Public
>>>> VmWare Virtual Switch:vSwitch3
>>>> CS Physical Network:PhysNet-public
>>>> Network:10.10.4.0
>>>> Subnet:/24
>>>> Gateway:10.10.4.254
>>>> VLAN TAG: NONE
>>>> Start IP Range:10.10.4.1
>>>> End IP Range: 10.10.4.240
>>>>
>>>>
>>>> vRouter (VPC) System VM - doesn't have a specific route to MS:
>>>>
>>>> root@r-53-VM:~# netstat -nr
>>>> Kernel IP routing table
>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>> Iface
>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>> eth3
>>>> root@r-53-VM:~#
>>>>
>>>>
>>>> CS management server:
>>>>
>>>> [root@cs-1 ~]# netstat -nr
>>>> Kernel IP routing table
>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>> Iface
>>>> 10.10.10.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>> eth0
>>>> 169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0
>>>> eth0
>>>> 0.0.0.0 10.10.10.254 0.0.0.0 UG 0 0 0
>>>> eth0
>>>> [root@cs-1 ~]#
>>>>
>>>> Console Proxy System VM:
>>>>
>>>> root@v-50-VM:~# netstat -nr
>>>> Kernel IP routing table
>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>> Iface
>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0 0
>>>> eth1
>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0 0
>>>> eth1
>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>> eth2
>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>> eth1
>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
>>>> eth1
>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
>>>> eth2
>>>> root@v-50-VM:~#
>>>>
>>>> vRouter (no VPC- Guest Network) System VM:
>>>>
>>>> root@r-49-VM:~# netstat -nr
>>>> Kernel IP routing table
>>>> Destination Gateway Genmask Flags MSS Window irtt
>>>> Iface
>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>> eth2
>>>> 10.10.3.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>> eth0
>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
>>>> eth1
>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
>>>> eth1
>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
>>>> eth2
>>>> root@r-49-VM:~#
>>>>
>>>> Secondary Storage System VM:
>>>>
>>>> root@s-28-VM:~# netstat -nr
>>>> Kernel IP routing table
>>>> Destination Gateway Genmask Flags MSS
>>>> Window irtt Iface
>>>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
>>>> 0 eth1
>>>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
>>>> 0 eth1
>>>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0
>>>> 0 0 eth2
>>>> 10.10.2.0 0.0.0.0 255.255.255.0 U 0
>>>> 0 0 eth3
>>>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0
>>>> 0 0 eth1
>>>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0
>>>> 0 eth1
>>>> 0.0.0.0 10.10.4.254 0.0.0.0 UG
>>>> 0 0 0 eth2
>>>> root@s-28-VM:~#
>>>>
>>>>
>>>> Thanks,
>>>> Regards.
>>>>
>>>>
>>>>
>> ---------------------------------------------------------------------------------------------
>>>>
>>>>
>> ---------------------------------------------------------------------------------------------
>>>>
>>>>
>>>>> Date: Mon, 26 Aug 2013 15:19:06 +0100
>>>>> Subject: Re: VPC virtual router fails to start up - no route to CS
>>>> Management Server.
>>>>> From: msweet.dev@gmail.com <javascript:;>
>>>>> To: users@cloudstack.apache.org <javascript:;>
>>>>>
>>>>> Hi,
>>>>>
>>>>> I don't think this has got a response because of the poor formatting of
>>>> the
>>>>> log. Please could you attach the log in a separate file and I will
>> take a
>>>>> look?
>>>>> Am I correct in thinking that it is creating the system VM, and then
>>>>> destroying it?
>>>>>
>>>>> Thanks,
>>>>> Marty
>>>>>
>>>>>
>>>>> On Sun, Aug 25, 2013 at 11:46 PM, Enrique Ladrón de Guevara Hernández <
>>>>> enriquelgh@hotmail.com> wrote:
>>>>>
>>>>>> Hi,
>>>>>> I'm carrying out my End of Career Project related to CloudStack
>>>>>> deployment. I got issues when I try to deploy a VPC, the VPC virtual
>>>> router
>>>>>> isn't deployed completely and It's destroyed after timeout.
>>>>>> The rest of SSVMs (Console Proxy VM, Storage VM and Guest Network VM)
>>>> are
>>>>>> deployed correctly. I can access to the instance console, put into
>> guest
>>>>>> network a instance, connect to it, etc ...
>>>>>> Could you help me to resolve this issue? I don't know which is the
>> thing
>>>>>> that I'm doing wrong ...
>>>>>> This is the context:
>>>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)Num. of Management
>>>> Server:
>>>>>> 1 (under CentOS 6.4) [physical server]. The MS has this network
>>>>>> configuration:IP: 10.10.10.110/24GW: 10.10.10.254DNS server:
>>>>>> 10.10.10.116/24Hypervisor: VMWARE 4.1:2 ESXi hosts:IPs: 10.10.1.101 &
>>>>>> .102/24GW: 10.10.1.254vCenter: 10.10.1.100Standard Virtual Switches.
>>>>>> Virtual Network Architecture:VmWare Virtual Switch CS Physical
>>>>>> Network Network Subnet Gateway VLAN
>>>>>> TAG CS Traffic Type Start IP Range End IP RangevSwitch0
>>>>>> PhysNet-mgmt-svm 10.10.1.0
>>>>>> 255.255.255.0 10.10.1.254 NONE CS Management 10.10.1.120
>>>>>> 10.10.1.240vSwitch1
>>>>>> PhysNet-storage 10.10.2.0 255.255.255.0 10.10.2.254
>>>>>> NONE Storage 10.10.2.120
>>>>>> 10.10.2.240vSwitch2 PhysNet-guest-1
>>>>>> 10.10.3.0 255.255.255.0 10.10.3.254 NONE
>>>>>> Guest 10.10.3.1 10.10.3.254vSwitch3
>>>>>> PhysNet-public 10.10.4.0
>>>>>> 255.255.255.0 10.10.4.254 NONE Public
>>>>>> 10.10.4.1 10.10.4.240
>>>>>> I log in to ssvm consoles and I can see the following:vRouter (VPC)
>>>> System
>>>>>> VM - doesn't have a specific route to MS:root@r-53-VM:~# netstat
>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
>>>>>> Flags MSS Window irtt Iface10.10.1.0 0.0.0.0 255.255.255.0
>>>>>> U 0 0 0 eth3root@r-53-VM:~#
>>>>>> CS management server:[root@cs-1 ~]# netstat -nrKernel IP routing
>>>>>> tableDestination Gateway Genmask Flags MSS Window
>>>>>> irtt Iface10.10.10.0 0.0.0.0 255.255.255.0 U 0 0
>>>>>> 0 eth0169.254.0.0 0.0.0.0 255.255.0.0 U 0 0
>>>>>> 0 eth00.0.0.0 10.10.10.254 0.0.0.0 UG 0
>>>>>> 0 0 eth0[root@cs-1 ~]#
>>>>>> Console Proxy System VM:root@v-50-VM:~# netstat -nrKernel IP routing
>>>>>> tableDestination Gateway Genmask Flags MSS Window
>>>>>> irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>> 0 eth110.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
>>>>>> 0 eth110.10.4.0 0.0.0.0 255.255.255.0 U 0
>>>>>> 0 0 eth210.10.1.0 0.0.0.0 255.255.255.0 U
>>>>>> 0 0 0 eth110.10.10.0 10.10.1.254 255.255.255.0 UG
>>>>>> 0 0 0 eth10.0.0.0 10.10.4.254 0.0.0.0 UG
>>>>>> 0 0 0 eth2root@v-50-VM:~#
>>>>>> vRouter (no VPC- Guest Network) System VM:root@r-49-VM:~# netstat
>>>>>> -nrKernel IP routing tableDestination Gateway Genmask
>>>>>> Flags MSS Window irtt Iface10.10.4.0 0.0.0.0 255.255.255.0
>>>>>> U 0 0 0 eth210.10.3.0 0.0.0.0
>>>>>> 255.255.255.0 U 0 0 0 eth010.10.1.0 0.0.0.0
>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0 10.10.1.254
>>>>>> 255.255.255.0 UG 0 0 0 eth10.0.0.0
>>>>>> 10.10.4.254 0.0.0.0 UG 0 0 0 eth2root@r-49-VM
>>>>>> :~#
>>>>>> Secondary Storage System VMroot@s-28-VM:~# netstat -nrKernel IP
>> routing
>>>>>> tableDestination Gateway Genmask Flags MSS
>>>>>> Window irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH
>>>>>> 0 0 0 eth110.10.10.110 10.10.1.254
>>>>>> 255.255.255.255 UGH 0 0 0 eth110.10.4.0
>>>>>> 0.0.0.0 255.255.255.0 U 0 0
>>>>>> 0 eth210.10.2.0 0.0.0.0 255.255.255.0 U
>>>>>> 0 0 0 eth310.10.1.0 0.0.0.0
>>>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0
>>>>>> 10.10.1.254 255.255.255.0 UG 0 0 0
>>>>>> eth10.0.0.0 10.10.4.254 0.0.0.0 UG
>>>>>> 0 0 0 eth2root@s-28-VM:~# management-server.log
>>>>>> (filtered by r-53-VM):
>>>>>> [root@cs-1 ~]# g>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116 template=domP
>>>> name=r-53-VM
>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true
>>>> extra_pubnics=2
>>>>>>
>>>>
>> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}},{"check.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":100,"name":"r-53-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.1.238","
>>>>>> router.name
>>>>>>
>>>>
>> ":"r-53-VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbps":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"10.10.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"router.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"10.10.1.238","
>>>>>> router.name
>>>>>>
>>>>
>> ":"r-53-VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessDetails":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","
>>>>>> router.name":"r-53-VM"},"wait":0}},{}] }2013-08-25 11:34:48,001 DEBUG
>>>>>> [agent.transport.Request] (Job-Executor-13:job-11) Seq 1-1308430869:
>>>>>> Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags:
>> 100111,
>>>>>>
>>>>
>> [{"StartCommand":{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter">>
>>>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
>>>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116 template=domP
>>>> name=r-53-VM
>>>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
>>>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true
>>>> extra_pubnics=2
>>>>>>
>>>>
>> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":>>
>>>> GNU/Linux 5.0 (32-bit)",
>>
Re: VPC virtual router fails to start up - no route to CS Management Server.
Posted by Marty Sweet <ms...@gmail.com>.
Hi,
Could you let me know the IP addresses listed in the cloudstack interface
under Infrastructure > Virtual Routers > VPC
Marty
On Tue, Aug 27, 2013 at 11:11 PM, Enrique Ladrón de Guevara Hernández <
enriquelgh@hotmail.com> wrote:
> Hi Marty,
>
> Yes, I have still got this issue ... :S I'm very lost ...
>
> Guest Networks are working fine, but in VPC nop ...
>
> If you need more info, please let me know.
>
> Thanks a lot for your time,
> Regards.
>
>
> ----------------------------------------
> > Date: Tue, 27 Aug 2013 22:54:11 +0100
> > Subject: Re: VPC virtual router fails to start up - no route to CS
> Management Server.
> > From: msweet.dev@gmail.com
> > To: users@cloudstack.apache.org
> >
> > Hi Enrique,
> >
> > Sorry I haven't got back to you, is this still an issue?
> > If so, I will take a look at it and get back to you in the morning.
> >
> > Thanks,
> > Marty
> >
> > On Monday, August 26, 2013, Enrique Ladrón de Guevara Hernández wrote:
> >
> >> Hi Marty,
> >>
> >> My apologies for the format. I hope this time the email format will be
> >> better. You can find the logs attached.
> >>
> >> In this log you can see several VPC deployment tests. One of them is:
> >> - VPC name: VPC-Prueba-1
> >> - job: job-11
> >> - ssvm: r-53-VM.
> >>
> >> I use GUI to create VPC. The system VM (virutal router) is created and I
> >> can log in by console (VNC or VMWARE console), but after 40 min (aprox)
> >> this SSVM are destroyed because the MS is not able to connect with.
> >>
> >> I think the System VM needs default gateway route or static route to MS
> >> server like the rest of SystemVMs (Console, Sec. Storage or Guest Net.).
> >>
> >>
> >> CloudStack Version: 4.1.1 (upgraded from 4.0.2)
> >>
> >> Num. of Management Server: 1 (under CentOS 6.4) [physical server].
> >>
> >> The MS has this network configuration: IP: 10.10.10.110/24 GW:
> >> 10.10.10.254
> >>
> >> DNS server:10.10.10.116/24
> >>
> >> Hypervisor: VMWARE 4.1 (with Standard Virtual Switches), 2 ESXi hosts:
> >> IPs: 10.10.1.101 & .102/24 GW: 10.10.1.254
> >>
> >> vCenter: 10.10.1.100/24.
> >>
> >> Virtual Network Architecture:
> >>
> >> CS Traffic Type:CS Management
> >> VmWare Virtual Switch:vSwitch0
> >> CS Physical Network:PhysNet-mgmt-svm
> >> Network:10.10.1.0
> >> Subnet:/24
> >> Gateway:10.10.1.254
> >> VLAN TAG: NONE
> >> Start IP Range:10.10.1.120
> >> End IP Range: 10.10.1.240
> >>
> >> CS Traffic Type: Storage
> >> VmWare Virtual Switch:vSwitch1
> >> CS Physical Network:PhysNet-storage
> >> Network:10.10.2.0
> >> Subnet:/24
> >> Gateway:10.10.2.254
> >> VLAN TAG: NONE
> >> Start IP Range:10.10.2.120
> >> End IP Range: 10.10.2.240
> >>
> >>
> >> CS Traffic Type:Guest
> >> VmWare Virtual Switch:vSwitch2
> >> CS Physical Network:PhysNet-guest-1
> >> Network:10.10.3.0
> >> Subnet:/24
> >> Gateway:10.10.3.254
> >> VLAN TAG: NONE
> >> Start IP Range:10.10.3.1
> >> End IP Range: 10.10.3.254
> >>
> >> CS Traffic Type:Public
> >> VmWare Virtual Switch:vSwitch3
> >> CS Physical Network:PhysNet-public
> >> Network:10.10.4.0
> >> Subnet:/24
> >> Gateway:10.10.4.254
> >> VLAN TAG: NONE
> >> Start IP Range:10.10.4.1
> >> End IP Range: 10.10.4.240
> >>
> >>
> >> vRouter (VPC) System VM - doesn't have a specific route to MS:
> >>
> >> root@r-53-VM:~# netstat -nr
> >> Kernel IP routing table
> >> Destination Gateway Genmask Flags MSS Window irtt
> >> Iface
> >> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> >> eth3
> >> root@r-53-VM:~#
> >>
> >>
> >> CS management server:
> >>
> >> [root@cs-1 ~]# netstat -nr
> >> Kernel IP routing table
> >> Destination Gateway Genmask Flags MSS Window irtt
> >> Iface
> >> 10.10.10.0 0.0.0.0 255.255.255.0 U 0 0 0
> >> eth0
> >> 169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0
> >> eth0
> >> 0.0.0.0 10.10.10.254 0.0.0.0 UG 0 0 0
> >> eth0
> >> [root@cs-1 ~]#
> >>
> >> Console Proxy System VM:
> >>
> >> root@v-50-VM:~# netstat -nr
> >> Kernel IP routing table
> >> Destination Gateway Genmask Flags MSS Window irtt
> >> Iface
> >> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0 0
> >> eth1
> >> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0 0
> >> eth1
> >> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
> >> eth2
> >> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> >> eth1
> >> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
> >> eth1
> >> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
> >> eth2
> >> root@v-50-VM:~#
> >>
> >> vRouter (no VPC- Guest Network) System VM:
> >>
> >> root@r-49-VM:~# netstat -nr
> >> Kernel IP routing table
> >> Destination Gateway Genmask Flags MSS Window irtt
> >> Iface
> >> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
> >> eth2
> >> 10.10.3.0 0.0.0.0 255.255.255.0 U 0 0 0
> >> eth0
> >> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> >> eth1
> >> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
> >> eth1
> >> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
> >> eth2
> >> root@r-49-VM:~#
> >>
> >> Secondary Storage System VM:
> >>
> >> root@s-28-VM:~# netstat -nr
> >> Kernel IP routing table
> >> Destination Gateway Genmask Flags MSS
> >> Window irtt Iface
> >> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
> >> 0 eth1
> >> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
> >> 0 eth1
> >> 10.10.4.0 0.0.0.0 255.255.255.0 U 0
> >> 0 0 eth2
> >> 10.10.2.0 0.0.0.0 255.255.255.0 U 0
> >> 0 0 eth3
> >> 10.10.1.0 0.0.0.0 255.255.255.0 U 0
> >> 0 0 eth1
> >> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0
> >> 0 eth1
> >> 0.0.0.0 10.10.4.254 0.0.0.0 UG
> >> 0 0 0 eth2
> >> root@s-28-VM:~#
> >>
> >>
> >> Thanks,
> >> Regards.
> >>
> >>
> >>
> ---------------------------------------------------------------------------------------------
> >>
> >>
> ---------------------------------------------------------------------------------------------
> >>
> >>
> >>> Date: Mon, 26 Aug 2013 15:19:06 +0100
> >>> Subject: Re: VPC virtual router fails to start up - no route to CS
> >> Management Server.
> >>> From: msweet.dev@gmail.com <javascript:;>
> >>> To: users@cloudstack.apache.org <javascript:;>
> >>>
> >>> Hi,
> >>>
> >>> I don't think this has got a response because of the poor formatting of
> >> the
> >>> log. Please could you attach the log in a separate file and I will
> take a
> >>> look?
> >>> Am I correct in thinking that it is creating the system VM, and then
> >>> destroying it?
> >>>
> >>> Thanks,
> >>> Marty
> >>>
> >>>
> >>> On Sun, Aug 25, 2013 at 11:46 PM, Enrique Ladrón de Guevara Hernández <
> >>> enriquelgh@hotmail.com> wrote:
> >>>
> >>>> Hi,
> >>>> I'm carrying out my End of Career Project related to CloudStack
> >>>> deployment. I got issues when I try to deploy a VPC, the VPC virtual
> >> router
> >>>> isn't deployed completely and It's destroyed after timeout.
> >>>> The rest of SSVMs (Console Proxy VM, Storage VM and Guest Network VM)
> >> are
> >>>> deployed correctly. I can access to the instance console, put into
> guest
> >>>> network a instance, connect to it, etc ...
> >>>> Could you help me to resolve this issue? I don't know which is the
> thing
> >>>> that I'm doing wrong ...
> >>>> This is the context:
> >>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)Num. of Management
> >> Server:
> >>>> 1 (under CentOS 6.4) [physical server]. The MS has this network
> >>>> configuration:IP: 10.10.10.110/24GW: 10.10.10.254DNS server:
> >>>> 10.10.10.116/24Hypervisor: VMWARE 4.1:2 ESXi hosts:IPs: 10.10.1.101 &
> >>>> .102/24GW: 10.10.1.254vCenter: 10.10.1.100Standard Virtual Switches.
> >>>> Virtual Network Architecture:VmWare Virtual Switch CS Physical
> >>>> Network Network Subnet Gateway VLAN
> >>>> TAG CS Traffic Type Start IP Range End IP RangevSwitch0
> >>>> PhysNet-mgmt-svm 10.10.1.0
> >>>> 255.255.255.0 10.10.1.254 NONE CS Management 10.10.1.120
> >>>> 10.10.1.240vSwitch1
> >>>> PhysNet-storage 10.10.2.0 255.255.255.0 10.10.2.254
> >>>> NONE Storage 10.10.2.120
> >>>> 10.10.2.240vSwitch2 PhysNet-guest-1
> >>>> 10.10.3.0 255.255.255.0 10.10.3.254 NONE
> >>>> Guest 10.10.3.1 10.10.3.254vSwitch3
> >>>> PhysNet-public 10.10.4.0
> >>>> 255.255.255.0 10.10.4.254 NONE Public
> >>>> 10.10.4.1 10.10.4.240
> >>>> I log in to ssvm consoles and I can see the following:vRouter (VPC)
> >> System
> >>>> VM - doesn't have a specific route to MS:root@r-53-VM:~# netstat
> >>>> -nrKernel IP routing tableDestination Gateway Genmask
> >>>> Flags MSS Window irtt Iface10.10.1.0 0.0.0.0 255.255.255.0
> >>>> U 0 0 0 eth3root@r-53-VM:~#
> >>>> CS management server:[root@cs-1 ~]# netstat -nrKernel IP routing
> >>>> tableDestination Gateway Genmask Flags MSS Window
> >>>> irtt Iface10.10.10.0 0.0.0.0 255.255.255.0 U 0 0
> >>>> 0 eth0169.254.0.0 0.0.0.0 255.255.0.0 U 0 0
> >>>> 0 eth00.0.0.0 10.10.10.254 0.0.0.0 UG 0
> >>>> 0 0 eth0[root@cs-1 ~]#
> >>>> Console Proxy System VM:root@v-50-VM:~# netstat -nrKernel IP routing
> >>>> tableDestination Gateway Genmask Flags MSS Window
> >>>> irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
> >>>> 0 eth110.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
> >>>> 0 eth110.10.4.0 0.0.0.0 255.255.255.0 U 0
> >>>> 0 0 eth210.10.1.0 0.0.0.0 255.255.255.0 U
> >>>> 0 0 0 eth110.10.10.0 10.10.1.254 255.255.255.0 UG
> >>>> 0 0 0 eth10.0.0.0 10.10.4.254 0.0.0.0 UG
> >>>> 0 0 0 eth2root@v-50-VM:~#
> >>>> vRouter (no VPC- Guest Network) System VM:root@r-49-VM:~# netstat
> >>>> -nrKernel IP routing tableDestination Gateway Genmask
> >>>> Flags MSS Window irtt Iface10.10.4.0 0.0.0.0 255.255.255.0
> >>>> U 0 0 0 eth210.10.3.0 0.0.0.0
> >>>> 255.255.255.0 U 0 0 0 eth010.10.1.0 0.0.0.0
> >>>> 255.255.255.0 U 0 0 0 eth110.10.10.0 10.10.1.254
> >>>> 255.255.255.0 UG 0 0 0 eth10.0.0.0
> >>>> 10.10.4.254 0.0.0.0 UG 0 0 0 eth2root@r-49-VM
> >>>> :~#
> >>>> Secondary Storage System VMroot@s-28-VM:~# netstat -nrKernel IP
> routing
> >>>> tableDestination Gateway Genmask Flags MSS
> >>>> Window irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH
> >>>> 0 0 0 eth110.10.10.110 10.10.1.254
> >>>> 255.255.255.255 UGH 0 0 0 eth110.10.4.0
> >>>> 0.0.0.0 255.255.255.0 U 0 0
> >>>> 0 eth210.10.2.0 0.0.0.0 255.255.255.0 U
> >>>> 0 0 0 eth310.10.1.0 0.0.0.0
> >>>> 255.255.255.0 U 0 0 0 eth110.10.10.0
> >>>> 10.10.1.254 255.255.255.0 UG 0 0 0
> >>>> eth10.0.0.0 10.10.4.254 0.0.0.0 UG
> >>>> 0 0 0 eth2root@s-28-VM:~# management-server.log
> >>>> (filtered by r-53-VM):
> >>>> [root@cs-1 ~]# g>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
> >> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116 template=domP
> >> name=r-53-VM
> >>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
> >> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true
> >> extra_pubnics=2
> >>>>
> >>
> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}},{"check.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":100,"name":"r-53-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.1.238","
> >>>> router.name
> >>>>
> >>
> ":"r-53-VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbps":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"10.10.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"router.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"10.10.1.238","
> >>>> router.name
> >>>>
> >>
> ":"r-53-VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessDetails":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","
> >>>> router.name":"r-53-VM"},"wait":0}},{}] }2013-08-25 11:34:48,001 DEBUG
> >>>> [agent.transport.Request] (Job-Executor-13:job-11) Seq 1-1308430869:
> >>>> Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags:
> 100111,
> >>>>
> >>
> [{"StartCommand":{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter">>
> >> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
> >> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116 template=domP
> >> name=r-53-VM
> >>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
> >> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true
> >> extra_pubnics=2
> >>>>
> >>
> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":>>
> >> GNU/Linux 5.0 (32-bit)",
>
RE: VPC virtual router fails to start up - no route to CS
Management Server.
Posted by Enrique Ladrón de Guevara Hernández <en...@hotmail.com>.
Hi Marty,
Yes, I have still got this issue ... :S I'm very lost ...
Guest Networks are working fine, but in VPC nop ...
If you need more info, please let me know.
Thanks a lot for your time,
Regards.
----------------------------------------
> Date: Tue, 27 Aug 2013 22:54:11 +0100
> Subject: Re: VPC virtual router fails to start up - no route to CS Management Server.
> From: msweet.dev@gmail.com
> To: users@cloudstack.apache.org
>
> Hi Enrique,
>
> Sorry I haven't got back to you, is this still an issue?
> If so, I will take a look at it and get back to you in the morning.
>
> Thanks,
> Marty
>
> On Monday, August 26, 2013, Enrique Ladrón de Guevara Hernández wrote:
>
>> Hi Marty,
>>
>> My apologies for the format. I hope this time the email format will be
>> better. You can find the logs attached.
>>
>> In this log you can see several VPC deployment tests. One of them is:
>> - VPC name: VPC-Prueba-1
>> - job: job-11
>> - ssvm: r-53-VM.
>>
>> I use GUI to create VPC. The system VM (virutal router) is created and I
>> can log in by console (VNC or VMWARE console), but after 40 min (aprox)
>> this SSVM are destroyed because the MS is not able to connect with.
>>
>> I think the System VM needs default gateway route or static route to MS
>> server like the rest of SystemVMs (Console, Sec. Storage or Guest Net.).
>>
>>
>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)
>>
>> Num. of Management Server: 1 (under CentOS 6.4) [physical server].
>>
>> The MS has this network configuration: IP: 10.10.10.110/24 GW:
>> 10.10.10.254
>>
>> DNS server:10.10.10.116/24
>>
>> Hypervisor: VMWARE 4.1 (with Standard Virtual Switches), 2 ESXi hosts:
>> IPs: 10.10.1.101 & .102/24 GW: 10.10.1.254
>>
>> vCenter: 10.10.1.100/24.
>>
>> Virtual Network Architecture:
>>
>> CS Traffic Type:CS Management
>> VmWare Virtual Switch:vSwitch0
>> CS Physical Network:PhysNet-mgmt-svm
>> Network:10.10.1.0
>> Subnet:/24
>> Gateway:10.10.1.254
>> VLAN TAG: NONE
>> Start IP Range:10.10.1.120
>> End IP Range: 10.10.1.240
>>
>> CS Traffic Type: Storage
>> VmWare Virtual Switch:vSwitch1
>> CS Physical Network:PhysNet-storage
>> Network:10.10.2.0
>> Subnet:/24
>> Gateway:10.10.2.254
>> VLAN TAG: NONE
>> Start IP Range:10.10.2.120
>> End IP Range: 10.10.2.240
>>
>>
>> CS Traffic Type:Guest
>> VmWare Virtual Switch:vSwitch2
>> CS Physical Network:PhysNet-guest-1
>> Network:10.10.3.0
>> Subnet:/24
>> Gateway:10.10.3.254
>> VLAN TAG: NONE
>> Start IP Range:10.10.3.1
>> End IP Range: 10.10.3.254
>>
>> CS Traffic Type:Public
>> VmWare Virtual Switch:vSwitch3
>> CS Physical Network:PhysNet-public
>> Network:10.10.4.0
>> Subnet:/24
>> Gateway:10.10.4.254
>> VLAN TAG: NONE
>> Start IP Range:10.10.4.1
>> End IP Range: 10.10.4.240
>>
>>
>> vRouter (VPC) System VM - doesn't have a specific route to MS:
>>
>> root@r-53-VM:~# netstat -nr
>> Kernel IP routing table
>> Destination Gateway Genmask Flags MSS Window irtt
>> Iface
>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
>> eth3
>> root@r-53-VM:~#
>>
>>
>> CS management server:
>>
>> [root@cs-1 ~]# netstat -nr
>> Kernel IP routing table
>> Destination Gateway Genmask Flags MSS Window irtt
>> Iface
>> 10.10.10.0 0.0.0.0 255.255.255.0 U 0 0 0
>> eth0
>> 169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0
>> eth0
>> 0.0.0.0 10.10.10.254 0.0.0.0 UG 0 0 0
>> eth0
>> [root@cs-1 ~]#
>>
>> Console Proxy System VM:
>>
>> root@v-50-VM:~# netstat -nr
>> Kernel IP routing table
>> Destination Gateway Genmask Flags MSS Window irtt
>> Iface
>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0 0
>> eth1
>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0 0
>> eth1
>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
>> eth2
>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
>> eth1
>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
>> eth1
>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
>> eth2
>> root@v-50-VM:~#
>>
>> vRouter (no VPC- Guest Network) System VM:
>>
>> root@r-49-VM:~# netstat -nr
>> Kernel IP routing table
>> Destination Gateway Genmask Flags MSS Window irtt
>> Iface
>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
>> eth2
>> 10.10.3.0 0.0.0.0 255.255.255.0 U 0 0 0
>> eth0
>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
>> eth1
>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
>> eth1
>> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
>> eth2
>> root@r-49-VM:~#
>>
>> Secondary Storage System VM:
>>
>> root@s-28-VM:~# netstat -nr
>> Kernel IP routing table
>> Destination Gateway Genmask Flags MSS
>> Window irtt Iface
>> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
>> 0 eth1
>> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
>> 0 eth1
>> 10.10.4.0 0.0.0.0 255.255.255.0 U 0
>> 0 0 eth2
>> 10.10.2.0 0.0.0.0 255.255.255.0 U 0
>> 0 0 eth3
>> 10.10.1.0 0.0.0.0 255.255.255.0 U 0
>> 0 0 eth1
>> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0
>> 0 eth1
>> 0.0.0.0 10.10.4.254 0.0.0.0 UG
>> 0 0 0 eth2
>> root@s-28-VM:~#
>>
>>
>> Thanks,
>> Regards.
>>
>>
>> ---------------------------------------------------------------------------------------------
>>
>> ---------------------------------------------------------------------------------------------
>>
>>
>>> Date: Mon, 26 Aug 2013 15:19:06 +0100
>>> Subject: Re: VPC virtual router fails to start up - no route to CS
>> Management Server.
>>> From: msweet.dev@gmail.com <javascript:;>
>>> To: users@cloudstack.apache.org <javascript:;>
>>>
>>> Hi,
>>>
>>> I don't think this has got a response because of the poor formatting of
>> the
>>> log. Please could you attach the log in a separate file and I will take a
>>> look?
>>> Am I correct in thinking that it is creating the system VM, and then
>>> destroying it?
>>>
>>> Thanks,
>>> Marty
>>>
>>>
>>> On Sun, Aug 25, 2013 at 11:46 PM, Enrique Ladrón de Guevara Hernández <
>>> enriquelgh@hotmail.com> wrote:
>>>
>>>> Hi,
>>>> I'm carrying out my End of Career Project related to CloudStack
>>>> deployment. I got issues when I try to deploy a VPC, the VPC virtual
>> router
>>>> isn't deployed completely and It's destroyed after timeout.
>>>> The rest of SSVMs (Console Proxy VM, Storage VM and Guest Network VM)
>> are
>>>> deployed correctly. I can access to the instance console, put into guest
>>>> network a instance, connect to it, etc ...
>>>> Could you help me to resolve this issue? I don't know which is the thing
>>>> that I'm doing wrong ...
>>>> This is the context:
>>>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)Num. of Management
>> Server:
>>>> 1 (under CentOS 6.4) [physical server]. The MS has this network
>>>> configuration:IP: 10.10.10.110/24GW: 10.10.10.254DNS server:
>>>> 10.10.10.116/24Hypervisor: VMWARE 4.1:2 ESXi hosts:IPs: 10.10.1.101 &
>>>> .102/24GW: 10.10.1.254vCenter: 10.10.1.100Standard Virtual Switches.
>>>> Virtual Network Architecture:VmWare Virtual Switch CS Physical
>>>> Network Network Subnet Gateway VLAN
>>>> TAG CS Traffic Type Start IP Range End IP RangevSwitch0
>>>> PhysNet-mgmt-svm 10.10.1.0
>>>> 255.255.255.0 10.10.1.254 NONE CS Management 10.10.1.120
>>>> 10.10.1.240vSwitch1
>>>> PhysNet-storage 10.10.2.0 255.255.255.0 10.10.2.254
>>>> NONE Storage 10.10.2.120
>>>> 10.10.2.240vSwitch2 PhysNet-guest-1
>>>> 10.10.3.0 255.255.255.0 10.10.3.254 NONE
>>>> Guest 10.10.3.1 10.10.3.254vSwitch3
>>>> PhysNet-public 10.10.4.0
>>>> 255.255.255.0 10.10.4.254 NONE Public
>>>> 10.10.4.1 10.10.4.240
>>>> I log in to ssvm consoles and I can see the following:vRouter (VPC)
>> System
>>>> VM - doesn't have a specific route to MS:root@r-53-VM:~# netstat
>>>> -nrKernel IP routing tableDestination Gateway Genmask
>>>> Flags MSS Window irtt Iface10.10.1.0 0.0.0.0 255.255.255.0
>>>> U 0 0 0 eth3root@r-53-VM:~#
>>>> CS management server:[root@cs-1 ~]# netstat -nrKernel IP routing
>>>> tableDestination Gateway Genmask Flags MSS Window
>>>> irtt Iface10.10.10.0 0.0.0.0 255.255.255.0 U 0 0
>>>> 0 eth0169.254.0.0 0.0.0.0 255.255.0.0 U 0 0
>>>> 0 eth00.0.0.0 10.10.10.254 0.0.0.0 UG 0
>>>> 0 0 eth0[root@cs-1 ~]#
>>>> Console Proxy System VM:root@v-50-VM:~# netstat -nrKernel IP routing
>>>> tableDestination Gateway Genmask Flags MSS Window
>>>> irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
>>>> 0 eth110.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
>>>> 0 eth110.10.4.0 0.0.0.0 255.255.255.0 U 0
>>>> 0 0 eth210.10.1.0 0.0.0.0 255.255.255.0 U
>>>> 0 0 0 eth110.10.10.0 10.10.1.254 255.255.255.0 UG
>>>> 0 0 0 eth10.0.0.0 10.10.4.254 0.0.0.0 UG
>>>> 0 0 0 eth2root@v-50-VM:~#
>>>> vRouter (no VPC- Guest Network) System VM:root@r-49-VM:~# netstat
>>>> -nrKernel IP routing tableDestination Gateway Genmask
>>>> Flags MSS Window irtt Iface10.10.4.0 0.0.0.0 255.255.255.0
>>>> U 0 0 0 eth210.10.3.0 0.0.0.0
>>>> 255.255.255.0 U 0 0 0 eth010.10.1.0 0.0.0.0
>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0 10.10.1.254
>>>> 255.255.255.0 UG 0 0 0 eth10.0.0.0
>>>> 10.10.4.254 0.0.0.0 UG 0 0 0 eth2root@r-49-VM
>>>> :~#
>>>> Secondary Storage System VMroot@s-28-VM:~# netstat -nrKernel IP routing
>>>> tableDestination Gateway Genmask Flags MSS
>>>> Window irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH
>>>> 0 0 0 eth110.10.10.110 10.10.1.254
>>>> 255.255.255.255 UGH 0 0 0 eth110.10.4.0
>>>> 0.0.0.0 255.255.255.0 U 0 0
>>>> 0 eth210.10.2.0 0.0.0.0 255.255.255.0 U
>>>> 0 0 0 eth310.10.1.0 0.0.0.0
>>>> 255.255.255.0 U 0 0 0 eth110.10.10.0
>>>> 10.10.1.254 255.255.255.0 UG 0 0 0
>>>> eth10.0.0.0 10.10.4.254 0.0.0.0 UG
>>>> 0 0 0 eth2root@s-28-VM:~# management-server.log
>>>> (filtered by r-53-VM):
>>>> [root@cs-1 ~]# g>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116 template=domP
>> name=r-53-VM
>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true
>> extra_pubnics=2
>>>>
>> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}},{"check.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":100,"name":"r-53-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.1.238","
>>>> router.name
>>>>
>> ":"r-53-VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbps":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"10.10.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"router.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"10.10.1.238","
>>>> router.name
>>>>
>> ":"r-53-VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessDetails":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","
>>>> router.name":"r-53-VM"},"wait":0}},{}] }2013-08-25 11:34:48,001 DEBUG
>>>> [agent.transport.Request] (Job-Executor-13:job-11) Seq 1-1308430869:
>>>> Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags: 100111,
>>>>
>> [{"StartCommand":{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter">>
>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
>> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116 template=domP
>> name=r-53-VM
>>>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
>> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true
>> extra_pubnics=2
>>>>
>> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":>>
>> GNU/Linux 5.0 (32-bit)",
Re: VPC virtual router fails to start up - no route to CS Management Server.
Posted by Marty Sweet <ms...@gmail.com>.
Hi Enrique,
Sorry I haven't got back to you, is this still an issue?
If so, I will take a look at it and get back to you in the morning.
Thanks,
Marty
On Monday, August 26, 2013, Enrique Ladrón de Guevara Hernández wrote:
> Hi Marty,
>
> My apologies for the format. I hope this time the email format will be
> better. You can find the logs attached.
>
> In this log you can see several VPC deployment tests. One of them is:
> - VPC name: VPC-Prueba-1
> - job: job-11
> - ssvm: r-53-VM.
>
> I use GUI to create VPC. The system VM (virutal router) is created and I
> can log in by console (VNC or VMWARE console), but after 40 min (aprox)
> this SSVM are destroyed because the MS is not able to connect with.
>
> I think the System VM needs default gateway route or static route to MS
> server like the rest of SystemVMs (Console, Sec. Storage or Guest Net.).
>
>
> CloudStack Version: 4.1.1 (upgraded from 4.0.2)
>
> Num. of Management Server: 1 (under CentOS 6.4) [physical server].
>
> The MS has this network configuration: IP: 10.10.10.110/24 GW:
> 10.10.10.254
>
> DNS server:10.10.10.116/24
>
> Hypervisor: VMWARE 4.1 (with Standard Virtual Switches), 2 ESXi hosts:
> IPs: 10.10.1.101 & .102/24 GW: 10.10.1.254
>
> vCenter: 10.10.1.100/24.
>
> Virtual Network Architecture:
>
> CS Traffic Type:CS Management
> VmWare Virtual Switch:vSwitch0
> CS Physical Network:PhysNet-mgmt-svm
> Network:10.10.1.0
> Subnet:/24
> Gateway:10.10.1.254
> VLAN TAG: NONE
> Start IP Range:10.10.1.120
> End IP Range: 10.10.1.240
>
> CS Traffic Type: Storage
> VmWare Virtual Switch:vSwitch1
> CS Physical Network:PhysNet-storage
> Network:10.10.2.0
> Subnet:/24
> Gateway:10.10.2.254
> VLAN TAG: NONE
> Start IP Range:10.10.2.120
> End IP Range: 10.10.2.240
>
>
> CS Traffic Type:Guest
> VmWare Virtual Switch:vSwitch2
> CS Physical Network:PhysNet-guest-1
> Network:10.10.3.0
> Subnet:/24
> Gateway:10.10.3.254
> VLAN TAG: NONE
> Start IP Range:10.10.3.1
> End IP Range: 10.10.3.254
>
> CS Traffic Type:Public
> VmWare Virtual Switch:vSwitch3
> CS Physical Network:PhysNet-public
> Network:10.10.4.0
> Subnet:/24
> Gateway:10.10.4.254
> VLAN TAG: NONE
> Start IP Range:10.10.4.1
> End IP Range: 10.10.4.240
>
>
> vRouter (VPC) System VM - doesn't have a specific route to MS:
>
> root@r-53-VM:~# netstat -nr
> Kernel IP routing table
> Destination Gateway Genmask Flags MSS Window irtt
> Iface
> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> eth3
> root@r-53-VM:~#
>
>
> CS management server:
>
> [root@cs-1 ~]# netstat -nr
> Kernel IP routing table
> Destination Gateway Genmask Flags MSS Window irtt
> Iface
> 10.10.10.0 0.0.0.0 255.255.255.0 U 0 0 0
> eth0
> 169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0
> eth0
> 0.0.0.0 10.10.10.254 0.0.0.0 UG 0 0 0
> eth0
> [root@cs-1 ~]#
>
> Console Proxy System VM:
>
> root@v-50-VM:~# netstat -nr
> Kernel IP routing table
> Destination Gateway Genmask Flags MSS Window irtt
> Iface
> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0 0
> eth1
> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0 0
> eth1
> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
> eth2
> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> eth1
> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
> eth1
> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
> eth2
> root@v-50-VM:~#
>
> vRouter (no VPC- Guest Network) System VM:
>
> root@r-49-VM:~# netstat -nr
> Kernel IP routing table
> Destination Gateway Genmask Flags MSS Window irtt
> Iface
> 10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
> eth2
> 10.10.3.0 0.0.0.0 255.255.255.0 U 0 0 0
> eth0
> 10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
> eth1
> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
> eth1
> 0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
> eth2
> root@r-49-VM:~#
>
> Secondary Storage System VM:
>
> root@s-28-VM:~# netstat -nr
> Kernel IP routing table
> Destination Gateway Genmask Flags MSS
> Window irtt Iface
> 10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
> 0 eth1
> 10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
> 0 eth1
> 10.10.4.0 0.0.0.0 255.255.255.0 U 0
> 0 0 eth2
> 10.10.2.0 0.0.0.0 255.255.255.0 U 0
> 0 0 eth3
> 10.10.1.0 0.0.0.0 255.255.255.0 U 0
> 0 0 eth1
> 10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0
> 0 eth1
> 0.0.0.0 10.10.4.254 0.0.0.0 UG
> 0 0 0 eth2
> root@s-28-VM:~#
>
>
> Thanks,
> Regards.
>
>
> ---------------------------------------------------------------------------------------------
>
> ---------------------------------------------------------------------------------------------
>
>
> > Date: Mon, 26 Aug 2013 15:19:06 +0100
> > Subject: Re: VPC virtual router fails to start up - no route to CS
> Management Server.
> > From: msweet.dev@gmail.com <javascript:;>
> > To: users@cloudstack.apache.org <javascript:;>
> >
> > Hi,
> >
> > I don't think this has got a response because of the poor formatting of
> the
> > log. Please could you attach the log in a separate file and I will take a
> > look?
> > Am I correct in thinking that it is creating the system VM, and then
> > destroying it?
> >
> > Thanks,
> > Marty
> >
> >
> > On Sun, Aug 25, 2013 at 11:46 PM, Enrique Ladrón de Guevara Hernández <
> > enriquelgh@hotmail.com> wrote:
> >
> >> Hi,
> >> I'm carrying out my End of Career Project related to CloudStack
> >> deployment. I got issues when I try to deploy a VPC, the VPC virtual
> router
> >> isn't deployed completely and It's destroyed after timeout.
> >> The rest of SSVMs (Console Proxy VM, Storage VM and Guest Network VM)
> are
> >> deployed correctly. I can access to the instance console, put into guest
> >> network a instance, connect to it, etc ...
> >> Could you help me to resolve this issue? I don't know which is the thing
> >> that I'm doing wrong ...
> >> This is the context:
> >> CloudStack Version: 4.1.1 (upgraded from 4.0.2)Num. of Management
> Server:
> >> 1 (under CentOS 6.4) [physical server]. The MS has this network
> >> configuration:IP: 10.10.10.110/24GW: 10.10.10.254DNS server:
> >> 10.10.10.116/24Hypervisor: VMWARE 4.1:2 ESXi hosts:IPs: 10.10.1.101 &
> >> .102/24GW: 10.10.1.254vCenter: 10.10.1.100Standard Virtual Switches.
> >> Virtual Network Architecture:VmWare Virtual Switch CS Physical
> >> Network Network Subnet Gateway VLAN
> >> TAG CS Traffic Type Start IP Range End IP RangevSwitch0
> >> PhysNet-mgmt-svm 10.10.1.0
> >> 255.255.255.0 10.10.1.254 NONE CS Management 10.10.1.120
> >> 10.10.1.240vSwitch1
> >> PhysNet-storage 10.10.2.0 255.255.255.0 10.10.2.254
> >> NONE Storage 10.10.2.120
> >> 10.10.2.240vSwitch2 PhysNet-guest-1
> >> 10.10.3.0 255.255.255.0 10.10.3.254 NONE
> >> Guest 10.10.3.1 10.10.3.254vSwitch3
> >> PhysNet-public 10.10.4.0
> >> 255.255.255.0 10.10.4.254 NONE Public
> >> 10.10.4.1 10.10.4.240
> >> I log in to ssvm consoles and I can see the following:vRouter (VPC)
> System
> >> VM - doesn't have a specific route to MS:root@r-53-VM:~# netstat
> >> -nrKernel IP routing tableDestination Gateway Genmask
> >> Flags MSS Window irtt Iface10.10.1.0 0.0.0.0 255.255.255.0
> >> U 0 0 0 eth3root@r-53-VM:~#
> >> CS management server:[root@cs-1 ~]# netstat -nrKernel IP routing
> >> tableDestination Gateway Genmask Flags MSS Window
> >> irtt Iface10.10.10.0 0.0.0.0 255.255.255.0 U 0 0
> >> 0 eth0169.254.0.0 0.0.0.0 255.255.0.0 U 0 0
> >> 0 eth00.0.0.0 10.10.10.254 0.0.0.0 UG 0
> >> 0 0 eth0[root@cs-1 ~]#
> >> Console Proxy System VM:root@v-50-VM:~# netstat -nrKernel IP routing
> >> tableDestination Gateway Genmask Flags MSS Window
> >> irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
> >> 0 eth110.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
> >> 0 eth110.10.4.0 0.0.0.0 255.255.255.0 U 0
> >> 0 0 eth210.10.1.0 0.0.0.0 255.255.255.0 U
> >> 0 0 0 eth110.10.10.0 10.10.1.254 255.255.255.0 UG
> >> 0 0 0 eth10.0.0.0 10.10.4.254 0.0.0.0 UG
> >> 0 0 0 eth2root@v-50-VM:~#
> >> vRouter (no VPC- Guest Network) System VM:root@r-49-VM:~# netstat
> >> -nrKernel IP routing tableDestination Gateway Genmask
> >> Flags MSS Window irtt Iface10.10.4.0 0.0.0.0 255.255.255.0
> >> U 0 0 0 eth210.10.3.0 0.0.0.0
> >> 255.255.255.0 U 0 0 0 eth010.10.1.0 0.0.0.0
> >> 255.255.255.0 U 0 0 0 eth110.10.10.0 10.10.1.254
> >> 255.255.255.0 UG 0 0 0 eth10.0.0.0
> >> 10.10.4.254 0.0.0.0 UG 0 0 0 eth2root@r-49-VM
> >> :~#
> >> Secondary Storage System VMroot@s-28-VM:~# netstat -nrKernel IP routing
> >> tableDestination Gateway Genmask Flags MSS
> >> Window irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH
> >> 0 0 0 eth110.10.10.110 10.10.1.254
> >> 255.255.255.255 UGH 0 0 0 eth110.10.4.0
> >> 0.0.0.0 255.255.255.0 U 0 0
> >> 0 eth210.10.2.0 0.0.0.0 255.255.255.0 U
> >> 0 0 0 eth310.10.1.0 0.0.0.0
> >> 255.255.255.0 U 0 0 0 eth110.10.10.0
> >> 10.10.1.254 255.255.255.0 UG 0 0 0
> >> eth10.0.0.0 10.10.4.254 0.0.0.0 UG
> >> 0 0 0 eth2root@s-28-VM:~# management-server.log
> >> (filtered by r-53-VM):
> >> [root@cs-1 ~]# g>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116 template=domP
> name=r-53-VM
> >> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true
> extra_pubnics=2
> >>
> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}},{"check.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":100,"name":"r-53-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.1.238","
> >> router.name
> >>
> ":"r-53-VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbps":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"10.10.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"router.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"10.10.1.238","
> >> router.name
> >>
> ":"r-53-VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessDetails":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","
> >> router.name":"r-53-VM"},"wait":0}},{}] }2013-08-25 11:34:48,001 DEBUG
> >> [agent.transport.Request] (Job-Executor-13:job-11) Seq 1-1308430869:
> >> Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags: 100111,
> >>
> [{"StartCommand":{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter">>
> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=
> 192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116 template=domP
> name=r-53-VM
> >> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
> 10.10.10.0/24localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true
> extra_pubnics=2
> >>
> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":>>
> GNU/Linux 5.0 (32-bit)",
RE: VPC virtual router fails to start up - no route to CS
Management Server.
Posted by Enrique Ladrón de Guevara Hernández <en...@hotmail.com>.
Hi Marty,
My apologies for the format. I hope this time the email format will be better. You can find the logs attached.
In this log you can see several VPC deployment tests. One of them is:
- VPC name: VPC-Prueba-1
- job: job-11
- ssvm: r-53-VM.
I use GUI to create VPC. The system VM (virutal router) is created and I can log in by console (VNC or VMWARE console), but after 40 min (aprox) this SSVM are destroyed because the MS is not able to connect with.
I think the System VM needs default gateway route or static route to MS server like the rest of SystemVMs (Console, Sec. Storage or Guest Net.).
CloudStack Version: 4.1.1 (upgraded from 4.0.2)
Num. of Management Server: 1 (under CentOS 6.4) [physical server].
The MS has this network configuration: IP: 10.10.10.110/24 GW: 10.10.10.254
DNS server:10.10.10.116/24
Hypervisor: VMWARE 4.1 (with Standard Virtual Switches), 2 ESXi hosts: IPs: 10.10.1.101 & .102/24 GW: 10.10.1.254
vCenter: 10.10.1.100/24.
Virtual Network Architecture:
CS Traffic Type:CS Management
VmWare Virtual Switch:vSwitch0
CS Physical Network:PhysNet-mgmt-svm
Network:10.10.1.0
Subnet:/24
Gateway:10.10.1.254
VLAN TAG: NONE
Start IP Range:10.10.1.120
End IP Range: 10.10.1.240
CS Traffic Type: Storage
VmWare Virtual Switch:vSwitch1
CS Physical Network:PhysNet-storage
Network:10.10.2.0
Subnet:/24
Gateway:10.10.2.254
VLAN TAG: NONE
Start IP Range:10.10.2.120
End IP Range: 10.10.2.240
CS Traffic Type:Guest
VmWare Virtual Switch:vSwitch2
CS Physical Network:PhysNet-guest-1
Network:10.10.3.0
Subnet:/24
Gateway:10.10.3.254
VLAN TAG: NONE
Start IP Range:10.10.3.1
End IP Range: 10.10.3.254
CS Traffic Type:Public
VmWare Virtual Switch:vSwitch3
CS Physical Network:PhysNet-public
Network:10.10.4.0
Subnet:/24
Gateway:10.10.4.254
VLAN TAG: NONE
Start IP Range:10.10.4.1
End IP Range: 10.10.4.240
vRouter (VPC) System VM - doesn't have a specific route to MS:
root@r-53-VM:~# netstat -nr
Kernel IP routing table
Destination Gateway Genmask Flags MSS Window irtt Iface
10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0 eth3
root@r-53-VM:~#
CS management server:
[root@cs-1 ~]# netstat -nr
Kernel IP routing table
Destination Gateway Genmask Flags MSS Window irtt Iface
10.10.10.0 0.0.0.0 255.255.255.0 U 0 0 0 eth0
169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0 eth0
0.0.0.0 10.10.10.254 0.0.0.0 UG 0 0 0 eth0
[root@cs-1 ~]#
Console Proxy System VM:
root@v-50-VM:~# netstat -nr
Kernel IP routing table
Destination Gateway Genmask Flags MSS Window irtt Iface
10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0 0 eth1
10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0 0 eth1
10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0 eth2
10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0 eth1
10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0 eth1
0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0 eth2
root@v-50-VM:~#
vRouter (no VPC- Guest Network) System VM:
root@r-49-VM:~# netstat -nr
Kernel IP routing table
Destination Gateway Genmask Flags MSS Window irtt Iface
10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0 eth2
10.10.3.0 0.0.0.0 255.255.255.0 U 0 0 0 eth0
10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0 eth1
10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0 eth1
0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0 eth2
root@r-49-VM:~#
Secondary Storage System VM:
root@s-28-VM:~# netstat -nr
Kernel IP routing table
Destination Gateway Genmask Flags MSS Window irtt Iface
10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0 0 eth1
10.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0 0 eth1
10.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0 eth2
10.10.2.0 0.0.0.0 255.255.255.0 U 0 0 0 eth3
10.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0 eth1
10.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0 eth1
0.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0 eth2
root@s-28-VM:~#
Thanks,
Regards.
---------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------------
> Date: Mon, 26 Aug 2013 15:19:06 +0100
> Subject: Re: VPC virtual router fails to start up - no route to CS Management Server.
> From: msweet.dev@gmail.com
> To: users@cloudstack.apache.org
>
> Hi,
>
> I don't think this has got a response because of the poor formatting of the
> log. Please could you attach the log in a separate file and I will take a
> look?
> Am I correct in thinking that it is creating the system VM, and then
> destroying it?
>
> Thanks,
> Marty
>
>
> On Sun, Aug 25, 2013 at 11:46 PM, Enrique Ladrón de Guevara Hernández <
> enriquelgh@hotmail.com> wrote:
>
>> Hi,
>> I'm carrying out my End of Career Project related to CloudStack
>> deployment. I got issues when I try to deploy a VPC, the VPC virtual router
>> isn't deployed completely and It's destroyed after timeout.
>> The rest of SSVMs (Console Proxy VM, Storage VM and Guest Network VM) are
>> deployed correctly. I can access to the instance console, put into guest
>> network a instance, connect to it, etc ...
>> Could you help me to resolve this issue? I don't know which is the thing
>> that I'm doing wrong ...
>> This is the context:
>> CloudStack Version: 4.1.1 (upgraded from 4.0.2)Num. of Management Server:
>> 1 (under CentOS 6.4) [physical server]. The MS has this network
>> configuration:IP: 10.10.10.110/24GW: 10.10.10.254DNS server:
>> 10.10.10.116/24Hypervisor: VMWARE 4.1:2 ESXi hosts:IPs: 10.10.1.101 &
>> .102/24GW: 10.10.1.254vCenter: 10.10.1.100Standard Virtual Switches.
>> Virtual Network Architecture:VmWare Virtual Switch CS Physical
>> Network Network Subnet Gateway VLAN
>> TAG CS Traffic Type Start IP Range End IP RangevSwitch0
>> PhysNet-mgmt-svm 10.10.1.0
>> 255.255.255.0 10.10.1.254 NONE CS Management 10.10.1.120
>> 10.10.1.240vSwitch1
>> PhysNet-storage 10.10.2.0 255.255.255.0 10.10.2.254
>> NONE Storage 10.10.2.120
>> 10.10.2.240vSwitch2 PhysNet-guest-1
>> 10.10.3.0 255.255.255.0 10.10.3.254 NONE
>> Guest 10.10.3.1 10.10.3.254vSwitch3
>> PhysNet-public 10.10.4.0
>> 255.255.255.0 10.10.4.254 NONE Public
>> 10.10.4.1 10.10.4.240
>> I log in to ssvm consoles and I can see the following:vRouter (VPC) System
>> VM - doesn't have a specific route to MS:root@r-53-VM:~# netstat
>> -nrKernel IP routing tableDestination Gateway Genmask
>> Flags MSS Window irtt Iface10.10.1.0 0.0.0.0 255.255.255.0
>> U 0 0 0 eth3root@r-53-VM:~#
>> CS management server:[root@cs-1 ~]# netstat -nrKernel IP routing
>> tableDestination Gateway Genmask Flags MSS Window
>> irtt Iface10.10.10.0 0.0.0.0 255.255.255.0 U 0 0
>> 0 eth0169.254.0.0 0.0.0.0 255.255.0.0 U 0 0
>> 0 eth00.0.0.0 10.10.10.254 0.0.0.0 UG 0
>> 0 0 eth0[root@cs-1 ~]#
>> Console Proxy System VM:root@v-50-VM:~# netstat -nrKernel IP routing
>> tableDestination Gateway Genmask Flags MSS Window
>> irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
>> 0 eth110.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
>> 0 eth110.10.4.0 0.0.0.0 255.255.255.0 U 0
>> 0 0 eth210.10.1.0 0.0.0.0 255.255.255.0 U
>> 0 0 0 eth110.10.10.0 10.10.1.254 255.255.255.0 UG
>> 0 0 0 eth10.0.0.0 10.10.4.254 0.0.0.0 UG
>> 0 0 0 eth2root@v-50-VM:~#
>> vRouter (no VPC- Guest Network) System VM:root@r-49-VM:~# netstat
>> -nrKernel IP routing tableDestination Gateway Genmask
>> Flags MSS Window irtt Iface10.10.4.0 0.0.0.0 255.255.255.0
>> U 0 0 0 eth210.10.3.0 0.0.0.0
>> 255.255.255.0 U 0 0 0 eth010.10.1.0 0.0.0.0
>> 255.255.255.0 U 0 0 0 eth110.10.10.0 10.10.1.254
>> 255.255.255.0 UG 0 0 0 eth10.0.0.0
>> 10.10.4.254 0.0.0.0 UG 0 0 0 eth2root@r-49-VM
>> :~#
>> Secondary Storage System VMroot@s-28-VM:~# netstat -nrKernel IP routing
>> tableDestination Gateway Genmask Flags MSS
>> Window irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH
>> 0 0 0 eth110.10.10.110 10.10.1.254
>> 255.255.255.255 UGH 0 0 0 eth110.10.4.0
>> 0.0.0.0 255.255.255.0 U 0 0
>> 0 eth210.10.2.0 0.0.0.0 255.255.255.0 U
>> 0 0 0 eth310.10.1.0 0.0.0.0
>> 255.255.255.0 U 0 0 0 eth110.10.10.0
>> 10.10.1.254 255.255.255.0 UG 0 0 0
>> eth10.0.0.0 10.10.4.254 0.0.0.0 UG
>> 0 0 0 eth2root@s-28-VM:~# management-server.log
>> (filtered by r-53-VM):
>> [root@cs-1 ~]# grep -i r-53-VM management-server.log.2013-08-25
>> 2013-08-25 11:34:24,164 DEBUG [cloud.vm.VirtualMachineManagerImpl]
>> (Job-Executor-13:job-11) Allocating entries for VM:
>> VM[DomainRouter|r-53-VM]2013-08-25 11:34:24,167 DEBUG
>> [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) Allocating
>> nics for VM[DomainRouter|r-53-VM]2013-08-25 11:34:24,168 DEBUG
>> [cloud.network.NetworkManagerImpl] (Job-Executor-13:job-11) Allocating nic
>> for vm VM[DomainRouter|r-53-VM] in network Ntwk[202|Control|3] with
>> requested profile null2013-08-25 11:34:24,176 DEBUG
>> [cloud.network.NetworkManagerImpl] (Job-Executor-13:job-11) Allocating nic
>> for vm VM[DomainRouter|r-53-VM] in network Ntwk[200|Public|1] with
>> requested profile NicProfile[0-0-null-10.10.4.78-vlan://untagged2013-08-25
>> 11:34:24,185 DEBUG [cloud.vm.VirtualMachineManagerImpl]
>> (Job-Executor-13:job-11) Allocaing disks for
>> VM[DomainRouter|r-53-VM]2013-08-25 11:34:24,191 DEBUG
>> [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) Allocation
>> completed for VM: VM[DomainRouter|r-53-VM]2013-08-25 11:34:24,191 DEBUG
>> [network.router.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-13:job-11) Starting router VM[DomainRouter|r-53-VM]2013-08-25
>> 11:34:24,195 DEBUG [cloud.vm.VirtualMachineManagerImpl]
>> (Job-Executor-13:job-11) Successfully transitioned to start state for
>> VM[DomainRouter|r-53-VM] reservation id =
>> b4039e49-0c0a-455b-ba6a-7fde25ea27382013-08-25 11:34:24,233 DEBUG
>> [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) Deployment
>> found - P0=VM[DomainRouter|r-53-VM],
>> P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
>> :
>> Dest[Zone(1)-Pod(1)-Cluster(1)-Host(1)-Storage(Volume(54|ROOT-->Pool(200))]2013-08-25
>> 11:34:24,275 DEBUG [network.guru.PodBasedNetworkGuru]
>> (Job-Executor-13:job-11) Allocated a nic
>> NicProfile[166-53-b4039e49-0c0a-455b-ba6a-7fde25ea2738-10.10.1.238-null for
>> VM[DomainRouter|r-53-VM]2013-08-25 11:34:24,281 DEBUG
>> [cloud.storage.StorageManagerImpl] (Job-Executor-13:job-11) Checking if we
>> need to prepare 1 volumes for VM[DomainRouter|r-53-VM]2013-08-25
>> 11:34:47,940 DEBUG [network.router.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-13:job-11) Boot Args for VM[DomainRouter|r-53-VM]: vpccidr=
>> 192.168.0.0/22 domain=cs2cloud.internal dns1=10.10.10.116 template=domP
>> name=r-53-VM eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
>> 10.10.10.0/24 localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true
>> extra_pubnics=22013-08-25 11:34:47,994 DEBUG
>> [network.router.VpcVirtualNetworkApplianceManagerImpl]
>> (Job-Executor-13:job-11) Found 0 static routes to apply as a part of vpc
>> route VM[DomainRouter|r-53-VM] start2013-08-25 11:34:48,000 DEBUG
>> [agent.transport.Request] (Job-Executor-13:job-11) Seq 1-1308430869:
>> Sending { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags: 100111,
>> [{"StartCommand":{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter","cpus":1,"speed":500,"minRam":134217728,"maxRam":134217728,"arch":"i686","os":"Debian
>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116 template=domP name=r-53-VM
>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=10.10.10.0/24localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true extra_pubnics=2
>> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}},{"check.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":100,"name":"r-53-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.1.238","
>> router.name
>> ":"r-53-VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbps":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"10.10.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"router.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"10.10.1.238","
>> router.name
>> ":"r-53-VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessDetails":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","
>> router.name":"r-53-VM"},"wait":0}},{}] }2013-08-25 11:34:48,001 DEBUG
>> [agent.transport.Request] (Job-Executor-13:job-11) Seq 1-1308430869:
>> Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags: 100111,
>> [{"StartCommand":{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter","cpus":1,"speed":500,"minRam":134217728,"maxRam":134217728,"arch":"i686","os":"Debian
>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116 template=domP name=r-53-VM
>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=10.10.10.0/24localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true extra_pubnics=2
>> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}},{"check.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":100,"name":"r-53-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.1.238","
>> router.name
>> ":"r-53-VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbps":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"10.10.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"router.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"10.10.1.238","
>> router.name
>> ":"r-53-VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessDetails":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","
>> router.name":"r-53-VM"},"wait":0}},{}] }2013-08-25 11:34:48,002 INFO
>> [vmware.resource.VmwareResource] (DirectAgent-142:10.10.1.101) Executing
>> resource StartCommand:
>> {"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter","cpus":1,"speed":500,"minRam":134217728,"maxRam":134217728,"arch":"i686","os":"Debian
>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116 template=domP name=r-53-VM
>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=10.10.10.0/24localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true extra_pubnics=2
>> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}2013-08-25
>> 11:34:48,157 DEBUG [vmware.resource.VmwareResource]
>> (DirectAgent-142:10.10.1.101) VM r-53-VM will be started with NIC device
>> type: E10002013-08-25 11:34:48,810 DEBUG [vmware.mo.HostMO]
>> (DirectAgent-142:10.10.1.101) find VM r-53-VM on host2013-08-25
>> 11:34:53,628 DEBUG [vmware.mo.HostMO] (DirectAgent-142:10.10.1.101) find VM
>> r-53-VM on host2013-08-25 11:34:54,068 INFO
>> [vmware.mo.HypervisorHostHelper] (DirectAgent-142:10.10.1.101) Blank VM:
>> r-53-VM is ready for use2013-08-25 11:34:54,068 DEBUG [vmware.mo.HostMO]
>> (DirectAgent-142:10.10.1.101) find VM r-53-VM on host2013-08-25
>> 11:34:54,068 DEBUG [vmware.mo.HostMO] (DirectAgent-142:10.10.1.101) VM
>> r-53-VM found in host cache2013-08-25 11:34:57,182 DEBUG [vmware.mo.HostMO]
>> (DirectAgent-142:10.10.1.101) find VM r-53-VM on host2013-08-25
>> 11:34:57,182 DEBUG [vmware.mo.HostMO] (DirectAgent-142:10.10.1.101) VM
>> r-53-VM found in host cache2013-08-25 11:34:58,056 INFO
>> [vmware.resource.VmwareResource] (DirectAgent-142:10.10.1.101) Configure
>> VNC port for VM r-53-VM, port: 5929, host: 10.10.1.1012013-08-25
>> 12:17:13,198 ERROR [vmware.resource.VmwareResource]
>> (DirectAgent-142:10.10.1.101) Can not ping System vm r-53-VMdue to:Unable
>> to connect2013-08-25 12:17:13,201 DEBUG [agent.transport.Request]
>> (DirectAgent-142:null) Seq 1-1308430869: Processing: { Ans: , MgmtId:
>> 52244109874, via: 1, Ver: v1, Flags: 110,
>> [{"StartAnswer":{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter","cpus":1,"speed":500,"minRam":134217728,"maxRam":134217728,"arch":"i686","os":"Debian
>> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116 template=domP name=r-53-VM
>> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=10.10.10.0/24localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true extra_pubnics=2
>> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"result":true,"wait":0}},{"check.CheckSshAnswer":{"result":false,"details":"Can
>> not ping System vm r-53-VMdue to:Unable to connect","wait":0}}] }2013-08-25
>> 12:17:13,209 WARN [network.router.VirtualNetworkApplianceManagerImpl]
>> (Job-Executor-13:job-11) Unable to ssh to the VM: Can not ping System vm
>> r-53-VMdue to:Unable to connect2013-08-25 12:17:13,210 INFO
>> [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) The guru did
>> not like the answers so stopping VM[DomainRouter|r-53-VM]2013-08-25
>> 12:17:13,212 DEBUG [agent.transport.Request] (Job-Executor-13:job-11) Seq
>> 1-1308430987: Sending { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags:
>> 100111, [{"StopCommand":{"isProxy":false,"vmName":"r-53-VM","wait":0}}]
>> }2013-08-25 12:17:13,212 DEBUG [agent.transport.Request]
>> (Job-Executor-13:job-11) Seq 1-1308430987: Executing: { Cmd , MgmtId:
>> 52244109874, via: 1, Ver: v1, Flags: 100111,
>> [{"StopCommand":{"isProxy":false,"vmName":"r-53-VM","wait":0}}] }2013-08-25
>> 12:17:13,213 INFO [vmware.resource.VmwareResource]
>> (DirectAgent-484:10.10.1.101) Executing resource StopCommand:
>> {"isProxy":false,"vmName":"r-53-VM","wait":0}2013-08-25 12:17:13,213 DEBUG
>> [vmware.mo.HostMO] (DirectAgent-484:10.10.1.101) find VM r-53-VM on
>> host2013-08-25 12:17:14,111 INFO [vmware.resource.VmwareResource]
>> (DirectAgent-484:10.10.1.101) Remove all snapshot before stopping VM
>> r-53-VM2013-08-25 12:17:14,980 INFO [vmware.mo.VirtualMachineMO]
>> (DirectAgent-484:10.10.1.101) Try gracefully shut down VM r-53-VM2013-08-25
>> 12:17:25,148 DEBUG [vmware.resource.VmwareResource] (DirectAgent-142:null)
>> Ignoring vm r-53-VM because of a lag in stopping the vm. 2013-08-25
>> 12:17:34,694 DEBUG [agent.transport.Request] (DirectAgent-484:null) Seq
>> 1-1308430987: Processing: { Ans: , MgmtId: 52244109874, via: 1, Ver: v1,
>> Flags: 110, [{"StopAnswer":{"vncPort":0,"result":true,"details":"Stop VM
>> r-53-VM Succeed","wait":0}}] }2013-08-25 12:17:34,695 DEBUG
>> [agent.manager.AgentManagerImpl] (Job-Executor-13:job-11) Details from
>> executing class com.cloud.agent.api.StopCommand: Stop VM r-53-VM
>> Succeed2013-08-25 12:17:34,702 ERROR [cloud.vm.VirtualMachineManagerImpl]
>> (Job-Executor-13:job-11) Failed to start instance
>> VM[DomainRouter|r-53-VM]com.cloud.utils.exception.ExecutionException:
>> Unable to start VM[DomainRouter|r-53-VM] due to error in finalizeStart, not
>> retrying2013-08-25 12:17:34,707 DEBUG [cloud.vm.VirtualMachineManagerImpl]
>> (Job-Executor-13:job-11) Cleaning up resources for the vm
>> VM[DomainRouter|r-53-VM] in Starting state2013-08-25 12:17:34,708 DEBUG
>> [agent.transport.Request] (Job-Executor-13:job-11) Seq 1-1308430989:
>> Sending { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags: 100111,
>> [{"StopCommand":{"isProxy":false,"vmName":"r-53-VM","wait":0}}] }2013-08-25
>> 12:17:34,708 DEBUG [agent.transport.Request] (Job-Executor-13:job-11) Seq
>> 1-1308430989: Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1,
>> Flags: 100111,
>> [{"StopCommand":{"isProxy":false,"vmName":"r-53-VM","wait":0}}] }2013-08-25
>> 12:17:34,709 INFO [vmware.resource.VmwareResource]
>> (DirectAgent-453:10.10.1.101) Executing resource StopCommand:
>> {"isProxy":false,"vmName":"r-53-VM","wait":0}2013-08-25 12:17:34,709 DEBUG
>> [vmware.mo.HostMO] (DirectAgent-453:10.10.1.101) find VM r-53-VM on
>> host2013-08-25 12:17:35,596 INFO [vmware.resource.VmwareResource]
>> (DirectAgent-453:10.10.1.101) VM r-53-VM is already in stopped
>> state2013-08-25 12:17:35,598 DEBUG [agent.transport.Request]
>> (DirectAgent-453:null) Seq 1-1308430989: Processing: { Ans: , MgmtId:
>> 52244109874, via: 1, Ver: v1, Flags: 110,
>> [{"StopAnswer":{"vncPort":0,"result":true,"details":"VM r-53-VM is already
>> in stopped state","wait":0}}] }2013-08-25 12:17:35,619 DEBUG
>> [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) Successfully
>> released network resources for the vm VM[DomainRouter|r-53-VM]2013-08-25
>> 12:17:35,619 DEBUG [cloud.vm.VirtualMachineManagerImpl]
>> (Job-Executor-13:job-11) Successfully cleanued up resources for the vm
>> VM[DomainRouter|r-53-VM] in Starting
>> statecom.cloud.exception.AgentUnavailableException: Resource [Host:1] is
>> unreachable: Host 1: Unable to start instance due to Unable to start
>> VM[DomainRouter|r-53-VM] due to error in finalizeStart, not retryingCaused
>> by: com.cloud.utils.exception.ExecutionException: Unable to start
>> VM[DomainRouter|r-53-VM] due to error in finalizeStart, not
>> retrying2013-08-25 12:17:35,667 DEBUG [cloud.vm.VirtualMachineManagerImpl]
>> (Job-Executor-13:job-11) VM is already stopped:
>> VM[DomainRouter|r-53-VM]2013-08-25 12:17:35,671 DEBUG
>> [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) Destroying vm
>> VM[DomainRouter|r-53-VM]2013-08-25 12:17:35,701 DEBUG
>> [agent.transport.Request] (Job-Executor-13:job-11) Seq 1-1308430990:
>> Sending { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags: 100111,
>> [{"storage.DestroyCommand":{"vmName":"r-53-VM","volume":{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0},"wait":0}}]
>> }2013-08-25 12:17:35,701 DEBUG [agent.transport.Request]
>> (Job-Executor-13:job-11) Seq 1-1308430990: Executing: { Cmd , MgmtId:
>> 52244109874, via: 1, Ver: v1, Flags: 100111,
>> [{"storage.DestroyCommand":{"vmName":"r-53-VM","volume":{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0},"wait":0}}]
>> }2013-08-25 12:17:35,702 INFO [vmware.resource.VmwareResource]
>> (DirectAgent-106:10.10.1.101) Executing resource DestroyCommand:
>> {"vmName":"r-53-VM","volume":{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0},"wait":0}2013-08-25
>> 12:17:37,006 INFO [vmware.resource.VmwareResource]
>> (DirectAgent-106:10.10.1.101) Destroy root volume and VM itself. vmName
>> r-53-VM2013-08-25 12:17:48,412 DEBUG [cloud.vm.VirtualMachineManagerImpl]
>> (Job-Executor-13:job-11) Expunged VM[DomainRouter|r-53-VM]2013-08-25
>> 12:18:25,563 DEBUG [vmware.resource.VmwareResource] (DirectAgent-105:null)
>> VM r-53-VM is now missing from host report[root@cs-1 ~]#
>> Please, if you need more info to debug don't hesitate request it to me.
>>
>> Many Thanks for you help.Regards.
Re: VPC virtual router fails to start up - no route to CS Management Server.
Posted by Marty Sweet <ms...@gmail.com>.
Hi,
I don't think this has got a response because of the poor formatting of the
log. Please could you attach the log in a separate file and I will take a
look?
Am I correct in thinking that it is creating the system VM, and then
destroying it?
Thanks,
Marty
On Sun, Aug 25, 2013 at 11:46 PM, Enrique Ladrón de Guevara Hernández <
enriquelgh@hotmail.com> wrote:
> Hi,
> I'm carrying out my End of Career Project related to CloudStack
> deployment. I got issues when I try to deploy a VPC, the VPC virtual router
> isn't deployed completely and It's destroyed after timeout.
> The rest of SSVMs (Console Proxy VM, Storage VM and Guest Network VM) are
> deployed correctly. I can access to the instance console, put into guest
> network a instance, connect to it, etc ...
> Could you help me to resolve this issue? I don't know which is the thing
> that I'm doing wrong ...
> This is the context:
> CloudStack Version: 4.1.1 (upgraded from 4.0.2)Num. of Management Server:
> 1 (under CentOS 6.4) [physical server]. The MS has this network
> configuration:IP: 10.10.10.110/24GW: 10.10.10.254DNS server:
> 10.10.10.116/24Hypervisor: VMWARE 4.1:2 ESXi hosts:IPs: 10.10.1.101 &
> .102/24GW: 10.10.1.254vCenter: 10.10.1.100Standard Virtual Switches.
> Virtual Network Architecture:VmWare Virtual Switch CS Physical
> Network Network Subnet Gateway VLAN
> TAG CS Traffic Type Start IP Range End IP RangevSwitch0
> PhysNet-mgmt-svm 10.10.1.0
> 255.255.255.0 10.10.1.254 NONE CS Management 10.10.1.120
> 10.10.1.240vSwitch1
> PhysNet-storage 10.10.2.0 255.255.255.0 10.10.2.254
> NONE Storage 10.10.2.120
> 10.10.2.240vSwitch2 PhysNet-guest-1
> 10.10.3.0 255.255.255.0 10.10.3.254 NONE
> Guest 10.10.3.1 10.10.3.254vSwitch3
> PhysNet-public 10.10.4.0
> 255.255.255.0 10.10.4.254 NONE Public
> 10.10.4.1 10.10.4.240
> I log in to ssvm consoles and I can see the following:vRouter (VPC) System
> VM - doesn't have a specific route to MS:root@r-53-VM:~# netstat
> -nrKernel IP routing tableDestination Gateway Genmask
> Flags MSS Window irtt Iface10.10.1.0 0.0.0.0 255.255.255.0
> U 0 0 0 eth3root@r-53-VM:~#
> CS management server:[root@cs-1 ~]# netstat -nrKernel IP routing
> tableDestination Gateway Genmask Flags MSS Window
> irtt Iface10.10.10.0 0.0.0.0 255.255.255.0 U 0 0
> 0 eth0169.254.0.0 0.0.0.0 255.255.0.0 U 0 0
> 0 eth00.0.0.0 10.10.10.254 0.0.0.0 UG 0
> 0 0 eth0[root@cs-1 ~]#
> Console Proxy System VM:root@v-50-VM:~# netstat -nrKernel IP routing
> tableDestination Gateway Genmask Flags MSS Window
> irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0
> 0 eth110.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0
> 0 eth110.10.4.0 0.0.0.0 255.255.255.0 U 0
> 0 0 eth210.10.1.0 0.0.0.0 255.255.255.0 U
> 0 0 0 eth110.10.10.0 10.10.1.254 255.255.255.0 UG
> 0 0 0 eth10.0.0.0 10.10.4.254 0.0.0.0 UG
> 0 0 0 eth2root@v-50-VM:~#
> vRouter (no VPC- Guest Network) System VM:root@r-49-VM:~# netstat
> -nrKernel IP routing tableDestination Gateway Genmask
> Flags MSS Window irtt Iface10.10.4.0 0.0.0.0 255.255.255.0
> U 0 0 0 eth210.10.3.0 0.0.0.0
> 255.255.255.0 U 0 0 0 eth010.10.1.0 0.0.0.0
> 255.255.255.0 U 0 0 0 eth110.10.10.0 10.10.1.254
> 255.255.255.0 UG 0 0 0 eth10.0.0.0
> 10.10.4.254 0.0.0.0 UG 0 0 0 eth2root@r-49-VM
> :~#
> Secondary Storage System VMroot@s-28-VM:~# netstat -nrKernel IP routing
> tableDestination Gateway Genmask Flags MSS
> Window irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH
> 0 0 0 eth110.10.10.110 10.10.1.254
> 255.255.255.255 UGH 0 0 0 eth110.10.4.0
> 0.0.0.0 255.255.255.0 U 0 0
> 0 eth210.10.2.0 0.0.0.0 255.255.255.0 U
> 0 0 0 eth310.10.1.0 0.0.0.0
> 255.255.255.0 U 0 0 0 eth110.10.10.0
> 10.10.1.254 255.255.255.0 UG 0 0 0
> eth10.0.0.0 10.10.4.254 0.0.0.0 UG
> 0 0 0 eth2root@s-28-VM:~# management-server.log
> (filtered by r-53-VM):
> [root@cs-1 ~]# grep -i r-53-VM management-server.log.2013-08-25
> 2013-08-25 11:34:24,164 DEBUG [cloud.vm.VirtualMachineManagerImpl]
> (Job-Executor-13:job-11) Allocating entries for VM:
> VM[DomainRouter|r-53-VM]2013-08-25 11:34:24,167 DEBUG
> [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) Allocating
> nics for VM[DomainRouter|r-53-VM]2013-08-25 11:34:24,168 DEBUG
> [cloud.network.NetworkManagerImpl] (Job-Executor-13:job-11) Allocating nic
> for vm VM[DomainRouter|r-53-VM] in network Ntwk[202|Control|3] with
> requested profile null2013-08-25 11:34:24,176 DEBUG
> [cloud.network.NetworkManagerImpl] (Job-Executor-13:job-11) Allocating nic
> for vm VM[DomainRouter|r-53-VM] in network Ntwk[200|Public|1] with
> requested profile NicProfile[0-0-null-10.10.4.78-vlan://untagged2013-08-25
> 11:34:24,185 DEBUG [cloud.vm.VirtualMachineManagerImpl]
> (Job-Executor-13:job-11) Allocaing disks for
> VM[DomainRouter|r-53-VM]2013-08-25 11:34:24,191 DEBUG
> [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) Allocation
> completed for VM: VM[DomainRouter|r-53-VM]2013-08-25 11:34:24,191 DEBUG
> [network.router.VirtualNetworkApplianceManagerImpl]
> (Job-Executor-13:job-11) Starting router VM[DomainRouter|r-53-VM]2013-08-25
> 11:34:24,195 DEBUG [cloud.vm.VirtualMachineManagerImpl]
> (Job-Executor-13:job-11) Successfully transitioned to start state for
> VM[DomainRouter|r-53-VM] reservation id =
> b4039e49-0c0a-455b-ba6a-7fde25ea27382013-08-25 11:34:24,233 DEBUG
> [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) Deployment
> found - P0=VM[DomainRouter|r-53-VM],
> P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
> :
> Dest[Zone(1)-Pod(1)-Cluster(1)-Host(1)-Storage(Volume(54|ROOT-->Pool(200))]2013-08-25
> 11:34:24,275 DEBUG [network.guru.PodBasedNetworkGuru]
> (Job-Executor-13:job-11) Allocated a nic
> NicProfile[166-53-b4039e49-0c0a-455b-ba6a-7fde25ea2738-10.10.1.238-null for
> VM[DomainRouter|r-53-VM]2013-08-25 11:34:24,281 DEBUG
> [cloud.storage.StorageManagerImpl] (Job-Executor-13:job-11) Checking if we
> need to prepare 1 volumes for VM[DomainRouter|r-53-VM]2013-08-25
> 11:34:47,940 DEBUG [network.router.VirtualNetworkApplianceManagerImpl]
> (Job-Executor-13:job-11) Boot Args for VM[DomainRouter|r-53-VM]: vpccidr=
> 192.168.0.0/22 domain=cs2cloud.internal dns1=10.10.10.116 template=domP
> name=r-53-VM eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=
> 10.10.10.0/24 localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true
> extra_pubnics=22013-08-25 11:34:47,994 DEBUG
> [network.router.VpcVirtualNetworkApplianceManagerImpl]
> (Job-Executor-13:job-11) Found 0 static routes to apply as a part of vpc
> route VM[DomainRouter|r-53-VM] start2013-08-25 11:34:48,000 DEBUG
> [agent.transport.Request] (Job-Executor-13:job-11) Seq 1-1308430869:
> Sending { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags: 100111,
> [{"StartCommand":{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter","cpus":1,"speed":500,"minRam":134217728,"maxRam":134217728,"arch":"i686","os":"Debian
> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116 template=domP name=r-53-VM
> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=10.10.10.0/24localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true extra_pubnics=2
> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}},{"check.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":100,"name":"r-53-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.1.238","
> router.name
> ":"r-53-VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbps":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"10.10.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"router.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"10.10.1.238","
> router.name
> ":"r-53-VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessDetails":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","
> router.name":"r-53-VM"},"wait":0}},{}] }2013-08-25 11:34:48,001 DEBUG
> [agent.transport.Request] (Job-Executor-13:job-11) Seq 1-1308430869:
> Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags: 100111,
> [{"StartCommand":{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter","cpus":1,"speed":500,"minRam":134217728,"maxRam":134217728,"arch":"i686","os":"Debian
> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116 template=domP name=r-53-VM
> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=10.10.10.0/24localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true extra_pubnics=2
> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}},{"check.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":100,"name":"r-53-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.1.238","
> router.name
> ":"r-53-VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbps":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"10.10.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"router.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"10.10.1.238","
> router.name
> ":"r-53-VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessDetails":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","
> router.name":"r-53-VM"},"wait":0}},{}] }2013-08-25 11:34:48,002 INFO
> [vmware.resource.VmwareResource] (DirectAgent-142:10.10.1.101) Executing
> resource StartCommand:
> {"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter","cpus":1,"speed":500,"minRam":134217728,"maxRam":134217728,"arch":"i686","os":"Debian
> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116 template=domP name=r-53-VM
> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=10.10.10.0/24localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true extra_pubnics=2
> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}2013-08-25
> 11:34:48,157 DEBUG [vmware.resource.VmwareResource]
> (DirectAgent-142:10.10.1.101) VM r-53-VM will be started with NIC device
> type: E10002013-08-25 11:34:48,810 DEBUG [vmware.mo.HostMO]
> (DirectAgent-142:10.10.1.101) find VM r-53-VM on host2013-08-25
> 11:34:53,628 DEBUG [vmware.mo.HostMO] (DirectAgent-142:10.10.1.101) find VM
> r-53-VM on host2013-08-25 11:34:54,068 INFO
> [vmware.mo.HypervisorHostHelper] (DirectAgent-142:10.10.1.101) Blank VM:
> r-53-VM is ready for use2013-08-25 11:34:54,068 DEBUG [vmware.mo.HostMO]
> (DirectAgent-142:10.10.1.101) find VM r-53-VM on host2013-08-25
> 11:34:54,068 DEBUG [vmware.mo.HostMO] (DirectAgent-142:10.10.1.101) VM
> r-53-VM found in host cache2013-08-25 11:34:57,182 DEBUG [vmware.mo.HostMO]
> (DirectAgent-142:10.10.1.101) find VM r-53-VM on host2013-08-25
> 11:34:57,182 DEBUG [vmware.mo.HostMO] (DirectAgent-142:10.10.1.101) VM
> r-53-VM found in host cache2013-08-25 11:34:58,056 INFO
> [vmware.resource.VmwareResource] (DirectAgent-142:10.10.1.101) Configure
> VNC port for VM r-53-VM, port: 5929, host: 10.10.1.1012013-08-25
> 12:17:13,198 ERROR [vmware.resource.VmwareResource]
> (DirectAgent-142:10.10.1.101) Can not ping System vm r-53-VMdue to:Unable
> to connect2013-08-25 12:17:13,201 DEBUG [agent.transport.Request]
> (DirectAgent-142:null) Seq 1-1308430869: Processing: { Ans: , MgmtId:
> 52244109874, via: 1, Ver: v1, Flags: 110,
> [{"StartAnswer":{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter","cpus":1,"speed":500,"minRam":134217728,"maxRam":134217728,"arch":"i686","os":"Debian
> GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=192.168.0.0/22domain=cs2cloud.internal dns1=10.10.10.116 template=domP name=r-53-VM
> eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=10.10.10.0/24localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true extra_pubnics=2
> nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"result":true,"wait":0}},{"check.CheckSshAnswer":{"result":false,"details":"Can
> not ping System vm r-53-VMdue to:Unable to connect","wait":0}}] }2013-08-25
> 12:17:13,209 WARN [network.router.VirtualNetworkApplianceManagerImpl]
> (Job-Executor-13:job-11) Unable to ssh to the VM: Can not ping System vm
> r-53-VMdue to:Unable to connect2013-08-25 12:17:13,210 INFO
> [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) The guru did
> not like the answers so stopping VM[DomainRouter|r-53-VM]2013-08-25
> 12:17:13,212 DEBUG [agent.transport.Request] (Job-Executor-13:job-11) Seq
> 1-1308430987: Sending { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags:
> 100111, [{"StopCommand":{"isProxy":false,"vmName":"r-53-VM","wait":0}}]
> }2013-08-25 12:17:13,212 DEBUG [agent.transport.Request]
> (Job-Executor-13:job-11) Seq 1-1308430987: Executing: { Cmd , MgmtId:
> 52244109874, via: 1, Ver: v1, Flags: 100111,
> [{"StopCommand":{"isProxy":false,"vmName":"r-53-VM","wait":0}}] }2013-08-25
> 12:17:13,213 INFO [vmware.resource.VmwareResource]
> (DirectAgent-484:10.10.1.101) Executing resource StopCommand:
> {"isProxy":false,"vmName":"r-53-VM","wait":0}2013-08-25 12:17:13,213 DEBUG
> [vmware.mo.HostMO] (DirectAgent-484:10.10.1.101) find VM r-53-VM on
> host2013-08-25 12:17:14,111 INFO [vmware.resource.VmwareResource]
> (DirectAgent-484:10.10.1.101) Remove all snapshot before stopping VM
> r-53-VM2013-08-25 12:17:14,980 INFO [vmware.mo.VirtualMachineMO]
> (DirectAgent-484:10.10.1.101) Try gracefully shut down VM r-53-VM2013-08-25
> 12:17:25,148 DEBUG [vmware.resource.VmwareResource] (DirectAgent-142:null)
> Ignoring vm r-53-VM because of a lag in stopping the vm. 2013-08-25
> 12:17:34,694 DEBUG [agent.transport.Request] (DirectAgent-484:null) Seq
> 1-1308430987: Processing: { Ans: , MgmtId: 52244109874, via: 1, Ver: v1,
> Flags: 110, [{"StopAnswer":{"vncPort":0,"result":true,"details":"Stop VM
> r-53-VM Succeed","wait":0}}] }2013-08-25 12:17:34,695 DEBUG
> [agent.manager.AgentManagerImpl] (Job-Executor-13:job-11) Details from
> executing class com.cloud.agent.api.StopCommand: Stop VM r-53-VM
> Succeed2013-08-25 12:17:34,702 ERROR [cloud.vm.VirtualMachineManagerImpl]
> (Job-Executor-13:job-11) Failed to start instance
> VM[DomainRouter|r-53-VM]com.cloud.utils.exception.ExecutionException:
> Unable to start VM[DomainRouter|r-53-VM] due to error in finalizeStart, not
> retrying2013-08-25 12:17:34,707 DEBUG [cloud.vm.VirtualMachineManagerImpl]
> (Job-Executor-13:job-11) Cleaning up resources for the vm
> VM[DomainRouter|r-53-VM] in Starting state2013-08-25 12:17:34,708 DEBUG
> [agent.transport.Request] (Job-Executor-13:job-11) Seq 1-1308430989:
> Sending { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags: 100111,
> [{"StopCommand":{"isProxy":false,"vmName":"r-53-VM","wait":0}}] }2013-08-25
> 12:17:34,708 DEBUG [agent.transport.Request] (Job-Executor-13:job-11) Seq
> 1-1308430989: Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1,
> Flags: 100111,
> [{"StopCommand":{"isProxy":false,"vmName":"r-53-VM","wait":0}}] }2013-08-25
> 12:17:34,709 INFO [vmware.resource.VmwareResource]
> (DirectAgent-453:10.10.1.101) Executing resource StopCommand:
> {"isProxy":false,"vmName":"r-53-VM","wait":0}2013-08-25 12:17:34,709 DEBUG
> [vmware.mo.HostMO] (DirectAgent-453:10.10.1.101) find VM r-53-VM on
> host2013-08-25 12:17:35,596 INFO [vmware.resource.VmwareResource]
> (DirectAgent-453:10.10.1.101) VM r-53-VM is already in stopped
> state2013-08-25 12:17:35,598 DEBUG [agent.transport.Request]
> (DirectAgent-453:null) Seq 1-1308430989: Processing: { Ans: , MgmtId:
> 52244109874, via: 1, Ver: v1, Flags: 110,
> [{"StopAnswer":{"vncPort":0,"result":true,"details":"VM r-53-VM is already
> in stopped state","wait":0}}] }2013-08-25 12:17:35,619 DEBUG
> [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) Successfully
> released network resources for the vm VM[DomainRouter|r-53-VM]2013-08-25
> 12:17:35,619 DEBUG [cloud.vm.VirtualMachineManagerImpl]
> (Job-Executor-13:job-11) Successfully cleanued up resources for the vm
> VM[DomainRouter|r-53-VM] in Starting
> statecom.cloud.exception.AgentUnavailableException: Resource [Host:1] is
> unreachable: Host 1: Unable to start instance due to Unable to start
> VM[DomainRouter|r-53-VM] due to error in finalizeStart, not retryingCaused
> by: com.cloud.utils.exception.ExecutionException: Unable to start
> VM[DomainRouter|r-53-VM] due to error in finalizeStart, not
> retrying2013-08-25 12:17:35,667 DEBUG [cloud.vm.VirtualMachineManagerImpl]
> (Job-Executor-13:job-11) VM is already stopped:
> VM[DomainRouter|r-53-VM]2013-08-25 12:17:35,671 DEBUG
> [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) Destroying vm
> VM[DomainRouter|r-53-VM]2013-08-25 12:17:35,701 DEBUG
> [agent.transport.Request] (Job-Executor-13:job-11) Seq 1-1308430990:
> Sending { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags: 100111,
> [{"storage.DestroyCommand":{"vmName":"r-53-VM","volume":{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0},"wait":0}}]
> }2013-08-25 12:17:35,701 DEBUG [agent.transport.Request]
> (Job-Executor-13:job-11) Seq 1-1308430990: Executing: { Cmd , MgmtId:
> 52244109874, via: 1, Ver: v1, Flags: 100111,
> [{"storage.DestroyCommand":{"vmName":"r-53-VM","volume":{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0},"wait":0}}]
> }2013-08-25 12:17:35,702 INFO [vmware.resource.VmwareResource]
> (DirectAgent-106:10.10.1.101) Executing resource DestroyCommand:
> {"vmName":"r-53-VM","volume":{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0},"wait":0}2013-08-25
> 12:17:37,006 INFO [vmware.resource.VmwareResource]
> (DirectAgent-106:10.10.1.101) Destroy root volume and VM itself. vmName
> r-53-VM2013-08-25 12:17:48,412 DEBUG [cloud.vm.VirtualMachineManagerImpl]
> (Job-Executor-13:job-11) Expunged VM[DomainRouter|r-53-VM]2013-08-25
> 12:18:25,563 DEBUG [vmware.resource.VmwareResource] (DirectAgent-105:null)
> VM r-53-VM is now missing from host report[root@cs-1 ~]#
> Please, if you need more info to debug don't hesitate request it to me.
>
> Many Thanks for you help.Regards.