You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@cloudstack.apache.org by "Marcus Sorensen (JIRA)" <ji...@apache.org> on 2013/03/07 21:15:11 UTC
[jira] [Commented] (CLOUDSTACK-1565) Used Master Branch System VM
Template: Default Route on the System VMs (SSVM,CPVM and VR) is missing
[ https://issues.apache.org/jira/browse/CLOUDSTACK-1565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13596311#comment-13596311 ]
Marcus Sorensen commented on CLOUDSTACK-1565:
---------------------------------------------
I observed this too, however it seems to be random. Sometimes it works, sometimes it doesn't. We should probably add some sort of debugging in the cloud-early-config. I just now deployed a fresh master install with the latest build of Rohit's system vm, and it worked fine, but I don't think anything has changed since I saw it fail, and when I did, a stop/start of the system vm fixed it.
> Used Master Branch System VM Template: Default Route on the System VMs (SSVM,CPVM and VR) is missing
> ----------------------------------------------------------------------------------------------------
>
> Key: CLOUDSTACK-1565
> URL: https://issues.apache.org/jira/browse/CLOUDSTACK-1565
> Project: CloudStack
> Issue Type: Bug
> Security Level: Public(Anyone can view this level - this is the default.)
> Components: Management Server
> Affects Versions: 4.2.0
> Reporter: Chandan Purushothama
> Assignee: Rohit Yadav
> Priority: Blocker
> Fix For: 4.2.0
>
>
> ================
> Steps to Reproduce:
> ================
> 1. Deploy an Advanced Zone Setup with XenServer 6.0.2 Host
> 2. Use the System Template at http://jenkins.cloudstack.org/view/master/job/build-systemvm-master/lastSuccessfulBuild/artifact/tools/appliance/dist/systemvmtemplate-2013-03-05-master-xen.vhd.bz2 during the Setup deployment.
> 3. Observe that the default template download fails with "Network is Unreachable" Status.
> ===========
> Observations:
> ===========
> On the SSVM:
> *Observe the missing default route*
> root@s-1-NEWXENTEMPL:~# ip route
> 10.223.58.0/26 dev eth1 proto kernel scope link src 10.223.58.7
> 10.223.58.0/26 dev eth3 proto kernel scope link src 10.223.58.8
> 10.223.110.232 via 10.223.58.1 dev eth1
> 10.223.110.253 via 10.223.58.1 dev eth1
> 10.223.110.254 via 10.223.58.1 dev eth1
> 10.223.131.170 via 10.223.58.1 dev eth1
> 10.223.138.0/26 dev eth2 proto kernel scope link src 10.223.138.21
> 169.254.0.0/16 dev eth0 proto kernel scope link src 169.254.1.101
> root@s-1-NEWXENTEMPL:~#
> root@s-1-NEWXENTEMPL:~# cat /proc/cmdline
> root=UUID=d18a6135-d041-46ea-a137-b8259269c02e ro -- quiet console=hvc0%template=domP%type=secstorage%host=10.223.131.170%port=8250%name=s-1-NEWXENTEMPL%zone=1%pod=1%guid=s-1-NEWXENTEMPL%resource=com.cloud.storage.resource.NfsSecondaryStorageResource%instance=SecStorage%sslcopy=true%role=templateProcessor%mtu=1500%eth2ip=10.223.138.21%eth2mask=255.255.255.192%gateway=10.223.138.1%public.network.device=eth2%eth0ip=169.254.1.101%eth0mask=255.255.0.0%eth1ip=10.223.58.7%eth1mask=255.255.255.192%mgmtcidr=10.223.131.0/24%localgw=10.223.58.1%private.network.device=eth1%eth3ip=10.223.58.8%eth3mask=255.255.255.192%storageip=10.223.58.8%storagenetmask=255.255.255.192%storagegateway=10.223.58.1%internaldns1=10.223.110.254%internaldns2=10.223.110.253%dns1=8.8.8.8%dns2=8.8.4.4
> root@s-1-NEWXENTEMPL:~#
> On the management Server Log:
> 2013-03-06 17:37:01,252 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Telling the ssvm to load the NfsSecondaryStorageResource
> 2013-03-06 17:37:01,253 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Boot Args for VM[SecondaryStorageVm|s-1-NEWXENTEMPL]: template=domP type=secstorage host=10.223.131.170 port=8250 name=s-1-NEWXENTEMPL zone=1 pod=1 guid=s-1-NEWXENTEMPL resource=com.cloud.storage.resource.NfsSecondaryStorageResource instance=SecStorage sslcopy=true role=templateProcessor mtu=1500 eth2ip=10.223.138.21 eth2mask=255.255.255.192 gateway=10.223.138.1 public.network.device=eth2 eth0ip=169.254.1.101 eth0mask=255.255.0.0 eth1ip=10.223.58.7 eth1mask=255.255.255.192 mgmtcidr=10.223.131.0/24 localgw=10.223.58.1 private.network.device=eth1 eth3ip=10.223.58.8 eth3mask=255.255.255.192 storageip=10.223.58.8 storagenetmask=255.255.255.192 storagegateway=10.223.58.1 internaldns1=10.223.110.254 internaldns2=10.223.110.253 dns1=8.8.8.8 dns2=8.8.4.4
> 2013-03-06 17:37:01,275 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 1-2123956242: Sending { Cmd , MgmtId: 7200344900649, via: 1, Ver: v1, Flags: 100111, [{"StartCommand":{"vm":{"id":1,"name":"s-1-NEWXENTEMPL","bootloader":"PyGrub","type":"SecondaryStorageVm","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":268435456,"maxRam":268435456,"arch":"x86_64","os":"Debian GNU/Linux 6(64-bit)","bootArgs":" template=domP type=secstorage host=10.223.131.170 port=8250 name=s-1-NEWXENTEMPL zone=1 pod=1 guid=s-1-NEWXENTEMPL resource=com.cloud.storage.resource.NfsSecondaryStorageResource instance=SecStorage sslcopy=true role=templateProcessor mtu=1500 eth2ip=10.223.138.21 eth2mask=255.255.255.192 gateway=10.223.138.1 public.network.device=eth2 eth0ip=169.254.1.101 eth0mask=255.255.0.0 eth1ip=10.223.58.7 eth1mask=255.255.255.192 mgmtcidr=10.223.131.0/24 localgw=10.223.58.1 private.network.device=eth1 eth3ip=10.223.58.8 eth3mask=255.255.255.192 storageip=10.223.58.8 storagenetmask=255.255.255.192 storagegateway=10.223.58.1 internaldns1=10.223.110.254 internaldns2=10.223.110.253 dns1=8.8.8.8 dns2=8.8.4.4","rebootOnCrash":false,"enableHA":false,"limitCpuUse":false,"vncPassword":"72d0e0bb4c42cc9c","params":{},"uuid":"fd705739-d518-48cf-8680-3e16f02f7253","disks":[{"id":1,"name":"ROOT-1","mountPoint":"/export/home/chandan/asfmas-131-170/primary","path":"bf5a3843-c603-4d94-bdad-fe2ebbef90bd","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"b06ada48-12e1-343e-b429-6e8e516397ba","deviceId":0}],"nics":[{"deviceId":2,"networkRateMbps":-1,"defaultNic":true,"uuid":"e9026157-f1d8-4486-a89e-74b9dd21f624","ip":"10.223.138.21","netmask":"255.255.255.192","gateway":"10.223.138.1","mac":"06:4b:2c:00:00:1b","dns1":"8.8.8.8","dns2":"8.8.4.4","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://1380","isolationUri":"vlan://1380","isSecurityGroupEnabled":false},{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"f3d9931c-395b-450d-b4e2-8968ea936642","ip":"169.254.1.101","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:01:65","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"uuid":"05478ed5-8cd6-41fe-be55-afe0bafa3ba6","ip":"10.223.58.7","netmask":"255.255.255.192","gateway":"10.223.58.1","mac":"06:17:da:00:00:04","broadcastType":"Native","type":"Management","isSecurityGroupEnabled":false},{"deviceId":3,"networkRateMbps":-1,"defaultNic":false,"uuid":"27ff90a9-82a5-4276-a9c9-a39d396b8de1","ip":"10.223.58.8","netmask":"255.255.255.192","gateway":"10.223.58.1","mac":"06:15:e0:00:00:05","broadcastType":"Native","type":"Storage","isSecurityGroupEnabled":false}]},"hostIp":"10.223.58.2","wait":0}},{"check.CheckSshCommand":{"ip":"169.254.1.101","port":3922,"interval":6,"retries":100,"name":"s-1-NEWXENTEMPL","wait":0}}] }
> 2013-03-06 17:37:01,283 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 1-2123956242: Executing: { Cmd , MgmtId: 7200344900649, via: 1, Ver: v1, Flags: 100111, [{"StartCommand":{"vm":{"id":1,"name":"s-1-NEWXENTEMPL","bootloader":"PyGrub","type":"SecondaryStorageVm","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":268435456,"maxRam":268435456,"arch":"x86_64","os":"Debian GNU/Linux 6(64-bit)","bootArgs":" template=domP type=secstorage host=10.223.131.170 port=8250 name=s-1-NEWXENTEMPL zone=1 pod=1 guid=s-1-NEWXENTEMPL resource=com.cloud.storage.resource.NfsSecondaryStorageResource instance=SecStorage sslcopy=true role=templateProcessor mtu=1500 eth2ip=10.223.138.21 eth2mask=255.255.255.192 gateway=10.223.138.1 public.network.device=eth2 eth0ip=169.254.1.101 eth0mask=255.255.0.0 eth1ip=10.223.58.7 eth1mask=255.255.255.192 mgmtcidr=10.223.131.0/24 localgw=10.223.58.1 private.network.device=eth1 eth3ip=10.223.58.8 eth3mask=255.255.255.192 storageip=10.223.58.8 storagenetmask=255.255.255.192 storagegateway=10.223.58.1 internaldns1=10.223.110.254 internaldns2=10.223.110.253 dns1=8.8.8.8 dns2=8.8.4.4","rebootOnCrash":false,"enableHA":false,"limitCpuUse":false,"vncPassword":"72d0e0bb4c42cc9c","params":{},"uuid":"fd705739-d518-48cf-8680-3e16f02f7253","disks":[{"id":1,"name":"ROOT-1","mountPoint":"/export/home/chandan/asfmas-131-170/primary","path":"bf5a3843-c603-4d94-bdad-fe2ebbef90bd","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"b06ada48-12e1-343e-b429-6e8e516397ba","deviceId":0}],"nics":[{"deviceId":2,"networkRateMbps":-1,"defaultNic":true,"uuid":"e9026157-f1d8-4486-a89e-74b9dd21f624","ip":"10.223.138.21","netmask":"255.255.255.192","gateway":"10.223.138.1","mac":"06:4b:2c:00:00:1b","dns1":"8.8.8.8","dns2":"8.8.4.4","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://1380","isolationUri":"vlan://1380","isSecurityGroupEnabled":false},{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"f3d9931c-395b-450d-b4e2-8968ea936642","ip":"169.254.1.101","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:01:65","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"uuid":"05478ed5-8cd6-41fe-be55-afe0bafa3ba6","ip":"10.223.58.7","netmask":"255.255.255.192","gateway":"10.223.58.1","mac":"06:17:da:00:00:04","broadcastType":"Native","type":"Management","isSecurityGroupEnabled":false},{"deviceId":3,"networkRateMbps":-1,"defaultNic":false,"uuid":"27ff90a9-82a5-4276-a9c9-a39d396b8de1","ip":"10.223.58.8","netmask":"255.255.255.192","gateway":"10.223.58.1","mac":"06:15:e0:00:00:05","broadcastType":"Native","type":"Storage","isSecurityGroupEnabled":false}]},"hostIp":"10.223.58.2","wait":0}},{"check.CheckSshCommand":{"ip":"169.254.1.101","port":3922,"interval":6,"retries":100,"name":"s-1-NEWXENTEMPL","wait":0}}] }
> 2013-03-06 17:37:01,283 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-2:null) Seq 1-2123956242: Executing request
> 2013-03-06 17:37:01,400 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-2:null) 1. The VM s-1-NEWXENTEMPL is in Starting state.
> 2013-03-06 17:37:01,563 DEBUG [xen.resource.XenServer56FP1Resource] (DirectAgent-2:null) Created VM e168bed7-3445-14b2-288b-fd20493c2482 for s-1-NEWXENTEMPL
> 2013-03-06 17:37:01,601 DEBUG [xen.resource.XenServer56FP1Resource] (DirectAgent-2:null) PV args are -- quiet console=hvc0%template=domP%type=secstorage%host=10.223.131.170%port=8250%name=s-1-NEWXENTEMPL%zone=1%pod=1%guid=s-1-NEWXENTEMPL%resource=com.cloud.storage.resource.NfsSecondaryStorageResource%instance=SecStorage%sslcopy=true%role=templateProcessor%mtu=1500%eth2ip=10.223.138.21%eth2mask=255.255.255.192%gateway=10.223.138.1%public.network.device=eth2%eth0ip=169.254.1.101%eth0mask=255.255.0.0%eth1ip=10.223.58.7%eth1mask=255.255.255.192%mgmtcidr=10.223.131.0/24%localgw=10.223.58.1%private.network.device=eth1%eth3ip=10.223.58.8%eth3mask=255.255.255.192%storageip=10.223.58.8%storagenetmask=255.255.255.192%storagegateway=10.223.58.1%internaldns1=10.223.110.254%internaldns2=10.223.110.253%dns1=8.8.8.8%dns2=8.8.4.4
> 2013-03-06 17:37:01,711 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-2:null) VBD 95f97e8f-4ce8-76e6-5536-222a8eecc45c created for Vol[1|ROOT|bf5a3843-c603-4d94-bdad-fe2ebbef90bd|2097152000]
> 2013-03-06 17:37:01,797 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-2:null) Creating VIF for s-1-NEWXENTEMPL on nic [Nic:Public-10.223.138.21-vlan://1380]
> I see the gateway Information in the mgmt log and on the cmdline info on the SSVM. I am not sure why the default route didnt get programmed on the SSVM,
> ===========
> Work Around:
> ===========
> Manually add the missing default route on the SSVM.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira