You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cloudstack.apache.org by Prashanth Manthena <pr...@nuagenetworks.net> on 2016/05/10 15:51:17 UTC

Virtual router failed to start on KVM + Linux Bridges

Hi All,

 I am seeing CLOUDSTACK-9013 on master (4.9.0) with KVM+Linux Bridges.

Any pointers on this issue ?

CLOUDSTACK-9013: https://issues.apache.org/jira/browse/CLOUDSTACK-9013

With reagrds,
Prashanth

Re: Virtual router failed to start on KVM + Linux Bridges

Posted by Prashanth Manthena <pr...@nuagenetworks.net>.
Thank you Wei & Remi !!

I will start using the latest system VM templates.

With regards,
Prashanth

On Wed, May 11, 2016 at 2:20 PM, Remi Bergsma <RB...@schubergphilis.com>
wrote:

> Hi Prashanth,
>
> As Wei suggested, when you use CloudStack 4.6/4.7/4.8/4.9 you also need
> the systemvm template with version 4.6.0. This does include the needed
> Python modules. The 4.4 template you used won't fly. You will run into
> other missing packages and changes as well.
>
> Regards, Remi
>
> Sent from my iPhone
>
> > On 11 May 2016, at 13:50, Prashanth Manthena <
> prashanth.manthena@nuagenetworks.net> wrote:
> >
> > Hi Will,
> >
> > I was able to put a break-point and debug the actual issue in the VR
> > (system VM template), it's a Python import error of the package
> "netaddr",
> > which can be fixed by updating the system template with the "netaddr"
> > package installed in it. Hopefully, it fixes this issue.
> >
> > Here is the error in VR's /var/log/cloud.log:
> >
> > Wed May 11 10:29:37 UTC 2016 : VR config: configuation format version 1.0
> > Wed May 11 10:29:37 UTC 2016 : VR config: creating file:
> > /var/cache/cloud/ip_asss
> > ociations.json
> > Wed May 11 10:29:37 UTC 2016 : VR config: create file success
> > Wed May 11 10:29:37 UTC 2016 : VR config: executing:
> > /opt/cloud/bin/update_confii
> > g.py ip_associations.json
> > Traceback (most recent call last):
> >  File "/opt/cloud/bin/update_config.py", line 20, in <module>
> >    from merge import QueueFile
> >  File "/opt/cloud/bin/merge.py", line 23, in <module>
> >    import cs_ip
> >  File "/opt/cloud/bin/cs_ip.py", line 19, in <module>
> >    from netaddr import *
> > ImportError: No module named netaddr
> > Wed May 11 10:29:37 UTC 2016 : VR config: executing failed:
> > /opt/cloud/bin/updatt
> > e_config.py ip_associations.json
> >
> > With regards,
> > Prashanth
> >
> > On Wed, May 11, 2016 at 12:06 PM, Prashanth Manthena <
> > prashanth.manthena@nuagenetworks.net> wrote:
> >
> >> Hi Will,
> >>
> >> I am hitting an issue similar to CLOUDSTACK-9013 on master (4.9.0). Here
> >> are the management server error logs:
> >>
> >> 2016-05-10 08:24:03,109 ERROR
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> >> (Work-Job-Executor-3:ctx-5069ea04 job-247/job-250 ctx-48a763a9)
> >> (logid:2735b868) VR config: execution failed:
> >> "/opt/cloud/bin/update_config.py ip_associations.json", check
> >> /var/log/cloud.log in VR for details
> >>
> >> 2016-05-10 08:24:03,109 WARN
> [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> >> (Work-Job-Executor-3:ctx-5069ea04 job-247/job-250 ctx-48a763a9)
> >> (logid:2735b868) Command: com.cloud.agent.api.Command failed while
> starting
> >> virtual router
> >>
> >> 2016-05-10 08:24:03,109 INFO  [c.c.v.VirtualMachineManagerImpl]
> >> (Work-Job-Executor-3:ctx-5069ea04 job-247/job-250 ctx-48a763a9)
> >> (logid:2735b868) The guru did not like the answers so stopping
> >> VM[DomainRouter|r-30-VM]
> >>
> >> Response:
> >>
> >> 2016-05-10 08:24:03,067 DEBUG [c.c.a.t.Request]
> >> (AgentManager-Handler-10:null) (logid:) Seq 1-4347381015296081926:
> >> Processing:  { Ans: , MgmtId: 275619426932736, via: 1, Ver: v1, Flags:
> 10,
> >>
> [{"com.cloud.agent.api.StartAnswer":{"vm":{"id":30,"name":"r-30-VM","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":268435456,"maxRam":268435456,"arch":"x86_64","os":"Debian
> >> GNU/Linux 5.0 (64-bit)","platformEmulator":"Debian GNU/Linux
> >> 5","bootArgs":" template=domP name=r-30-VM eth2ip=10.100.100.117
> >> eth2mask=255.255.255.0 gateway=10.100.100.1 eth0ip=10.10.1.1
> >> eth0mask=255.255.255.0 domain=cs2cloud.internal cidrsize=24
> >> dhcprange=10.10.1.1 eth1ip=169.254.2.130 eth1mask=255.255.0.0
> type=router
> >> disable_rp_filter=true dns1=128.251.10.29 dns2=4.4.4.4
> >>
> baremetalnotificationsecuritykey=ODFTmygvs7oVAHVFZMmv7RpvsNNsawY9tf6sfeMvkUJlmEhWXGli5sO_oWAr52vrF18Z5xMgzjclu9P7G_w9Fg
> >>
> baremetalnotificationapikey=pguqxBGrlU2ItCuTHa7xb6pmjrpl9KbVMEE7o6TKrJ-mjDoaRayL_Nj21VkqrKvbtc10L8BxPqaYIhnGJkeHfw
> >> host=10.30.36.11
> >>
> port=8080","enableHA":true,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"Pj8GDPW2vqLfkdOMoCOogg","vncAddr":"10.100.100.11","params":{},"uuid":"f406776f-3b4c-4d23-917e-715ceaea0a7a","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"f44bbb4e-a788-4034-9389-dc1fa47dce70","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"63a122cd-ac74-3cc1-85b0-e3ad105234dc","id":1,"poolType":"NetworkFilesystem","host":"
> >> andcvtb05.be.alcatel-lucent.com
> >> ","path":"/andcvtb05/storage","port":2049,"url":"NetworkFilesystem://
> >>
> andcvtb05.be.alcatel-lucent.com/andcvtb05/storage/?ROLE=Primary&STOREUUID=63a122cd-ac74-3cc1-85b0-e3ad105234dc
> >>
> "}},"name":"ROOT-30","size":304774144,"path":"f44bbb4e-a788-4034-9389-dc1fa47dce70","volumeId":30,"vmName":"r-30-VM","accountId":2,"format":"QCOW2","provisioningType":"THIN","id":30,"deviceId":0,"hypervisorType":"KVM"}},"diskSeq":0,"path":"f44bbb4e-a788-4034-9389-dc1fa47dce70","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"
> >> andcvtb05.be.alcatel-lucent.com
> ","volumeSize":"304774144"}}],"nics":[{"deviceId":2,"networkRateMbps":200,"defaultNic":true,"pxeDisable":true,"nicUuid":"697871c5-d76f-405d-952c-c2d598ae09ae","uuid":"db6e7bae-8dbf-4b31-813f-dba0cad7a817","ip":"10.100.100.117","netmask":"255.255.255.0","gateway":"10.100.100.1","mac":"06:4f:3c:00:00:8f","dns1":"128.251.10.29","dns2":"4.4.4.4","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"cloudbr0"},{"deviceId":0,"networkRateMbps":200,"defaultNic":false,"pxeDisable":true,"nicUuid":"c08c5f3b-8725-4006-9660-551ecdc492fe","uuid":"e118f6ac-d812-403c-b948-99a510f7fd93","ip":"10.10.1.1","netmask":"255.255.255.0","mac":"02:00:6b:7b:00:02","dns1":"128.251.10.29","dns2":"4.4.4.4","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://300","isolationUri":"vlan://300","isSecurityGroupEnabled":false,"name":"cloudbr1"},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"pxeDisable":true,"nicUuid":"fe94aabc-705f-47e3-9981-0139acf1af3d","uuid":"6f1abde1-d0cb-4411-9e9b-9db1fdd5f7ab","ip":"169.254.2.130","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:02:82","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"result":true,"wait":0}},{"com.cloud.agent.api.check.CheckSshAnswer":{"result":true,"wait":0}},{"com.cloud.agent.api.GetDomRVersionAnswer":{"templateVersion":"Cloudstack
> >> Release 4.4.0 Wed Mar 26 23:26:41 UTC
> >>
> 2014","scriptsVersion":"e54d6a03fe7d28ff66432d33c8897934\n","result":true,"details":"Cloudstack
> >> Release 4.4.0 Wed Mar 26 23:26:41 UTC
> >>
> 2014&e54d6a03fe7d28ff66432d33c8897934\n","wait":0}},{"com.cloud.agent.api.NetworkUsageAnswer":{"routerName":"r-30-VM","bytesSent":0,"bytesReceived":0,"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"details":"Command
> >> aggregation
> >>
> started","wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":false,"details":"VR
> >> config: execution failed: \"/opt/cloud/bin/update_config.py
> >> ip_associations.json\", check /var/log/cloud.log in VR for details
> >> ","wait":0}}] }
> >> 2016-05-10 08:24:03,068 DEBUG [c.c.a.t.Request]
> >> (Work-Job-Executor-3:ctx-5069ea04 job-247/job-250 ctx-48a763a9)
> >> (logid:2735b868) Seq 1-4347381015296081926: Received:  { Ans: , MgmtId:
> >> 275619426932736, via: 1(ovs-1.andcvtb05.be.alcatel-lucent.com), Ver:
> v1,
> >> Flags: 10, { StartAnswer, CheckSshAnswer, GetDomRVersionAnswer,
> >> NetworkUsageAnswer, Answer, Answer, Answer, Answer, Answer } }
> >> 2016-05-10 08:24:03,091 WARN  [o.a.c.alerts]
> >> (Work-Job-Executor-3:ctx-5069ea04 job-247/job-250 ctx-48a763a9)
> >> (logid:2735b868)  alertType:: 9 // dataCenterId:: 2 // podId:: 2 //
> >> clusterId:: null // message:: Command: com.cloud.agent.api.Command
> failed
> >> while starting virtual router
> >>
> >>
> >> With regards,
> >> Prashanth
> >>
> >>
> >>
> >>
> >> On Tue, May 10, 2016 at 6:18 PM, Will Stevens <ws...@cloudops.com>
> >> wrote:
> >>
> >>> I am doing CI on KVM and I believe I am using bridged networking in
> this
> >>> environment.  Can you give more details of what you are seeing?
> >>>
> >>> *Will STEVENS*
> >>> Lead Developer
> >>>
> >>> *CloudOps* *| *Cloud Solutions Experts
> >>> 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6
> >>> w cloudops.com *|* tw @CloudOps_
> >>>
> >>> On Tue, May 10, 2016 at 11:51 AM, Prashanth Manthena <
> >>> prashanth.manthena@nuagenetworks.net> wrote:
> >>>
> >>>> Hi All,
> >>>>
> >>>> I am seeing CLOUDSTACK-9013 on master (4.9.0) with KVM+Linux Bridges.
> >>>>
> >>>> Any pointers on this issue ?
> >>>>
> >>>> CLOUDSTACK-9013:
> https://issues.apache.org/jira/browse/CLOUDSTACK-9013
> >>>>
> >>>> With reagrds,
> >>>> Prashanth
> >>
> >>
>

Re: Virtual router failed to start on KVM + Linux Bridges

Posted by Remi Bergsma <RB...@schubergphilis.com>.
Hi Prashanth,

As Wei suggested, when you use CloudStack 4.6/4.7/4.8/4.9 you also need the systemvm template with version 4.6.0. This does include the needed Python modules. The 4.4 template you used won't fly. You will run into other missing packages and changes as well. 

Regards, Remi 

Sent from my iPhone

> On 11 May 2016, at 13:50, Prashanth Manthena <pr...@nuagenetworks.net> wrote:
> 
> Hi Will,
> 
> I was able to put a break-point and debug the actual issue in the VR
> (system VM template), it's a Python import error of the package "netaddr",
> which can be fixed by updating the system template with the "netaddr"
> package installed in it. Hopefully, it fixes this issue.
> 
> Here is the error in VR's /var/log/cloud.log:
> 
> Wed May 11 10:29:37 UTC 2016 : VR config: configuation format version 1.0
> Wed May 11 10:29:37 UTC 2016 : VR config: creating file:
> /var/cache/cloud/ip_asss
> ociations.json
> Wed May 11 10:29:37 UTC 2016 : VR config: create file success
> Wed May 11 10:29:37 UTC 2016 : VR config: executing:
> /opt/cloud/bin/update_confii
> g.py ip_associations.json
> Traceback (most recent call last):
>  File "/opt/cloud/bin/update_config.py", line 20, in <module>
>    from merge import QueueFile
>  File "/opt/cloud/bin/merge.py", line 23, in <module>
>    import cs_ip
>  File "/opt/cloud/bin/cs_ip.py", line 19, in <module>
>    from netaddr import *
> ImportError: No module named netaddr
> Wed May 11 10:29:37 UTC 2016 : VR config: executing failed:
> /opt/cloud/bin/updatt
> e_config.py ip_associations.json
> 
> With regards,
> Prashanth
> 
> On Wed, May 11, 2016 at 12:06 PM, Prashanth Manthena <
> prashanth.manthena@nuagenetworks.net> wrote:
> 
>> Hi Will,
>> 
>> I am hitting an issue similar to CLOUDSTACK-9013 on master (4.9.0). Here
>> are the management server error logs:
>> 
>> 2016-05-10 08:24:03,109 ERROR [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Work-Job-Executor-3:ctx-5069ea04 job-247/job-250 ctx-48a763a9)
>> (logid:2735b868) VR config: execution failed:
>> "/opt/cloud/bin/update_config.py ip_associations.json", check
>> /var/log/cloud.log in VR for details
>> 
>> 2016-05-10 08:24:03,109 WARN  [c.c.n.r.VirtualNetworkApplianceManagerImpl]
>> (Work-Job-Executor-3:ctx-5069ea04 job-247/job-250 ctx-48a763a9)
>> (logid:2735b868) Command: com.cloud.agent.api.Command failed while starting
>> virtual router
>> 
>> 2016-05-10 08:24:03,109 INFO  [c.c.v.VirtualMachineManagerImpl]
>> (Work-Job-Executor-3:ctx-5069ea04 job-247/job-250 ctx-48a763a9)
>> (logid:2735b868) The guru did not like the answers so stopping
>> VM[DomainRouter|r-30-VM]
>> 
>> Response:
>> 
>> 2016-05-10 08:24:03,067 DEBUG [c.c.a.t.Request]
>> (AgentManager-Handler-10:null) (logid:) Seq 1-4347381015296081926:
>> Processing:  { Ans: , MgmtId: 275619426932736, via: 1, Ver: v1, Flags: 10,
>> [{"com.cloud.agent.api.StartAnswer":{"vm":{"id":30,"name":"r-30-VM","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":268435456,"maxRam":268435456,"arch":"x86_64","os":"Debian
>> GNU/Linux 5.0 (64-bit)","platformEmulator":"Debian GNU/Linux
>> 5","bootArgs":" template=domP name=r-30-VM eth2ip=10.100.100.117
>> eth2mask=255.255.255.0 gateway=10.100.100.1 eth0ip=10.10.1.1
>> eth0mask=255.255.255.0 domain=cs2cloud.internal cidrsize=24
>> dhcprange=10.10.1.1 eth1ip=169.254.2.130 eth1mask=255.255.0.0 type=router
>> disable_rp_filter=true dns1=128.251.10.29 dns2=4.4.4.4
>> baremetalnotificationsecuritykey=ODFTmygvs7oVAHVFZMmv7RpvsNNsawY9tf6sfeMvkUJlmEhWXGli5sO_oWAr52vrF18Z5xMgzjclu9P7G_w9Fg
>> baremetalnotificationapikey=pguqxBGrlU2ItCuTHa7xb6pmjrpl9KbVMEE7o6TKrJ-mjDoaRayL_Nj21VkqrKvbtc10L8BxPqaYIhnGJkeHfw
>> host=10.30.36.11
>> port=8080","enableHA":true,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"Pj8GDPW2vqLfkdOMoCOogg","vncAddr":"10.100.100.11","params":{},"uuid":"f406776f-3b4c-4d23-917e-715ceaea0a7a","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"f44bbb4e-a788-4034-9389-dc1fa47dce70","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"63a122cd-ac74-3cc1-85b0-e3ad105234dc","id":1,"poolType":"NetworkFilesystem","host":"
>> andcvtb05.be.alcatel-lucent.com
>> ","path":"/andcvtb05/storage","port":2049,"url":"NetworkFilesystem://
>> andcvtb05.be.alcatel-lucent.com/andcvtb05/storage/?ROLE=Primary&STOREUUID=63a122cd-ac74-3cc1-85b0-e3ad105234dc
>> "}},"name":"ROOT-30","size":304774144,"path":"f44bbb4e-a788-4034-9389-dc1fa47dce70","volumeId":30,"vmName":"r-30-VM","accountId":2,"format":"QCOW2","provisioningType":"THIN","id":30,"deviceId":0,"hypervisorType":"KVM"}},"diskSeq":0,"path":"f44bbb4e-a788-4034-9389-dc1fa47dce70","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"
>> andcvtb05.be.alcatel-lucent.com","volumeSize":"304774144"}}],"nics":[{"deviceId":2,"networkRateMbps":200,"defaultNic":true,"pxeDisable":true,"nicUuid":"697871c5-d76f-405d-952c-c2d598ae09ae","uuid":"db6e7bae-8dbf-4b31-813f-dba0cad7a817","ip":"10.100.100.117","netmask":"255.255.255.0","gateway":"10.100.100.1","mac":"06:4f:3c:00:00:8f","dns1":"128.251.10.29","dns2":"4.4.4.4","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"cloudbr0"},{"deviceId":0,"networkRateMbps":200,"defaultNic":false,"pxeDisable":true,"nicUuid":"c08c5f3b-8725-4006-9660-551ecdc492fe","uuid":"e118f6ac-d812-403c-b948-99a510f7fd93","ip":"10.10.1.1","netmask":"255.255.255.0","mac":"02:00:6b:7b:00:02","dns1":"128.251.10.29","dns2":"4.4.4.4","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://300","isolationUri":"vlan://300","isSecurityGroupEnabled":false,"name":"cloudbr1"},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"pxeDisable":true,"nicUuid":"fe94aabc-705f-47e3-9981-0139acf1af3d","uuid":"6f1abde1-d0cb-4411-9e9b-9db1fdd5f7ab","ip":"169.254.2.130","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:02:82","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"result":true,"wait":0}},{"com.cloud.agent.api.check.CheckSshAnswer":{"result":true,"wait":0}},{"com.cloud.agent.api.GetDomRVersionAnswer":{"templateVersion":"Cloudstack
>> Release 4.4.0 Wed Mar 26 23:26:41 UTC
>> 2014","scriptsVersion":"e54d6a03fe7d28ff66432d33c8897934\n","result":true,"details":"Cloudstack
>> Release 4.4.0 Wed Mar 26 23:26:41 UTC
>> 2014&e54d6a03fe7d28ff66432d33c8897934\n","wait":0}},{"com.cloud.agent.api.NetworkUsageAnswer":{"routerName":"r-30-VM","bytesSent":0,"bytesReceived":0,"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"details":"Command
>> aggregation
>> started","wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":false,"details":"VR
>> config: execution failed: \"/opt/cloud/bin/update_config.py
>> ip_associations.json\", check /var/log/cloud.log in VR for details
>> ","wait":0}}] }
>> 2016-05-10 08:24:03,068 DEBUG [c.c.a.t.Request]
>> (Work-Job-Executor-3:ctx-5069ea04 job-247/job-250 ctx-48a763a9)
>> (logid:2735b868) Seq 1-4347381015296081926: Received:  { Ans: , MgmtId:
>> 275619426932736, via: 1(ovs-1.andcvtb05.be.alcatel-lucent.com), Ver: v1,
>> Flags: 10, { StartAnswer, CheckSshAnswer, GetDomRVersionAnswer,
>> NetworkUsageAnswer, Answer, Answer, Answer, Answer, Answer } }
>> 2016-05-10 08:24:03,091 WARN  [o.a.c.alerts]
>> (Work-Job-Executor-3:ctx-5069ea04 job-247/job-250 ctx-48a763a9)
>> (logid:2735b868)  alertType:: 9 // dataCenterId:: 2 // podId:: 2 //
>> clusterId:: null // message:: Command: com.cloud.agent.api.Command failed
>> while starting virtual router
>> 
>> 
>> With regards,
>> Prashanth
>> 
>> 
>> 
>> 
>> On Tue, May 10, 2016 at 6:18 PM, Will Stevens <ws...@cloudops.com>
>> wrote:
>> 
>>> I am doing CI on KVM and I believe I am using bridged networking in this
>>> environment.  Can you give more details of what you are seeing?
>>> 
>>> *Will STEVENS*
>>> Lead Developer
>>> 
>>> *CloudOps* *| *Cloud Solutions Experts
>>> 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6
>>> w cloudops.com *|* tw @CloudOps_
>>> 
>>> On Tue, May 10, 2016 at 11:51 AM, Prashanth Manthena <
>>> prashanth.manthena@nuagenetworks.net> wrote:
>>> 
>>>> Hi All,
>>>> 
>>>> I am seeing CLOUDSTACK-9013 on master (4.9.0) with KVM+Linux Bridges.
>>>> 
>>>> Any pointers on this issue ?
>>>> 
>>>> CLOUDSTACK-9013: https://issues.apache.org/jira/browse/CLOUDSTACK-9013
>>>> 
>>>> With reagrds,
>>>> Prashanth
>> 
>> 

Re: Virtual router failed to start on KVM + Linux Bridges

Posted by Prashanth Manthena <pr...@nuagenetworks.net>.
Hi Will,

I was able to put a break-point and debug the actual issue in the VR
(system VM template), it's a Python import error of the package "netaddr",
which can be fixed by updating the system template with the "netaddr"
package installed in it. Hopefully, it fixes this issue.

Here is the error in VR's /var/log/cloud.log:

Wed May 11 10:29:37 UTC 2016 : VR config: configuation format version 1.0
Wed May 11 10:29:37 UTC 2016 : VR config: creating file:
/var/cache/cloud/ip_asss
ociations.json
Wed May 11 10:29:37 UTC 2016 : VR config: create file success
Wed May 11 10:29:37 UTC 2016 : VR config: executing:
/opt/cloud/bin/update_confii
g.py ip_associations.json
Traceback (most recent call last):
  File "/opt/cloud/bin/update_config.py", line 20, in <module>
    from merge import QueueFile
  File "/opt/cloud/bin/merge.py", line 23, in <module>
    import cs_ip
  File "/opt/cloud/bin/cs_ip.py", line 19, in <module>
    from netaddr import *
ImportError: No module named netaddr
Wed May 11 10:29:37 UTC 2016 : VR config: executing failed:
/opt/cloud/bin/updatt
e_config.py ip_associations.json

With regards,
Prashanth

On Wed, May 11, 2016 at 12:06 PM, Prashanth Manthena <
prashanth.manthena@nuagenetworks.net> wrote:

> Hi Will,
>
> I am hitting an issue similar to CLOUDSTACK-9013 on master (4.9.0). Here
> are the management server error logs:
>
> 2016-05-10 08:24:03,109 ERROR [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (Work-Job-Executor-3:ctx-5069ea04 job-247/job-250 ctx-48a763a9)
> (logid:2735b868) VR config: execution failed:
> "/opt/cloud/bin/update_config.py ip_associations.json", check
> /var/log/cloud.log in VR for details
>
> 2016-05-10 08:24:03,109 WARN  [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (Work-Job-Executor-3:ctx-5069ea04 job-247/job-250 ctx-48a763a9)
> (logid:2735b868) Command: com.cloud.agent.api.Command failed while starting
> virtual router
>
> 2016-05-10 08:24:03,109 INFO  [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-3:ctx-5069ea04 job-247/job-250 ctx-48a763a9)
> (logid:2735b868) The guru did not like the answers so stopping
> VM[DomainRouter|r-30-VM]
>
> Response:
>
> 2016-05-10 08:24:03,067 DEBUG [c.c.a.t.Request]
> (AgentManager-Handler-10:null) (logid:) Seq 1-4347381015296081926:
> Processing:  { Ans: , MgmtId: 275619426932736, via: 1, Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.StartAnswer":{"vm":{"id":30,"name":"r-30-VM","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":268435456,"maxRam":268435456,"arch":"x86_64","os":"Debian
> GNU/Linux 5.0 (64-bit)","platformEmulator":"Debian GNU/Linux
> 5","bootArgs":" template=domP name=r-30-VM eth2ip=10.100.100.117
> eth2mask=255.255.255.0 gateway=10.100.100.1 eth0ip=10.10.1.1
> eth0mask=255.255.255.0 domain=cs2cloud.internal cidrsize=24
> dhcprange=10.10.1.1 eth1ip=169.254.2.130 eth1mask=255.255.0.0 type=router
> disable_rp_filter=true dns1=128.251.10.29 dns2=4.4.4.4
> baremetalnotificationsecuritykey=ODFTmygvs7oVAHVFZMmv7RpvsNNsawY9tf6sfeMvkUJlmEhWXGli5sO_oWAr52vrF18Z5xMgzjclu9P7G_w9Fg
> baremetalnotificationapikey=pguqxBGrlU2ItCuTHa7xb6pmjrpl9KbVMEE7o6TKrJ-mjDoaRayL_Nj21VkqrKvbtc10L8BxPqaYIhnGJkeHfw
> host=10.30.36.11
> port=8080","enableHA":true,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"Pj8GDPW2vqLfkdOMoCOogg","vncAddr":"10.100.100.11","params":{},"uuid":"f406776f-3b4c-4d23-917e-715ceaea0a7a","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"f44bbb4e-a788-4034-9389-dc1fa47dce70","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"63a122cd-ac74-3cc1-85b0-e3ad105234dc","id":1,"poolType":"NetworkFilesystem","host":"
> andcvtb05.be.alcatel-lucent.com
> ","path":"/andcvtb05/storage","port":2049,"url":"NetworkFilesystem://
> andcvtb05.be.alcatel-lucent.com/andcvtb05/storage/?ROLE=Primary&STOREUUID=63a122cd-ac74-3cc1-85b0-e3ad105234dc
> "}},"name":"ROOT-30","size":304774144,"path":"f44bbb4e-a788-4034-9389-dc1fa47dce70","volumeId":30,"vmName":"r-30-VM","accountId":2,"format":"QCOW2","provisioningType":"THIN","id":30,"deviceId":0,"hypervisorType":"KVM"}},"diskSeq":0,"path":"f44bbb4e-a788-4034-9389-dc1fa47dce70","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"
> andcvtb05.be.alcatel-lucent.com","volumeSize":"304774144"}}],"nics":[{"deviceId":2,"networkRateMbps":200,"defaultNic":true,"pxeDisable":true,"nicUuid":"697871c5-d76f-405d-952c-c2d598ae09ae","uuid":"db6e7bae-8dbf-4b31-813f-dba0cad7a817","ip":"10.100.100.117","netmask":"255.255.255.0","gateway":"10.100.100.1","mac":"06:4f:3c:00:00:8f","dns1":"128.251.10.29","dns2":"4.4.4.4","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"cloudbr0"},{"deviceId":0,"networkRateMbps":200,"defaultNic":false,"pxeDisable":true,"nicUuid":"c08c5f3b-8725-4006-9660-551ecdc492fe","uuid":"e118f6ac-d812-403c-b948-99a510f7fd93","ip":"10.10.1.1","netmask":"255.255.255.0","mac":"02:00:6b:7b:00:02","dns1":"128.251.10.29","dns2":"4.4.4.4","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://300","isolationUri":"vlan://300","isSecurityGroupEnabled":false,"name":"cloudbr1"},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"pxeDisable":true,"nicUuid":"fe94aabc-705f-47e3-9981-0139acf1af3d","uuid":"6f1abde1-d0cb-4411-9e9b-9db1fdd5f7ab","ip":"169.254.2.130","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:02:82","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"result":true,"wait":0}},{"com.cloud.agent.api.check.CheckSshAnswer":{"result":true,"wait":0}},{"com.cloud.agent.api.GetDomRVersionAnswer":{"templateVersion":"Cloudstack
> Release 4.4.0 Wed Mar 26 23:26:41 UTC
> 2014","scriptsVersion":"e54d6a03fe7d28ff66432d33c8897934\n","result":true,"details":"Cloudstack
> Release 4.4.0 Wed Mar 26 23:26:41 UTC
> 2014&e54d6a03fe7d28ff66432d33c8897934\n","wait":0}},{"com.cloud.agent.api.NetworkUsageAnswer":{"routerName":"r-30-VM","bytesSent":0,"bytesReceived":0,"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"details":"Command
> aggregation
> started","wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":false,"details":"VR
> config: execution failed: \"/opt/cloud/bin/update_config.py
> ip_associations.json\", check /var/log/cloud.log in VR for details
> ","wait":0}}] }
> 2016-05-10 08:24:03,068 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-3:ctx-5069ea04 job-247/job-250 ctx-48a763a9)
> (logid:2735b868) Seq 1-4347381015296081926: Received:  { Ans: , MgmtId:
> 275619426932736, via: 1(ovs-1.andcvtb05.be.alcatel-lucent.com), Ver: v1,
> Flags: 10, { StartAnswer, CheckSshAnswer, GetDomRVersionAnswer,
> NetworkUsageAnswer, Answer, Answer, Answer, Answer, Answer } }
> 2016-05-10 08:24:03,091 WARN  [o.a.c.alerts]
> (Work-Job-Executor-3:ctx-5069ea04 job-247/job-250 ctx-48a763a9)
> (logid:2735b868)  alertType:: 9 // dataCenterId:: 2 // podId:: 2 //
> clusterId:: null // message:: Command: com.cloud.agent.api.Command failed
> while starting virtual router
>
>
> With regards,
> Prashanth
>
>
>
>
> On Tue, May 10, 2016 at 6:18 PM, Will Stevens <ws...@cloudops.com>
> wrote:
>
>> I am doing CI on KVM and I believe I am using bridged networking in this
>> environment.  Can you give more details of what you are seeing?
>>
>> *Will STEVENS*
>> Lead Developer
>>
>> *CloudOps* *| *Cloud Solutions Experts
>> 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6
>> w cloudops.com *|* tw @CloudOps_
>>
>> On Tue, May 10, 2016 at 11:51 AM, Prashanth Manthena <
>> prashanth.manthena@nuagenetworks.net> wrote:
>>
>> > Hi All,
>> >
>> >  I am seeing CLOUDSTACK-9013 on master (4.9.0) with KVM+Linux Bridges.
>> >
>> > Any pointers on this issue ?
>> >
>> > CLOUDSTACK-9013: https://issues.apache.org/jira/browse/CLOUDSTACK-9013
>> >
>> > With reagrds,
>> > Prashanth
>> >
>>
>
>

Re: Virtual router failed to start on KVM + Linux Bridges

Posted by Wei ZHOU <us...@gmail.com>.
Prashanth,

it looks you still use the systemvm template 4.4.0. Please upload the new
systemvm template and test it again.
you can follow
http://docs.cloudstack.apache.org/projects/cloudstack-release-notes/en/4.8.0/upgrade/upgrade-4.5.html
.

-Wei

2016-05-11 12:06 GMT+02:00 Prashanth Manthena <
prashanth.manthena@nuagenetworks.net>:

> Hi Will,
>
> I am hitting an issue similar to CLOUDSTACK-9013 on master (4.9.0). Here
> are the management server error logs:
>
> 2016-05-10 08:24:03,109 ERROR [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (Work-Job-Executor-3:ctx-5069ea04 job-247/job-250 ctx-48a763a9)
> (logid:2735b868) VR config: execution failed:
> "/opt/cloud/bin/update_config.py ip_associations.json", check
> /var/log/cloud.log in VR for details
>
> 2016-05-10 08:24:03,109 WARN  [c.c.n.r.VirtualNetworkApplianceManagerImpl]
> (Work-Job-Executor-3:ctx-5069ea04 job-247/job-250 ctx-48a763a9)
> (logid:2735b868) Command: com.cloud.agent.api.Command failed while starting
> virtual router
>
> 2016-05-10 08:24:03,109 INFO  [c.c.v.VirtualMachineManagerImpl]
> (Work-Job-Executor-3:ctx-5069ea04 job-247/job-250 ctx-48a763a9)
> (logid:2735b868) The guru did not like the answers so stopping
> VM[DomainRouter|r-30-VM]
>
> Response:
>
> 2016-05-10 08:24:03,067 DEBUG [c.c.a.t.Request]
> (AgentManager-Handler-10:null) (logid:) Seq 1-4347381015296081926:
> Processing:  { Ans: , MgmtId: 275619426932736, via: 1, Ver: v1, Flags: 10,
>
> [{"com.cloud.agent.api.StartAnswer":{"vm":{"id":30,"name":"r-30-VM","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":268435456,"maxRam":268435456,"arch":"x86_64","os":"Debian
> GNU/Linux 5.0 (64-bit)","platformEmulator":"Debian GNU/Linux
> 5","bootArgs":" template=domP name=r-30-VM eth2ip=10.100.100.117
> eth2mask=255.255.255.0 gateway=10.100.100.1 eth0ip=10.10.1.1
> eth0mask=255.255.255.0 domain=cs2cloud.internal cidrsize=24
> dhcprange=10.10.1.1 eth1ip=169.254.2.130 eth1mask=255.255.0.0 type=router
> disable_rp_filter=true dns1=128.251.10.29 dns2=4.4.4.4
>
> baremetalnotificationsecuritykey=ODFTmygvs7oVAHVFZMmv7RpvsNNsawY9tf6sfeMvkUJlmEhWXGli5sO_oWAr52vrF18Z5xMgzjclu9P7G_w9Fg
>
> baremetalnotificationapikey=pguqxBGrlU2ItCuTHa7xb6pmjrpl9KbVMEE7o6TKrJ-mjDoaRayL_Nj21VkqrKvbtc10L8BxPqaYIhnGJkeHfw
> host=10.30.36.11
>
> port=8080","enableHA":true,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"Pj8GDPW2vqLfkdOMoCOogg","vncAddr":"10.100.100.11","params":{},"uuid":"f406776f-3b4c-4d23-917e-715ceaea0a7a","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"f44bbb4e-a788-4034-9389-dc1fa47dce70","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"63a122cd-ac74-3cc1-85b0-e3ad105234dc","id":1,"poolType":"NetworkFilesystem","host":"
> andcvtb05.be.alcatel-lucent.com
> ","path":"/andcvtb05/storage","port":2049,"url":"NetworkFilesystem://
>
> andcvtb05.be.alcatel-lucent.com/andcvtb05/storage/?ROLE=Primary&STOREUUID=63a122cd-ac74-3cc1-85b0-e3ad105234dc
>
> "}},"name":"ROOT-30","size":304774144,"path":"f44bbb4e-a788-4034-9389-dc1fa47dce70","volumeId":30,"vmName":"r-30-VM","accountId":2,"format":"QCOW2","provisioningType":"THIN","id":30,"deviceId":0,"hypervisorType":"KVM"}},"diskSeq":0,"path":"f44bbb4e-a788-4034-9389-dc1fa47dce70","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"
> andcvtb05.be.alcatel-lucent.com
> ","volumeSize":"304774144"}}],"nics":[{"deviceId":2,"networkRateMbps":200,"defaultNic":true,"pxeDisable":true,"nicUuid":"697871c5-d76f-405d-952c-c2d598ae09ae","uuid":"db6e7bae-8dbf-4b31-813f-dba0cad7a817","ip":"10.100.100.117","netmask":"255.255.255.0","gateway":"10.100.100.1","mac":"06:4f:3c:00:00:8f","dns1":"128.251.10.29","dns2":"4.4.4.4","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"cloudbr0"},{"deviceId":0,"networkRateMbps":200,"defaultNic":false,"pxeDisable":true,"nicUuid":"c08c5f3b-8725-4006-9660-551ecdc492fe","uuid":"e118f6ac-d812-403c-b948-99a510f7fd93","ip":"10.10.1.1","netmask":"255.255.255.0","mac":"02:00:6b:7b:00:02","dns1":"128.251.10.29","dns2":"4.4.4.4","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://300","isolationUri":"vlan://300","isSecurityGroupEnabled":false,"name":"cloudbr1"},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"pxeDisable":true,"nicUuid":"fe94aabc-705f-47e3-9981-0139acf1af3d","uuid":"6f1abde1-d0cb-4411-9e9b-9db1fdd5f7ab","ip":"169.254.2.130","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:02:82","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"result":true,"wait":0}},{"com.cloud.agent.api.check.CheckSshAnswer":{"result":true,"wait":0}},{"com.cloud.agent.api.GetDomRVersionAnswer":{"templateVersion":"Cloudstack
> Release 4.4.0 Wed Mar 26 23:26:41 UTC
>
> 2014","scriptsVersion":"e54d6a03fe7d28ff66432d33c8897934\n","result":true,"details":"Cloudstack
> Release 4.4.0 Wed Mar 26 23:26:41 UTC
>
> 2014&e54d6a03fe7d28ff66432d33c8897934\n","wait":0}},{"com.cloud.agent.api.NetworkUsageAnswer":{"routerName":"r-30-VM","bytesSent":0,"bytesReceived":0,"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"details":"Command
> aggregation
>
> started","wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":false,"details":"VR
> config: execution failed: \"/opt/cloud/bin/update_config.py
> ip_associations.json\", check /var/log/cloud.log in VR for details
> ","wait":0}}] }
> 2016-05-10 08:24:03,068 DEBUG [c.c.a.t.Request]
> (Work-Job-Executor-3:ctx-5069ea04 job-247/job-250 ctx-48a763a9)
> (logid:2735b868) Seq 1-4347381015296081926: Received:  { Ans: , MgmtId:
> 275619426932736, via: 1(ovs-1.andcvtb05.be.alcatel-lucent.com), Ver: v1,
> Flags: 10, { StartAnswer, CheckSshAnswer, GetDomRVersionAnswer,
> NetworkUsageAnswer, Answer, Answer, Answer, Answer, Answer } }
> 2016-05-10 08:24:03,091 WARN  [o.a.c.alerts]
> (Work-Job-Executor-3:ctx-5069ea04 job-247/job-250 ctx-48a763a9)
> (logid:2735b868)  alertType:: 9 // dataCenterId:: 2 // podId:: 2 //
> clusterId:: null // message:: Command: com.cloud.agent.api.Command failed
> while starting virtual router
>
>
> With regards,
> Prashanth
>
>
>
>
> On Tue, May 10, 2016 at 6:18 PM, Will Stevens <ws...@cloudops.com>
> wrote:
>
> > I am doing CI on KVM and I believe I am using bridged networking in this
> > environment.  Can you give more details of what you are seeing?
> >
> > *Will STEVENS*
> > Lead Developer
> >
> > *CloudOps* *| *Cloud Solutions Experts
> > 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6
> > w cloudops.com *|* tw @CloudOps_
> >
> > On Tue, May 10, 2016 at 11:51 AM, Prashanth Manthena <
> > prashanth.manthena@nuagenetworks.net> wrote:
> >
> > > Hi All,
> > >
> > >  I am seeing CLOUDSTACK-9013 on master (4.9.0) with KVM+Linux Bridges.
> > >
> > > Any pointers on this issue ?
> > >
> > > CLOUDSTACK-9013: https://issues.apache.org/jira/browse/CLOUDSTACK-9013
> > >
> > > With reagrds,
> > > Prashanth
> > >
> >
>

Re: Virtual router failed to start on KVM + Linux Bridges

Posted by Prashanth Manthena <pr...@nuagenetworks.net>.
Hi Will,

I am hitting an issue similar to CLOUDSTACK-9013 on master (4.9.0). Here
are the management server error logs:

2016-05-10 08:24:03,109 ERROR [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-3:ctx-5069ea04 job-247/job-250 ctx-48a763a9)
(logid:2735b868) VR config: execution failed:
"/opt/cloud/bin/update_config.py ip_associations.json", check
/var/log/cloud.log in VR for details

2016-05-10 08:24:03,109 WARN  [c.c.n.r.VirtualNetworkApplianceManagerImpl]
(Work-Job-Executor-3:ctx-5069ea04 job-247/job-250 ctx-48a763a9)
(logid:2735b868) Command: com.cloud.agent.api.Command failed while starting
virtual router

2016-05-10 08:24:03,109 INFO  [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-3:ctx-5069ea04 job-247/job-250 ctx-48a763a9)
(logid:2735b868) The guru did not like the answers so stopping
VM[DomainRouter|r-30-VM]

Response:

2016-05-10 08:24:03,067 DEBUG [c.c.a.t.Request]
(AgentManager-Handler-10:null) (logid:) Seq 1-4347381015296081926:
Processing:  { Ans: , MgmtId: 275619426932736, via: 1, Ver: v1, Flags: 10,
[{"com.cloud.agent.api.StartAnswer":{"vm":{"id":30,"name":"r-30-VM","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":268435456,"maxRam":268435456,"arch":"x86_64","os":"Debian
GNU/Linux 5.0 (64-bit)","platformEmulator":"Debian GNU/Linux
5","bootArgs":" template=domP name=r-30-VM eth2ip=10.100.100.117
eth2mask=255.255.255.0 gateway=10.100.100.1 eth0ip=10.10.1.1
eth0mask=255.255.255.0 domain=cs2cloud.internal cidrsize=24
dhcprange=10.10.1.1 eth1ip=169.254.2.130 eth1mask=255.255.0.0 type=router
disable_rp_filter=true dns1=128.251.10.29 dns2=4.4.4.4
baremetalnotificationsecuritykey=ODFTmygvs7oVAHVFZMmv7RpvsNNsawY9tf6sfeMvkUJlmEhWXGli5sO_oWAr52vrF18Z5xMgzjclu9P7G_w9Fg
baremetalnotificationapikey=pguqxBGrlU2ItCuTHa7xb6pmjrpl9KbVMEE7o6TKrJ-mjDoaRayL_Nj21VkqrKvbtc10L8BxPqaYIhnGJkeHfw
host=10.30.36.11
port=8080","enableHA":true,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"Pj8GDPW2vqLfkdOMoCOogg","vncAddr":"10.100.100.11","params":{},"uuid":"f406776f-3b4c-4d23-917e-715ceaea0a7a","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"f44bbb4e-a788-4034-9389-dc1fa47dce70","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"63a122cd-ac74-3cc1-85b0-e3ad105234dc","id":1,"poolType":"NetworkFilesystem","host":"
andcvtb05.be.alcatel-lucent.com
","path":"/andcvtb05/storage","port":2049,"url":"NetworkFilesystem://
andcvtb05.be.alcatel-lucent.com/andcvtb05/storage/?ROLE=Primary&STOREUUID=63a122cd-ac74-3cc1-85b0-e3ad105234dc
"}},"name":"ROOT-30","size":304774144,"path":"f44bbb4e-a788-4034-9389-dc1fa47dce70","volumeId":30,"vmName":"r-30-VM","accountId":2,"format":"QCOW2","provisioningType":"THIN","id":30,"deviceId":0,"hypervisorType":"KVM"}},"diskSeq":0,"path":"f44bbb4e-a788-4034-9389-dc1fa47dce70","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"
andcvtb05.be.alcatel-lucent.com","volumeSize":"304774144"}}],"nics":[{"deviceId":2,"networkRateMbps":200,"defaultNic":true,"pxeDisable":true,"nicUuid":"697871c5-d76f-405d-952c-c2d598ae09ae","uuid":"db6e7bae-8dbf-4b31-813f-dba0cad7a817","ip":"10.100.100.117","netmask":"255.255.255.0","gateway":"10.100.100.1","mac":"06:4f:3c:00:00:8f","dns1":"128.251.10.29","dns2":"4.4.4.4","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"cloudbr0"},{"deviceId":0,"networkRateMbps":200,"defaultNic":false,"pxeDisable":true,"nicUuid":"c08c5f3b-8725-4006-9660-551ecdc492fe","uuid":"e118f6ac-d812-403c-b948-99a510f7fd93","ip":"10.10.1.1","netmask":"255.255.255.0","mac":"02:00:6b:7b:00:02","dns1":"128.251.10.29","dns2":"4.4.4.4","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://300","isolationUri":"vlan://300","isSecurityGroupEnabled":false,"name":"cloudbr1"},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"pxeDisable":true,"nicUuid":"fe94aabc-705f-47e3-9981-0139acf1af3d","uuid":"6f1abde1-d0cb-4411-9e9b-9db1fdd5f7ab","ip":"169.254.2.130","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:02:82","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"result":true,"wait":0}},{"com.cloud.agent.api.check.CheckSshAnswer":{"result":true,"wait":0}},{"com.cloud.agent.api.GetDomRVersionAnswer":{"templateVersion":"Cloudstack
Release 4.4.0 Wed Mar 26 23:26:41 UTC
2014","scriptsVersion":"e54d6a03fe7d28ff66432d33c8897934\n","result":true,"details":"Cloudstack
Release 4.4.0 Wed Mar 26 23:26:41 UTC
2014&e54d6a03fe7d28ff66432d33c8897934\n","wait":0}},{"com.cloud.agent.api.NetworkUsageAnswer":{"routerName":"r-30-VM","bytesSent":0,"bytesReceived":0,"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"details":"Command
aggregation
started","wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":false,"details":"VR
config: execution failed: \"/opt/cloud/bin/update_config.py
ip_associations.json\", check /var/log/cloud.log in VR for details
","wait":0}}] }
2016-05-10 08:24:03,068 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-3:ctx-5069ea04 job-247/job-250 ctx-48a763a9)
(logid:2735b868) Seq 1-4347381015296081926: Received:  { Ans: , MgmtId:
275619426932736, via: 1(ovs-1.andcvtb05.be.alcatel-lucent.com), Ver: v1,
Flags: 10, { StartAnswer, CheckSshAnswer, GetDomRVersionAnswer,
NetworkUsageAnswer, Answer, Answer, Answer, Answer, Answer } }
2016-05-10 08:24:03,091 WARN  [o.a.c.alerts]
(Work-Job-Executor-3:ctx-5069ea04 job-247/job-250 ctx-48a763a9)
(logid:2735b868)  alertType:: 9 // dataCenterId:: 2 // podId:: 2 //
clusterId:: null // message:: Command: com.cloud.agent.api.Command failed
while starting virtual router


With regards,
Prashanth




On Tue, May 10, 2016 at 6:18 PM, Will Stevens <ws...@cloudops.com> wrote:

> I am doing CI on KVM and I believe I am using bridged networking in this
> environment.  Can you give more details of what you are seeing?
>
> *Will STEVENS*
> Lead Developer
>
> *CloudOps* *| *Cloud Solutions Experts
> 420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6
> w cloudops.com *|* tw @CloudOps_
>
> On Tue, May 10, 2016 at 11:51 AM, Prashanth Manthena <
> prashanth.manthena@nuagenetworks.net> wrote:
>
> > Hi All,
> >
> >  I am seeing CLOUDSTACK-9013 on master (4.9.0) with KVM+Linux Bridges.
> >
> > Any pointers on this issue ?
> >
> > CLOUDSTACK-9013: https://issues.apache.org/jira/browse/CLOUDSTACK-9013
> >
> > With reagrds,
> > Prashanth
> >
>

Re: Virtual router failed to start on KVM + Linux Bridges

Posted by Will Stevens <ws...@cloudops.com>.
I am doing CI on KVM and I believe I am using bridged networking in this
environment.  Can you give more details of what you are seeing?

*Will STEVENS*
Lead Developer

*CloudOps* *| *Cloud Solutions Experts
420 rue Guy *|* Montreal *|* Quebec *|* H3J 1S6
w cloudops.com *|* tw @CloudOps_

On Tue, May 10, 2016 at 11:51 AM, Prashanth Manthena <
prashanth.manthena@nuagenetworks.net> wrote:

> Hi All,
>
>  I am seeing CLOUDSTACK-9013 on master (4.9.0) with KVM+Linux Bridges.
>
> Any pointers on this issue ?
>
> CLOUDSTACK-9013: https://issues.apache.org/jira/browse/CLOUDSTACK-9013
>
> With reagrds,
> Prashanth
>