You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cloudstack.apache.org by GitBox <gi...@apache.org> on 2021/09/06 10:09:39 UTC
[GitHub] [cloudstack] xuanyuanaosheng opened a new issue #5409: The cloudstack work node network problem (Oracle 8)
xuanyuanaosheng opened a new issue #5409:
URL: https://github.com/apache/cloudstack/issues/5409
##### ISSUE TYPE
* Bug Report
##### OS / ENVIRONMENT
1. OS Version: Red Hat Enterprise Linux release 8.4 (Ootpa)
3. cloudstack version: cloudstack-agent-4.15.1.0-1.el8.x86_64
4. libvirt: 6.0.0-35
The network-scripts:
```
network-scripts-team-1.31-2.el8.x86_64
network-scripts-10.00.15-1.el8.x86_64
network-scripts-openvswitch-2.12.0-1.1.el8.x86_64
```
The net-tools
`net-tools-2.0-0.52.20160912git.el8.x86_64`
The openvswitch version:
```
openvswitch-devel-2.12.0-1.1.el8.x86_64
openvswitch-2.12.0-1.1.el8.x86_64
openvswitch-ipsec-2.12.0-1.1.el8.x86_64
pcp-pmda-openvswitch-5.2.5-4.el8.x86_64
python3-openvswitch-2.12.0-1.1.el8.x86_64
network-scripts-openvswitch-2.12.0-1.1.el8.x86_64
```
The cloudstack work node is using KVM + openvswitch (http://docs.cloudstack.apache.org/en/latest/installguide/hypervisor/kvm.html#configuring-the-network-bridges-for-openvswitch )
##### The configuration:
```
ovs-vsctl add-br cloudbr
ovs-vsctl add-port cloudbr eno1
ovs-vsctl set port cloudbr trunks=136,291,300
ovs-vsctl add-br mgmt0 cloudbr 136
ovs-vsctl add-br cloudbr0 cloudbr 291
ovs-vsctl add-br cloudbr1 cloudbr 300
```
The network configuration:
ifcfg-eno1
```
TYPE=OVSPort
IPV6INIT=no
BOOTPROTO=none
DEVICETYPE=ovs
OVS_BRIDGE=cloudbr
UUID=22c22720-553e-4c78-9f8a-5873805a0842
HOTPLUG=no
DEVICE=eno1
ONBOOT=yes
```
ifcfg-cloudbr
```
DEVICE=cloudbr
TYPE=OVSBridge
ONBOOT=yes
HOTPLUG=no
BOOTPROT=none
DEVICETYPE=ovs
```
ifcfg-mgmt0
```
DEVICE=mgmt0
TYPE=OVSBridge
ONBOOT=yes
HOTPLUG=no
BOOTPROT=static
DEVICETYPE=ovs
IPADDR=10.67.36.200
NETMASK=255.255.252.0
GATEWAY=10.67.39.254
```
ifcfg-cloudbr0
```
DEVICE=cloudbr0
ONBOOT=yes
HOTPLUG=no
DEVICETYPE=ovs
TYPE=OVSBridge
BOOTPROT=none
```
ifcfg-cloudbr1
```
DEVICE=cloudbr1
ONBOOT=yes
HOTPLUG=no
DEVICETYPE=ovs
TYPE=OVSBridge
BOOTPROT=none
```
The result:
```
# nmcli d
DEVICE TYPE STATE CONNECTION
virbr0 bridge connected (externally) virbr0
eno1 ethernet disconnected --
eno2 ethernet disconnected --
lo loopback unmanaged --
cloudbr openvswitch unmanaged --
cloudbr0 openvswitch unmanaged --
cloudbr1 openvswitch unmanaged --
mgmt0 openvswitch unmanaged --
ovs-system openvswitch unmanaged --
virbr0-nic tun unmanaged --
ip_vti0 vti unmanaged --
# nmcli c
NAME UUID TYPE DEVICE
virbr0 0f5b515b-1b16-4137-82fd-5cfb9dd38bd3 bridge virbr0
eno1 22c22720-553e-4c78-9f8a-5873805a0842 ethernet --
eno2 9652cf18-0c29-4100-b962-424aca932852 ethernet --
# ovs-vsctl show
8f14de15-de35-4934-8f6d-c6eff0995af9
Bridge cloudbr
Port "eno1"
Interface "eno1"
Port "mgmt0"
tag: 136
Interface "mgmt0"
type: internal
Port "cloudbr1"
tag: 501
Interface "cloudbr1"
type: internal
Port "cloudbr0"
tag: 291
Interface "cloudbr0"
type: internal
Port cloudbr
trunks: [136, 291, 501]
Interface cloudbr
type: internal
ovs_version: "2.12.0"
```
The openvswitch status
```
systemctl status openvswitch
● openvswitch.service - Open vSwitch
Loaded: loaded (/usr/lib/systemd/system/openvswitch.service; enabled; vendor preset: disabled)
Active: active (exited) since Mon 2021-09-06 18:07:01 CST; 3min 27s ago
Process: 12375 ExecStop=/bin/true (code=exited, status=0/SUCCESS)
Process: 12686 ExecStart=/bin/true (code=exited, status=0/SUCCESS)
Main PID: 12686 (code=exited, status=0/SUCCESS)
Tasks: 0 (limit: 3355442)
Memory: 0B
CGroup: /system.slice/openvswitch.service
Sep 06 18:07:01 wqdccls006.cn.infra systemd[1]: Starting Open vSwitch...
Sep 06 18:07:01 wqdccls006.cn.infra systemd[1]: Started Open vSwitch.
```
The openvswitch's log is:
1. ovsdb-server.log
```
2021-09-06T10:07:01.648Z|00001|vlog|INFO|opened log file /var/log/openvswitch/ovsdb-server.log
2021-09-06T10:07:01.652Z|00002|ovsdb_server|INFO|ovsdb-server (Open vSwitch) 2.12.0
2021-09-06T10:07:01.656Z|00003|jsonrpc|WARN|unix#0: receive error: Connection reset by peer
2021-09-06T10:07:01.656Z|00004|reconnect|WARN|unix#0: connection dropped (Connection reset by peer)
2021-09-06T10:07:01.670Z|00005|jsonrpc|WARN|unix#2: receive error: Connection reset by peer
2021-09-06T10:07:01.670Z|00006|reconnect|WARN|unix#2: connection dropped (Connection reset by peer)
2021-09-06T10:07:01.794Z|00007|jsonrpc|WARN|unix#5: receive error: Connection reset by peer
2021-09-06T10:07:01.794Z|00008|reconnect|WARN|unix#5: connection dropped (Connection reset by peer)
```
2. ovs-vswitchd.log
```
2021-09-06T10:07:01.345Z|00035|bridge|INFO|bridge cloudbr: deleted interface cloudbr on port 65534
2021-09-06T10:07:01.345Z|00036|bridge|INFO|bridge cloudbr: deleted interface eno1 on port 1
2021-09-06T10:07:01.345Z|00037|bridge|INFO|bridge cloudbr: deleted interface cloudbr1 on port 4
2021-09-06T10:07:01.345Z|00038|bridge|INFO|bridge cloudbr: deleted interface cloudbr0 on port 3
2021-09-06T10:07:01.345Z|00039|bridge|INFO|bridge cloudbr: deleted interface mgmt0 on port 2
2021-09-06T10:07:01.352Z|00001|ofproto_dpif_xlate(handler66)|WARN|received packet on unknown port 1 on bridge cloudbr while processing arp,in_port=1,dl_vlan=136,dl_vlan_pcp=1,vlan_tci1=0x0000,dl_src=00:50:56:ae:6d:67,dl_dst=ff:ff:ff:ff:ff:ff,arp_spa=10.67.39.112,arp_tpa=10.67.39.104,arp_op=1,arp_sha=00:50:56:ae:6d:67,arp_tha=00:00:00:00:00:00
2021-09-06T10:07:01.354Z|00002|ofproto_dpif_xlate(handler66)|WARN|received packet on unknown port 1 on bridge cloudbr while processing tcp,in_port=1,dl_vlan=136,dl_vlan_pcp=0,vlan_tci1=0x0000,dl_src=00:de:fb:bb:15:c1,dl_dst=82:95:f3:d0:06:43,nw_src=10.30.149.88,nw_dst=10.67.36.200,nw_tos=0,nw_ecn=0,nw_ttl=123,tp_src=54279,tp_dst=22,tcp_flags=ack
2021-09-06T10:07:01.371Z|00001|ofproto_dpif_upcall(handler98)|INFO|Dropped 3 log messages in last 2505 seconds (most recently, 2505 seconds ago) due to excessive rate
2021-09-06T10:07:01.371Z|00002|ofproto_dpif_upcall(handler98)|INFO|received packet on unassociated datapath port 2
2021-09-06T10:07:01.716Z|00001|vlog|INFO|opened log file /var/log/openvswitch/ovs-vswitchd.log
2021-09-06T10:07:01.720Z|00002|ovs_numa|INFO|Discovered 16 CPU cores on NUMA node 0
2021-09-06T10:07:01.720Z|00003|ovs_numa|INFO|Discovered 16 CPU cores on NUMA node 1
2021-09-06T10:07:01.720Z|00004|ovs_numa|INFO|Discovered 2 NUMA nodes and 32 CPU cores
2021-09-06T10:07:01.720Z|00005|reconnect|INFO|unix:/var/run/openvswitch/db.sock: connecting...
2021-09-06T10:07:01.720Z|00006|reconnect|INFO|unix:/var/run/openvswitch/db.sock: connected
2021-09-06T10:07:01.724Z|00007|ofproto_dpif|INFO|system@ovs-system: Datapath supports recirculation
2021-09-06T10:07:01.724Z|00008|ofproto_dpif|INFO|system@ovs-system: VLAN header stack length probed as 2
2021-09-06T10:07:01.724Z|00009|ofproto_dpif|INFO|system@ovs-system: MPLS label stack length probed as 1
2021-09-06T10:07:01.724Z|00010|ofproto_dpif|INFO|system@ovs-system: Datapath supports truncate action
2021-09-06T10:07:01.724Z|00011|ofproto_dpif|INFO|system@ovs-system: Datapath supports unique flow ids
2021-09-06T10:07:01.724Z|00012|ofproto_dpif|INFO|system@ovs-system: Datapath supports clone action
2021-09-06T10:07:01.724Z|00013|ofproto_dpif|INFO|system@ovs-system: Max sample nesting level probed as 10
2021-09-06T10:07:01.724Z|00014|ofproto_dpif|INFO|system@ovs-system: Datapath supports eventmask in conntrack action
2021-09-06T10:07:01.724Z|00015|ofproto_dpif|INFO|system@ovs-system: Datapath supports ct_clear action
2021-09-06T10:07:01.724Z|00016|ofproto_dpif|INFO|system@ovs-system: Max dp_hash algorithm probed to be 0
2021-09-06T10:07:01.724Z|00017|ofproto_dpif|INFO|system@ovs-system: Datapath supports check_pkt_len action
2021-09-06T10:07:01.724Z|00018|ofproto_dpif|INFO|system@ovs-system: Datapath supports ct_state
2021-09-06T10:07:01.724Z|00019|ofproto_dpif|INFO|system@ovs-system: Datapath supports ct_zone
2021-09-06T10:07:01.724Z|00020|ofproto_dpif|INFO|system@ovs-system: Datapath supports ct_mark
2021-09-06T10:07:01.725Z|00021|ofproto_dpif|INFO|system@ovs-system: Datapath supports ct_label
2021-09-06T10:07:01.725Z|00022|ofproto_dpif|INFO|system@ovs-system: Datapath supports ct_state_nat
2021-09-06T10:07:01.725Z|00023|ofproto_dpif|INFO|system@ovs-system: Datapath supports ct_orig_tuple
2021-09-06T10:07:01.725Z|00024|ofproto_dpif|INFO|system@ovs-system: Datapath supports ct_orig_tuple6
```
##### EXPECTED RESULTS
The cloudstack work node's network works fine.
##### ACTUAL RESULTS
The cloudstack work node has no IP as configuration, the openvswitch status is not ok
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] weizhouapache commented on issue #5409: The cloudstack work node network problem (Oracle 8)
Posted by GitBox <gi...@apache.org>.
weizhouapache commented on issue #5409:
URL: https://github.com/apache/cloudstack/issues/5409#issuecomment-914088595
@xuanyuanaosheng
since you use fake bridges, can you add `OVS_OPTIONS="cloudbr <vlantag>` in ifcfg-mgmt0 , ifcfg-cloudbr0 and ifcfg-cloudbr1 ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] xuanyuanaosheng closed issue #5409: How to configure the OpenVswitch using Single network card on Centos 8 Or Oracle 8?
Posted by GitBox <gi...@apache.org>.
xuanyuanaosheng closed issue #5409:
URL: https://github.com/apache/cloudstack/issues/5409
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] xuanyuanaosheng edited a comment on issue #5409: How to configure the OpenVswitch using Single network card on Centos 8 Or Oracle 8?
Posted by GitBox <gi...@apache.org>.
xuanyuanaosheng edited a comment on issue #5409:
URL: https://github.com/apache/cloudstack/issues/5409#issuecomment-918091036
I reinstall this server using the same system.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] xuanyuanaosheng commented on issue #5409: How to configure The OpenVswitch using Single network card On Centos 8 Or Oracle8?
Posted by GitBox <gi...@apache.org>.
xuanyuanaosheng commented on issue #5409:
URL: https://github.com/apache/cloudstack/issues/5409#issuecomment-918091036
I reinstall the system.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] rhtyd commented on issue #5409: The cloudstack work node network problem (Oracle 8)
Posted by GitBox <gi...@apache.org>.
rhtyd commented on issue #5409:
URL: https://github.com/apache/cloudstack/issues/5409#issuecomment-913673313
Hi @xuanyuanaosheng I'm not sure if your config if wrong, have you tested this against CentOS7 or Oracle Linux 7? cc @nvazquez @weizhouapache
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] weizhouapache commented on issue #5409: The cloudstack work node network problem (Oracle 8)
Posted by GitBox <gi...@apache.org>.
weizhouapache commented on issue #5409:
URL: https://github.com/apache/cloudstack/issues/5409#issuecomment-915825369
@xuanyuanaosheng
have you solved the issue ?
can you post the result of following commands ?
ip addr show cloudbr
ip addr show mgmt0
ifup cloudbr
ifup mgmt0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] xuanyuanaosheng edited a comment on issue #5409: The cloudstack work node network problem (Oracle 8)
Posted by GitBox <gi...@apache.org>.
xuanyuanaosheng edited a comment on issue #5409:
URL: https://github.com/apache/cloudstack/issues/5409#issuecomment-914013939
@rhtyd I have not tested on Oracle Linux 7, I will do some test. Please give some advices on CentOS 8 or Oracle Linux 8.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] xuanyuanaosheng commented on issue #5409: How to configure the OpenVswitch using Single network card on Centos 8 Or Oracle 8?
Posted by GitBox <gi...@apache.org>.
xuanyuanaosheng commented on issue #5409:
URL: https://github.com/apache/cloudstack/issues/5409#issuecomment-918834964
1. https://github.com/apache/cloudstack/issues/5426
2. https://github.com/apache/cloudstack/issues/5443
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] weizhouapache commented on issue #5409: The cloudstack work node network problem (Oracle 8)
Posted by GitBox <gi...@apache.org>.
weizhouapache commented on issue #5409:
URL: https://github.com/apache/cloudstack/issues/5409#issuecomment-916722659
@xuanyuanaosheng
I think the problem is that the interfaces (cloudbr, mgmt0) are not brought up automatically.
you probably need to create a script and systemd service to bring up the interfaces when vm starts.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] xuanyuanaosheng commented on issue #5409: The cloudstack work node network problem (Oracle 8)
Posted by GitBox <gi...@apache.org>.
xuanyuanaosheng commented on issue #5409:
URL: https://github.com/apache/cloudstack/issues/5409#issuecomment-914013939
@rhtyd I have not tested on Oracle Linux 7, I will do some test.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [cloudstack] weizhouapache commented on issue #5409: How to configure the OpenVswitch using Single network card on Centos 8 Or Oracle 8?
Posted by GitBox <gi...@apache.org>.
weizhouapache commented on issue #5409:
URL: https://github.com/apache/cloudstack/issues/5409#issuecomment-918238128
@xuanyuanaosheng
have you made it work without bond in centos 8 ?
I saw your issue in #5443.If this works (no bonding), #5443 might be a compatibility issue between NetworkManager and OVS/bond support.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@cloudstack.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org