You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by giraffeg forestg <gi...@gmail.com> on 2014/06/23 17:51:49 UTC
Performance degrades when I use the StaticNAT in Virtual Router. Is
there a way to speed up?
Hi All
Performance degrades when I use the StaticNAT in Virtual Router. Is there a
way to speed up?
Environment:
Apache CloudStack 4.3.0
SystemVM:systemvm64template-2014-01-14-master-xen.vhd
HyperVisor:XenServer 6.2SP1
Network:1Gbps (Catalyst3550-12G)
System Offering:
CPU:2000 MHz
Memory:2048 MB
Network Rate:10000 MB
Network Offering:
Network Rate:10000 MB
(Case-1, Direct Access) Good
PhysicalServer--->VM Instance1
# ./nuttcp 192.168.11.2
1122.3928 MB / 10.07 sec = 935.0451 Mbps 4 %TX 59 %RX 0 retrans 0.93
msRTT
(Case-2, VirtualRouter SourceNAT) Good
VM Instance2--->VirtualRouter--->PhysicalServer
# ./nuttcp 192.168.11.248
1123.1641 MB / 10.03 sec = 938.9331 Mbps 12 %TX 15 %RX 0 retrans 3.11
msRTT
(Case-3, VirtualRouter StaticNAT) Not Good
PhysicalServer--->VirtualRouter--->VM Instance2
# ./nuttcp 192.168.11.173
738.0000 MB / 10.01 sec = 618.6374 Mbps 2 %TX 48 %RX 0 retrans 2.84
msRTT
Thanks.
--------------------------
Satoru Nakaya
Re: Performance degrades when I use the StaticNAT in Virtual Router.
Is there a way to speed up?
Posted by giraffeg forestg <gi...@gmail.com>.
Hi All
Solved.
I gave the performance of the hardware. Speed of StaticNAT for the
virtual router is faster now.
Performance of the hardware seems to have been insufficient.
(VirtualRouter StaticNAT)
PhysicalServer--->VirtualRouter--->VM Instance
--Before
CPU
AMD Opteron Processor 3250 HE 2.5GHz
Disk
7,200rpm SATA
# ./nuttcp 192.168.11.173
738.0000 MB / 10.01 sec = 618.6374 Mbps 2 %TX 48 %RX 0 retrans 2.84
--After
CPU
Xeon X5260 3.33GHz
Disk
15,000rpm SAS
# ./nuttcp 192.168.11.234
1051.9286 MB / 10.06 sec = 876.9177 Mbps 3 %TX 27 %RX 0 retrans 0.38
msRTT
Thanks.
--------------------------
Satoru Nakaya
2014-06-24 3:34 GMT+09:00 giraffeg forestg <gi...@gmail.com>:
> Thank you for advice. :)
>
> # Isolation based on Security Groups in Advanced Zone
> #
> https://cwiki.apache.org/confluence/display/CLOUDSTACK/Security+Groups+Isolation+in+Advanced+Zone
>
> However, I'm want to improve the speed of StaticNAT in Virtual Router.
>
> Trial-1:linux kernel parameter tuning of virural router
>
> /etc/sysctl.conf
>
> net.core.rmem_max = 16777216
> net.core.wmem_max = 16777216
> net.ipv4.tcp_rmem = 4096 87380 16777216
> net.ipv4.tcp_wmem = 4096 65536 16777216
>
> -> Did not improve performance. :(
>
>
> Trial-2:disabling TSO of virural router
>
> /ethtool -K eth0 tso off
> /ethtool -K eth2 tso off
>
> -> Did not improve performance. :(
>
>
> Thanks.
>
> --------------------------
> Satoru Nakaya
>
>
>
> 2014-06-24 1:46 GMT+09:00 Nux! <nu...@li.nux.ro>:
>
>> Depending on your circumstances, you could move to an Advanced Zone with
>> Security Groups, this way traffic will bypass the Virtual Router and go
>> directly to the VMs.
>>
>> HTH
>> Lucian
>>
>>
>> --
>> Sent from the Delta quadrant using Borg technology!
>>
>> Nux!
>> www.nux.ro
>>
>>
>> ----- Original Message -----
>> From: "giraffeg forestg" <gi...@gmail.com>
>> To: users@cloudstack.apache.org
>> Sent: Monday, 23 June, 2014 4:51:49 PM
>> Subject: Performance degrades when I use the StaticNAT in Virtual Router.
>> Is there a way to speed up?
>>
>> Hi All
>>
>> Performance degrades when I use the StaticNAT in Virtual Router. Is there
>> a
>> way to speed up?
>>
>> Environment:
>> Apache CloudStack 4.3.0
>> SystemVM:systemvm64template-2014-01-14-master-xen.vhd
>> HyperVisor:XenServer 6.2SP1
>> Network:1Gbps (Catalyst3550-12G)
>>
>> System Offering:
>> CPU:2000 MHz
>> Memory:2048 MB
>> Network Rate:10000 MB
>>
>> Network Offering:
>> Network Rate:10000 MB
>>
>>
>> (Case-1, Direct Access) Good
>> PhysicalServer--->VM Instance1
>> # ./nuttcp 192.168.11.2
>> 1122.3928 MB / 10.07 sec = 935.0451 Mbps 4 %TX 59 %RX 0 retrans 0.93
>> msRTT
>>
>>
>> (Case-2, VirtualRouter SourceNAT) Good
>> VM Instance2--->VirtualRouter--->PhysicalServer
>> # ./nuttcp 192.168.11.248
>> 1123.1641 MB / 10.03 sec = 938.9331 Mbps 12 %TX 15 %RX 0 retrans 3.11
>> msRTT
>>
>>
>> (Case-3, VirtualRouter StaticNAT) Not Good
>> PhysicalServer--->VirtualRouter--->VM Instance2
>> # ./nuttcp 192.168.11.173
>> 738.0000 MB / 10.01 sec = 618.6374 Mbps 2 %TX 48 %RX 0 retrans 2.84
>> msRTT
>>
>>
>> Thanks.
>>
>> --------------------------
>> Satoru Nakaya
>>
>
>
Re: Performance degrades when I use the StaticNAT in Virtual Router.
Is there a way to speed up?
Posted by giraffeg forestg <gi...@gmail.com>.
Thank you for advice. :)
# Isolation based on Security Groups in Advanced Zone
#
https://cwiki.apache.org/confluence/display/CLOUDSTACK/Security+Groups+Isolation+in+Advanced+Zone
However, I'm want to improve the speed of StaticNAT in Virtual Router.
Trial-1:linux kernel parameter tuning of virural router
/etc/sysctl.conf
net.core.rmem_max = 16777216
net.core.wmem_max = 16777216
net.ipv4.tcp_rmem = 4096 87380 16777216
net.ipv4.tcp_wmem = 4096 65536 16777216
-> Did not improve performance. :(
Trial-2:disabling TSO of virural router
/ethtool -K eth0 tso off
/ethtool -K eth2 tso off
-> Did not improve performance. :(
Thanks.
--------------------------
Satoru Nakaya
2014-06-24 1:46 GMT+09:00 Nux! <nu...@li.nux.ro>:
> Depending on your circumstances, you could move to an Advanced Zone with
> Security Groups, this way traffic will bypass the Virtual Router and go
> directly to the VMs.
>
> HTH
> Lucian
>
>
> --
> Sent from the Delta quadrant using Borg technology!
>
> Nux!
> www.nux.ro
>
>
> ----- Original Message -----
> From: "giraffeg forestg" <gi...@gmail.com>
> To: users@cloudstack.apache.org
> Sent: Monday, 23 June, 2014 4:51:49 PM
> Subject: Performance degrades when I use the StaticNAT in Virtual Router.
> Is there a way to speed up?
>
> Hi All
>
> Performance degrades when I use the StaticNAT in Virtual Router. Is there a
> way to speed up?
>
> Environment:
> Apache CloudStack 4.3.0
> SystemVM:systemvm64template-2014-01-14-master-xen.vhd
> HyperVisor:XenServer 6.2SP1
> Network:1Gbps (Catalyst3550-12G)
>
> System Offering:
> CPU:2000 MHz
> Memory:2048 MB
> Network Rate:10000 MB
>
> Network Offering:
> Network Rate:10000 MB
>
>
> (Case-1, Direct Access) Good
> PhysicalServer--->VM Instance1
> # ./nuttcp 192.168.11.2
> 1122.3928 MB / 10.07 sec = 935.0451 Mbps 4 %TX 59 %RX 0 retrans 0.93
> msRTT
>
>
> (Case-2, VirtualRouter SourceNAT) Good
> VM Instance2--->VirtualRouter--->PhysicalServer
> # ./nuttcp 192.168.11.248
> 1123.1641 MB / 10.03 sec = 938.9331 Mbps 12 %TX 15 %RX 0 retrans 3.11
> msRTT
>
>
> (Case-3, VirtualRouter StaticNAT) Not Good
> PhysicalServer--->VirtualRouter--->VM Instance2
> # ./nuttcp 192.168.11.173
> 738.0000 MB / 10.01 sec = 618.6374 Mbps 2 %TX 48 %RX 0 retrans 2.84
> msRTT
>
>
> Thanks.
>
> --------------------------
> Satoru Nakaya
>
Re: Performance degrades when I use the StaticNAT in Virtual
Router. Is there a way to speed up?
Posted by Nux! <nu...@li.nux.ro>.
Depending on your circumstances, you could move to an Advanced Zone with Security Groups, this way traffic will bypass the Virtual Router and go directly to the VMs.
HTH
Lucian
--
Sent from the Delta quadrant using Borg technology!
Nux!
www.nux.ro
----- Original Message -----
From: "giraffeg forestg" <gi...@gmail.com>
To: users@cloudstack.apache.org
Sent: Monday, 23 June, 2014 4:51:49 PM
Subject: Performance degrades when I use the StaticNAT in Virtual Router. Is there a way to speed up?
Hi All
Performance degrades when I use the StaticNAT in Virtual Router. Is there a
way to speed up?
Environment:
Apache CloudStack 4.3.0
SystemVM:systemvm64template-2014-01-14-master-xen.vhd
HyperVisor:XenServer 6.2SP1
Network:1Gbps (Catalyst3550-12G)
System Offering:
CPU:2000 MHz
Memory:2048 MB
Network Rate:10000 MB
Network Offering:
Network Rate:10000 MB
(Case-1, Direct Access) Good
PhysicalServer--->VM Instance1
# ./nuttcp 192.168.11.2
1122.3928 MB / 10.07 sec = 935.0451 Mbps 4 %TX 59 %RX 0 retrans 0.93
msRTT
(Case-2, VirtualRouter SourceNAT) Good
VM Instance2--->VirtualRouter--->PhysicalServer
# ./nuttcp 192.168.11.248
1123.1641 MB / 10.03 sec = 938.9331 Mbps 12 %TX 15 %RX 0 retrans 3.11
msRTT
(Case-3, VirtualRouter StaticNAT) Not Good
PhysicalServer--->VirtualRouter--->VM Instance2
# ./nuttcp 192.168.11.173
738.0000 MB / 10.01 sec = 618.6374 Mbps 2 %TX 48 %RX 0 retrans 2.84
msRTT
Thanks.
--------------------------
Satoru Nakaya