You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@mesos.apache.org by "DiGiorgio, Mr. Rinaldo S." <rd...@pace.edu> on 2016/05/20 11:49:52 UTC
Are multiple settings required for ephemeral ports on the mesos
agent?
Hi,
I have configured some Linux machines 4 of them to run several thousand tests which use many different ports.
I have change the ephemeral port range to:
net.ipv4.ip_local_port_range = 61000 65500
I am not using network isolation, since it doesn’t appear to be supported on OSX.
Does the mesos-slave agent honor the ephemeral setting of the OS it is running by design? It appears to.
Do I need to explicitly set any param for the mesos agent?
Initial observation using netstat shows expected results.
tcp 0 0 11.111.111.111:65438 11.139.163.164:80 TIME_WAIT
tcp 0 0 11.111.111.111:65434 11.139.163.164:80 TIME_WAIT
tcp 0 0 11.111.111.111:62848 11.211.178.5:389 ESTABLISHED
tcp 0 0 11.111.111.111:62180 11.111.111.111:65301 ESTABLISHED
tcp 0 0 11.111.111.111:22 11.170.254.40:50584 ESTABLISHED
tcp 0 0 11.111.111.111:65435 11.139.163.164:80 TIME_WAIT
tcp 0 0 11.111.111.111:62847 11.211.178.5:389 ESTABLISHED
tcp 0 0 169.254.182.77:12 169.254.182.76:24 ESTABLISHED
tcp 0 0 11.111.111.111:62704 11.211.178.5:389 ESTABLISHED
tcp 0 0 11.111.111.111:65067 148.87.19.20:80 TIME_WAIT
tcp 0 0 11.111.111.111:5051 11.111.111.111:62724 ESTABLISHED
tcp 0 0 11.111.111.111:65436 11.139.163.164:80 TIME_WAIT
tcp 0 0 11.111.111.111:63711 11.133.69.88:22 ESTABLISHED
tcp 0 0 11.111.111.111:65114 11.128.128.54:5050 ESTABLISHED
tcp 0 0 11.111.111.111:65068 148.87.19.20:80 TIME_WAIT
tcp 0 0 11.111.111.111:832 11.211.137.103:2049 ESTABLISHED
tcp 0 0 11.111.111.111:62724 11.111.111.111:5051 ESTABLISHED
tcp 0 0 11.111.111.111:5051 11.128.128.54:52107 ESTABLISHED
tcp 0 0 11.111.111.111:62895 11.242.12.81:80 TIME_WAIT
tcp 0 36 11.111.111.111:22 11.154.185.216:52468 ESTABLISHED
tcp 0 0 11.111.111.111:65066 148.87.19.20:80 TIME_WAIT
tcp 0 0 11.111.111.111:868 11.211.137.101:2049 ESTABLISHED
tcp 0 0 11.111.111.111:62001 11.128.128.94:58906 ESTABLISHED
tcp 0 0 11.111.111.111:65437 11.139.163.164:80 TIME_WAIT
Re: Are multiple settings required for ephemeral ports on the mesos agent?
Posted by haosdent <ha...@gmail.com>.
Thank you for your explanation, for osx. There are two config item to
specify the free random port range. net.inet.ip.portrange.first and
net.inet.ip.portrange.last You could use sysctl to set them as well.
On Fri, May 20, 2016 at 9:46 PM, DiGiorgio, Mr. Rinaldo S. <
rdigiorgio@pace.edu> wrote:
>
> On May 20, 2016, at 09:38, haosdent <ha...@gmail.com> wrote:
>
> Sorry, confusing here, you mentioned that you use OSX.
>
> >I am not using network isolation, since it doesn’t appear to be
> supported on OSX.
>
> Which conflict with
>
> >I have configured some Linux machines 4 of them to run several
>
> So you use OS X or Linux?
>
>
> I use both I have 300 CPUs a mix of Linux and OSX for the evaluation
> system 1 TB of Ram and about 10 TB of disk over 15-20 OSX and Linux
> machines.
>
>
> For ephemeral communication port in mesos, it bind to 0 and Linux would
> assign a free random port between ip_local_port_range.
>
>
> Thanks for the confirmation. I am trying to track down port conflict
> issues and I want to rule out mesos completely.
>
> So I do not have to set any specific Mesos settings. Mesos behaves well
> and uses the OS for all ports.
>
> OSX has slightly different settings. I want to get Linux stable first and
> then deal with OSX.
>
>
> Thanks
>
>
> On Fri, May 20, 2016 at 7:49 PM, DiGiorgio, Mr. Rinaldo S. <
> rdigiorgio@pace.edu> wrote:
>
>> Hi,
>>
>> I have configured some Linux machines 4 of them to run several thousand
>> tests which use many different ports.
>>
>> I have change the ephemeral port range to:
>>
>> *net.ipv4.ip_local_port_range = 61000 65500*
>>
>> I am not using network isolation, since it doesn’t appear to be supported
>> on OSX.
>> Does the mesos-slave agent honor the ephemeral setting of the OS it is
>> running by design? It appears to.
>>
>> Do I need to explicitly set any param for the mesos agent?
>>
>> Initial observation using netstat shows expected results.
>>
>> tcp 0 0 11.111.111.111:65438 11.139.163.164:80
>> TIME_WAIT
>> tcp 0 0 11.111.111.111:65434 11.139.163.164:80
>> TIME_WAIT
>> tcp 0 0 11.111.111.111:62848 11.211.178.5:389
>> ESTABLISHED
>> tcp 0 0 11.111.111.111:62180 11.111.111.111:65301
>> ESTABLISHED
>> tcp 0 0 11.111.111.111:22 11.170.254.40:50584
>> ESTABLISHED
>> tcp 0 0 11.111.111.111:65435 11.139.163.164:80
>> TIME_WAIT
>> tcp 0 0 11.111.111.111:62847 11.211.178.5:389
>> ESTABLISHED
>> tcp 0 0 169.254.182.77:12 169.254.182.76:24
>> ESTABLISHED
>> tcp 0 0 11.111.111.111:62704 11.211.178.5:389
>> ESTABLISHED
>> tcp 0 0 11.111.111.111:65067 148.87.19.20:80
>> <http://148.87.19.20/> TIME_WAIT
>> tcp 0 0 11.111.111.111:5051 11.111.111.111:62724
>> ESTABLISHED
>> tcp 0 0 11.111.111.111:65436 11.139.163.164:80
>> TIME_WAIT
>> tcp 0 0 11.111.111.111:63711 11.133.69.88:22
>> ESTABLISHED
>> tcp 0 0 11.111.111.111:65114 11.128.128.54:5050
>> ESTABLISHED
>> tcp 0 0 11.111.111.111:65068 148.87.19.20:80
>> <http://148.87.19.20/> TIME_WAIT
>> tcp 0 0 11.111.111.111:832 11.211.137.103:2049
>> ESTABLISHED
>> tcp 0 0 11.111.111.111:62724 11.111.111.111:5051
>> ESTABLISHED
>> tcp 0 0 11.111.111.111:5051 11.128.128.54:52107
>> ESTABLISHED
>> tcp 0 0 11.111.111.111:62895 11.242.12.81:80
>> TIME_WAIT
>> tcp 0 36 11.111.111.111:22 11.154.185.216:52468
>> ESTABLISHED
>> tcp 0 0 11.111.111.111:65066 148.87.19.20:80
>> <http://148.87.19.20/> TIME_WAIT
>> tcp 0 0 11.111.111.111:868 11.211.137.101:2049
>> ESTABLISHED
>> tcp 0 0 11.111.111.111:62001 11.128.128.94:58906
>> ESTABLISHED
>> tcp 0 0 11.111.111.111:65437 11.139.163.164:80
>> TIME_WAIT
>>
>>
>
>
> --
> Best Regards,
> Haosdent Huang
>
>
>
--
Best Regards,
Haosdent Huang
Re: Are multiple settings required for ephemeral ports on the mesos
agent?
Posted by "DiGiorgio, Mr. Rinaldo S." <rd...@pace.edu>.
On May 20, 2016, at 09:38, haosdent <ha...@gmail.com>> wrote:
Sorry, confusing here, you mentioned that you use OSX.
>I am not using network isolation, since it doesn’t appear to be supported on OSX.
Which conflict with
>I have configured some Linux machines 4 of them to run several
So you use OS X or Linux?
I use both I have 300 CPUs a mix of Linux and OSX for the evaluation system 1 TB of Ram and about 10 TB of disk over 15-20 OSX and Linux machines.
For ephemeral communication port in mesos, it bind to 0 and Linux would assign a free random port between ip_local_port_range.
Thanks for the confirmation. I am trying to track down port conflict issues and I want to rule out mesos completely.
So I do not have to set any specific Mesos settings. Mesos behaves well and uses the OS for all ports.
OSX has slightly different settings. I want to get Linux stable first and then deal with OSX.
Thanks
On Fri, May 20, 2016 at 7:49 PM, DiGiorgio, Mr. Rinaldo S. <rd...@pace.edu>> wrote:
Hi,
I have configured some Linux machines 4 of them to run several thousand tests which use many different ports.
I have change the ephemeral port range to:
net.ipv4.ip_local_port_range = 61000 65500
I am not using network isolation, since it doesn’t appear to be supported on OSX.
Does the mesos-slave agent honor the ephemeral setting of the OS it is running by design? It appears to.
Do I need to explicitly set any param for the mesos agent?
Initial observation using netstat shows expected results.
tcp 0 0 11.111.111.111:65438<http://11.111.111.111:65438/> 11.139.163.164:80 TIME_WAIT
tcp 0 0 11.111.111.111:65434<http://11.111.111.111:65434/> 11.139.163.164:80 TIME_WAIT
tcp 0 0 11.111.111.111:62848<http://11.111.111.111:62848/> 11.211.178.5:389 ESTABLISHED
tcp 0 0 11.111.111.111:62180<http://11.111.111.111:62180/> 11.111.111.111:65301<http://11.111.111.111:65301/> ESTABLISHED
tcp 0 0 11.111.111.111:22<http://11.111.111.111:22/> 11.170.254.40:50584 ESTABLISHED
tcp 0 0 11.111.111.111:65435<http://11.111.111.111:65435/> 11.139.163.164:80 TIME_WAIT
tcp 0 0 11.111.111.111:62847<http://11.111.111.111:62847/> 11.211.178.5:389 ESTABLISHED
tcp 0 0 169.254.182.77:12<http://169.254.182.77:12/> 169.254.182.76:24<http://169.254.182.76:24/> ESTABLISHED
tcp 0 0 11.111.111.111:62704<http://11.111.111.111:62704/> 11.211.178.5:389 ESTABLISHED
tcp 0 0 11.111.111.111:65067<http://11.111.111.111:65067/> 148.87.19.20:80<http://148.87.19.20/> TIME_WAIT
tcp 0 0 11.111.111.111:5051<http://11.111.111.111:5051/> 11.111.111.111:62724<http://11.111.111.111:62724/> ESTABLISHED
tcp 0 0 11.111.111.111:65436<http://11.111.111.111:65436/> 11.139.163.164:80 TIME_WAIT
tcp 0 0 11.111.111.111:63711<http://11.111.111.111:63711/> 11.133.69.88:22 ESTABLISHED
tcp 0 0 11.111.111.111:65114<http://11.111.111.111:65114/> 11.128.128.54:5050 ESTABLISHED
tcp 0 0 11.111.111.111:65068<http://11.111.111.111:65068/> 148.87.19.20:80<http://148.87.19.20/> TIME_WAIT
tcp 0 0 11.111.111.111:832<http://11.111.111.111:832/> 11.211.137.103:2049 ESTABLISHED
tcp 0 0 11.111.111.111:62724<http://11.111.111.111:62724/> 11.111.111.111:5051<http://11.111.111.111:5051/> ESTABLISHED
tcp 0 0 11.111.111.111:5051<http://11.111.111.111:5051/> 11.128.128.54:52107 ESTABLISHED
tcp 0 0 11.111.111.111:62895<http://11.111.111.111:62895/> 11.242.12.81:80 TIME_WAIT
tcp 0 36 11.111.111.111:22<http://11.111.111.111:22/> 11.154.185.216:52468 ESTABLISHED
tcp 0 0 11.111.111.111:65066<http://11.111.111.111:65066/> 148.87.19.20:80<http://148.87.19.20/> TIME_WAIT
tcp 0 0 11.111.111.111:868<http://11.111.111.111:868/> 11.211.137.101:2049 ESTABLISHED
tcp 0 0 11.111.111.111:62001<http://11.111.111.111:62001/> 11.128.128.94:58906 ESTABLISHED
tcp 0 0 11.111.111.111:65437<http://11.111.111.111:65437/> 11.139.163.164:80 TIME_WAIT
--
Best Regards,
Haosdent Huang
Re: Are multiple settings required for ephemeral ports on the mesos agent?
Posted by haosdent <ha...@gmail.com>.
Sorry, confusing here, you mentioned that you use OSX.
>I am not using network isolation, since it doesn’t appear to be supported
on OSX.
Which conflict with
>I have configured some Linux machines 4 of them to run several
So you use OS X or Linux?
For ephemeral communication port in mesos, it bind to 0 and Linux would
assign a free random port between ip_local_port_range.
On Fri, May 20, 2016 at 7:49 PM, DiGiorgio, Mr. Rinaldo S. <
rdigiorgio@pace.edu> wrote:
> Hi,
>
> I have configured some Linux machines 4 of them to run several thousand
> tests which use many different ports.
>
> I have change the ephemeral port range to:
>
> *net.ipv4.ip_local_port_range = 61000 65500*
>
> I am not using network isolation, since it doesn’t appear to be supported
> on OSX.
> Does the mesos-slave agent honor the ephemeral setting of the OS it is
> running by design? It appears to.
>
> Do I need to explicitly set any param for the mesos agent?
>
> Initial observation using netstat shows expected results.
>
> tcp 0 0 11.111.111.111:65438 11.139.163.164:80
> TIME_WAIT
> tcp 0 0 11.111.111.111:65434 11.139.163.164:80
> TIME_WAIT
> tcp 0 0 11.111.111.111:62848 11.211.178.5:389
> ESTABLISHED
> tcp 0 0 11.111.111.111:62180 11.111.111.111:65301
> ESTABLISHED
> tcp 0 0 11.111.111.111:22 11.170.254.40:50584
> ESTABLISHED
> tcp 0 0 11.111.111.111:65435 11.139.163.164:80
> TIME_WAIT
> tcp 0 0 11.111.111.111:62847 11.211.178.5:389
> ESTABLISHED
> tcp 0 0 169.254.182.77:12 169.254.182.76:24
> ESTABLISHED
> tcp 0 0 11.111.111.111:62704 11.211.178.5:389
> ESTABLISHED
> tcp 0 0 11.111.111.111:65067 148.87.19.20:80
> TIME_WAIT
> tcp 0 0 11.111.111.111:5051 11.111.111.111:62724
> ESTABLISHED
> tcp 0 0 11.111.111.111:65436 11.139.163.164:80
> TIME_WAIT
> tcp 0 0 11.111.111.111:63711 11.133.69.88:22
> ESTABLISHED
> tcp 0 0 11.111.111.111:65114 11.128.128.54:5050
> ESTABLISHED
> tcp 0 0 11.111.111.111:65068 148.87.19.20:80
> TIME_WAIT
> tcp 0 0 11.111.111.111:832 11.211.137.103:2049
> ESTABLISHED
> tcp 0 0 11.111.111.111:62724 11.111.111.111:5051
> ESTABLISHED
> tcp 0 0 11.111.111.111:5051 11.128.128.54:52107
> ESTABLISHED
> tcp 0 0 11.111.111.111:62895 11.242.12.81:80
> TIME_WAIT
> tcp 0 36 11.111.111.111:22 11.154.185.216:52468
> ESTABLISHED
> tcp 0 0 11.111.111.111:65066 148.87.19.20:80
> TIME_WAIT
> tcp 0 0 11.111.111.111:868 11.211.137.101:2049
> ESTABLISHED
> tcp 0 0 11.111.111.111:62001 11.128.128.94:58906
> ESTABLISHED
> tcp 0 0 11.111.111.111:65437 11.139.163.164:80
> TIME_WAIT
>
>
--
Best Regards,
Haosdent Huang