You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by Niranda Perera <ni...@gmail.com> on 2015/03/18 06:40:21 UTC
Fixed worker ports in the spark worker
Hi all,
I see that spark server opens up random ports, especially in the workers.
is there any way to fix these ports or give an set of ports for the worker
to choose from?
cheers
--
Niranda
Re: Fixed worker ports in the spark worker
Posted by Arush Kharbanda <ar...@sigmoidanalytics.com>.
Yes
On Wed, Mar 18, 2015 at 1:35 PM, Niranda Perera <ni...@gmail.com>
wrote:
> Thanks Arush.
>
> this is governed by the conf/spark-defaults.conf config, is it?
>
> On Wed, Mar 18, 2015 at 1:30 PM, Arush Kharbanda <
> arush@sigmoidanalytics.com> wrote:
>
>> You can fix the ports in the configuration -
>>
>> http://spark.apache.org/docs/1.2.0/configuration.html#networking
>>
>> On Wed, Mar 18, 2015 at 11:10 AM, Niranda Perera <
>> niranda.perera@gmail.com> wrote:
>>
>>> Hi all,
>>>
>>> I see that spark server opens up random ports, especially in the workers.
>>>
>>> is there any way to fix these ports or give an set of ports for the
>>> worker
>>> to choose from?
>>>
>>> cheers
>>>
>>> --
>>> Niranda
>>>
>>
>>
>>
>> --
>>
>> [image: Sigmoid Analytics] <http://htmlsig.com/www.sigmoidanalytics.com>
>>
>> *Arush Kharbanda* || Technical Teamlead
>>
>> arush@sigmoidanalytics.com || www.sigmoidanalytics.com
>>
>
>
>
> --
> Niranda
>
--
[image: Sigmoid Analytics] <http://htmlsig.com/www.sigmoidanalytics.com>
*Arush Kharbanda* || Technical Teamlead
arush@sigmoidanalytics.com || www.sigmoidanalytics.com
Re: Fixed worker ports in the spark worker
Posted by Niranda Perera <ni...@gmail.com>.
Thanks Arush.
this is governed by the conf/spark-defaults.conf config, is it?
On Wed, Mar 18, 2015 at 1:30 PM, Arush Kharbanda <arush@sigmoidanalytics.com
> wrote:
> You can fix the ports in the configuration -
>
> http://spark.apache.org/docs/1.2.0/configuration.html#networking
>
> On Wed, Mar 18, 2015 at 11:10 AM, Niranda Perera <niranda.perera@gmail.com
> > wrote:
>
>> Hi all,
>>
>> I see that spark server opens up random ports, especially in the workers.
>>
>> is there any way to fix these ports or give an set of ports for the worker
>> to choose from?
>>
>> cheers
>>
>> --
>> Niranda
>>
>
>
>
> --
>
> [image: Sigmoid Analytics] <http://htmlsig.com/www.sigmoidanalytics.com>
>
> *Arush Kharbanda* || Technical Teamlead
>
> arush@sigmoidanalytics.com || www.sigmoidanalytics.com
>
--
Niranda
Re: Fixed worker ports in the spark worker
Posted by Arush Kharbanda <ar...@sigmoidanalytics.com>.
You can fix the ports in the configuration -
http://spark.apache.org/docs/1.2.0/configuration.html#networking
On Wed, Mar 18, 2015 at 11:10 AM, Niranda Perera <ni...@gmail.com>
wrote:
> Hi all,
>
> I see that spark server opens up random ports, especially in the workers.
>
> is there any way to fix these ports or give an set of ports for the worker
> to choose from?
>
> cheers
>
> --
> Niranda
>
--
[image: Sigmoid Analytics] <http://htmlsig.com/www.sigmoidanalytics.com>
*Arush Kharbanda* || Technical Teamlead
arush@sigmoidanalytics.com || www.sigmoidanalytics.com