You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Rudraneel chakraborty <ru...@gmail.com> on 2016/06/24 00:37:44 UTC
Worker process start time
Hi
I am observing that my worker processes take a little over 15 seconds to
start up (a single worker process with 6 executors with no ackers). Do you
guys find it normal?
Can i speed things up??
--
Rudraneel Chakraborty
Carleton University Real Time and Distributed Systems Reserach
Re: Worker process start time
Posted by Rudraneel chakraborty <ru...@gmail.com>.
I am using kafkaspouts. Actually i am writing a custom scheduler and
observing that whenever i assign some executors to a worker slot, the slot
starts after 15/20 seconds. I wanted to know usually what could be an ideal
time for the worker processes to start
On Monday, 27 June 2016, Spico Florin <sp...@gmail.com> wrote:
> Hi!
> What kind of connections (spout, bolt) to external system do you have?
> Are you connecting to other external systems (databases, distributed
> message systems).
> If this is the case, please have a look what time do you need to connect
> to them.
> Regards,
> Florin
>
> On Fri, Jun 24, 2016 at 4:50 PM, Rudraneel chakraborty <
> rudraneel.chakraborty@gmail.com
> <javascript:_e(%7B%7D,'cvml','rudraneel.chakraborty@gmail.com');>> wrote:
>
>> My storm configuration is v1 3 nodes each with 2 core and 2gb rab
>>
>>
>> On Friday, 24 June 2016, Jungtaek Lim <kabhwan@gmail.com
>> <javascript:_e(%7B%7D,'cvml','kabhwan@gmail.com');>> wrote:
>>
>>> Hi Rudraneel,
>>>
>>> What's your Storm version and how cluster is configured?
>>>
>>> Thanks,
>>> Jungtaek Lim (HeartSaVioR)
>>>
>>> 2016년 6월 24일 (금) 오전 9:37, Rudraneel chakraborty <
>>> rudraneel.chakraborty@gmail.com>님이 작성:
>>>
>>>> Hi
>>>>
>>>> I am observing that my worker processes take a little over 15 seconds
>>>> to start up (a single worker process with 6 executors with no ackers). Do
>>>> you guys find it normal?
>>>>
>>>> Can i speed things up??
>>>>
>>>>
>>>> --
>>>> Rudraneel Chakraborty
>>>> Carleton University Real Time and Distributed Systems Reserach
>>>>
>>>>
>>
>> --
>> Rudraneel Chakraborty
>> Carleton University Real Time and Distributed Systems Reserach
>>
>>
>
--
Rudraneel Chakraborty
Carleton University Real Time and Distributed Systems Reserach
Re: Worker process start time
Posted by Spico Florin <sp...@gmail.com>.
Hi!
What kind of connections (spout, bolt) to external system do you have?
Are you connecting to other external systems (databases, distributed
message systems).
If this is the case, please have a look what time do you need to connect
to them.
Regards,
Florin
On Fri, Jun 24, 2016 at 4:50 PM, Rudraneel chakraborty <
rudraneel.chakraborty@gmail.com> wrote:
> My storm configuration is v1 3 nodes each with 2 core and 2gb rab
>
>
> On Friday, 24 June 2016, Jungtaek Lim <ka...@gmail.com> wrote:
>
>> Hi Rudraneel,
>>
>> What's your Storm version and how cluster is configured?
>>
>> Thanks,
>> Jungtaek Lim (HeartSaVioR)
>>
>> 2016년 6월 24일 (금) 오전 9:37, Rudraneel chakraborty <
>> rudraneel.chakraborty@gmail.com>님이 작성:
>>
>>> Hi
>>>
>>> I am observing that my worker processes take a little over 15 seconds to
>>> start up (a single worker process with 6 executors with no ackers). Do you
>>> guys find it normal?
>>>
>>> Can i speed things up??
>>>
>>>
>>> --
>>> Rudraneel Chakraborty
>>> Carleton University Real Time and Distributed Systems Reserach
>>>
>>>
>
> --
> Rudraneel Chakraborty
> Carleton University Real Time and Distributed Systems Reserach
>
>
Re: Worker process start time
Posted by Rudraneel chakraborty <ru...@gmail.com>.
My storm configuration is v1 3 nodes each with 2 core and 2gb rab
On Friday, 24 June 2016, Jungtaek Lim <ka...@gmail.com> wrote:
> Hi Rudraneel,
>
> What's your Storm version and how cluster is configured?
>
> Thanks,
> Jungtaek Lim (HeartSaVioR)
>
> 2016년 6월 24일 (금) 오전 9:37, Rudraneel chakraborty <
> rudraneel.chakraborty@gmail.com
> <javascript:_e(%7B%7D,'cvml','rudraneel.chakraborty@gmail.com');>>님이 작성:
>
>> Hi
>>
>> I am observing that my worker processes take a little over 15 seconds to
>> start up (a single worker process with 6 executors with no ackers). Do you
>> guys find it normal?
>>
>> Can i speed things up??
>>
>>
>> --
>> Rudraneel Chakraborty
>> Carleton University Real Time and Distributed Systems Reserach
>>
>>
--
Rudraneel Chakraborty
Carleton University Real Time and Distributed Systems Reserach
Re: Worker process start time
Posted by Jungtaek Lim <ka...@gmail.com>.
Hi Rudraneel,
What's your Storm version and how cluster is configured?
Thanks,
Jungtaek Lim (HeartSaVioR)
2016년 6월 24일 (금) 오전 9:37, Rudraneel chakraborty <
rudraneel.chakraborty@gmail.com>님이 작성:
> Hi
>
> I am observing that my worker processes take a little over 15 seconds to
> start up (a single worker process with 6 executors with no ackers). Do you
> guys find it normal?
>
> Can i speed things up??
>
>
> --
> Rudraneel Chakraborty
> Carleton University Real Time and Distributed Systems Reserach
>
>