You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Vladi Feigin <vl...@gmail.com> on 2014/08/04 20:51:38 UTC
Very high memory usage in one worker process
Hi,
Recently we observed very strange Storm behavior :
We had only one worker process, among dozens with very high memory usage (a
few gigs). We understand that this is not Java objects , since our heap
size is only 1G. We don't use field grouping in this topology so this is
not a hot spot.
Does someone had problems like that? How can we investigate the cause?
We use Storm version 0.82
Thank you in advance,
Vladi
Re: Very high memory usage in one worker process
Posted by padma priya chitturi <pa...@gmail.com>.
I guess using jsonsole or using some profiling mechanism try to identify
which part of processing in the worker is consuming more memory ...
On Tue, Aug 5, 2014 at 11:32 AM, Vladi Feigin <vl...@gmail.com> wrote:
> These are lot of logs and they are relatively large . Could you point me
> to the specific details to look for..?
> Vladi
>
>
> On Tue, Aug 5, 2014 at 8:28 AM, padma priya chitturi <
> padmapriya30@gmail.com> wrote:
>
>> Can you share with us the worker logs.
>>
>> --Padma Ch
>>
>>
>> On Tue, Aug 5, 2014 at 12:21 AM, Vladi Feigin <vl...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> Recently we observed very strange Storm behavior :
>>> We had only one worker process, among dozens with very high memory usage
>>> (a few gigs). We understand that this is not Java objects , since our heap
>>> size is only 1G. We don't use field grouping in this topology so this is
>>> not a hot spot.
>>> Does someone had problems like that? How can we investigate the cause?
>>>
>>> We use Storm version 0.82
>>> Thank you in advance,
>>> Vladi
>>>
>>>
>>
>>
>
Re: Very high memory usage in one worker process
Posted by Vladi Feigin <vl...@gmail.com>.
These are lot of logs and they are relatively large . Could you point me to
the specific details to look for..?
Vladi
On Tue, Aug 5, 2014 at 8:28 AM, padma priya chitturi <padmapriya30@gmail.com
> wrote:
> Can you share with us the worker logs.
>
> --Padma Ch
>
>
> On Tue, Aug 5, 2014 at 12:21 AM, Vladi Feigin <vl...@gmail.com> wrote:
>
>> Hi,
>>
>> Recently we observed very strange Storm behavior :
>> We had only one worker process, among dozens with very high memory usage
>> (a few gigs). We understand that this is not Java objects , since our heap
>> size is only 1G. We don't use field grouping in this topology so this is
>> not a hot spot.
>> Does someone had problems like that? How can we investigate the cause?
>>
>> We use Storm version 0.82
>> Thank you in advance,
>> Vladi
>>
>>
>
>
Re: Very high memory usage in one worker process
Posted by padma priya chitturi <pa...@gmail.com>.
Can you share with us the worker logs.
--Padma Ch
On Tue, Aug 5, 2014 at 12:21 AM, Vladi Feigin <vl...@gmail.com> wrote:
> Hi,
>
> Recently we observed very strange Storm behavior :
> We had only one worker process, among dozens with very high memory usage
> (a few gigs). We understand that this is not Java objects , since our heap
> size is only 1G. We don't use field grouping in this topology so this is
> not a hot spot.
> Does someone had problems like that? How can we investigate the cause?
>
> We use Storm version 0.82
> Thank you in advance,
> Vladi
>
>