You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Nithesh Kb <ni...@gmail.com> on 2015/08/20 17:02:30 UTC
Storm UI doubts
Hi Storm experts,
please help me with understanding below mentioned doubt.
I have created a sample twitter processing program in Storm and it is been
deployed in a two node cluster. But the question is i don't understand why
the blot executed is more than the spout emitted number.
[image: Inline image 1]
Regards,
Nithesh
Re: Storm UI doubts
Posted by Nithesh Kb <ni...@gmail.com>.
Thank you Javier!
Regards
Nithesh
On Sat, Aug 22, 2015 at 8:08 PM, Javier Gonzalez <ja...@gmail.com> wrote:
> Yes. I think the default "bucket" is 20, so the ui reports in multiples of
> 20.
>
> Since storm is meant for digesting an unending stream of data, the idea of
> the UI is to give you a close enough number of what's happening at any
> given time. It's not meant to be used as a reliable, exact number of tuples
> processed.
>
> Regards,
> Javier
> On Aug 22, 2015 2:46 AM, "Nithesh Kb" <ni...@gmail.com> wrote:
>
>> HI Javier,
>> Thanks for your time!
>> So these counter values are not exact numbers. which are just indicative
>> and can not be trusted ? is that correct ?
>>
>> Regards,
>> Nithesh
>>
>> On Fri, Aug 21, 2015 at 9:44 PM, Javier Gonzalez <ja...@gmail.com>
>> wrote:
>>
>>> Hi Nithesh,
>>>
>>> Mind that the storm metrics are gathered by sampling, so it isn't
>>> unusual that the counts are slightly off. I think the default is 5%
>>> sampling, it can be tweaked to more in storm.yaml, but it will impact your
>>> performance if you ramp it up.
>>>
>>> Regards,
>>> Javier
>>>
>>
>>
Re: Storm UI doubts
Posted by Javier Gonzalez <ja...@gmail.com>.
Yes. I think the default "bucket" is 20, so the ui reports in multiples of
20.
Since storm is meant for digesting an unending stream of data, the idea of
the UI is to give you a close enough number of what's happening at any
given time. It's not meant to be used as a reliable, exact number of tuples
processed.
Regards,
Javier
On Aug 22, 2015 2:46 AM, "Nithesh Kb" <ni...@gmail.com> wrote:
> HI Javier,
> Thanks for your time!
> So these counter values are not exact numbers. which are just indicative
> and can not be trusted ? is that correct ?
>
> Regards,
> Nithesh
>
> On Fri, Aug 21, 2015 at 9:44 PM, Javier Gonzalez <ja...@gmail.com>
> wrote:
>
>> Hi Nithesh,
>>
>> Mind that the storm metrics are gathered by sampling, so it isn't unusual
>> that the counts are slightly off. I think the default is 5% sampling, it
>> can be tweaked to more in storm.yaml, but it will impact your performance
>> if you ramp it up.
>>
>> Regards,
>> Javier
>>
>
>
Re: Storm UI doubts
Posted by Nithesh Kb <ni...@gmail.com>.
HI Javier,
Thanks for your time!
So these counter values are not exact numbers. which are just indicative
and can not be trusted ? is that correct ?
Regards,
Nithesh
On Fri, Aug 21, 2015 at 9:44 PM, Javier Gonzalez <ja...@gmail.com> wrote:
> Hi Nithesh,
>
> Mind that the storm metrics are gathered by sampling, so it isn't unusual
> that the counts are slightly off. I think the default is 5% sampling, it
> can be tweaked to more in storm.yaml, but it will impact your performance
> if you ramp it up.
>
> Regards,
> Javier
>
Re: Storm UI doubts
Posted by Javier Gonzalez <ja...@gmail.com>.
Hi Nithesh,
Mind that the storm metrics are gathered by sampling, so it isn't unusual
that the counts are slightly off. I think the default is 5% sampling, it
can be tweaked to more in storm.yaml, but it will impact your performance
if you ramp it up.
Regards,
Javier