You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@storm.apache.org by Punit Tiwan <ti...@coviam.com> on 2017/01/27 06:09:08 UTC

Good examples of StatefulWindowedBoltExecutor

Hi,
Doe anyone know any good example of StatefulWindowedBoltExecutor and how does it actually work?

I am currently using 30min window but memory usage is issue for us. To solve that i am thinking of using lesser time window(like 2-3mins) plus something to keep my computed states into redis. 
I think StatefulWindowedBoltExecutor will solve my problem. Please correct me if i am wrong.

Regards,
Punit Tiwan

Re: Good examples of StatefulWindowedBoltExecutor

Posted by Punit Tiwan <ti...@coviam.com>.

Thanks Arun, will consider both approach.

Regards,
Punit Tiwan



> On 27-Jan-2017, at 3:45 PM, Arun Mahadevan <ar...@apache.org> wrote:
> 
> There is an example here - https://github.com/apache/storm/blob/master/examples/storm-starter/src/jvm/storm/starter/StatefulWindowingTopology.java. Also checkout the “Stateful windowing” section under https://community.hortonworks.com/articles/14171/windowing-and-state-checkpointing-in-apache-storm.html. 
> 
> As an alternative, you could instead have a regular windowed bolt which sends the aggregate results of you 2-3 min window to a downstream bolt (like RedisBolt) which updates the result in a permanent state.
> 
> Thanks,
> Arun
> 
> On 1/27/17, 11:39 AM, "Punit Tiwan" <ti...@coviam.com> wrote:
> 
>> Hi,
>> Doe anyone know any good example of StatefulWindowedBoltExecutor and how does it actually work?
>> 
>> I am currently using 30min window but memory usage is issue for us. To solve that i am thinking of using lesser time window(like 2-3mins) plus something to keep my computed states into redis. 
>> I think StatefulWindowedBoltExecutor will solve my problem. Please correct me if i am wrong.
>> 
>> Regards,
>> Punit Tiwan
>> 
>> 
>> 
>> 
> 
>

Re: Good examples of StatefulWindowedBoltExecutor

Posted by Arun Mahadevan <ar...@apache.org>.

There is an example here - https://github.com/apache/storm/blob/master/examples/storm-starter/src/jvm/storm/starter/StatefulWindowingTopology.java. Also checkout the “Stateful windowing” section under https://community.hortonworks.com/articles/14171/windowing-and-state-checkpointing-in-apache-storm.html. 

As an alternative, you could instead have a regular windowed bolt which sends the aggregate results of you 2-3 min window to a downstream bolt (like RedisBolt) which updates the result in a permanent state.

Thanks,
Arun

On 1/27/17, 11:39 AM, "Punit Tiwan" <ti...@coviam.com> wrote:

>Hi,
>Doe anyone know any good example of StatefulWindowedBoltExecutor and how does it actually work?
>
>I am currently using 30min window but memory usage is issue for us. To solve that i am thinking of using lesser time window(like 2-3mins) plus something to keep my computed states into redis. 
>I think StatefulWindowedBoltExecutor will solve my problem. Please correct me if i am wrong.
>
>Regards,
>Punit Tiwan
>
>
>
>