Is there a time period for spout/bolt to wait for open()/prepare() to complete?

[Richards Peter <hb...@gmail.com>]

Hi,

I have one query related to the order in which open()-nextTuple() and
prepare()-execute() methods are invoked by storm. In one of my use cases
the amount of work that I do in open() or prepare() is more. It may take
more time for it to get completed.

Is there a guarantee that storm will not invoke execute() of the bolt
before prepare() is completed? If not, is there a time period up to which
storm will wait for the prepare() of the bolt to complete before invoking
execute().

Thanks,
Richards Peter.

Re: Is there a time period for spout/bolt to wait for open()/prepare() to complete?

[Richards Peter <hb...@gmail.com>]

Hi all,
I would like to inform you that the issue was in the third party library
only. We confirmed it by writing some sample test cases.
We were able to resolve the issue by changing a configuration parameter in
that library.
Thanks for your support
Richards Peter.

Re: Is there a time period for spout/bolt to wait for open()/prepare() to complete?

[Richards Peter <hb...@gmail.com>]

Hi,


I am not sure whether the third party library class is getting initialized
in a non-blocking manner. I have to verify that. Other than that method
call, all other methods are blocking calls.

I tried to reproduce the same behavior in local cluster mode. But in local
cluster mode, the initialization happened as expected.

I will check whether the calls are blocking or non-blocking and get back to
you.

Thanks,
Richards Peter.

Re: Is there a time period for spout/bolt to wait for open()/prepare() to complete?

[Enno Shioji <es...@gmail.com>]

@Richards
Are you sure you are blocking inside prepare until the initialization is
complete?


On Sun, Feb 23, 2014 at 4:02 AM, Richards Peter <hb...@gmail.com>wrote:

> Would anyone like to share their thoughts about this? I am using  storm
> 0.8.2. I am facing an issue when I use another open source library. I am
> trying to initialize one of the classes in that third party library in the
> prepare() of the bolt. I see that the library class is not getting
> initialized before the first tuple is received by this bolt. Hence some
> values in the first tuple are getting rejected. If I replay the same tuple,
> it gets processed completely. I tried this exercise with one worker and
> more workers. I observed the same behavior.
>
> I am trying to isolate the root cause: issue in storm or issue in library.
> I would like to introduce a work around based on your response for this
> query.
>
> Thanks
> Richards Peter.
>

Re: Is there a time period for spout/bolt to wait for open()/prepare() to complete?

[Richards Peter <hb...@gmail.com>]

Would anyone like to share their thoughts about this? I am using  storm
0.8.2. I am facing an issue when I use another open source library. I am
trying to initialize one of the classes in that third party library in the
prepare() of the bolt. I see that the library class is not getting
initialized before the first tuple is received by this bolt. Hence some
values in the first tuple are getting rejected. If I replay the same tuple,
it gets processed completely. I tried this exercise with one worker and
more workers. I observed the same behavior.

I am trying to isolate the root cause: issue in storm or issue in library.
I would like to introduce a work around based on your response for this
query.

Thanks
Richards Peter.