You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@storm.apache.org by clay teahouse <cl...@gmail.com> on 2015/04/12 03:37:15 UTC
streams in storm and memory usage
Hi all,
I have a simple question which probably has been asked before, but I cannot
find a concrete answer. I'd appreciate your feedback.
Assume I have a spout that emit tuples which are consumed by 4 different
bolts .
Spout A ---> Bolt B
---> Bolt C
---> Bolt D
---> Bolt E
I have 4 works, each with one executor thread. I understand that there are
send and receive queues for sending and receiving tuples. Does this mean in
this scenario, the memory usage would be 4 times as if I had one spout and
one bolt (ignoring all other overheads)?
thanks,
Clay
Re: streams in storm and memory usage
Posted by Bobby Evans <ev...@yahoo-inc.com>.
That depends on scheduling, but probably that would be true. Until the tuple is sent across the wire its memory will be shared, as soon as it goes to a different worker, the memory is duplicated.
- Bobby
On Saturday, April 11, 2015 8:39 PM, clay teahouse <cl...@gmail.com> wrote:
Hi all,I have a simple question which probably has been asked before, but I cannot find a concrete answer. I'd appreciate your feedback.
Assume I have a spout that emit tuples which are consumed by 4 different bolts .
Spout A ---> Bolt B ---> Bolt C ---> Bolt D ---> Bolt E
I have 4 works, each with one executor thread. I understand that there are send and receive queues for sending and receiving tuples. Does this mean in this scenario, the memory usage would be 4 times as if I had one spout and one bolt (ignoring all other overheads)?
thanks,Clay
Re: streams in storm and memory usage
Posted by Bobby Evans <ev...@yahoo-inc.com.INVALID>.
That depends on scheduling, but probably that would be true. Until the tuple is sent across the wire its memory will be shared, as soon as it goes to a different worker, the memory is duplicated.
- Bobby
On Saturday, April 11, 2015 8:39 PM, clay teahouse <cl...@gmail.com> wrote:
Hi all,I have a simple question which probably has been asked before, but I cannot find a concrete answer. I'd appreciate your feedback.
Assume I have a spout that emit tuples which are consumed by 4 different bolts .
Spout A ---> Bolt B ---> Bolt C ---> Bolt D ---> Bolt E
I have 4 works, each with one executor thread. I understand that there are send and receive queues for sending and receiving tuples. Does this mean in this scenario, the memory usage would be 4 times as if I had one spout and one bolt (ignoring all other overheads)?
thanks,Clay