You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by 李家宏 <jh...@gmail.com> on 2014/05/16 06:21:14 UTC

[Tuple loss] in Storm-0.9.0.1

I am running storm-0.9.0.1 with zmq as transport layer, and I set zmq.hwm =
2000 to avoid significant memory leaks, Also I disableed ackers.

I found from UI that some components executed much less tuples than being
transferred to them.
Let's say, a topology looks like this : componentA -> componentB.
ComponentA transferred 100M tuples while componentB only executed 1M
tuples. I'am wondering where do the left tuples gone. If they were queueing
in the transport layer, then the queue should be keep increasing and thus
the momory usage, But I didn't see any noticeable memeory leaks.

Does storm have the guarantee that all tuples transferred from taskA to
taskB should be received by taskB, moreover, the tulpes are in order.

Regards

-- 

======================================================

Gvain

Email: jh.li.em@gmail.com