You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@storm.apache.org by "Grant Overby (groverby)" <gr...@cisco.com> on 2015/03/11 17:35:20 UTC

Limit max tuples in a Storm Trident topology

Is there a way to limit the maximum number of tuples in a Trident topology? Ie, if greater than x tuples are being processed, then spouts pause.
[http://www.cisco.com/web/europe/images/email/signature/est2014/logo_06.png?ct=1398192119726]

Grant Overby
Software Engineer
Cisco.com<http://www.cisco.com/>
groverby@cisco.com<ma...@cisco.com>
Mobile: 865 724 4910






[http://www.cisco.com/assets/swa/img/thinkbeforeyouprint.gif] Think before you print.

This email may contain confidential and privileged material for the sole use of the intended recipient. Any review, use, distribution or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive for the recipient), please contact the sender by reply email and delete all copies of this message.

Please click here<http://www.cisco.com/web/about/doing_business/legal/cri/index.html> for Company Registration Information.

Re: Limit max tuples in a Storm Trident topology

Posted by Nikhil Singh <ns...@yahoo.com>.

You can set the following settings:topology.max.spout.pending 
to control the number of batches processing in parallel. If it is set to 1 then only one batch will be processed at a time.
The number of tuples emitted per batch is controlled by the spout implementation. See the Kafka spout implementation.apache/storm

|   |
|   |  |   |   |   |   |   |
| apache/stormstorm - Mirror of Apache Storm |
|  |
| View on github.com | Preview by Yahoo |
|  |
|   |


-Nikhil  

     On Wednesday, March 11, 2015 11:36 AM, Grant Overby (groverby) <gr...@cisco.com> wrote:
   

  Is there a way to limit the maximum number of tuples in a Trident topology? Ie, if greater than x tuples are being processed, then spouts pause.
| 
|  |
| Grant Overby
Software Engineer
Cisco.com
groverby@cisco.com
Mobile: 865 724 4910
 | 

 |
|  |


|  Think before you print. |
| This email may contain confidential and privileged material for the sole use of the intended recipient. Any review, use, distribution or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive for the recipient), please contact the sender by reply email and delete all copies of this message.Please click here for Company Registration Information. |


 |