You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Yunmeng Ban <ba...@gmail.com> on 2014/02/27 22:51:29 UTC

How does emitBatch in IBatchSpout work?

Hi,

I am benchmarking the latency of trident. I send tuples with timestamp in
batchs using a BatchSpout that implements IBatchSpout. But I found the
latency of the tuples keeps increasing. I found that the the emitBatch
executes every 1.7 seconds even I don't have any processing in the
BatchSpout, but I want spout to send tuples without blocking.

Does anyone know how emitBatch works? How can I avoid blocking in emitBatch?

Thanks.

Yunmeng

Re: How does emitBatch in IBatchSpout work?

Posted by Yunmeng Ban <ba...@gmail.com>.
Thank you Danijel !

Best,

Yunmeng


2014-02-28 3:03 GMT-05:00 Danijel Schiavuzzi <da...@schiavuzzi.com>:

> Hi Yunmeng,
>
> Take a look at the Config.setMaxSpoutPending() and
> Config.TRIDENT_BATCH_EMIT_INTERVAL_MILLIS parameters.
>
> Regards,
>
> Danijel
>
>
> On Thu, Feb 27, 2014 at 10:51 PM, Yunmeng Ban <ba...@gmail.com>wrote:
>
>> Hi,
>>
>> I am benchmarking the latency of trident. I send tuples with timestamp in
>> batchs using a BatchSpout that implements IBatchSpout. But I found the
>> latency of the tuples keeps increasing. I found that the the emitBatch
>> executes every 1.7 seconds even I don't have any processing in the
>> BatchSpout, but I want spout to send tuples without blocking.
>>
>> Does anyone know how emitBatch works? How can I avoid blocking in
>> emitBatch?
>>
>> Thanks.
>>
>> Yunmeng
>>
>
>
>
> --
> Danijel Schiavuzzi
>
> E: danijel@schiavuzzi.com
> W: www.schiavuzzi.com
> T: +385989035562
> Skype: danijels7
>

Re: How does emitBatch in IBatchSpout work?

Posted by Danijel Schiavuzzi <da...@schiavuzzi.com>.
Hi Yunmeng,

Take a look at the Config.setMaxSpoutPending() and
Config.TRIDENT_BATCH_EMIT_INTERVAL_MILLIS parameters.

Regards,

Danijel


On Thu, Feb 27, 2014 at 10:51 PM, Yunmeng Ban <ba...@gmail.com> wrote:

> Hi,
>
> I am benchmarking the latency of trident. I send tuples with timestamp in
> batchs using a BatchSpout that implements IBatchSpout. But I found the
> latency of the tuples keeps increasing. I found that the the emitBatch
> executes every 1.7 seconds even I don't have any processing in the
> BatchSpout, but I want spout to send tuples without blocking.
>
> Does anyone know how emitBatch works? How can I avoid blocking in
> emitBatch?
>
> Thanks.
>
> Yunmeng
>



-- 
Danijel Schiavuzzi

E: danijel@schiavuzzi.com
W: www.schiavuzzi.com
T: +385989035562
Skype: danijels7