You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Florian Hussonnois <fh...@gmail.com> on 2015/03/11 17:27:41 UTC
kafka spout - very high latency
Hi,
I'm facing with a high latency for the kafka spout (v0.9.3). I don't know
where this problem may come from. In addition, I have no error in logs and
no failed tuples.
This is my configuration for the Spout(parallelism = 4)
kafkaConfig.fetchSizeBytes = 1024 * 1024 * 6;
kafkaConfig.bufferSizeBytes = 1024 * 1024 * 6;
I have a 5 broker cluster with 4 partitions per topics.
Storm configuration
topology.max.spout.pending: 1000
Then, this is a screenshot of my storm UI.
[image: Images intégrées 1]
Thank you for your help.
--
Florian HUSSONNOIS
Re: kafka spout - very high latency
Posted by Florian Hussonnois <fh...@gmail.com>.
Thank you very much for your feedbacks. I've a better understanding now of
my spout latency.
2015-03-11 20:34 GMT+01:00 Nathan Leung <nc...@gmail.com>:
> Yes, and this includes the amount of time it takes for tuples ahead of it
> in the spout output queue to drain.
>
> On Wed, Mar 11, 2015 at 3:02 PM, Haralds Ulmanis <ha...@evilezh.net>
> wrote:
>
>> If i remember right .. then kafka spout latency you see is actual latency
>> for message to travel from spout to last ACK it gets.
>>
>> On 11 March 2015 at 18:47, Nathan Leung <nc...@gmail.com> wrote:
>>
>>> Your transformer bolt is your bottleneck. It is fully utilitized. With
>>> 1000 max spout pending, a fully bottlenecked bolt, the latency you see at
>>> your spout does not surprise me.
>>>
>>> On Wed, Mar 11, 2015 at 12:27 PM, Florian Hussonnois <
>>> fhussonnois@gmail.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> I'm facing with a high latency for the kafka spout (v0.9.3). I don't
>>>> know where this problem may come from. In addition, I have no error in logs
>>>> and no failed tuples.
>>>>
>>>> This is my configuration for the Spout(parallelism = 4)
>>>>
>>>> kafkaConfig.fetchSizeBytes = 1024 * 1024 * 6;
>>>> kafkaConfig.bufferSizeBytes = 1024 * 1024 * 6;
>>>>
>>>> I have a 5 broker cluster with 4 partitions per topics.
>>>>
>>>> Storm configuration
>>>> topology.max.spout.pending: 1000
>>>>
>>>> Then, this is a screenshot of my storm UI.
>>>>
>>>> [image: Images intégrées 1]
>>>>
>>>> Thank you for your help.
>>>>
>>>>
>>>> --
>>>> Florian HUSSONNOIS
>>>>
>>>
>>>
>>
>
--
Florian HUSSONNOIS
Tel +33 6 26 92 82 23
Re: kafka spout - very high latency
Posted by Nathan Leung <nc...@gmail.com>.
Yes, and this includes the amount of time it takes for tuples ahead of it
in the spout output queue to drain.
On Wed, Mar 11, 2015 at 3:02 PM, Haralds Ulmanis <ha...@evilezh.net>
wrote:
> If i remember right .. then kafka spout latency you see is actual latency
> for message to travel from spout to last ACK it gets.
>
> On 11 March 2015 at 18:47, Nathan Leung <nc...@gmail.com> wrote:
>
>> Your transformer bolt is your bottleneck. It is fully utilitized. With
>> 1000 max spout pending, a fully bottlenecked bolt, the latency you see at
>> your spout does not surprise me.
>>
>> On Wed, Mar 11, 2015 at 12:27 PM, Florian Hussonnois <
>> fhussonnois@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> I'm facing with a high latency for the kafka spout (v0.9.3). I don't
>>> know where this problem may come from. In addition, I have no error in logs
>>> and no failed tuples.
>>>
>>> This is my configuration for the Spout(parallelism = 4)
>>>
>>> kafkaConfig.fetchSizeBytes = 1024 * 1024 * 6;
>>> kafkaConfig.bufferSizeBytes = 1024 * 1024 * 6;
>>>
>>> I have a 5 broker cluster with 4 partitions per topics.
>>>
>>> Storm configuration
>>> topology.max.spout.pending: 1000
>>>
>>> Then, this is a screenshot of my storm UI.
>>>
>>> [image: Images intégrées 1]
>>>
>>> Thank you for your help.
>>>
>>>
>>> --
>>> Florian HUSSONNOIS
>>>
>>
>>
>
Re: kafka spout - very high latency
Posted by Haralds Ulmanis <ha...@evilezh.net>.
If i remember right .. then kafka spout latency you see is actual latency
for message to travel from spout to last ACK it gets.
On 11 March 2015 at 18:47, Nathan Leung <nc...@gmail.com> wrote:
> Your transformer bolt is your bottleneck. It is fully utilitized. With
> 1000 max spout pending, a fully bottlenecked bolt, the latency you see at
> your spout does not surprise me.
>
> On Wed, Mar 11, 2015 at 12:27 PM, Florian Hussonnois <
> fhussonnois@gmail.com> wrote:
>
>> Hi,
>>
>> I'm facing with a high latency for the kafka spout (v0.9.3). I don't know
>> where this problem may come from. In addition, I have no error in logs and
>> no failed tuples.
>>
>> This is my configuration for the Spout(parallelism = 4)
>>
>> kafkaConfig.fetchSizeBytes = 1024 * 1024 * 6;
>> kafkaConfig.bufferSizeBytes = 1024 * 1024 * 6;
>>
>> I have a 5 broker cluster with 4 partitions per topics.
>>
>> Storm configuration
>> topology.max.spout.pending: 1000
>>
>> Then, this is a screenshot of my storm UI.
>>
>> [image: Images intégrées 1]
>>
>> Thank you for your help.
>>
>>
>> --
>> Florian HUSSONNOIS
>>
>
>
Re: kafka spout - very high latency
Posted by Nathan Leung <nc...@gmail.com>.
Your transformer bolt is your bottleneck. It is fully utilitized. With
1000 max spout pending, a fully bottlenecked bolt, the latency you see at
your spout does not surprise me.
On Wed, Mar 11, 2015 at 12:27 PM, Florian Hussonnois <fh...@gmail.com>
wrote:
> Hi,
>
> I'm facing with a high latency for the kafka spout (v0.9.3). I don't know
> where this problem may come from. In addition, I have no error in logs and
> no failed tuples.
>
> This is my configuration for the Spout(parallelism = 4)
>
> kafkaConfig.fetchSizeBytes = 1024 * 1024 * 6;
> kafkaConfig.bufferSizeBytes = 1024 * 1024 * 6;
>
> I have a 5 broker cluster with 4 partitions per topics.
>
> Storm configuration
> topology.max.spout.pending: 1000
>
> Then, this is a screenshot of my storm UI.
>
> [image: Images intégrées 1]
>
> Thank you for your help.
>
>
> --
> Florian HUSSONNOIS
>