You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by "Tauzell, Dave" <Da...@surescripts.com> on 2016/07/27 20:08:12 UTC

Negative message latency

I'm seeing this reported when I run lots of small messages (3K) through Kakfa:  Negative message latency

Could this be because the clocks on the producer/consumer servers are slightly off?

-Dave

Dave Tauzell | Senior Software Engineer | Surescripts
O: 651.855.3042 | www.surescripts.com<http://www.surescripts.com/> |   Dave.Tauzell@surescripts.com<ma...@surescripts.com>
Connect with us: Twitter<https://twitter.com/Surescripts> I LinkedIn<https://www.linkedin.com/company/surescripts-llc> I Facebook<https://www.facebook.com/Surescripts> I YouTube<http://www.youtube.com/SurescriptsTV>


This e-mail and any files transmitted with it are confidential, may contain sensitive information, and are intended solely for the use of the individual or entity to whom they are addressed. If you have received this e-mail in error, please notify the sender by reply e-mail immediately and destroy all copies of the e-mail and any attachments.

RE: Negative message latency

Posted by "Tauzell, Dave" <Da...@surescripts.com>.
One test where I sent messages of size 3kb and was running the "kafka-console-consumer" was getting around 34ms end-to-end latency.   When I sent larger messages, up to 1MB, I started to see higher latency but it was under 250ms.

-Dave

Dave Tauzell | Senior Software Engineer | Surescripts
O: 651.855.3042 | www.surescripts.com |   Dave.Tauzell@surescripts.com
Connect with us: Twitter I LinkedIn I Facebook I YouTube


-----Original Message-----
From: Luo, Chao [mailto:chao.luo@here.com] 
Sent: Wednesday, July 27, 2016 3:45 PM
To: users@kafka.apache.org
Subject: RE: Negative message latency

Hi Dave,

When I tested Kafka, I also observed negative latency sometimes. I guess it is because the slight clock difference between producers and consumers. 

Btw, what is your typical producer-to-consumer latency? My system has an average of 250 milliseconds. I cannot reduce it anymore.

Best,
Chao

-----Original Message-----
From: Tauzell, Dave [mailto:Dave.Tauzell@surescripts.com] 
Sent: Wednesday, July 27, 2016 3:08 PM
To: users@kafka.apache.org
Subject: Negative message latency

I'm seeing this reported when I run lots of small messages (3K) through Kakfa:  Negative message latency

Could this be because the clocks on the producer/consumer servers are slightly off?

-Dave

Dave Tauzell | Senior Software Engineer | Surescripts
O: 651.855.3042 | www.surescripts.com<http://www.surescripts.com/> |   Dave.Tauzell@surescripts.com<ma...@surescripts.com>
Connect with us: Twitter<https://twitter.com/Surescripts> I LinkedIn<https://www.linkedin.com/company/surescripts-llc> I Facebook<https://www.facebook.com/Surescripts> I YouTube<http://www.youtube.com/SurescriptsTV>


This e-mail and any files transmitted with it are confidential, may contain sensitive information, and are intended solely for the use of the individual or entity to whom they are addressed. If you have received this e-mail in error, please notify the sender by reply e-mail immediately and destroy all copies of the e-mail and any attachments.

RE: Negative message latency

Posted by "Luo, Chao" <ch...@here.com>.
Hi Dave,

When I tested Kafka, I also observed negative latency sometimes. I guess it is because the slight clock difference between producers and consumers. 

Btw, what is your typical producer-to-consumer latency? My system has an average of 250 milliseconds. I cannot reduce it anymore.

Best,
Chao

-----Original Message-----
From: Tauzell, Dave [mailto:Dave.Tauzell@surescripts.com] 
Sent: Wednesday, July 27, 2016 3:08 PM
To: users@kafka.apache.org
Subject: Negative message latency

I'm seeing this reported when I run lots of small messages (3K) through Kakfa:  Negative message latency

Could this be because the clocks on the producer/consumer servers are slightly off?

-Dave

Dave Tauzell | Senior Software Engineer | Surescripts
O: 651.855.3042 | www.surescripts.com<http://www.surescripts.com/> |   Dave.Tauzell@surescripts.com<ma...@surescripts.com>
Connect with us: Twitter<https://twitter.com/Surescripts> I LinkedIn<https://www.linkedin.com/company/surescripts-llc> I Facebook<https://www.facebook.com/Surescripts> I YouTube<http://www.youtube.com/SurescriptsTV>


This e-mail and any files transmitted with it are confidential, may contain sensitive information, and are intended solely for the use of the individual or entity to whom they are addressed. If you have received this e-mail in error, please notify the sender by reply e-mail immediately and destroy all copies of the e-mail and any attachments.