Cross-cluster mirror making

[Husna Hadi <hh...@adobe.com.INVALID>]

Hi, I read on The Definitive Guide to Kafka that when using cross-cluster kafka mirroring, when possible, consume from a remote datacenter rather than produce to a
remote datacenter. Why is that the case?

-Husna

Re: Cross-cluster mirror making

[Andrew Otto <ot...@wikimedia.org>]

Hi Husna,

The trouble with cross cluster Kafka use is unpredictable network latency.
If a consumer encounters high latency, it will just lag, but (hopefully)
eventually it will catch up.  If a producer encounters high latency, it
will have to buffer messages locally until those messages are ACKed by the
Kafka cluster.  If the buffer gets too full, it will have to start dropping
messages.

- Andrew Otto

On Thu, Feb 8, 2018 at 5:21 PM, Husna Hadi <hh...@adobe.com.invalid> wrote:

> Hi, I read on The Definitive Guide to Kafka that when using cross-cluster
> kafka mirroring, when possible, consume from a remote datacenter rather
> than produce to a
> remote datacenter. Why is that the case?
>
> -Husna
>
>