You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Bill Hastings <bl...@gmail.com> on 2015/05/19 20:46:17 UTC
Consumers in a different datacenters
Hi All
Has anyone tried this? We have two data centers A and B. We would like data
replicated between A and B. So I would like to have a kafka cluster set up
in A and B. When we need to replicate from A-->B I would like the app in A
publish a topic to the kafla cluster in data center A. The corresponding
consumers are in data center B. When they get the topic they apply locally.
Does this sound like a viable solution?
--
Cheers
Bill
Re: Consumers in a different datacenters
Posted by Manoj Khangaonkar <kh...@gmail.com>.
You can use MirrorMaker to mirror the topic from cluster A to cluster B.
This has the benefit of avoiding consumers in B connecting to A which could
have some latency
regards
On Tue, May 19, 2015 at 11:46 AM, Bill Hastings <bl...@gmail.com>
wrote:
> Hi All
>
> Has anyone tried this? We have two data centers A and B. We would like data
> replicated between A and B. So I would like to have a kafka cluster set up
> in A and B. When we need to replicate from A-->B I would like the app in A
> publish a topic to the kafla cluster in data center A. The corresponding
> consumers are in data center B. When they get the topic they apply locally.
> Does this sound like a viable solution?
>
> --
> Cheers
> Bill
>
--
http://khangaonkar.blogspot.com/
Re: Consumers in a different datacenters
Posted by Adam Dubiel <du...@gmail.com>.
Hi Bill,
I don't know if this is exactly the same case (last part "when they get the
topic tehy apply locally" is bit unclear), but we have setup with Kafka in
DC A and consumers both in DC A and DC B. Actually we also have producers
in A and B writing to Kafka in A, but we are trying to change this (we have
7ms trip time between DCs). We want to achieve DC-locality by using
DC-aware service discovery and Hermes, our product built on top of Kafka.
BR,
Adam
2015-05-19 20:46 GMT+02:00 Bill Hastings <bl...@gmail.com>:
> Hi All
>
> Has anyone tried this? We have two data centers A and B. We would like data
> replicated between A and B. So I would like to have a kafka cluster set up
> in A and B. When we need to replicate from A-->B I would like the app in A
> publish a topic to the kafla cluster in data center A. The corresponding
> consumers are in data center B. When they get the topic they apply locally.
> Does this sound like a viable solution?
>
> --
> Cheers
> Bill
>