mirror maker and failover to another data center

[Kane Kim <ka...@gmail.com>]

Hello,

What's the best strategy for failover when using mirror-maker to replicate
across datacenters? As I understand offsets in both datacenters will be
different, how consumers should be reconfigured to continue reading from
the same point where they stopped without data loss and/or duplication?

Thanks.

Re: mirror maker and failover to another data center

[Guozhang Wang <wa...@gmail.com>]

Hi Kane,

Unfortunately we do not have a perfect solution for this problem yet, since
as you said the offsets on different DCs are different.

At LinkedIn we bite the bullet on data duplication, i.e. when failover
happens, the consumer queries the other DC for some offsets appended some
time before the the failover time, and start consuming.

Guozhang

On Thu, Mar 19, 2015 at 11:18 AM, Kane Kim <ka...@gmail.com> wrote:

> Hello,
>
> What's the best strategy for failover when using mirror-maker to replicate
> across datacenters? As I understand offsets in both datacenters will be
> different, how consumers should be reconfigured to continue reading from
> the same point where they stopped without data loss and/or duplication?
>
> Thanks.
>



-- 
-- Guozhang