You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by tao xiao <xi...@gmail.com> on 2015/01/23 07:34:27 UTC

New mirror maker consumer.config question

Hi,

I discovered that the new mirror maker implementation in trunk now only
accept one consumer.config property instead of a list of them which means
we can only supply one source per mirror maker process. Is it a reason for
it? If I have multiple source kafka clusters do I need to setup multiple
mirror maker processes?

-- 
Regards,
Tao

Re: New mirror maker consumer.config question

Posted by Jun Rao <ju...@confluent.io>.
Yes, in 0.8.2, each mirror maker instance will only be able to consumer
from one source. The reasoning for that is accepting consumers from
multiple sources complicates monitoring and configuration. If you have
multiple sources to mirror from, it's simpler to just run multiple
instances of mirror maker, one for each source.

Thanks,

Jun

On Thu, Jan 22, 2015 at 10:34 PM, tao xiao <xi...@gmail.com> wrote:

> Hi,
>
> I discovered that the new mirror maker implementation in trunk now only
> accept one consumer.config property instead of a list of them which means
> we can only supply one source per mirror maker process. Is it a reason for
> it? If I have multiple source kafka clusters do I need to setup multiple
> mirror maker processes?
>
> --
> Regards,
> Tao
>