You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by "Mhaskar, Tushar" <tm...@paypal.com.INVALID> on 2016/01/27 23:08:05 UTC

Kafka 0.9 mirror maker - different destination topic name

Hi All,

How to use Kafka 0.9 MirrorMaker to produce data to different topic name.
Gwen has informed that --message.handler option needs to be used, but  I couldn't find any documentation related to that.
Any pointers will be useful.

Thanks,
Tushar


Re: Kafka 0.9 mirror maker - different destination topic name

Posted by Gwen Shapira <gw...@confluent.io>.
Hi,

I added a small example on how to implement a MirrorMaker handler with a
readme on how to use it:
https://github.com/gwenshap/kafka-examples/tree/master/MirrorMakerHandler

Hope it helps!

Gwen

On Thu, Jan 28, 2016 at 6:27 PM, tao xiao <xi...@gmail.com> wrote:

> You can pass --message.handler in the mirror make command line along with
> the fully qualified class name
>
> On Fri, 29 Jan 2016 at 07:48 Mhaskar, Tushar <tm...@paypal.com.invalid>
> wrote:
>
> > Thanks for your response.
> >
> > I had looked at the code but I am curious as how can we achieve that from
> > command line with —message.handler option .
> >
> > Thanks,
> > Tushar
> >
> >
> >
> >
> > On 1/27/16, 8:06 PM, "tao xiao" <xi...@gmail.com> wrote:
> >
> > >You can take a look at the source code
> > >
> >
> https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/tools/MirrorMaker.scala#L642
> > >
> > >basically you need to construct a new ProducerRecord with the topic name
> > >you want
> > >
> > >On Thu, 28 Jan 2016 at 06:08 Mhaskar, Tushar
> <tmhaskar@paypal.com.invalid
> > >
> > >wrote:
> > >
> > >> Hi All,
> > >>
> > >> How to use Kafka 0.9 MirrorMaker to produce data to different topic
> > name.
> > >> Gwen has informed that --message.handler option needs to be used,
> but  I
> > >> couldn't find any documentation related to that.
> > >> Any pointers will be useful.
> > >>
> > >> Thanks,
> > >> Tushar
> > >>
> > >>
> >
>

Re: Kafka 0.9 mirror maker - different destination topic name

Posted by tao xiao <xi...@gmail.com>.
You can pass --message.handler in the mirror make command line along with
the fully qualified class name

On Fri, 29 Jan 2016 at 07:48 Mhaskar, Tushar <tm...@paypal.com.invalid>
wrote:

> Thanks for your response.
>
> I had looked at the code but I am curious as how can we achieve that from
> command line with —message.handler option .
>
> Thanks,
> Tushar
>
>
>
>
> On 1/27/16, 8:06 PM, "tao xiao" <xi...@gmail.com> wrote:
>
> >You can take a look at the source code
> >
> https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/tools/MirrorMaker.scala#L642
> >
> >basically you need to construct a new ProducerRecord with the topic name
> >you want
> >
> >On Thu, 28 Jan 2016 at 06:08 Mhaskar, Tushar <tmhaskar@paypal.com.invalid
> >
> >wrote:
> >
> >> Hi All,
> >>
> >> How to use Kafka 0.9 MirrorMaker to produce data to different topic
> name.
> >> Gwen has informed that --message.handler option needs to be used, but  I
> >> couldn't find any documentation related to that.
> >> Any pointers will be useful.
> >>
> >> Thanks,
> >> Tushar
> >>
> >>
>

Re: Kafka 0.9 mirror maker - different destination topic name

Posted by "Mhaskar, Tushar" <tm...@paypal.com.INVALID>.
Thanks for your response.

I had looked at the code but I am curious as how can we achieve that from command line with —message.handler option .

Thanks,
Tushar




On 1/27/16, 8:06 PM, "tao xiao" <xi...@gmail.com> wrote:

>You can take a look at the source code
>https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/tools/MirrorMaker.scala#L642
>
>basically you need to construct a new ProducerRecord with the topic name
>you want
>
>On Thu, 28 Jan 2016 at 06:08 Mhaskar, Tushar <tm...@paypal.com.invalid>
>wrote:
>
>> Hi All,
>>
>> How to use Kafka 0.9 MirrorMaker to produce data to different topic name.
>> Gwen has informed that --message.handler option needs to be used, but  I
>> couldn't find any documentation related to that.
>> Any pointers will be useful.
>>
>> Thanks,
>> Tushar
>>
>>

Re: Kafka 0.9 mirror maker - different destination topic name

Posted by tao xiao <xi...@gmail.com>.
You can take a look at the source code
https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/tools/MirrorMaker.scala#L642

basically you need to construct a new ProducerRecord with the topic name
you want

On Thu, 28 Jan 2016 at 06:08 Mhaskar, Tushar <tm...@paypal.com.invalid>
wrote:

> Hi All,
>
> How to use Kafka 0.9 MirrorMaker to produce data to different topic name.
> Gwen has informed that --message.handler option needs to be used, but  I
> couldn't find any documentation related to that.
> Any pointers will be useful.
>
> Thanks,
> Tushar
>
>