You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@kafka.apache.org by Clelio De Souza <cl...@gmail.com> on 2015/10/08 19:47:28 UTC

Kafka Mirror to consume data from beginning of topics

Hi there,

I am trying to setup a Kafka Mirror mechanism, but it seems the consumer
from the source Kafka cluster only reads from new incoming data to the
topics, i.e. it does not read historically saved data in the topics.

Is there a way to define the consumer of Kafka Mirror to read from the
beginning of the topics of my source Kafka cluster?

Many thanks in advance!

Cheers,
Leo

Re: Kafka Mirror to consume data from beginning of topics

Posted by Ben Stopford <be...@confluent.io>.

Hi Leo 

Set auto.offset.reset=smallest in your consumer.config

B
> On 8 Oct 2015, at 18:47, Clelio De Souza <cl...@gmail.com> wrote:
> 
> Hi there,
> 
> I am trying to setup a Kafka Mirror mechanism, but it seems the consumer
> from the source Kafka cluster only reads from new incoming data to the
> topics, i.e. it does not read historically saved data in the topics.
> 
> Is there a way to define the consumer of Kafka Mirror to read from the
> beginning of the topics of my source Kafka cluster?
> 
> Many thanks in advance!
> 
> Cheers,
> Leo