Does Kafka recover all data if node is reimaged

[Rajasekar Elango <re...@salesforce.com>]

I was wondering if a kafka broker node get reimaged and all data is wiped
off, Will kafka recover all data on node from replication?

-- 
Thanks,
Raja.

Re: Does Kafka recover all data if node is reimaged

[Todd Palino <tp...@gmail.com>]

Yes. As long as you have not reassigned the partitions to other brokers,
the wiped broker will rebuild from replication. Keep in mind, however, that
if you are using the retention by time configuration, you will have 2x
retention on that broker for the length of retention. This means that if
your retention is 1 week, replication will copy over the last week's worth
of data. That data will not be expired for 1 week, as the expiration is
based on the file modification time.

There is work ongoing that will resolve this extra retention problem.

-Todd

On Monday, October 12, 2015, Rajasekar Elango <re...@salesforce.com>
wrote:

> I was wondering if a kafka broker node get reimaged and all data is wiped
> off, Will kafka recover all data on node from replication?
>
> --
> Thanks,
> Raja.
>