Adding replicas

[Scott Thibault <sc...@multiscalehn.com>]

Hi,

If we add a new broker and then assign it as a new replica for a topic,
does the entire log for the topic get copied to that new node or does the
new node just get new data?

Thanks
--Scott Thibault


-- 
*This e-mail is not encrypted.  Due to the unsecured nature of unencrypted
e-mail, there may be some level of risk that the information in this e-mail
could be read by a third party.  Accordingly, the recipient(s) named above
are hereby advised to not communicate protected health information using
this e-mail address.  If you desire to send protected health information
electronically, please contact MultiScale Health Networks at (206)538-6090*

Re: Adding replicas

[Bart Wyatt <ba...@dsvolition.com>]

It will pull the available section of the log into the new replica.   In other words, yes it will copy the "entire" log, where entire respects that the earliest available offset is probably not 0.

In the case of a compacted log the replicated log may or may not have the same structure (I think it runs its own compactor on its own schedule) but it should have the same guarantees of a compacted log, you just might get more/less stale keys when reading it from the beginning after a leadership change.

-Bart
________________________________________
From: Scott Thibault <sc...@multiscalehn.com>
Sent: Thursday, September 17, 2015 8:22 AM
To: users@kafka.apache.org
Subject: Adding replicas

Hi,

If we add a new broker and then assign it as a new replica for a topic,
does the entire log for the topic get copied to that new node or does the
new node just get new data?

Thanks
--Scott Thibault


--
*This e-mail is not encrypted.  Due to the unsecured nature of unencrypted
e-mail, there may be some level of risk that the information in this e-mail
could be read by a third party.  Accordingly, the recipient(s) named above
are hereby advised to not communicate protected health information using
this e-mail address.  If you desire to send protected health information
electronically, please contact MultiScale Health Networks at (206)538-6090*


________________________________
This e-mail may contain CONFIDENTIAL AND PROPRIETARY INFORMATION and/or PRIVILEGED AND CONFIDENTIAL COMMUNICATION intended solely for the recipient and, therefore, may not be retransmitted to any party outside of the recipient's organization without the prior written consent of the sender. If you have received this e-mail in error please notify the sender immediately by telephone or reply e-mail and destroy the original message without making a copy. Deep Silver, Inc. accepts no liability for any losses or damages resulting from infected e-mail transmissions and viruses in e-mail attachments.