You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by Mcs Vemuri <mc...@yahoo.com.INVALID> on 2022/12/02 05:00:50 UTC
Kafka log segments recovery on startup
Hello,
Can anyone please point to any docs re how replica recovery works when broker is started?
The documentation has information about broker rebuilding based on data on data dir- but what happens if data is completely lost? Would an empty replica be created based on zookeeper state- and if yes, how would election work in this case?
The case im looking for is when brokers are stopped, data folder for all brokers are completely deleted but zk is untouched, and brokers are started again. So, zk retains all information of topics
https://cwiki.apache.org/confluence/plugins/servlet/mobile?contentId=27844516#content/view/27844516 indicates that it is indeed rebuilt based on zk state but I couldn’t find any more details on this
Kafka log segments recovery/replica creation on startup
Posted by Mcs Vemuri <mc...@yahoo.com.INVALID>.
Hello,
Can anyone please point to any docs re how replica recovery works when broker is started?
The documentation has information about broker rebuilding based on data on data dir- but what happens if data is completely lost? Would an empty replica be created based on zookeeper state- and if yes, how would election work in this case?
The case im looking for is when brokers are stopped, data folder for all brokers are completely deleted but zk is untouched, and brokers are started again. So, zk retains all information of topics
https://cwiki.apache.org/confluence/plugins/servlet/mobile?contentId=27844516#content/view/27844516 indicates that it is indeed rebuilt based on zk state but I couldn’t find any more details on this