[GitHub] [pulsar] manjupriya-ar opened a new issue #11717: Request for steps to upgrade Pulsar from Single AZ to Multi-AZ deployment on AWS

[GitBox <gi...@apache.org>]

manjupriya-ar opened a new issue #11717:
URL: https://github.com/apache/pulsar/issues/11717


   **Describe the bug**
   
   We are looking for steps to upgrade from Single AZ to Multi-AZ deployment on AWS. The options considered and the challenges are listed below
   
   **Option 1: Deploy a new statefulset which spans across different AZ and decommission Bookie one by one from single AZ statefulset.** 
   
   **Assumption** : Autorecovery replicates data so that when Bookies are decommissioned one by one there is no data loss.
   
   **Questions :**
   1.	Number of EKS worker nodes in the cluster is 3. Considering anti affinity rule is set in Bookie ( which means only one Bookie can run on one node), we assume that the cluster needs to scales out to include 3 more nodes.
   2.	How to ensure the worker nodes on which the older Bookie statefulset runs is not moved to a different zone. Wouldn’t the autoscaling groups created on EKS distribute nodes equally across zones ? If the number of worker nodes in the auto scale group is set as 3 * total AZ (for example say in 3 AZ region set the count as 9)  then probably the initial nodes of the cluster may stay in the same AZ.
   3.	How to ensure the replication is complete before shutting down the second/third bookie?
   
   **Option 2: Migrate from single AZ to Multi AZ with downtime using EBS snapshots**
   
   
   Can Pulsar deployment/statefulset be scaled down and EBS snapshotting be used to backup and restore data to EBS volumes in different AZ ? 
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [pulsar] codelipenghui commented on issue #11717: Request for steps to upgrade Pulsar from Single AZ to Multi-AZ deployment on AWS

[GitBox <gi...@apache.org>]

codelipenghui commented on issue #11717:
URL: https://github.com/apache/pulsar/issues/11717#issuecomment-1058887004


   The issue had no activity for 30 days, mark with Stale label.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org