You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pulsar.apache.org by Sathiskumar Perumal <sa...@gmail.com> on 2023/08/31 07:10:18 UTC
Pulsar Geo replication is not working
Hi,
I have followed the steps and completed the Geo replication setup as per
the pulsar documentation
https://pulsar.apache.org/docs/3.1.x/administration-geo/
All the geo replication related setup was enabled and working fine.
When I try to produce a message from the US-WEST cluster , I am unable to
consume it from the US-EAST.
Can you please help me to fix the issue.
Regards,
Sathis
Re: Pulsar Geo replication is not working
Posted by Eric Shen <er...@outlook.com>.
Your shared steps are not using global configuration store and both US-EAST and US-WEST are using their own zk cluster as the configuration store.
To deploy with a global configuration store, you may need to follow:
1. Use a separate helm release to provision a zk-only cluster.
2. When provisioning the US-EAST and US-WEST should specify the configurationStore address as the separate zk cluster by https://github.com/apache/pulsar-helm-chart/blob/master/charts/pulsar/values.yaml#L657
This deploy will make the US-EAST and US-WEST to their local zk cluster as the metadata store and the separate zk cluster as the configuration store.
Geo Replication can still work without the support of the global configuration store, and you just need to make that when you create a new namespace or topic that needs to be replicated, you should run the command `bin/pulsar-admin topics create my-tenant/my-namespace/my-topic --clusters east-region-pulsar,west-region-pulsar` on both clusters first then to try with the produce and consume.
---
Best regards,
Eric Shen
在 2023年8月31日 +0800 PM6:23，Sathiskumar Perumal <sa...@gmail.com>，写道：
>
> I have executed the following commands. PFA.
> I have separate PODs for each cluster and enabled Geo replication.
> Can you please elaborate about the Global Configuration store or the cluster flag settings, if there is no global configuration store.
> Would you please check the document and let me know what is missing in my configuration?
Re: Pulsar Geo replication is not working
Posted by Sathiskumar Perumal <sa...@gmail.com>.
Hi Eric,
Thanks for your response.
I have executed the following commands. PFA.
I have separate PODs for each cluster and enabled Geo replication.
Can you please elaborate about the Global Configuration store or the
cluster flag settings, if there is no global configuration store.
Would you please check the document and let me know what is missing in my
configuration?
Regards,
Sathis
On Thu, Aug 31, 2023 at 1:24 PM Eric Shen <er...@outlook.com> wrote:
> Hi Sathis,
>
> Did you deploy a global configure store for both US-West and US-EAST
> clusters?
>
> If there is no global configure store in your deployment when you create
> the namespaces or topics with the —clusters flag should be executed
> duplicately on both clusters.
>
> Because without the global configure store, the —clusters flag just
> enables the replicator in the local cluster and can’t help create the same
> namespace or topic on the peer cluster.
>
> ---
> Best regards,
> Eric Shen
> 在 2023年8月31日 +0800 PM3:10，Sathiskumar Perumal <
> sathiskumarperumaljava@gmail.com>，写道：
> > Hi,
> > I have followed the steps and completed the Geo replication setup as per
> > the pulsar documentation
> > https://pulsar.apache.org/docs/3.1.x/administration-geo/
> > All the geo replication related setup was enabled and working fine.
> > When I try to produce a message from the US-WEST cluster , I am unable to
> > consume it from the US-EAST.
> > Can you please help me to fix the issue.
> >
> > Regards,
> > Sathis
>
Re: Pulsar Geo replication is not working
Posted by Eric Shen <er...@outlook.com>.
Hi Sathis,
Did you deploy a global configure store for both US-West and US-EAST clusters?
If there is no global configure store in your deployment when you create the namespaces or topics with the —clusters flag should be executed duplicately on both clusters.
Because without the global configure store, the —clusters flag just enables the replicator in the local cluster and can’t help create the same namespace or topic on the peer cluster.
---
Best regards,
Eric Shen
在 2023年8月31日 +0800 PM3:10，Sathiskumar Perumal <sa...@gmail.com>，写道：
> Hi,
> I have followed the steps and completed the Geo replication setup as per
> the pulsar documentation
> https://pulsar.apache.org/docs/3.1.x/administration-geo/
> All the geo replication related setup was enabled and working fine.
> When I try to produce a message from the US-WEST cluster , I am unable to
> consume it from the US-EAST.
> Can you please help me to fix the issue.
>
> Regards,
> Sathis