You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2021/01/12 18:38:42 UTC
[GitHub] [pulsar] dlsprague opened a new issue #9197: Partitioned Topics not able to create on all clusters for geo redundancy
dlsprague opened a new issue #9197:
URL: https://github.com/apache/pulsar/issues/9197
**Describe the bug**
For partitioned topics, we are unable to create on all clusters that namespace is set up for. ( Non-partitioned topics are able to create successfully. ) Namespace has two clusters, and partitions are created fine on one cluster and everything works fine but will not allow creation on the other cluster. When attempting to create receives error that Topic already exists. When doing a topic list on the namespace it does not show up in the list and if trying to produce a message to it, it gets error Topic Not Found.
**To Reproduce**
Steps to reproduce the behavior:
1. Make sure both clusters are listed for the namespace and if not add additional cluster for replication.
2. On broker server in first cluster, create partitioned topic.
3. On broker server in second cluster, create partitioned topic. (Gets error Topic Already exists)
4. List topics for namespace on second cluster. (Topic does not appear in list)
5. Attempt to produce message on broker in second cluster. (Get Topic Not Found)
**Expected behavior**
Expect to be able to create topic in both clusters. For non-partitioned, this works fine.
**Screenshots**
If applicable, add screenshots to help explain your problem.
**Desktop (please complete the following information):**
- OS: CentOS Linux release 7.8
**Additional context**
Pulsar 2.6.0
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] codelipenghui commented on issue #9197: Partitioned Topics not able to create on all clusters for geo redundancy
Posted by GitBox <gi...@apache.org>.
codelipenghui commented on issue #9197:
URL: https://github.com/apache/pulsar/issues/9197#issuecomment-788563011
BTW, @dlsprague Did you disabled the topic auto-creation?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] codelipenghui commented on issue #9197: Partitioned Topics not able to create on all clusters for geo redundancy
Posted by GitBox <gi...@apache.org>.
codelipenghui commented on issue #9197:
URL: https://github.com/apache/pulsar/issues/9197#issuecomment-790180244
@dlsprague I see, I think the problem is the `allowAutoTopicCreation=false` and the partitions have not created in the second cluster. It's related to https://github.com/apache/pulsar/issues/9173
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] codelipenghui commented on issue #9197: Partitioned Topics not able to create on all clusters for geo redundancy
Posted by GitBox <gi...@apache.org>.
codelipenghui commented on issue #9197:
URL: https://github.com/apache/pulsar/issues/9197#issuecomment-1058894151
The issue had no activity for 30 days, mark with Stale label.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] dlsprague commented on issue #9197: Partitioned Topics not able to create on all clusters for geo redundancy
Posted by GitBox <gi...@apache.org>.
dlsprague commented on issue #9197:
URL: https://github.com/apache/pulsar/issues/9197#issuecomment-790007889
HI.. thank you for the response. yes, we are planning to upgrade to 2.7.0, or actually I think maybe waiting for 2.7.1. Its in the planning and testing stage now.
Also, the broker settings I found for auto creation is:
# Enable topic auto creation if new producer or consumer connected (disable auto creation with value false)
allowAutoTopicCreation=false
# The type of topic that is allowed to be automatically created.(partitioned/non-partitioned)
allowAutoTopicCreationType=non-partitioned
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] dlsprague commented on issue #9197: Partitioned Topics not able to create on all clusters for geo redundancy
Posted by GitBox <gi...@apache.org>.
dlsprague commented on issue #9197:
URL: https://github.com/apache/pulsar/issues/9197#issuecomment-777752143
If I understand correctly, the configuration store is the global zookeeper, is that correct? What we are using is 5 zookeepers with both local and global for each cluster. Each quorum of zookeepers should be syncing to the other cluster's zookeepers.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] codelipenghui commented on issue #9197: Partitioned Topics not able to create on all clusters for geo redundancy
Posted by GitBox <gi...@apache.org>.
codelipenghui commented on issue #9197:
URL: https://github.com/apache/pulsar/issues/9197#issuecomment-770232249
@dlsprague Do you use the same configuration store for the both 2 clusters?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] codelipenghui commented on issue #9197: Partitioned Topics not able to create on all clusters for geo redundancy
Posted by GitBox <gi...@apache.org>.
codelipenghui commented on issue #9197:
URL: https://github.com/apache/pulsar/issues/9197#issuecomment-788560868
Ok, interesting. Have you tried the new Pulsar version 2.7.0 or 2.6.3?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org