You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2021/04/06 04:01:10 UTC
[GitHub] [pulsar] thanhcb opened a new issue #10143: Partitioned topics not served enough active brokers
thanhcb opened a new issue #10143:
URL: https://github.com/apache/pulsar/issues/10143
**Describe the bug**
I have 3 active brokers in the picture, using ./pulsar-admin brokers list to show
**Expected behavior**
A clear and concise description of what you expected to happen.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] michaeljmarshall commented on issue #10143: Partitioned topics not served enough active brokers
Posted by GitBox <gi...@apache.org>.
michaeljmarshall commented on issue #10143:
URL: https://github.com/apache/pulsar/issues/10143#issuecomment-815488266
The following documentation describes Pulsar's load balancing feature: https://pulsar.apache.org/docs/en/2.7.0/administration-load-balance/. I think it should help explain these configurations and their impact on your cluster. Note that if your topics do not have much data flowing through them, they will not get unloaded, which means they will not get distributed across all 3 brokers. Feel free to let me know if you have follow up questions.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] thanhcb commented on issue #10143: Partitioned topics not served enough active brokers
Posted by GitBox <gi...@apache.org>.
thanhcb commented on issue #10143:
URL: https://github.com/apache/pulsar/issues/10143#issuecomment-816503420
ok, i've got it, close issue
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] michaeljmarshall commented on issue #10143: Partitioned topics not served enough active brokers
Posted by GitBox <gi...@apache.org>.
michaeljmarshall commented on issue #10143:
URL: https://github.com/apache/pulsar/issues/10143#issuecomment-813913528
@thanhcb - I have some questions based on what you provided. Are you actively producing to all topic partitions? Can you also provide the current number of bundles for the namespace? Do you have any bundle limits on the topic's namespace? Further, what is your bundle splitting configuration?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] thanhcb commented on issue #10143: Partitioned topics not served enough active brokers
Posted by GitBox <gi...@apache.org>.
thanhcb commented on issue #10143:
URL: https://github.com/apache/pulsar/issues/10143#issuecomment-815423207
i thought each of internal topics was split across to all active brokers at first, after reading the bundles you said, maybe i have some misunderstanding here.
The bundles in broker.conf i keep all default
# When a namespace is created without specifying the number of bundle, this
# value will be used as the default
defaultNumberOfNamespaceBundles=4
# enable/disable namespace bundle auto split
loadBalancerAutoBundleSplitEnabled=true
# enable/disable automatic unloading of split bundles
loadBalancerAutoUnloadSplitBundlesEnabled=true
# maximum topics in a bundle, otherwise bundle split will be triggered
loadBalancerNamespaceBundleMaxTopics=1000
Could you explain what is the link between the configs and the issue i wrote above? Why the internal topics in partitioned topic is not split across all the brokers? Thanks u so much
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] thanhcb closed issue #10143: Partitioned topics not served enough active brokers
Posted by GitBox <gi...@apache.org>.
thanhcb closed issue #10143:
URL: https://github.com/apache/pulsar/issues/10143
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] thanhcb edited a comment on issue #10143: Partitioned topics not served enough active brokers
Posted by GitBox <gi...@apache.org>.
thanhcb edited a comment on issue #10143:
URL: https://github.com/apache/pulsar/issues/10143#issuecomment-815423207
i thought each of internal topics was split across to all active brokers at first, after reading the bundles you said, maybe i have some misunderstanding here.
The bundles in broker.conf i keep all default
//When a namespace is created without specifying the number of bundle, this
//value will be used as the default
defaultNumberOfNamespaceBundles=4
//enable/disable namespace bundle auto split
loadBalancerAutoBundleSplitEnabled=true
//enable/disable automatic unloading of split bundles
loadBalancerAutoUnloadSplitBundlesEnabled=true
//maximum topics in a bundle, otherwise bundle split will be triggered
loadBalancerNamespaceBundleMaxTopics=1000
Could you explain what is the link between the configs and the issue i wrote above? Why the internal topics in partitioned topic is not split across all the brokers? Thanks u so much
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] thanhcb closed issue #10143: Partitioned topics not served enough active brokers
Posted by GitBox <gi...@apache.org>.
thanhcb closed issue #10143:
URL: https://github.com/apache/pulsar/issues/10143
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org